2023-11-27T20:35:54.190 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-27T20:35:54.190 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468107 --verbose --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468107/orig.config.yaml 2023-11-27T20:35:54.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T20:35:54.324 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468107 branch: wip-yuri10-testing-2023-11-22-1112 description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} email: yweinste@redhat.com first_in_suite: false job_id: '7468107' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri10-testing-2023-11-22-1112 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd crush smoke test: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow request - SLOW_OPS - MON_DOWN sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes check-counter: counters: mds: - mds.exported - mds.imported install: ceph: debuginfo: true flavor: default sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri10-testing-2023-11-22-1112 sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 8541 sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri10-testing-2023-11-22-1112 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi088.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL71wxUxtJbDOuVa26K1cK6t4mjPRN/Qcu2tsvDxg8Ssg1F5LLsufU8S4hAbUGgJAfRi9Ls89cxfakoIrcqOeEA= smithi167.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHYOIliM6xRMOlzggjF9H50uOouZE9Vxw7Qk4DkaDeLcLy+l2KC+817iNLxXAzJYTkYkWQzYvPjbMdP/a1TehY4= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 2442239d2653456406c25ae0c71b689c8f2657b6 timestamp: 2023-11-27_17:14:24 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-27T20:35:54.325 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa; will attempt to use it 2023-11-27T20:35:54.325 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks 2023-11-27T20:35:54.326 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-27T20:35:54.327 INFO:teuthology.task.internal:Checking packages... 2023-11-27T20:35:54.356 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '369173db14b6995b2bd07c60ec5f63d01cf21631' 2023-11-27T20:35:54.356 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-27T20:35:54.356 INFO:teuthology.packaging:ref: None 2023-11-27T20:35:54.356 INFO:teuthology.packaging:tag: None 2023-11-27T20:35:54.356 INFO:teuthology.packaging:branch: wip-yuri10-testing-2023-11-22-1112 2023-11-27T20:35:54.356 INFO:teuthology.packaging:sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T20:35:54.356 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri10-testing-2023-11-22-1112 2023-11-27T20:35:54.575 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7498.g369173db 2023-11-27T20:35:54.575 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-27T20:35:54.584 INFO:teuthology.task.internal:no buildpackages task found 2023-11-27T20:35:54.584 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-27T20:35:54.590 INFO:teuthology.task.internal:Saving configuration 2023-11-27T20:35:54.607 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-27T20:35:54.613 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-27T20:35:54.636 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468107', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 20:30:20.578743', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL71wxUxtJbDOuVa26K1cK6t4mjPRN/Qcu2tsvDxg8Ssg1F5LLsufU8S4hAbUGgJAfRi9Ls89cxfakoIrcqOeEA='} 2023-11-27T20:35:54.660 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468107', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 20:30:20.576786', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHYOIliM6xRMOlzggjF9H50uOouZE9Vxw7Qk4DkaDeLcLy+l2KC+817iNLxXAzJYTkYkWQzYvPjbMdP/a1TehY4='} 2023-11-27T20:35:54.660 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-27T20:35:54.667 INFO:teuthology.task.internal:roles: ubuntu@smithi088.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-11-27T20:35:54.667 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-11-27T20:35:54.667 INFO:teuthology.run_tasks:Running task console_log... 2023-11-27T20:35:54.740 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2956c2db80>, signals=[15]) 2023-11-27T20:35:54.740 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-27T20:35:54.747 INFO:teuthology.task.internal:Opening connections... 2023-11-27T20:35:54.747 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi088.front.sepia.ceph.com 2023-11-27T20:35:54.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T20:35:54.831 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi167.front.sepia.ceph.com 2023-11-27T20:35:54.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T20:35:54.919 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-27T20:35:54.926 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2023-11-27T20:35:54.943 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2023-11-27T20:35:54.943 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-11-27T20:35:55.000 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2023-11-27T20:35:55.000 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="9" 2023-11-27T20:35:55.000 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2023-11-27T20:35:55.000 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2023-11-27T20:35:55.000 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="9" 2023-11-27T20:35:55.000 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el9" 2023-11-27T20:35:55.000 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-27T20:35:55.000 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2023-11-27T20:35:55.001 INFO:teuthology.orchestra.run.smithi088.stdout:LOGO="fedora-logo-icon" 2023-11-27T20:35:55.001 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-27T20:35:55.001 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2023-11-27T20:35:55.001 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-27T20:35:55.001 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-27T20:35:55.001 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-27T20:35:55.002 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-11-27T20:35:55.029 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2023-11-27T20:35:55.047 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2023-11-27T20:35:55.048 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-11-27T20:35:55.105 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2023-11-27T20:35:55.105 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9" 2023-11-27T20:35:55.105 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2023-11-27T20:35:55.105 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2023-11-27T20:35:55.105 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9" 2023-11-27T20:35:55.105 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9" 2023-11-27T20:35:55.105 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-27T20:35:55.105 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2023-11-27T20:35:55.105 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon" 2023-11-27T20:35:55.106 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-27T20:35:55.106 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2023-11-27T20:35:55.106 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-27T20:35:55.106 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-27T20:35:55.106 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-27T20:35:55.106 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-11-27T20:35:55.129 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-27T20:35:55.138 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-27T20:35:55.143 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-27T20:35:55.143 DEBUG:teuthology.orchestra.run.smithi088:> test '!' -e /home/ubuntu/cephtest 2023-11-27T20:35:55.146 DEBUG:teuthology.orchestra.run.smithi167:> test '!' -e /home/ubuntu/cephtest 2023-11-27T20:35:55.163 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-27T20:35:55.172 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-27T20:35:55.172 DEBUG:teuthology.orchestra.run.smithi088:> test -z $(ls -A /var/lib/ceph) 2023-11-27T20:35:55.202 DEBUG:teuthology.orchestra.run.smithi167:> test -z $(ls -A /var/lib/ceph) 2023-11-27T20:35:55.228 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-27T20:35:55.282 INFO:teuthology.run_tasks:Running task kernel... 2023-11-27T20:35:55.298 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-11-27T20:35:55.298 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-11-27T20:35:55.299 DEBUG:teuthology.orchestra.run.smithi088:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-27T20:35:55.299 DEBUG:teuthology.orchestra.run.smithi167:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-27T20:35:55.314 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T20:35:55.315 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2023-11-27T20:35:55.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T20:35:55.316 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2023-11-27T20:35:55.375 INFO:teuthology.orchestra.run.smithi167.stdout:5.14.0-361.el9.x86_64 2023-11-27T20:35:55.375 INFO:teuthology.orchestra.run.smithi088.stdout:5.14.0-361.el9.x86_64 2023-11-27T20:35:55.375 INFO:teuthology.task.kernel:Running kernel on smithi167: 5.14.0-361.el9.x86_64 2023-11-27T20:35:55.376 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum install -y kernel 2023-11-27T20:35:55.376 INFO:teuthology.task.kernel:Running kernel on smithi088: 5.14.0-361.el9.x86_64 2023-11-27T20:35:55.376 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum install -y kernel 2023-11-27T20:35:57.797 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS-9 - AppStream 8.3 MB/s | 6.4 MB 00:00 2023-11-27T20:35:58.057 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS-9 - AppStream 5.6 MB/s | 6.4 MB 00:01 2023-11-27T20:35:59.941 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS-9 - BaseOS 2.4 MB/s | 2.0 MB 00:00 2023-11-27T20:36:00.265 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS-9 - BaseOS 1.4 MB/s | 2.0 MB 00:01 2023-11-27T20:36:01.472 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - BaseOS 9.0 MB/s | 7.9 MB 00:00 2023-11-27T20:36:01.573 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - BaseOS 6.1 MB/s | 7.9 MB 00:01 2023-11-27T20:36:03.632 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - AppStream 19 MB/s | 18 MB 00:00 2023-11-27T20:36:05.448 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - AppStream 6.3 MB/s | 18 MB 00:02 2023-11-27T20:36:08.567 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 5.8 MB 00:01 2023-11-27T20:36:09.932 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 15 kB 00:00 2023-11-27T20:36:10.234 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 5.8 MB 00:01 2023-11-27T20:36:12.092 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 15 kB 00:00 2023-11-27T20:36:13.419 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 5.9 MB/s | 20 MB 00:03 2023-11-27T20:36:13.827 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 12 MB/s | 20 MB 00:01 2023-11-27T20:36:18.383 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 4.9 kB/s | 1.7 kB 00:00 2023-11-27T20:36:18.609 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2023-11-27T20:36:20.681 INFO:teuthology.orchestra.run.smithi088.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-27T20:36:20.681 INFO:teuthology.orchestra.run.smithi088.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-27T20:36:20.765 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-11-27T20:36:20.780 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-11-27T20:36:20.780 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2023-11-27T20:36:20.780 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-11-27T20:36:20.780 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-11-27T20:36:20.780 INFO:teuthology.orchestra.run.smithi088.stdout: kernel x86_64 5.14.0-386.el9 baseos 5.5 M 2023-11-27T20:36:20.780 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-11-27T20:36:20.781 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-core x86_64 5.14.0-386.el9 baseos 20 M 2023-11-27T20:36:20.781 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules x86_64 5.14.0-386.el9 baseos 38 M 2023-11-27T20:36:20.781 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules-core x86_64 5.14.0-386.el9 baseos 32 M 2023-11-27T20:36:20.781 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:36:20.781 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-11-27T20:36:20.781 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-11-27T20:36:20.781 INFO:teuthology.orchestra.run.smithi088.stdout:Install 4 Packages 2023-11-27T20:36:20.781 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:36:20.781 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 95 M 2023-11-27T20:36:20.781 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 121 M 2023-11-27T20:36:20.781 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-11-27T20:36:20.948 INFO:teuthology.orchestra.run.smithi167.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-27T20:36:20.949 INFO:teuthology.orchestra.run.smithi167.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-27T20:36:21.050 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2023-11-27T20:36:21.059 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2023-11-27T20:36:21.060 INFO:teuthology.orchestra.run.smithi167.stdout: Package Architecture Version Repository Size 2023-11-27T20:36:21.060 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2023-11-27T20:36:21.060 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2023-11-27T20:36:21.060 INFO:teuthology.orchestra.run.smithi167.stdout: kernel x86_64 5.14.0-386.el9 baseos 5.5 M 2023-11-27T20:36:21.060 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2023-11-27T20:36:21.061 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-core x86_64 5.14.0-386.el9 baseos 20 M 2023-11-27T20:36:21.061 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules x86_64 5.14.0-386.el9 baseos 38 M 2023-11-27T20:36:21.061 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules-core x86_64 5.14.0-386.el9 baseos 32 M 2023-11-27T20:36:21.061 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:36:21.061 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2023-11-27T20:36:21.062 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2023-11-27T20:36:21.062 INFO:teuthology.orchestra.run.smithi167.stdout:Install 4 Packages 2023-11-27T20:36:21.062 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:36:21.062 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 95 M 2023-11-27T20:36:21.062 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 121 M 2023-11-27T20:36:21.062 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2023-11-27T20:36:22.735 INFO:teuthology.orchestra.run.smithi167.stdout:(1/4): kernel-5.14.0-386.el9.x86_64.rpm 3.3 MB/s | 5.5 MB 00:01 2023-11-27T20:36:23.102 INFO:teuthology.orchestra.run.smithi167.stdout:(2/4): kernel-core-5.14.0-386.el9.x86_64.rpm 10 MB/s | 20 MB 00:01 2023-11-27T20:36:23.483 INFO:teuthology.orchestra.run.smithi088.stdout:(1/4): kernel-5.14.0-386.el9.x86_64.rpm 2.1 MB/s | 5.5 MB 00:02 2023-11-27T20:36:23.684 INFO:teuthology.orchestra.run.smithi088.stdout:(2/4): kernel-core-5.14.0-386.el9.x86_64.rpm 7.2 MB/s | 20 MB 00:02 2023-11-27T20:36:24.519 INFO:teuthology.orchestra.run.smithi167.stdout:(3/4): kernel-modules-5.14.0-386.el9.x86_64.rpm 11 MB/s | 38 MB 00:03 2023-11-27T20:36:26.060 INFO:teuthology.orchestra.run.smithi167.stdout:(4/4): kernel-modules-core-5.14.0-386.el9.x86_6 9.7 MB/s | 32 MB 00:03 2023-11-27T20:36:26.061 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2023-11-27T20:36:26.061 INFO:teuthology.orchestra.run.smithi167.stdout:Total 19 MB/s | 95 MB 00:05 2023-11-27T20:36:26.912 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2023-11-27T20:36:27.306 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2023-11-27T20:36:27.306 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2023-11-27T20:36:27.666 INFO:teuthology.orchestra.run.smithi088.stdout:(3/4): kernel-modules-5.14.0-386.el9.x86_64.rpm 5.6 MB/s | 38 MB 00:06 2023-11-27T20:36:28.595 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2023-11-27T20:36:28.595 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2023-11-27T20:36:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2023-11-27T20:36:31.957 INFO:teuthology.orchestra.run.smithi088.stdout:(4/4): kernel-modules-core-5.14.0-386.el9.x86_6 3.8 MB/s | 32 MB 00:08 2023-11-27T20:36:31.958 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-11-27T20:36:31.958 INFO:teuthology.orchestra.run.smithi088.stdout:Total 8.5 MB/s | 95 MB 00:11 2023-11-27T20:36:32.165 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-modules-core-5.14.0-386.el9.x86_64 1/4 2023-11-27T20:36:32.295 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-core-5.14.0-386.el9.x86_64 2/4 2023-11-27T20:36:32.805 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-11-27T20:36:33.161 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-11-27T20:36:33.161 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-11-27T20:36:34.479 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-11-27T20:36:34.479 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-11-27T20:36:35.049 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-core-5.14.0-386.el9.x86_64 2/4 2023-11-27T20:36:35.248 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-modules-5.14.0-386.el9.x86_64 3/4 2023-11-27T20:36:37.361 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-11-27T20:36:37.995 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-modules-core-5.14.0-386.el9.x86_64 1/4 2023-11-27T20:36:38.115 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-core-5.14.0-386.el9.x86_64 2/4 2023-11-27T20:36:39.870 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-modules-5.14.0-386.el9.x86_64 3/4 2023-11-27T20:36:39.988 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-5.14.0-386.el9.x86_64 4/4 2023-11-27T20:36:40.860 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-core-5.14.0-386.el9.x86_64 2/4 2023-11-27T20:36:41.026 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-modules-5.14.0-386.el9.x86_64 3/4 2023-11-27T20:36:44.634 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-modules-core-5.14.0-386.el9.x86_64 4/4 2023-11-27T20:36:45.596 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-modules-5.14.0-386.el9.x86_64 3/4 2023-11-27T20:36:45.708 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-5.14.0-386.el9.x86_64 4/4 2023-11-27T20:36:50.345 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-modules-core-5.14.0-386.el9.x86_64 4/4 2023-11-27T20:37:13.367 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-core-5.14.0-386.el9.x86_64 4/4 2023-11-27T20:37:13.411 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-modules-5.14.0-386.el9.x86_64 4/4 2023-11-27T20:37:13.842 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-5.14.0-386.el9.x86_64 4/4 2023-11-27T20:37:13.842 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-5.14.0-386.el9.x86_64 1/4 2023-11-27T20:37:13.842 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-core-5.14.0-386.el9.x86_64 2/4 2023-11-27T20:37:13.842 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-modules-5.14.0-386.el9.x86_64 3/4 2023-11-27T20:37:14.289 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-modules-core-5.14.0-386.el9.x86_64 4/4 2023-11-27T20:37:14.289 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:37:14.289 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2023-11-27T20:37:14.289 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-5.14.0-386.el9.x86_64 2023-11-27T20:37:14.289 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-core-5.14.0-386.el9.x86_64 2023-11-27T20:37:14.290 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules-5.14.0-386.el9.x86_64 2023-11-27T20:37:14.290 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules-core-5.14.0-386.el9.x86_64 2023-11-27T20:37:14.290 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:37:14.290 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2023-11-27T20:37:14.768 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q kernel | sort -rV | head -n 1 2023-11-27T20:37:14.910 INFO:teuthology.orchestra.run.smithi167.stdout:kernel-5.14.0-386.el9.x86_64 2023-11-27T20:37:14.911 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-386.el9.x86_64 2023-11-27T20:37:14.911 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-386.el9.x86_64 2023-11-27T20:37:14.911 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-27T20:37:14.911 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-27T20:37:14.911 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-11-27T20:37:14.911 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi167.front.sepia.ceph.com, path=None, version=distro) 2023-11-27T20:37:14.911 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q kernel | sort -rV | head -n 1 2023-11-27T20:37:15.029 INFO:teuthology.orchestra.run.smithi167.stdout:kernel-5.14.0-386.el9.x86_64 2023-11-27T20:37:15.030 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-386.el9.x86_64 2023-11-27T20:37:15.030 DEBUG:teuthology.orchestra.run.smithi167:> sudo rpm -qi grub2-tools 2023-11-27T20:37:15.074 INFO:teuthology.orchestra.run.smithi167.stdout:Name : grub2-tools 2023-11-27T20:37:15.074 INFO:teuthology.orchestra.run.smithi167.stdout:Epoch : 1 2023-11-27T20:37:15.074 INFO:teuthology.orchestra.run.smithi167.stdout:Version : 2.06 2023-11-27T20:37:15.074 INFO:teuthology.orchestra.run.smithi167.stdout:Release : 68.el9 2023-11-27T20:37:15.074 INFO:teuthology.orchestra.run.smithi167.stdout:Architecture: x86_64 2023-11-27T20:37:15.074 INFO:teuthology.orchestra.run.smithi167.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-27T20:37:15.074 INFO:teuthology.orchestra.run.smithi167.stdout:Group : Unspecified 2023-11-27T20:37:15.075 INFO:teuthology.orchestra.run.smithi167.stdout:Size : 8264254 2023-11-27T20:37:15.075 INFO:teuthology.orchestra.run.smithi167.stdout:License : GPLv3+ 2023-11-27T20:37:15.075 INFO:teuthology.orchestra.run.smithi167.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-27T20:37:15.075 INFO:teuthology.orchestra.run.smithi167.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-27T20:37:15.075 INFO:teuthology.orchestra.run.smithi167.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-27T20:37:15.075 INFO:teuthology.orchestra.run.smithi167.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-27T20:37:15.075 INFO:teuthology.orchestra.run.smithi167.stdout:Packager : builder@centos.org 2023-11-27T20:37:15.075 INFO:teuthology.orchestra.run.smithi167.stdout:Vendor : CentOS 2023-11-27T20:37:15.075 INFO:teuthology.orchestra.run.smithi167.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-27T20:37:15.075 INFO:teuthology.orchestra.run.smithi167.stdout:Summary : Support tools for GRUB. 2023-11-27T20:37:15.075 INFO:teuthology.orchestra.run.smithi167.stdout:Description : 2023-11-27T20:37:15.075 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:37:15.076 INFO:teuthology.orchestra.run.smithi167.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-27T20:37:15.076 INFO:teuthology.orchestra.run.smithi167.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-27T20:37:15.076 INFO:teuthology.orchestra.run.smithi167.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-27T20:37:15.076 INFO:teuthology.orchestra.run.smithi167.stdout:hardware devices. 2023-11-27T20:37:15.076 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:37:15.076 INFO:teuthology.orchestra.run.smithi167.stdout:This subpackage provides tools for support of all platforms. 2023-11-27T20:37:15.077 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-27T20:37:15.077 INFO:teuthology.task.kernel:Updating grub on smithi167 to boot 5.14.0-386.el9.x86_64 2023-11-27T20:37:15.077 DEBUG:teuthology.orchestra.run.smithi167:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-27T20:37:15.750 INFO:teuthology.orchestra.run.smithi167.stderr:Generating grub configuration file ... 2023-11-27T20:37:17.295 INFO:teuthology.orchestra.run.smithi167.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-27T20:37:17.335 INFO:teuthology.orchestra.run.smithi167.stderr:done 2023-11-27T20:37:17.338 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2023-11-27T20:37:17.363 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.kSbnrWIf6i 2023-11-27T20:37:17.363 DEBUG:teuthology.orchestra.run.smithi167:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.kSbnrWIf6i 2023-11-27T20:37:17.444 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.kSbnrWIf6i 2023-11-27T20:37:17.597 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.kSbnrWIf6i is 6KB 2023-11-27T20:37:17.637 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.kSbnrWIf6i 2023-11-27T20:37:17.658 DEBUG:teuthology.orchestra.run.smithi167:> sudo /bin/ls /boot/loader/entries || true 2023-11-27T20:37:17.726 INFO:teuthology.orchestra.run.smithi167.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-27T20:37:17.726 INFO:teuthology.orchestra.run.smithi167.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-27T20:37:17.727 INFO:teuthology.orchestra.run.smithi167.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-27T20:37:17.727 INFO:teuthology.orchestra.run.smithi167.stdout:15949e3c88704300882482eddfd7baae-5.14.0-386.el9.x86_64.conf 2023-11-27T20:37:17.728 DEBUG:teuthology.orchestra.run.smithi167:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-386.el9.x86_64 2023-11-27T20:37:17.897 DEBUG:teuthology.orchestra.run.smithi167:> sudo shutdown -r now 2023-11-27T20:37:18.005 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-11-27T20:37:19.291 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-core-5.14.0-386.el9.x86_64 4/4 2023-11-27T20:37:19.334 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-modules-5.14.0-386.el9.x86_64 4/4 2023-11-27T20:37:19.716 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-5.14.0-386.el9.x86_64 4/4 2023-11-27T20:37:19.717 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-5.14.0-386.el9.x86_64 1/4 2023-11-27T20:37:19.717 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-core-5.14.0-386.el9.x86_64 2/4 2023-11-27T20:37:19.717 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-modules-5.14.0-386.el9.x86_64 3/4 2023-11-27T20:37:20.119 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-modules-core-5.14.0-386.el9.x86_64 4/4 2023-11-27T20:37:20.120 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:37:20.120 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-11-27T20:37:20.120 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-5.14.0-386.el9.x86_64 2023-11-27T20:37:20.120 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-core-5.14.0-386.el9.x86_64 2023-11-27T20:37:20.120 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules-5.14.0-386.el9.x86_64 2023-11-27T20:37:20.121 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules-core-5.14.0-386.el9.x86_64 2023-11-27T20:37:20.121 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:37:20.121 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-11-27T20:37:20.604 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q kernel | sort -rV | head -n 1 2023-11-27T20:37:20.769 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-5.14.0-386.el9.x86_64 2023-11-27T20:37:20.769 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-386.el9.x86_64 2023-11-27T20:37:20.770 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-386.el9.x86_64 2023-11-27T20:37:20.770 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-27T20:37:20.770 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-27T20:37:20.770 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-11-27T20:37:20.770 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi088.front.sepia.ceph.com, path=None, version=distro) 2023-11-27T20:37:20.770 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q kernel | sort -rV | head -n 1 2023-11-27T20:37:20.888 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-5.14.0-386.el9.x86_64 2023-11-27T20:37:20.888 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-386.el9.x86_64 2023-11-27T20:37:20.888 DEBUG:teuthology.orchestra.run.smithi088:> sudo rpm -qi grub2-tools 2023-11-27T20:37:20.933 INFO:teuthology.orchestra.run.smithi088.stdout:Name : grub2-tools 2023-11-27T20:37:20.933 INFO:teuthology.orchestra.run.smithi088.stdout:Epoch : 1 2023-11-27T20:37:20.933 INFO:teuthology.orchestra.run.smithi088.stdout:Version : 2.06 2023-11-27T20:37:20.933 INFO:teuthology.orchestra.run.smithi088.stdout:Release : 68.el9 2023-11-27T20:37:20.933 INFO:teuthology.orchestra.run.smithi088.stdout:Architecture: x86_64 2023-11-27T20:37:20.934 INFO:teuthology.orchestra.run.smithi088.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-27T20:37:20.934 INFO:teuthology.orchestra.run.smithi088.stdout:Group : Unspecified 2023-11-27T20:37:20.934 INFO:teuthology.orchestra.run.smithi088.stdout:Size : 8264254 2023-11-27T20:37:20.934 INFO:teuthology.orchestra.run.smithi088.stdout:License : GPLv3+ 2023-11-27T20:37:20.934 INFO:teuthology.orchestra.run.smithi088.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-27T20:37:20.934 INFO:teuthology.orchestra.run.smithi088.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-27T20:37:20.934 INFO:teuthology.orchestra.run.smithi088.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-27T20:37:20.934 INFO:teuthology.orchestra.run.smithi088.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-27T20:37:20.934 INFO:teuthology.orchestra.run.smithi088.stdout:Packager : builder@centos.org 2023-11-27T20:37:20.934 INFO:teuthology.orchestra.run.smithi088.stdout:Vendor : CentOS 2023-11-27T20:37:20.935 INFO:teuthology.orchestra.run.smithi088.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-27T20:37:20.935 INFO:teuthology.orchestra.run.smithi088.stdout:Summary : Support tools for GRUB. 2023-11-27T20:37:20.935 INFO:teuthology.orchestra.run.smithi088.stdout:Description : 2023-11-27T20:37:20.935 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:37:20.935 INFO:teuthology.orchestra.run.smithi088.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-27T20:37:20.935 INFO:teuthology.orchestra.run.smithi088.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-27T20:37:20.935 INFO:teuthology.orchestra.run.smithi088.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-27T20:37:20.935 INFO:teuthology.orchestra.run.smithi088.stdout:hardware devices. 2023-11-27T20:37:20.935 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:37:20.935 INFO:teuthology.orchestra.run.smithi088.stdout:This subpackage provides tools for support of all platforms. 2023-11-27T20:37:20.936 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-27T20:37:20.937 INFO:teuthology.task.kernel:Updating grub on smithi088 to boot 5.14.0-386.el9.x86_64 2023-11-27T20:37:20.937 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-27T20:37:21.529 INFO:teuthology.orchestra.run.smithi088.stderr:Generating grub configuration file ... 2023-11-27T20:37:23.001 INFO:teuthology.orchestra.run.smithi088.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-27T20:37:23.039 INFO:teuthology.orchestra.run.smithi088.stderr:done 2023-11-27T20:37:23.042 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2023-11-27T20:37:23.056 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.dGMCDUDzoW 2023-11-27T20:37:23.056 DEBUG:teuthology.orchestra.run.smithi088:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.dGMCDUDzoW 2023-11-27T20:37:23.124 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.dGMCDUDzoW 2023-11-27T20:37:23.261 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.dGMCDUDzoW is 6KB 2023-11-27T20:37:23.307 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.dGMCDUDzoW 2023-11-27T20:37:23.321 DEBUG:teuthology.orchestra.run.smithi088:> sudo /bin/ls /boot/loader/entries || true 2023-11-27T20:37:23.386 INFO:teuthology.orchestra.run.smithi088.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-27T20:37:23.387 INFO:teuthology.orchestra.run.smithi088.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-27T20:37:23.387 INFO:teuthology.orchestra.run.smithi088.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-27T20:37:23.387 INFO:teuthology.orchestra.run.smithi088.stdout:15949e3c88704300882482eddfd7baae-5.14.0-386.el9.x86_64.conf 2023-11-27T20:37:23.388 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-386.el9.x86_64 2023-11-27T20:37:23.528 DEBUG:teuthology.orchestra.run.smithi088:> sudo shutdown -r now 2023-11-27T20:37:47.926 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-27T20:37:47.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-11-27T20:37:47.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T20:37:53.534 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-27T20:37:53.534 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-11-27T20:37:53.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T20:38:06.438 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-11-27T20:38:12.070 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-11-27T20:38:15.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-11-27T20:38:15.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T20:38:18.498 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-11-27T20:38:21.072 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-11-27T20:38:21.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T20:38:24.134 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-11-27T20:38:30.502 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-11-27T20:38:30.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T20:38:36.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-11-27T20:38:36.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T20:38:39.206 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-11-27T20:38:48.930 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-11-27T20:38:54.211 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-11-27T20:38:54.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T20:39:03.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-11-27T20:39:03.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T20:39:04.235 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-11-27T20:39:04.796 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-11-27T20:39:04.796 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-386.el9.x86_64"... 2023-11-27T20:39:04.796 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2023-11-27T20:39:04.810 INFO:teuthology.orchestra.run.smithi167.stdout:5.14.0-386.el9.x86_64 2023-11-27T20:39:04.810 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-386.el9.x86_64 vs 5.14.0-386.el9.x86_64 2023-11-27T20:39:04.810 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-27T20:39:04.810 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-27T20:39:05.811 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-27T20:39:05.812 DEBUG:teuthology.orchestra.run.smithi167:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-27T20:39:05.901 INFO:teuthology.orchestra.run.smithi167.stdout:ttyS1 2023-11-27T20:39:05.939 DEBUG:teuthology.parallel:result is None 2023-11-27T20:39:26.100 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-11-27T20:39:26.570 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-11-27T20:39:26.570 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-386.el9.x86_64"... 2023-11-27T20:39:26.571 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2023-11-27T20:39:26.599 INFO:teuthology.orchestra.run.smithi088.stdout:5.14.0-386.el9.x86_64 2023-11-27T20:39:26.600 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-386.el9.x86_64 vs 5.14.0-386.el9.x86_64 2023-11-27T20:39:26.600 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-27T20:39:26.600 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-27T20:39:27.601 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-27T20:39:27.601 DEBUG:teuthology.orchestra.run.smithi088:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-27T20:39:27.654 INFO:teuthology.orchestra.run.smithi088.stdout:ttyS1 2023-11-27T20:39:27.812 DEBUG:teuthology.parallel:result is None 2023-11-27T20:39:27.813 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-27T20:39:27.821 INFO:teuthology.task.internal:Creating test directory... 2023-11-27T20:39:27.821 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-27T20:39:27.824 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-27T20:39:27.843 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-27T20:39:27.850 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-27T20:39:27.866 INFO:teuthology.task.internal:Creating archive directory... 2023-11-27T20:39:27.867 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-27T20:39:27.876 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-27T20:39:27.909 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-27T20:39:27.916 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-27T20:39:27.916 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-27T20:39:27.935 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-27T20:39:27.961 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-27T20:39:27.974 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-27T20:39:27.976 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-27T20:39:27.990 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-27T20:39:27.991 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-27T20:39:27.998 INFO:teuthology.task.internal:Configuring sudo... 2023-11-27T20:39:27.998 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-27T20:39:28.016 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-27T20:39:28.060 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-27T20:39:28.069 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-27T20:39:28.069 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-27T20:39:28.080 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-27T20:39:28.116 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-27T20:39:28.173 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-27T20:39:28.227 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-27T20:39:28.269 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-27T20:39:28.307 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:39:28.307 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-27T20:39:28.372 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-27T20:39:28.413 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-27T20:39:28.469 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-27T20:39:28.551 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-27T20:39:28.593 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-27T20:39:28.593 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-27T20:39:28.660 DEBUG:teuthology.orchestra.run.smithi088:> sudo service rsyslog restart 2023-11-27T20:39:28.662 DEBUG:teuthology.orchestra.run.smithi167:> sudo service rsyslog restart 2023-11-27T20:39:28.706 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-27T20:39:28.754 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-27T20:39:29.208 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-27T20:39:29.216 INFO:teuthology.task.internal:Starting timer... 2023-11-27T20:39:29.216 INFO:teuthology.run_tasks:Running task pcp... 2023-11-27T20:39:29.248 INFO:teuthology.run_tasks:Running task selinux... 2023-11-27T20:39:29.256 DEBUG:teuthology.orchestra.run.smithi088:> sudo service auditd rotate 2023-11-27T20:39:29.315 INFO:teuthology.orchestra.run.smithi088.stdout:Rotating logs: 2023-11-27T20:39:29.317 DEBUG:teuthology.orchestra.run.smithi167:> sudo service auditd rotate 2023-11-27T20:39:29.374 INFO:teuthology.orchestra.run.smithi167.stdout:Rotating logs: 2023-11-27T20:39:29.375 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-27T20:39:29.376 DEBUG:teuthology.orchestra.run.smithi088:> /usr/sbin/getenforce 2023-11-27T20:39:29.396 INFO:teuthology.orchestra.run.smithi088.stdout:Permissive 2023-11-27T20:39:29.396 DEBUG:teuthology.orchestra.run.smithi167:> /usr/sbin/getenforce 2023-11-27T20:39:29.443 INFO:teuthology.orchestra.run.smithi167.stdout:Permissive 2023-11-27T20:39:29.444 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi088.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi167.front.sepia.ceph.com': 'permissive'} 2023-11-27T20:39:29.444 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-27T20:39:29.471 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T20:39:29.472 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-27T20:39:29.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T20:39:29.499 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-27T20:39:29.499 DEBUG:teuthology.orchestra.run.smithi088:> sudo /usr/sbin/setenforce permissive 2023-11-27T20:39:29.557 DEBUG:teuthology.orchestra.run.smithi167:> sudo /usr/sbin/setenforce permissive 2023-11-27T20:39:29.586 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-27T20:39:29.596 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-27T20:39:29.597 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-27T20:39:29.613 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-27T20:39:29.614 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi088.front.sepia.ceph.com,smithi167.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-27T20:45:07.914 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi088.front.sepia.ceph.com'), Remote(name='ubuntu@smithi167.front.sepia.ceph.com')] 2023-11-27T20:45:07.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-11-27T20:45:07.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T20:45:07.998 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-11-27T20:45:08.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-11-27T20:45:08.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-11-27T20:45:08.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T20:45:08.152 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-11-27T20:45:08.226 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-11-27T20:45:08.226 INFO:teuthology.run_tasks:Running task clock... 2023-11-27T20:45:08.237 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-27T20:45:08.237 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-27T20:45:08.238 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-27T20:45:08.240 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-27T20:45:08.240 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-27T20:45:08.268 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-27T20:45:08.285 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-27T20:45:08.300 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-27T20:45:08.314 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: ntpd: command not found 2023-11-27T20:45:08.317 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-27T20:45:08.327 INFO:teuthology.orchestra.run.smithi088.stdout:506 Cannot talk to daemon 2023-11-27T20:45:08.344 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-27T20:45:08.347 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: ntpd: command not found 2023-11-27T20:45:08.361 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-27T20:45:08.361 INFO:teuthology.orchestra.run.smithi167.stdout:506 Cannot talk to daemon 2023-11-27T20:45:08.378 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-27T20:45:08.395 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-27T20:45:08.404 INFO:teuthology.orchestra.run.smithi088.stderr:bash: line 1: ntpq: command not found 2023-11-27T20:45:08.407 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-27T20:45:08.407 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2023-11-27T20:45:08.407 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T20:45:08.407 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T20:45:08.407 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T20:45:08.407 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T20:45:08.438 INFO:teuthology.orchestra.run.smithi167.stderr:bash: line 1: ntpq: command not found 2023-11-27T20:45:08.441 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-27T20:45:08.441 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2023-11-27T20:45:08.441 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T20:45:08.442 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T20:45:08.442 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T20:45:08.442 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T20:45:08.443 INFO:teuthology.run_tasks:Running task install... 2023-11-27T20:45:08.451 DEBUG:teuthology.task.install:project ceph 2023-11-27T20:45:08.451 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}} 2023-11-27T20:45:08.451 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'} 2023-11-27T20:45:08.451 INFO:teuthology.task.install:Using flavor: default 2023-11-27T20:45:08.457 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2023-11-27T20:45:08.457 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-27T20:45:08.457 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'tag': None, 'wait_for_package': False} 2023-11-27T20:45:08.458 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T20:45:08.459 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'tag': None, 'wait_for_package': False} 2023-11-27T20:45:08.460 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T20:45:08.597 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/9/flavors/default/ 2023-11-27T20:45:08.597 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7498.g369173db 2023-11-27T20:45:08.734 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/9/flavors/default/ 2023-11-27T20:45:08.735 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7498.g369173db 2023-11-27T20:45:08.816 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-27T20:45:08.816 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:45:08.816 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-27T20:45:08.844 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-27T20:45:08.845 DEBUG:teuthology.orchestra.run.smithi088:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/369173db14b6995b2bd07c60ec5f63d01cf21631/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-27T20:45:08.912 DEBUG:teuthology.orchestra.run.smithi088:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-27T20:45:08.934 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-27T20:45:08.935 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-27T20:45:08.935 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-27T20:45:08.965 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-27T20:45:08.965 DEBUG:teuthology.orchestra.run.smithi167:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/369173db14b6995b2bd07c60ec5f63d01cf21631/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-27T20:45:08.992 DEBUG:teuthology.orchestra.run.smithi088:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-27T20:45:09.034 DEBUG:teuthology.orchestra.run.smithi167:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-27T20:45:09.060 INFO:teuthology.orchestra.run.smithi088.stdout:check_obsoletes = 1 2023-11-27T20:45:09.061 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum clean all 2023-11-27T20:45:09.114 DEBUG:teuthology.orchestra.run.smithi167:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-27T20:45:09.181 INFO:teuthology.orchestra.run.smithi167.stdout:check_obsoletes = 1 2023-11-27T20:45:09.183 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum clean all 2023-11-27T20:45:09.299 INFO:teuthology.orchestra.run.smithi088.stdout:73 files removed 2023-11-27T20:45:09.327 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-27T20:45:09.422 INFO:teuthology.orchestra.run.smithi167.stdout:73 files removed 2023-11-27T20:45:09.448 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-27T20:45:10.102 INFO:teuthology.orchestra.run.smithi088.stdout:ceph packages for x86_64 170 kB/s | 78 kB 00:00 2023-11-27T20:45:10.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph packages for x86_64 183 kB/s | 78 kB 00:00 2023-11-27T20:45:10.502 INFO:teuthology.orchestra.run.smithi088.stdout:ceph noarch packages 27 kB/s | 9.5 kB 00:00 2023-11-27T20:45:10.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph noarch packages 26 kB/s | 9.5 kB 00:00 2023-11-27T20:45:10.936 INFO:teuthology.orchestra.run.smithi088.stdout:ceph source packages 4.7 kB/s | 1.9 kB 00:00 2023-11-27T20:45:11.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph source packages 5.2 kB/s | 1.9 kB 00:00 2023-11-27T20:45:11.347 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS-9 - AppStream 17 MB/s | 6.4 MB 00:00 2023-11-27T20:45:11.459 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS-9 - AppStream 16 MB/s | 6.4 MB 00:00 2023-11-27T20:45:12.689 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS-9 - BaseOS 7.7 MB/s | 2.0 MB 00:00 2023-11-27T20:45:12.793 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS-9 - BaseOS 7.7 MB/s | 2.0 MB 00:00 2023-11-27T20:45:15.038 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - BaseOS 3.9 MB/s | 7.9 MB 00:02 2023-11-27T20:45:15.059 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 7.9 MB 00:01 2023-11-27T20:45:20.418 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - AppStream 4.3 MB/s | 18 MB 00:04 2023-11-27T20:45:20.633 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - AppStream 4.0 MB/s | 18 MB 00:04 2023-11-27T20:45:24.381 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - CRB 16 MB/s | 5.8 MB 00:00 2023-11-27T20:45:25.043 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - CRB 4.7 MB/s | 5.8 MB 00:01 2023-11-27T20:45:25.782 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 15 kB 00:00 2023-11-27T20:45:26.461 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 15 kB 00:00 2023-11-27T20:45:29.541 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 5.4 MB/s | 20 MB 00:03 2023-11-27T20:45:32.823 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 3.2 MB/s | 20 MB 00:06 2023-11-27T20:45:34.182 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2023-11-27T20:45:36.834 INFO:teuthology.orchestra.run.smithi088.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-27T20:45:36.835 INFO:teuthology.orchestra.run.smithi088.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-27T20:45:36.861 INFO:teuthology.orchestra.run.smithi088.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-27T20:45:36.862 INFO:teuthology.orchestra.run.smithi088.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-27T20:45:36.863 INFO:teuthology.orchestra.run.smithi088.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-27T20:45:36.864 INFO:teuthology.orchestra.run.smithi088.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-27T20:45:36.865 INFO:teuthology.orchestra.run.smithi088.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-27T20:45:36.868 INFO:teuthology.orchestra.run.smithi088.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-27T20:45:36.869 INFO:teuthology.orchestra.run.smithi088.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-27T20:45:36.942 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-11-27T20:45:36.953 INFO:teuthology.orchestra.run.smithi088.stdout:==================================================================================================== 2023-11-27T20:45:36.953 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-11-27T20:45:36.954 INFO:teuthology.orchestra.run.smithi088.stdout:==================================================================================================== 2023-11-27T20:45:36.954 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-11-27T20:45:36.954 INFO:teuthology.orchestra.run.smithi088.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-27T20:45:36.954 INFO:teuthology.orchestra.run.smithi088.stdout: ceph x86_64 2:18.0.0-7498.g369173db.el9 ceph 6.5 k 2023-11-27T20:45:36.954 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base x86_64 2:18.0.0-7498.g369173db.el9 ceph 5.2 M 2023-11-27T20:45:36.954 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 73 M 2023-11-27T20:45:36.954 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 404 M 2023-11-27T20:45:36.954 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse x86_64 2:18.0.0-7498.g369173db.el9 ceph 860 k 2023-11-27T20:45:36.955 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 5.8 M 2023-11-27T20:45:36.955 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7498.g369173db.el9 ceph 141 k 2023-11-27T20:45:36.955 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 1.4 M 2023-11-27T20:45:36.955 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 47 M 2023-11-27T20:45:36.955 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr x86_64 2:18.0.0-7498.g369173db.el9 ceph 1.5 M 2023-11-27T20:45:36.955 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 133 k 2023-11-27T20:45:36.955 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 1.8 M 2023-11-27T20:45:36.955 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 19 M 2023-11-27T20:45:36.955 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 7.4 M 2023-11-27T20:45:36.955 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 50 k 2023-11-27T20:45:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 111 M 2023-11-27T20:45:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 311 M 2023-11-27T20:45:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw x86_64 2:18.0.0-7498.g369173db.el9 ceph 8.6 M 2023-11-27T20:45:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 173 M 2023-11-27T20:45:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test x86_64 2:18.0.0-7498.g369173db.el9 ceph 41 M 2023-11-27T20:45:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 623 M 2023-11-27T20:45:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-volume noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 262 k 2023-11-27T20:45:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 774 k 2023-11-27T20:45:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-mirror x86_64 2:18.0.0-7498.g369173db.el9 ceph 217 k 2023-11-27T20:45:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-top noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 18 k 2023-11-27T20:45:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-27T20:45:36.956 INFO:teuthology.orchestra.run.smithi088.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-27T20:45:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-27T20:45:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel x86_64 2:18.0.0-7498.g369173db.el9 ceph 31 k 2023-11-27T20:45:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2 x86_64 2:18.0.0-7498.g369173db.el9 ceph 719 k 2023-11-27T20:45:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 5.1 M 2023-11-27T20:45:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel x86_64 2:18.0.0-7498.g369173db.el9 ceph 126 k 2023-11-27T20:45:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 108 k 2023-11-27T20:45:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: librados2-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 43 M 2023-11-27T20:45:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 50 M 2023-11-27T20:45:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-27T20:45:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-27T20:45:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-11-27T20:45:36.957 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-27T20:45:36.958 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-27T20:45:36.958 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-27T20:45:36.958 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs x86_64 2:18.0.0-7498.g369173db.el9 ceph 162 k 2023-11-27T20:45:36.958 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 615 k 2023-11-27T20:45:36.958 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados x86_64 2:18.0.0-7498.g369173db.el9 ceph 320 k 2023-11-27T20:45:36.958 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 770 k 2023-11-27T20:45:36.958 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd x86_64 2:18.0.0-7498.g369173db.el9 ceph 297 k 2023-11-27T20:45:36.958 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 1.1 M 2023-11-27T20:45:36.958 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw x86_64 2:18.0.0-7498.g369173db.el9 ceph 99 k 2023-11-27T20:45:36.958 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 337 k 2023-11-27T20:45:36.959 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse x86_64 2:18.0.0-7498.g369173db.el9 ceph 85 k 2023-11-27T20:45:36.959 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 507 k 2023-11-27T20:45:36.959 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror x86_64 2:18.0.0-7498.g369173db.el9 ceph 3.0 M 2023-11-27T20:45:36.959 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 50 M 2023-11-27T20:45:36.959 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd x86_64 2:18.0.0-7498.g369173db.el9 ceph 170 k 2023-11-27T20:45:36.959 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 1.2 M 2023-11-27T20:45:36.959 INFO:teuthology.orchestra.run.smithi088.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-27T20:45:36.959 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrading: 2023-11-27T20:45:36.959 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager x86_64 1:1.45.6-1.el9 CentOS-BaseOS 2.2 M 2023-11-27T20:45:36.959 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-libnm x86_64 1:1.45.6-1.el9 CentOS-BaseOS 1.8 M 2023-11-27T20:45:36.959 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-team x86_64 1:1.45.6-1.el9 CentOS-BaseOS 42 k 2023-11-27T20:45:36.959 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-tui x86_64 1:1.45.6-1.el9 CentOS-BaseOS 245 k 2023-11-27T20:45:36.960 INFO:teuthology.orchestra.run.smithi088.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-27T20:45:36.960 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-27T20:45:36.960 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-27T20:45:36.960 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-27T20:45:36.960 INFO:teuthology.orchestra.run.smithi088.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-27T20:45:36.960 INFO:teuthology.orchestra.run.smithi088.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-27T20:45:36.960 INFO:teuthology.orchestra.run.smithi088.stdout: librados2 x86_64 2:18.0.0-7498.g369173db.el9 ceph 3.3 M 2023-11-27T20:45:36.960 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1 x86_64 2:18.0.0-7498.g369173db.el9 ceph 3.0 M 2023-11-27T20:45:36.960 INFO:teuthology.orchestra.run.smithi088.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-11-27T20:45:36.960 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-11-27T20:45:36.960 INFO:teuthology.orchestra.run.smithi088.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-27T20:45:36.960 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-11-27T20:45:36.961 INFO:teuthology.orchestra.run.smithi088.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-27T20:45:36.961 INFO:teuthology.orchestra.run.smithi088.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-27T20:45:36.961 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common x86_64 2:18.0.0-7498.g369173db.el9 ceph 19 M 2023-11-27T20:45:36.961 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 21 M 2023-11-27T20:45:36.961 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 28 k 2023-11-27T20:45:36.961 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds x86_64 2:18.0.0-7498.g369173db.el9 ceph 2.1 M 2023-11-27T20:45:36.961 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 243 k 2023-11-27T20:45:36.961 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon x86_64 2:18.0.0-7498.g369173db.el9 ceph 4.4 M 2023-11-27T20:45:36.961 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd x86_64 2:18.0.0-7498.g369173db.el9 ceph 18 M 2023-11-27T20:45:36.961 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 15 k 2023-11-27T20:45:36.961 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux x86_64 2:18.0.0-7498.g369173db.el9 ceph 24 k 2023-11-27T20:45:36.962 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-27T20:45:36.962 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-27T20:45:36.962 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-27T20:45:36.962 INFO:teuthology.orchestra.run.smithi088.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-27T20:45:36.962 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-27T20:45:36.962 INFO:teuthology.orchestra.run.smithi088.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-27T20:45:36.962 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-27T20:45:36.962 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-27T20:45:36.962 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite x86_64 2:18.0.0-7498.g369173db.el9 ceph 164 k 2023-11-27T20:45:36.962 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-27T20:45:36.962 INFO:teuthology.orchestra.run.smithi088.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-27T20:45:36.963 INFO:teuthology.orchestra.run.smithi088.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-27T20:45:36.963 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-27T20:45:36.963 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-27T20:45:36.963 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1 x86_64 2:18.0.0-7498.g369173db.el9 ceph 476 k 2023-11-27T20:45:36.963 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-27T20:45:36.963 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2 x86_64 2:18.0.0-7498.g369173db.el9 ceph 4.8 M 2023-11-27T20:45:36.963 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-27T20:45:36.963 INFO:teuthology.orchestra.run.smithi088.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-27T20:45:36.963 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-27T20:45:36.963 INFO:teuthology.orchestra.run.smithi088.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-27T20:45:36.963 INFO:teuthology.orchestra.run.smithi088.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-27T20:45:36.963 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-27T20:45:36.964 INFO:teuthology.orchestra.run.smithi088.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-27T20:45:36.964 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-27T20:45:36.964 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-27T20:45:36.964 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-27T20:45:36.964 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-27T20:45:36.964 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-27T20:45:36.964 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse x86_64 2:18.0.0-7498.g369173db.el9 ceph 45 k 2023-11-27T20:45:36.964 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common x86_64 2:18.0.0-7498.g369173db.el9 ceph 129 k 2023-11-27T20:45:36.964 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-27T20:45:36.964 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-27T20:45:36.965 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-27T20:45:36.965 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-27T20:45:36.965 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-27T20:45:36.965 INFO:teuthology.orchestra.run.smithi088.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-27T20:45:36.965 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-27T20:45:36.965 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-27T20:45:36.965 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-27T20:45:36.965 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-27T20:45:36.965 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-27T20:45:36.965 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-27T20:45:36.965 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-27T20:45:36.966 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-27T20:45:36.966 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-27T20:45:36.966 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-27T20:45:36.966 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-27T20:45:36.966 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-27T20:45:36.966 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-27T20:45:36.966 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-27T20:45:36.966 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-27T20:45:36.966 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-27T20:45:36.966 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-27T20:45:36.966 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-27T20:45:36.967 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-27T20:45:36.967 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-27T20:45:36.967 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-27T20:45:36.967 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-27T20:45:36.967 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-27T20:45:36.967 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-27T20:45:36.967 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-27T20:45:36.967 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-27T20:45:36.967 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-27T20:45:36.968 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-27T20:45:36.968 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-27T20:45:36.968 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-27T20:45:36.968 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-27T20:45:36.968 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-27T20:45:36.968 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-27T20:45:36.969 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-27T20:45:36.969 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-27T20:45:36.970 INFO:teuthology.orchestra.run.smithi088.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-27T20:45:36.970 INFO:teuthology.orchestra.run.smithi088.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-27T20:45:36.970 INFO:teuthology.orchestra.run.smithi088.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-27T20:45:36.970 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-27T20:45:36.970 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-27T20:45:36.970 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-27T20:45:36.971 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-27T20:45:36.971 INFO:teuthology.orchestra.run.smithi088.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-27T20:45:36.971 INFO:teuthology.orchestra.run.smithi088.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-27T20:45:36.971 INFO:teuthology.orchestra.run.smithi088.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-27T20:45:36.971 INFO:teuthology.orchestra.run.smithi088.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-27T20:45:36.971 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-27T20:45:36.971 INFO:teuthology.orchestra.run.smithi088.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-27T20:45:36.971 INFO:teuthology.orchestra.run.smithi088.stdout:Installing weak dependencies: 2023-11-27T20:45:36.971 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-27T20:45:36.971 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:45:36.971 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-11-27T20:45:36.971 INFO:teuthology.orchestra.run.smithi088.stdout:==================================================================================================== 2023-11-27T20:45:36.972 INFO:teuthology.orchestra.run.smithi088.stdout:Install 154 Packages 2023-11-27T20:45:36.972 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrade 15 Packages 2023-11-27T20:45:36.972 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:45:36.972 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 2.1 G 2023-11-27T20:45:36.972 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-11-27T20:45:37.562 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2023-11-27T20:45:37.617 INFO:teuthology.orchestra.run.smithi088.stdout:(1/169): ceph-18.0.0-7498.g369173db.el9.x86_64. 29 kB/s | 6.5 kB 00:00 2023-11-27T20:45:38.467 INFO:teuthology.orchestra.run.smithi088.stdout:(2/169): ceph-base-18.0.0-7498.g369173db.el9.x8 4.9 MB/s | 5.2 MB 00:01 2023-11-27T20:45:40.025 INFO:teuthology.orchestra.run.smithi088.stdout:(3/169): ceph-common-18.0.0-7498.g369173db.el9. 7.9 MB/s | 19 MB 00:02 2023-11-27T20:45:40.241 INFO:teuthology.orchestra.run.smithi167.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-27T20:45:40.242 INFO:teuthology.orchestra.run.smithi167.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-27T20:45:40.274 INFO:teuthology.orchestra.run.smithi167.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-27T20:45:40.275 INFO:teuthology.orchestra.run.smithi167.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-27T20:45:40.276 INFO:teuthology.orchestra.run.smithi167.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-27T20:45:40.277 INFO:teuthology.orchestra.run.smithi167.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-27T20:45:40.279 INFO:teuthology.orchestra.run.smithi167.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-27T20:45:40.282 INFO:teuthology.orchestra.run.smithi167.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-27T20:45:40.283 INFO:teuthology.orchestra.run.smithi167.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-27T20:45:40.359 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2023-11-27T20:45:40.390 INFO:teuthology.orchestra.run.smithi167.stdout:==================================================================================================== 2023-11-27T20:45:40.390 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2023-11-27T20:45:40.391 INFO:teuthology.orchestra.run.smithi167.stdout:==================================================================================================== 2023-11-27T20:45:40.391 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2023-11-27T20:45:40.391 INFO:teuthology.orchestra.run.smithi167.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-27T20:45:40.391 INFO:teuthology.orchestra.run.smithi167.stdout: ceph x86_64 2:18.0.0-7498.g369173db.el9 ceph 6.5 k 2023-11-27T20:45:40.391 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base x86_64 2:18.0.0-7498.g369173db.el9 ceph 5.2 M 2023-11-27T20:45:40.391 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 73 M 2023-11-27T20:45:40.391 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 404 M 2023-11-27T20:45:40.391 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse x86_64 2:18.0.0-7498.g369173db.el9 ceph 860 k 2023-11-27T20:45:40.391 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 5.8 M 2023-11-27T20:45:40.391 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7498.g369173db.el9 ceph 141 k 2023-11-27T20:45:40.391 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 1.4 M 2023-11-27T20:45:40.391 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 47 M 2023-11-27T20:45:40.392 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr x86_64 2:18.0.0-7498.g369173db.el9 ceph 1.5 M 2023-11-27T20:45:40.392 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 133 k 2023-11-27T20:45:40.392 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 1.8 M 2023-11-27T20:45:40.392 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 19 M 2023-11-27T20:45:40.392 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 7.4 M 2023-11-27T20:45:40.392 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 50 k 2023-11-27T20:45:40.392 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 111 M 2023-11-27T20:45:40.392 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 311 M 2023-11-27T20:45:40.392 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw x86_64 2:18.0.0-7498.g369173db.el9 ceph 8.6 M 2023-11-27T20:45:40.392 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 173 M 2023-11-27T20:45:40.392 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test x86_64 2:18.0.0-7498.g369173db.el9 ceph 41 M 2023-11-27T20:45:40.392 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 623 M 2023-11-27T20:45:40.393 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 262 k 2023-11-27T20:45:40.393 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 774 k 2023-11-27T20:45:40.393 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror x86_64 2:18.0.0-7498.g369173db.el9 ceph 217 k 2023-11-27T20:45:40.393 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-top noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 18 k 2023-11-27T20:45:40.393 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-27T20:45:40.393 INFO:teuthology.orchestra.run.smithi167.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-27T20:45:40.393 INFO:teuthology.orchestra.run.smithi167.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-27T20:45:40.393 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel x86_64 2:18.0.0-7498.g369173db.el9 ceph 31 k 2023-11-27T20:45:40.393 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2 x86_64 2:18.0.0-7498.g369173db.el9 ceph 719 k 2023-11-27T20:45:40.393 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 5.1 M 2023-11-27T20:45:40.393 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel x86_64 2:18.0.0-7498.g369173db.el9 ceph 126 k 2023-11-27T20:45:40.393 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 108 k 2023-11-27T20:45:40.393 INFO:teuthology.orchestra.run.smithi167.stdout: librados2-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 43 M 2023-11-27T20:45:40.394 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 50 M 2023-11-27T20:45:40.394 INFO:teuthology.orchestra.run.smithi167.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-27T20:45:40.394 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-27T20:45:40.394 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-11-27T20:45:40.394 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-27T20:45:40.394 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-27T20:45:40.394 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-27T20:45:40.394 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs x86_64 2:18.0.0-7498.g369173db.el9 ceph 162 k 2023-11-27T20:45:40.394 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 615 k 2023-11-27T20:45:40.394 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados x86_64 2:18.0.0-7498.g369173db.el9 ceph 320 k 2023-11-27T20:45:40.394 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 770 k 2023-11-27T20:45:40.394 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd x86_64 2:18.0.0-7498.g369173db.el9 ceph 297 k 2023-11-27T20:45:40.395 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 1.1 M 2023-11-27T20:45:40.395 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw x86_64 2:18.0.0-7498.g369173db.el9 ceph 99 k 2023-11-27T20:45:40.395 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 337 k 2023-11-27T20:45:40.395 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse x86_64 2:18.0.0-7498.g369173db.el9 ceph 85 k 2023-11-27T20:45:40.395 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 507 k 2023-11-27T20:45:40.395 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror x86_64 2:18.0.0-7498.g369173db.el9 ceph 3.0 M 2023-11-27T20:45:40.395 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 50 M 2023-11-27T20:45:40.395 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd x86_64 2:18.0.0-7498.g369173db.el9 ceph 170 k 2023-11-27T20:45:40.395 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 1.2 M 2023-11-27T20:45:40.395 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-27T20:45:40.395 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrading: 2023-11-27T20:45:40.395 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager x86_64 1:1.45.6-1.el9 CentOS-BaseOS 2.2 M 2023-11-27T20:45:40.395 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-libnm x86_64 1:1.45.6-1.el9 CentOS-BaseOS 1.8 M 2023-11-27T20:45:40.395 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-team x86_64 1:1.45.6-1.el9 CentOS-BaseOS 42 k 2023-11-27T20:45:40.396 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-tui x86_64 1:1.45.6-1.el9 CentOS-BaseOS 245 k 2023-11-27T20:45:40.396 INFO:teuthology.orchestra.run.smithi167.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-27T20:45:40.396 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-27T20:45:40.396 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-27T20:45:40.396 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-27T20:45:40.396 INFO:teuthology.orchestra.run.smithi167.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-27T20:45:40.396 INFO:teuthology.orchestra.run.smithi167.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-27T20:45:40.396 INFO:teuthology.orchestra.run.smithi167.stdout: librados2 x86_64 2:18.0.0-7498.g369173db.el9 ceph 3.3 M 2023-11-27T20:45:40.396 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1 x86_64 2:18.0.0-7498.g369173db.el9 ceph 3.0 M 2023-11-27T20:45:40.396 INFO:teuthology.orchestra.run.smithi167.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-11-27T20:45:40.396 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-11-27T20:45:40.396 INFO:teuthology.orchestra.run.smithi167.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-27T20:45:40.397 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2023-11-27T20:45:40.397 INFO:teuthology.orchestra.run.smithi167.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-27T20:45:40.397 INFO:teuthology.orchestra.run.smithi167.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-27T20:45:40.397 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common x86_64 2:18.0.0-7498.g369173db.el9 ceph 19 M 2023-11-27T20:45:40.397 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-debuginfo x86_64 2:18.0.0-7498.g369173db.el9 ceph 21 M 2023-11-27T20:45:40.397 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 28 k 2023-11-27T20:45:40.398 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds x86_64 2:18.0.0-7498.g369173db.el9 ceph 2.1 M 2023-11-27T20:45:40.398 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 243 k 2023-11-27T20:45:40.398 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon x86_64 2:18.0.0-7498.g369173db.el9 ceph 4.4 M 2023-11-27T20:45:40.398 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd x86_64 2:18.0.0-7498.g369173db.el9 ceph 18 M 2023-11-27T20:45:40.398 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 15 k 2023-11-27T20:45:40.398 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux x86_64 2:18.0.0-7498.g369173db.el9 ceph 24 k 2023-11-27T20:45:40.398 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-27T20:45:40.398 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-27T20:45:40.398 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-27T20:45:40.398 INFO:teuthology.orchestra.run.smithi167.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-27T20:45:40.398 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-27T20:45:40.399 INFO:teuthology.orchestra.run.smithi167.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-27T20:45:40.399 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-27T20:45:40.399 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-27T20:45:40.399 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite x86_64 2:18.0.0-7498.g369173db.el9 ceph 164 k 2023-11-27T20:45:40.399 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-27T20:45:40.399 INFO:teuthology.orchestra.run.smithi167.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-27T20:45:40.399 INFO:teuthology.orchestra.run.smithi167.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-27T20:45:40.399 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-27T20:45:40.399 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-27T20:45:40.399 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1 x86_64 2:18.0.0-7498.g369173db.el9 ceph 476 k 2023-11-27T20:45:40.399 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-27T20:45:40.399 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2 x86_64 2:18.0.0-7498.g369173db.el9 ceph 4.8 M 2023-11-27T20:45:40.400 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-27T20:45:40.400 INFO:teuthology.orchestra.run.smithi167.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-27T20:45:40.400 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-27T20:45:40.400 INFO:teuthology.orchestra.run.smithi167.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-27T20:45:40.400 INFO:teuthology.orchestra.run.smithi167.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-27T20:45:40.400 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-27T20:45:40.400 INFO:teuthology.orchestra.run.smithi167.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-27T20:45:40.400 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-27T20:45:40.400 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-27T20:45:40.400 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-27T20:45:40.400 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-27T20:45:40.400 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-27T20:45:40.401 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse x86_64 2:18.0.0-7498.g369173db.el9 ceph 45 k 2023-11-27T20:45:40.401 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common x86_64 2:18.0.0-7498.g369173db.el9 ceph 129 k 2023-11-27T20:45:40.401 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-27T20:45:40.401 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-27T20:45:40.401 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-27T20:45:40.401 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-27T20:45:40.401 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-27T20:45:40.401 INFO:teuthology.orchestra.run.smithi167.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-27T20:45:40.401 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-27T20:45:40.401 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-27T20:45:40.401 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-27T20:45:40.401 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-27T20:45:40.401 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-27T20:45:40.402 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-27T20:45:40.402 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-27T20:45:40.402 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-27T20:45:40.402 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-27T20:45:40.402 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-27T20:45:40.402 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-27T20:45:40.402 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-27T20:45:40.402 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-27T20:45:40.402 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-27T20:45:40.402 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-27T20:45:40.402 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-27T20:45:40.402 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-27T20:45:40.403 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-27T20:45:40.403 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-27T20:45:40.403 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-27T20:45:40.403 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-27T20:45:40.403 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-27T20:45:40.403 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-27T20:45:40.403 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-27T20:45:40.403 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-27T20:45:40.403 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-27T20:45:40.403 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-27T20:45:40.403 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-27T20:45:40.403 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-27T20:45:40.403 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-27T20:45:40.404 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-27T20:45:40.404 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-27T20:45:40.404 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-27T20:45:40.404 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-27T20:45:40.404 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-27T20:45:40.404 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-27T20:45:40.404 INFO:teuthology.orchestra.run.smithi167.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-27T20:45:40.404 INFO:teuthology.orchestra.run.smithi167.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-27T20:45:40.404 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-27T20:45:40.404 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-27T20:45:40.404 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-27T20:45:40.405 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-27T20:45:40.405 INFO:teuthology.orchestra.run.smithi167.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-27T20:45:40.405 INFO:teuthology.orchestra.run.smithi167.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-27T20:45:40.405 INFO:teuthology.orchestra.run.smithi167.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-27T20:45:40.405 INFO:teuthology.orchestra.run.smithi167.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-27T20:45:40.405 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-27T20:45:40.405 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-27T20:45:40.405 INFO:teuthology.orchestra.run.smithi167.stdout:Installing weak dependencies: 2023-11-27T20:45:40.405 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-27T20:45:40.405 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:45:40.405 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2023-11-27T20:45:40.405 INFO:teuthology.orchestra.run.smithi167.stdout:==================================================================================================== 2023-11-27T20:45:40.406 INFO:teuthology.orchestra.run.smithi167.stdout:Install 154 Packages 2023-11-27T20:45:40.406 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrade 15 Packages 2023-11-27T20:45:40.406 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:45:40.406 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 2.1 G 2023-11-27T20:45:40.406 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2023-11-27T20:45:41.288 INFO:teuthology.orchestra.run.smithi167.stdout:(1/169): ceph-18.0.0-7498.g369173db.el9.x86_64. 15 kB/s | 6.5 kB 00:00 2023-11-27T20:45:42.583 INFO:teuthology.orchestra.run.smithi088.stdout:(4/169): ceph-debuginfo-18.0.0-7498.g369173db.e 8.1 MB/s | 21 MB 00:02 2023-11-27T20:45:42.867 INFO:teuthology.orchestra.run.smithi088.stdout:(5/169): ceph-fuse-18.0.0-7498.g369173db.el9.x8 3.0 MB/s | 860 kB 00:00 2023-11-27T20:45:43.758 INFO:teuthology.orchestra.run.smithi088.stdout:(6/169): ceph-fuse-debuginfo-18.0.0-7498.g36917 6.5 MB/s | 5.8 MB 00:00 2023-11-27T20:45:43.867 INFO:teuthology.orchestra.run.smithi088.stdout:(7/169): ceph-immutable-object-cache-18.0.0-749 1.3 MB/s | 141 kB 00:00 2023-11-27T20:45:44.176 INFO:teuthology.orchestra.run.smithi088.stdout:(8/169): ceph-immutable-object-cache-debuginfo- 4.5 MB/s | 1.4 MB 00:00 2023-11-27T20:45:44.837 INFO:teuthology.orchestra.run.smithi088.stdout:(9/169): ceph-mds-18.0.0-7498.g369173db.el9.x86 3.2 MB/s | 2.1 MB 00:00 2023-11-27T20:45:46.113 INFO:teuthology.orchestra.run.smithi167.stdout:(2/169): ceph-base-18.0.0-7498.g369173db.el9.x8 1.0 MB/s | 5.2 MB 00:05 2023-11-27T20:45:46.285 INFO:teuthology.orchestra.run.smithi088.stdout:(10/169): ceph-base-debuginfo-18.0.0-7498.g3691 8.2 MB/s | 73 MB 00:08 2023-11-27T20:45:46.618 INFO:teuthology.orchestra.run.smithi088.stdout:(11/169): ceph-mgr-18.0.0-7498.g369173db.el9.x8 4.4 MB/s | 1.5 MB 00:00 2023-11-27T20:45:46.680 INFO:teuthology.orchestra.run.smithi167.stdout:(3/169): ceph-common-18.0.0-7498.g369173db.el9. 3.5 MB/s | 19 MB 00:05 2023-11-27T20:45:50.063 INFO:teuthology.orchestra.run.smithi167.stdout:(4/169): ceph-debuginfo-18.0.0-7498.g369173db.e 6.1 MB/s | 21 MB 00:03 2023-11-27T20:45:50.422 INFO:teuthology.orchestra.run.smithi167.stdout:(5/169): ceph-fuse-18.0.0-7498.g369173db.el9.x8 2.3 MB/s | 860 kB 00:00 2023-11-27T20:45:50.601 INFO:teuthology.orchestra.run.smithi088.stdout:(12/169): ceph-mgr-debuginfo-18.0.0-7498.g36917 4.8 MB/s | 19 MB 00:03 2023-11-27T20:45:51.343 INFO:teuthology.orchestra.run.smithi088.stdout:(13/169): ceph-mon-18.0.0-7498.g369173db.el9.x8 5.9 MB/s | 4.4 MB 00:00 2023-11-27T20:45:51.922 INFO:teuthology.orchestra.run.smithi167.stdout:(6/169): ceph-fuse-debuginfo-18.0.0-7498.g36917 3.8 MB/s | 5.8 MB 00:01 2023-11-27T20:45:52.014 INFO:teuthology.orchestra.run.smithi167.stdout:(7/169): ceph-immutable-object-cache-18.0.0-749 1.5 MB/s | 141 kB 00:00 2023-11-27T20:45:52.464 INFO:teuthology.orchestra.run.smithi167.stdout:(8/169): ceph-immutable-object-cache-debuginfo- 3.1 MB/s | 1.4 MB 00:00 2023-11-27T20:45:53.139 INFO:teuthology.orchestra.run.smithi167.stdout:(9/169): ceph-mds-18.0.0-7498.g369173db.el9.x86 3.1 MB/s | 2.1 MB 00:00 2023-11-27T20:45:54.993 INFO:teuthology.orchestra.run.smithi088.stdout:(14/169): ceph-mds-debuginfo-18.0.0-7498.g36917 4.6 MB/s | 47 MB 00:10 2023-11-27T20:45:56.114 INFO:teuthology.orchestra.run.smithi167.stdout:(10/169): ceph-base-debuginfo-18.0.0-7498.g3691 4.8 MB/s | 73 MB 00:15 2023-11-27T20:45:56.664 INFO:teuthology.orchestra.run.smithi167.stdout:(11/169): ceph-mgr-18.0.0-7498.g369173db.el9.x8 2.7 MB/s | 1.5 MB 00:00 2023-11-27T20:45:58.550 INFO:teuthology.orchestra.run.smithi088.stdout:(15/169): ceph-osd-18.0.0-7498.g369173db.el9.x8 5.0 MB/s | 18 MB 00:03 2023-11-27T20:46:00.997 INFO:teuthology.orchestra.run.smithi167.stdout:(12/169): ceph-mgr-debuginfo-18.0.0-7498.g36917 4.4 MB/s | 19 MB 00:04 2023-11-27T20:46:02.173 INFO:teuthology.orchestra.run.smithi167.stdout:(13/169): ceph-mon-18.0.0-7498.g369173db.el9.x8 3.7 MB/s | 4.4 MB 00:01 2023-11-27T20:46:06.539 INFO:teuthology.orchestra.run.smithi167.stdout:(14/169): ceph-mds-debuginfo-18.0.0-7498.g36917 3.5 MB/s | 47 MB 00:13 2023-11-27T20:46:13.014 INFO:teuthology.orchestra.run.smithi167.stdout:(15/169): ceph-osd-18.0.0-7498.g369173db.el9.x8 2.7 MB/s | 18 MB 00:06 2023-11-27T20:46:13.940 INFO:teuthology.orchestra.run.smithi088.stdout:(16/169): ceph-mon-debuginfo-18.0.0-7498.g36917 4.9 MB/s | 111 MB 00:22 2023-11-27T20:46:17.181 INFO:teuthology.orchestra.run.smithi088.stdout:(17/169): ceph-radosgw-18.0.0-7498.g369173db.el 2.7 MB/s | 8.6 MB 00:03 2023-11-27T20:46:31.788 INFO:teuthology.orchestra.run.smithi167.stdout:(16/169): ceph-mon-debuginfo-18.0.0-7498.g36917 3.8 MB/s | 111 MB 00:29 2023-11-27T20:46:34.437 INFO:teuthology.orchestra.run.smithi167.stdout:(17/169): ceph-radosgw-18.0.0-7498.g369173db.el 3.2 MB/s | 8.6 MB 00:02 2023-11-27T20:46:53.144 INFO:teuthology.orchestra.run.smithi088.stdout:(18/169): ceph-osd-debuginfo-18.0.0-7498.g36917 5.7 MB/s | 311 MB 00:54 2023-11-27T20:46:53.252 INFO:teuthology.orchestra.run.smithi088.stdout:(19/169): ceph-selinux-18.0.0-7498.g369173db.el 223 kB/s | 24 kB 00:00 2023-11-27T20:46:59.360 INFO:teuthology.orchestra.run.smithi088.stdout:(20/169): ceph-radosgw-debuginfo-18.0.0-7498.g3 4.1 MB/s | 173 MB 00:42 2023-11-27T20:47:03.151 INFO:teuthology.orchestra.run.smithi088.stdout:(21/169): ceph-common-debuginfo-18.0.0-7498.g36 4.8 MB/s | 404 MB 01:24 2023-11-27T20:47:03.510 INFO:teuthology.orchestra.run.smithi088.stdout:(22/169): ceph-test-18.0.0-7498.g369173db.el9.x 4.0 MB/s | 41 MB 00:10 2023-11-27T20:47:03.535 INFO:teuthology.orchestra.run.smithi088.stdout:(23/169): cephfs-mirror-18.0.0-7498.g369173db.e 567 kB/s | 217 kB 00:00 2023-11-27T20:47:03.669 INFO:teuthology.orchestra.run.smithi088.stdout:(24/169): libcephfs-devel-18.0.0-7498.g369173db 196 kB/s | 31 kB 00:00 2023-11-27T20:47:03.760 INFO:teuthology.orchestra.run.smithi088.stdout:(25/169): libcephfs2-18.0.0-7498.g369173db.el9. 3.1 MB/s | 719 kB 00:00 2023-11-27T20:47:03.861 INFO:teuthology.orchestra.run.smithi088.stdout:(26/169): libcephsqlite-18.0.0-7498.g369173db.e 1.6 MB/s | 164 kB 00:00 2023-11-27T20:47:03.961 INFO:teuthology.orchestra.run.smithi088.stdout:(27/169): librados-devel-18.0.0-7498.g369173db. 1.2 MB/s | 126 kB 00:00 2023-11-27T20:47:04.061 INFO:teuthology.orchestra.run.smithi088.stdout:(28/169): librados-devel-debuginfo-18.0.0-7498. 1.1 MB/s | 108 kB 00:00 2023-11-27T20:47:05.053 INFO:teuthology.orchestra.run.smithi088.stdout:(29/169): libcephfs2-debuginfo-18.0.0-7498.g369 3.7 MB/s | 5.1 MB 00:01 2023-11-27T20:47:05.228 INFO:teuthology.orchestra.run.smithi088.stdout:(30/169): libradosstriper1-18.0.0-7498.g369173d 2.7 MB/s | 476 kB 00:00 2023-11-27T20:47:08.192 INFO:teuthology.orchestra.run.smithi167.stdout:(18/169): ceph-osd-debuginfo-18.0.0-7498.g36917 5.6 MB/s | 311 MB 00:55 2023-11-27T20:47:08.334 INFO:teuthology.orchestra.run.smithi167.stdout:(19/169): ceph-selinux-18.0.0-7498.g369173db.el 170 kB/s | 24 kB 00:00 2023-11-27T20:47:12.619 INFO:teuthology.orchestra.run.smithi088.stdout:(31/169): librados2-debuginfo-18.0.0-7498.g3691 5.1 MB/s | 43 MB 00:08 2023-11-27T20:47:13.827 INFO:teuthology.orchestra.run.smithi088.stdout:(32/169): librgw2-18.0.0-7498.g369173db.el9.x86 4.0 MB/s | 4.8 MB 00:01 2023-11-27T20:47:13.927 INFO:teuthology.orchestra.run.smithi088.stdout:(33/169): python3-ceph-argparse-18.0.0-7498.g36 451 kB/s | 45 kB 00:00 2023-11-27T20:47:14.036 INFO:teuthology.orchestra.run.smithi088.stdout:(34/169): python3-ceph-common-18.0.0-7498.g3691 1.2 MB/s | 129 kB 00:00 2023-11-27T20:47:14.145 INFO:teuthology.orchestra.run.smithi088.stdout:(35/169): python3-cephfs-18.0.0-7498.g369173db. 1.5 MB/s | 162 kB 00:00 2023-11-27T20:47:14.353 INFO:teuthology.orchestra.run.smithi088.stdout:(36/169): python3-cephfs-debuginfo-18.0.0-7498. 2.9 MB/s | 615 kB 00:00 2023-11-27T20:47:14.862 INFO:teuthology.orchestra.run.smithi088.stdout:(37/169): librbd1-debuginfo-18.0.0-7498.g369173 5.2 MB/s | 50 MB 00:09 2023-11-27T20:47:14.887 INFO:teuthology.orchestra.run.smithi088.stdout:(38/169): python3-rados-18.0.0-7498.g369173db.e 600 kB/s | 320 kB 00:00 2023-11-27T20:47:15.088 INFO:teuthology.orchestra.run.smithi088.stdout:(39/169): python3-rbd-18.0.0-7498.g369173db.el9 1.5 MB/s | 297 kB 00:00 2023-11-27T20:47:15.171 INFO:teuthology.orchestra.run.smithi088.stdout:(40/169): python3-rados-debuginfo-18.0.0-7498.g 2.4 MB/s | 770 kB 00:00 2023-11-27T20:47:15.271 INFO:teuthology.orchestra.run.smithi088.stdout:(41/169): python3-rgw-18.0.0-7498.g369173db.el9 996 kB/s | 99 kB 00:00 2023-11-27T20:47:15.355 INFO:teuthology.orchestra.run.smithi088.stdout:(42/169): python3-rbd-debuginfo-18.0.0-7498.g36 4.2 MB/s | 1.1 MB 00:00 2023-11-27T20:47:15.447 INFO:teuthology.orchestra.run.smithi088.stdout:(43/169): rbd-fuse-18.0.0-7498.g369173db.el9.x8 933 kB/s | 85 kB 00:00 2023-11-27T20:47:15.489 INFO:teuthology.orchestra.run.smithi088.stdout:(44/169): python3-rgw-debuginfo-18.0.0-7498.g36 1.5 MB/s | 337 kB 00:00 2023-11-27T20:47:15.606 INFO:teuthology.orchestra.run.smithi088.stdout:(45/169): rbd-fuse-debuginfo-18.0.0-7498.g36917 3.1 MB/s | 507 kB 00:00 2023-11-27T20:47:16.398 INFO:teuthology.orchestra.run.smithi088.stdout:(46/169): rbd-mirror-18.0.0-7498.g369173db.el9. 3.3 MB/s | 3.0 MB 00:00 2023-11-27T20:47:16.506 INFO:teuthology.orchestra.run.smithi088.stdout:(47/169): rbd-nbd-18.0.0-7498.g369173db.el9.x86 1.5 MB/s | 170 kB 00:00 2023-11-27T20:47:16.873 INFO:teuthology.orchestra.run.smithi088.stdout:(48/169): rbd-nbd-debuginfo-18.0.0-7498.g369173 3.4 MB/s | 1.2 MB 00:00 2023-11-27T20:47:16.908 INFO:teuthology.orchestra.run.smithi167.stdout:(20/169): ceph-test-18.0.0-7498.g369173db.el9.x 4.8 MB/s | 41 MB 00:08 2023-11-27T20:47:16.948 INFO:teuthology.orchestra.run.smithi088.stdout:(49/169): ceph-grafana-dashboards-18.0.0-7498.g 375 kB/s | 28 kB 00:00 2023-11-27T20:47:17.065 INFO:teuthology.orchestra.run.smithi088.stdout:(50/169): ceph-mgr-cephadm-18.0.0-7498.g369173d 1.1 MB/s | 133 kB 00:00 2023-11-27T20:47:17.641 INFO:teuthology.orchestra.run.smithi088.stdout:(51/169): ceph-mgr-dashboard-18.0.0-7498.g36917 3.1 MB/s | 1.8 MB 00:00 2023-11-27T20:47:19.841 INFO:teuthology.orchestra.run.smithi088.stdout:(52/169): ceph-mgr-diskprediction-local-18.0.0- 3.4 MB/s | 7.4 MB 00:02 2023-11-27T20:47:19.941 INFO:teuthology.orchestra.run.smithi088.stdout:(53/169): ceph-mgr-modules-core-18.0.0-7498.g36 2.4 MB/s | 243 kB 00:00 2023-11-27T20:47:20.032 INFO:teuthology.orchestra.run.smithi088.stdout:(54/169): ceph-mgr-rook-18.0.0-7498.g369173db.e 549 kB/s | 50 kB 00:00 2023-11-27T20:47:20.116 INFO:teuthology.orchestra.run.smithi088.stdout:(55/169): ceph-prometheus-alerts-18.0.0-7498.g3 181 kB/s | 15 kB 00:00 2023-11-27T20:47:20.242 INFO:teuthology.orchestra.run.smithi088.stdout:(56/169): ceph-volume-18.0.0-7498.g369173db.el9 2.1 MB/s | 262 kB 00:00 2023-11-27T20:47:20.483 INFO:teuthology.orchestra.run.smithi088.stdout:(57/169): cephadm-18.0.0-7498.g369173db.el9.noa 3.1 MB/s | 774 kB 00:00 2023-11-27T20:47:20.575 INFO:teuthology.orchestra.run.smithi088.stdout:(58/169): cephfs-top-18.0.0-7498.g369173db.el9. 199 kB/s | 18 kB 00:00 2023-11-27T20:47:20.726 INFO:teuthology.orchestra.run.smithi088.stdout:(59/169): automake-1.16.2-8.el9.noarch.rpm 4.3 MB/s | 662 kB 00:00 2023-11-27T20:47:25.411 INFO:teuthology.orchestra.run.smithi167.stdout:(21/169): ceph-radosgw-debuginfo-18.0.0-7498.g3 3.5 MB/s | 173 MB 00:49 2023-11-27T20:47:25.411 INFO:teuthology.orchestra.run.smithi167.stdout:(22/169): cephfs-mirror-18.0.0-7498.g369173db.e 1.1 MB/s | 217 kB 00:00 2023-11-27T20:47:25.411 INFO:teuthology.orchestra.run.smithi167.stdout:(23/169): libcephfs-devel-18.0.0-7498.g369173db 416 kB/s | 31 kB 00:00 2023-11-27T20:47:25.411 INFO:teuthology.orchestra.run.smithi167.stdout:(24/169): libcephfs2-18.0.0-7498.g369173db.el9. 2.8 MB/s | 719 kB 00:00 2023-11-27T20:47:25.425 INFO:teuthology.orchestra.run.smithi088.stdout:(60/169): bison-3.7.4-5.el9.x86_64.rpm 13 MB/s | 920 kB 00:00 2023-11-27T20:47:25.425 INFO:teuthology.orchestra.run.smithi088.stdout:(61/169): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2023-11-27T20:47:25.425 INFO:teuthology.orchestra.run.smithi088.stdout:(62/169): elfutils-libelf-devel-0.190-1.el9.x86 861 kB/s | 21 kB 00:00 2023-11-27T20:47:25.426 INFO:teuthology.orchestra.run.smithi088.stdout:(63/169): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 307 kB 00:00 2023-11-27T20:47:25.426 INFO:teuthology.orchestra.run.smithi088.stdout:(64/169): flexiblas-3.0.4-8.el9.x86_64.rpm 1.2 MB/s | 32 kB 00:00 2023-11-27T20:47:25.427 INFO:teuthology.orchestra.run.smithi088.stdout:(65/169): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2023-11-27T20:47:25.427 INFO:teuthology.orchestra.run.smithi088.stdout:(66/169): flexiblas-openblas-openmp-3.0.4-8.el9 517 kB/s | 17 kB 00:00 2023-11-27T20:47:25.428 INFO:teuthology.orchestra.run.smithi088.stdout:(67/169): jq-1.6-16.el9.x86_64.rpm 4.7 MB/s | 186 kB 00:00 2023-11-27T20:47:25.428 INFO:teuthology.orchestra.run.smithi088.stdout:(68/169): libaio-devel-0.3.111-13.el9.x86_64.rp 302 kB/s | 10 kB 00:00 2023-11-27T20:47:25.428 INFO:teuthology.orchestra.run.smithi088.stdout:(69/169): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2023-11-27T20:47:25.429 INFO:teuthology.orchestra.run.smithi088.stdout:(70/169): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2023-11-27T20:47:25.429 INFO:teuthology.orchestra.run.smithi088.stdout:(71/169): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-11-27T20:47:25.429 INFO:teuthology.orchestra.run.smithi088.stdout:(72/169): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2023-11-27T20:47:25.430 INFO:teuthology.orchestra.run.smithi088.stdout:(73/169): libuuid-devel-2.37.4-15.el9.x86_64.rp 983 kB/s | 24 kB 00:00 2023-11-27T20:47:25.430 INFO:teuthology.orchestra.run.smithi088.stdout:(74/169): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.8 MB/s | 46 kB 00:00 2023-11-27T20:47:25.430 INFO:teuthology.orchestra.run.smithi088.stdout:(75/169): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2023-11-27T20:47:25.430 INFO:teuthology.orchestra.run.smithi088.stdout:(76/169): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.1 MB/s | 217 kB 00:00 2023-11-27T20:47:25.430 INFO:teuthology.orchestra.run.smithi088.stdout:(77/169): openblas-0.3.21-2.el9.x86_64.rpm 1.3 MB/s | 34 kB 00:00 2023-11-27T20:47:25.431 INFO:teuthology.orchestra.run.smithi088.stdout:(78/169): openblas-openmp-0.3.21-2.el9.x86_64.r 36 MB/s | 4.7 MB 00:00 2023-11-27T20:47:25.431 INFO:teuthology.orchestra.run.smithi088.stdout:(79/169): postgresql-13.11-1.el9.x86_64.rpm 23 MB/s | 1.5 MB 00:00 2023-11-27T20:47:25.432 INFO:teuthology.orchestra.run.smithi088.stdout:(80/169): postgresql-contrib-13.11-1.el9.x86_64 16 MB/s | 811 kB 00:00 2023-11-27T20:47:25.432 INFO:teuthology.orchestra.run.smithi088.stdout:(81/169): postgresql-private-libs-13.11-1.el9.x 2.6 MB/s | 134 kB 00:00 2023-11-27T20:47:25.432 INFO:teuthology.orchestra.run.smithi088.stdout:(82/169): postgresql-server-13.11-1.el9.x86_64. 34 MB/s | 5.7 MB 00:00 2023-11-27T20:47:25.433 INFO:teuthology.orchestra.run.smithi088.stdout:(83/169): python3-babel-2.9.1-2.el9.noarch.rpm 37 MB/s | 5.8 MB 00:00 2023-11-27T20:47:25.433 INFO:teuthology.orchestra.run.smithi088.stdout:(84/169): python3-jinja2-2.11.3-4.el9.noarch.rp 5.4 MB/s | 228 kB 00:00 2023-11-27T20:47:25.434 INFO:teuthology.orchestra.run.smithi088.stdout:(85/169): python3-jsonpatch-1.21-16.el9.noarch. 980 kB/s | 24 kB 00:00 2023-11-27T20:47:25.434 INFO:teuthology.orchestra.run.smithi088.stdout:(86/169): python3-jsonpointer-2.0-4.el9.noarch. 721 kB/s | 18 kB 00:00 2023-11-27T20:47:25.434 INFO:teuthology.orchestra.run.smithi088.stdout:(87/169): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2023-11-27T20:47:25.434 INFO:teuthology.orchestra.run.smithi088.stdout:(88/169): python3-markupsafe-1.1.1-12.el9.x86_6 949 kB/s | 32 kB 00:00 2023-11-27T20:47:25.434 INFO:teuthology.orchestra.run.smithi088.stdout:(89/169): python3-numpy-1.20.1-5.el9.x86_64.rpm 27 MB/s | 4.8 MB 00:00 2023-11-27T20:47:25.434 INFO:teuthology.orchestra.run.smithi088.stdout:(90/169): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.1 MB/s | 217 kB 00:00 2023-11-27T20:47:25.434 INFO:teuthology.orchestra.run.smithi088.stdout:(91/169): python3-oauthlib-3.1.1-5.el9.noarch.r 4.1 MB/s | 174 kB 00:00 2023-11-27T20:47:25.434 INFO:teuthology.orchestra.run.smithi088.stdout:(92/169): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 41 kB 00:00 2023-11-27T20:47:25.434 INFO:teuthology.orchestra.run.smithi088.stdout:(93/169): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.9 MB/s | 132 kB 00:00 2023-11-27T20:47:25.434 INFO:teuthology.orchestra.run.smithi088.stdout:(94/169): python3-pyasn1-modules-0.4.8-6.el9.no 4.9 MB/s | 211 kB 00:00 2023-11-27T20:47:25.435 INFO:teuthology.orchestra.run.smithi088.stdout:(95/169): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2023-11-27T20:47:25.435 INFO:teuthology.orchestra.run.smithi088.stdout:(96/169): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 43 kB 00:00 2023-11-27T20:47:25.435 INFO:teuthology.orchestra.run.smithi088.stdout:(97/169): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2023-11-27T20:47:25.435 INFO:teuthology.orchestra.run.smithi088.stdout:(98/169): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2023-11-27T20:47:25.435 INFO:teuthology.orchestra.run.smithi088.stdout:(99/169): socat-1.7.4.1-5.el9.x86_64.rpm 7.0 MB/s | 300 kB 00:00 2023-11-27T20:47:25.435 INFO:teuthology.orchestra.run.smithi088.stdout:(100/169): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 56 kB 00:00 2023-11-27T20:47:25.435 INFO:teuthology.orchestra.run.smithi088.stdout:(101/169): xfsprogs-devel-5.19.0-4.el9.x86_64.r 2.0 MB/s | 85 kB 00:00 2023-11-27T20:47:25.435 INFO:teuthology.orchestra.run.smithi088.stdout:(102/169): rbd-mirror-debuginfo-18.0.0-7498.g36 6.1 MB/s | 50 MB 00:08 2023-11-27T20:47:25.435 INFO:teuthology.orchestra.run.smithi088.stdout:(103/169): xmlstarlet-1.6.1-20.el9.x86_64.rpm 139 kB/s | 63 kB 00:00 2023-11-27T20:47:25.435 INFO:teuthology.orchestra.run.smithi088.stdout:(104/169): zlib-devel-1.2.11-40.el9.x86_64.rpm 884 kB/s | 44 kB 00:00 2023-11-27T20:47:25.435 INFO:teuthology.orchestra.run.smithi088.stdout:(105/169): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2023-11-27T20:47:25.435 INFO:teuthology.orchestra.run.smithi088.stdout:(106/169): libgfortran-11.4.1-2.3.el9.x86_64.rp 12 MB/s | 803 kB 00:00 2023-11-27T20:47:25.436 INFO:teuthology.orchestra.run.smithi088.stdout:(107/169): libquadmath-11.4.1-2.3.el9.x86_64.rp 2.9 MB/s | 195 kB 00:00 2023-11-27T20:47:25.436 INFO:teuthology.orchestra.run.smithi088.stdout:(108/169): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2023-11-27T20:47:25.436 INFO:teuthology.orchestra.run.smithi088.stdout:(109/169): python3-cryptography-36.0.1-4.el9.x8 15 MB/s | 1.1 MB 00:00 2023-11-27T20:47:25.436 INFO:teuthology.orchestra.run.smithi088.stdout:(110/169): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 103 kB 00:00 2023-11-27T20:47:25.436 INFO:teuthology.orchestra.run.smithi088.stdout:(111/169): python3-pycparser-2.20-6.el9.noarch. 2.1 MB/s | 124 kB 00:00 2023-11-27T20:47:25.436 INFO:teuthology.orchestra.run.smithi088.stdout:(112/169): python3-requests-2.25.1-7.el9.noarch 1.9 MB/s | 113 kB 00:00 2023-11-27T20:47:25.436 INFO:teuthology.orchestra.run.smithi088.stdout:(113/169): python3-urllib3-1.26.5-4.el9.noarch. 3.7 MB/s | 187 kB 00:00 2023-11-27T20:47:25.436 INFO:teuthology.orchestra.run.smithi088.stdout:(114/169): python3-devel-3.9.17-2.el9.x86_64.rp 1.5 MB/s | 245 kB 00:00 2023-11-27T20:47:25.436 INFO:teuthology.orchestra.run.smithi088.stdout:(115/169): openssl-devel-3.0.7-25.el9.x86_64.rp 12 MB/s | 4.1 MB 00:00 2023-11-27T20:47:25.436 INFO:teuthology.orchestra.run.smithi088.stdout:(116/169): gperftools-libs-2.9.1-2.el9.x86_64.r 824 kB/s | 309 kB 00:00 2023-11-27T20:47:25.436 INFO:teuthology.orchestra.run.smithi088.stdout:(117/169): libarrow-doc-9.0.0-9.el9.noarch.rpm 366 kB/s | 24 kB 00:00 2023-11-27T20:47:25.436 INFO:teuthology.orchestra.run.smithi088.stdout:(118/169): liboath-2.6.7-2.el9.x86_64.rpm 648 kB/s | 49 kB 00:00 2023-11-27T20:47:25.436 INFO:teuthology.orchestra.run.smithi088.stdout:(119/169): libunwind-1.6.2-1.el9.x86_64.rpm 809 kB/s | 67 kB 00:00 2023-11-27T20:47:25.437 INFO:teuthology.orchestra.run.smithi088.stdout:(120/169): parquet-libs-9.0.0-9.el9.x86_64.rpm 3.4 MB/s | 837 kB 00:00 2023-11-27T20:47:25.437 INFO:teuthology.orchestra.run.smithi088.stdout:(121/169): python3-asyncssh-2.13.2-3.el9.noarch 3.4 MB/s | 548 kB 00:00 2023-11-27T20:47:25.437 INFO:teuthology.orchestra.run.smithi088.stdout:(122/169): python3-bcrypt-3.2.2-1.el9.x86_64.rp 522 kB/s | 43 kB 00:00 2023-11-27T20:47:25.437 INFO:teuthology.orchestra.run.smithi088.stdout:(123/169): python3-cachetools-4.2.4-1.el9.noarc 483 kB/s | 32 kB 00:00 2023-11-27T20:47:25.437 INFO:teuthology.orchestra.run.smithi088.stdout:(124/169): python3-certifi-2021.10.8-2.el9.noar 225 kB/s | 15 kB 00:00 2023-11-27T20:47:25.500 INFO:teuthology.orchestra.run.smithi088.stdout:(125/169): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2023-11-27T20:47:25.642 INFO:teuthology.orchestra.run.smithi088.stdout:(126/169): python3-cherrypy-18.6.1-2.el9.noarch 2.5 MB/s | 358 kB 00:00 2023-11-27T20:47:25.717 INFO:teuthology.orchestra.run.smithi088.stdout:(127/169): python3-google-auth-2.23.4-1.el9.noa 2.6 MB/s | 197 kB 00:00 2023-11-27T20:47:25.732 INFO:teuthology.orchestra.run.smithi167.stdout:(25/169): libcephfs2-debuginfo-18.0.0-7498.g369 3.2 MB/s | 5.1 MB 00:01 2023-11-27T20:47:25.801 INFO:teuthology.orchestra.run.smithi088.stdout:(128/169): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2023-11-27T20:47:25.841 INFO:teuthology.orchestra.run.smithi167.stdout:(26/169): libcephsqlite-18.0.0-7498.g369173db.e 1.5 MB/s | 164 kB 00:00 2023-11-27T20:47:25.884 INFO:teuthology.orchestra.run.smithi088.stdout:(129/169): python3-jaraco-classes-3.2.1-5.el9.n 212 kB/s | 18 kB 00:00 2023-11-27T20:47:25.933 INFO:teuthology.orchestra.run.smithi167.stdout:(27/169): librados-devel-18.0.0-7498.g369173db. 1.3 MB/s | 126 kB 00:00 2023-11-27T20:47:25.943 INFO:teuthology.orchestra.run.smithi088.stdout:(130/169): python3-jaraco-collections-3.0.0-8.e 398 kB/s | 23 kB 00:00 2023-11-27T20:47:26.010 INFO:teuthology.orchestra.run.smithi088.stdout:(131/169): python3-jaraco-functools-3.5.0-2.el9 291 kB/s | 19 kB 00:00 2023-11-27T20:47:26.017 INFO:teuthology.orchestra.run.smithi167.stdout:(28/169): librados-devel-debuginfo-18.0.0-7498. 1.3 MB/s | 108 kB 00:00 2023-11-27T20:47:26.060 INFO:teuthology.orchestra.run.smithi088.stdout:(132/169): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2023-11-27T20:47:26.110 INFO:teuthology.orchestra.run.smithi088.stdout:(133/169): python3-jwt+crypto-2.4.0-1.el9.noarc 182 kB/s | 9.0 kB 00:00 2023-11-27T20:47:26.169 INFO:teuthology.orchestra.run.smithi088.stdout:(134/169): libarrow-9.0.0-9.el9.x86_64.rpm 2.4 MB/s | 4.4 MB 00:01 2023-11-27T20:47:26.186 INFO:teuthology.orchestra.run.smithi088.stdout:(135/169): python3-jwt-2.4.0-1.el9.noarch.rpm 544 kB/s | 41 kB 00:00 2023-11-27T20:47:26.237 INFO:teuthology.orchestra.run.smithi088.stdout:(136/169): python3-logutils-0.3.5-21.el9.noarch 927 kB/s | 46 kB 00:00 2023-11-27T20:47:26.287 INFO:teuthology.orchestra.run.smithi088.stdout:(137/169): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2023-11-27T20:47:26.362 INFO:teuthology.orchestra.run.smithi088.stdout:(138/169): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2023-11-27T20:47:26.379 INFO:teuthology.orchestra.run.smithi088.stdout:(139/169): python3-natsort-7.1.1-5.el9.noarch.r 626 kB/s | 58 kB 00:00 2023-11-27T20:47:26.438 INFO:teuthology.orchestra.run.smithi088.stdout:(140/169): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2023-11-27T20:47:26.455 INFO:teuthology.orchestra.run.smithi088.stdout:(141/169): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2023-11-27T20:47:26.513 INFO:teuthology.orchestra.run.smithi088.stdout:(142/169): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2023-11-27T20:47:26.530 INFO:teuthology.orchestra.run.smithi088.stdout:(143/169): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2023-11-27T20:47:26.589 INFO:teuthology.orchestra.run.smithi088.stdout:(144/169): python3-routes-2.5.1-5.el9.noarch.rp 2.5 MB/s | 188 kB 00:00 2023-11-27T20:47:26.606 INFO:teuthology.orchestra.run.smithi088.stdout:(145/169): python3-rsa-4.9-2.el9.noarch.rpm 788 kB/s | 59 kB 00:00 2023-11-27T20:47:26.656 INFO:teuthology.orchestra.run.smithi088.stdout:(146/169): python3-tempora-5.0.0-2.el9.noarch.r 535 kB/s | 36 kB 00:00 2023-11-27T20:47:26.673 INFO:teuthology.orchestra.run.smithi088.stdout:(147/169): python3-typing-extensions-4.4.0-2.el 761 kB/s | 51 kB 00:00 2023-11-27T20:47:26.732 INFO:teuthology.orchestra.run.smithi088.stdout:(148/169): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2023-11-27T20:47:26.757 INFO:teuthology.orchestra.run.smithi088.stdout:(149/169): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2023-11-27T20:47:26.807 INFO:teuthology.orchestra.run.smithi088.stdout:(150/169): python3-zc-lockfile-2.0-10.el9.noarc 401 kB/s | 20 kB 00:00 2023-11-27T20:47:26.832 INFO:teuthology.orchestra.run.smithi088.stdout:(151/169): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2023-11-27T20:47:26.866 INFO:teuthology.orchestra.run.smithi088.stdout:(152/169): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2023-11-27T20:47:27.049 INFO:teuthology.orchestra.run.smithi088.stdout:(153/169): thrift-0.15.0-2.el9.x86_64.rpm 7.3 MB/s | 1.6 MB 00:00 2023-11-27T20:47:27.725 INFO:teuthology.orchestra.run.smithi088.stdout:(154/169): librbd1-18.0.0-7498.g369173db.el9.x8 4.5 MB/s | 3.0 MB 00:00 2023-11-27T20:47:27.750 INFO:teuthology.orchestra.run.smithi088.stdout:(155/169): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.7 MB/s | 68 kB 00:00 2023-11-27T20:47:27.825 INFO:teuthology.orchestra.run.smithi088.stdout:(156/169): librados2-18.0.0-7498.g369173db.el9. 3.5 MB/s | 3.3 MB 00:00 2023-11-27T20:47:27.875 INFO:teuthology.orchestra.run.smithi088.stdout:(157/169): NetworkManager-1.45.6-1.el9.x86_64.r 18 MB/s | 2.2 MB 00:00 2023-11-27T20:47:27.934 INFO:teuthology.orchestra.run.smithi088.stdout:(158/169): NetworkManager-libnm-1.45.6-1.el9.x8 17 MB/s | 1.8 MB 00:00 2023-11-27T20:47:27.959 INFO:teuthology.orchestra.run.smithi088.stdout:(159/169): NetworkManager-team-1.45.6-1.el9.x86 514 kB/s | 42 kB 00:00 2023-11-27T20:47:27.985 INFO:teuthology.orchestra.run.smithi088.stdout:(160/169): NetworkManager-tui-1.45.6-1.el9.x86_ 4.8 MB/s | 245 kB 00:00 2023-11-27T20:47:28.010 INFO:teuthology.orchestra.run.smithi088.stdout:(161/169): acl-2.3.1-4.el9.x86_64.rpm 1.3 MB/s | 69 kB 00:00 2023-11-27T20:47:28.035 INFO:teuthology.orchestra.run.smithi088.stdout:(162/169): elfutils-debuginfod-client-0.190-1.e 731 kB/s | 36 kB 00:00 2023-11-27T20:47:28.060 INFO:teuthology.orchestra.run.smithi088.stdout:(163/169): elfutils-libelf-0.190-1.el9.x86_64.r 3.7 MB/s | 192 kB 00:00 2023-11-27T20:47:28.086 INFO:teuthology.orchestra.run.smithi088.stdout:(164/169): elfutils-libs-0.190-1.el9.x86_64.rpm 5.0 MB/s | 255 kB 00:00 2023-11-27T20:47:28.111 INFO:teuthology.orchestra.run.smithi088.stdout:(165/169): libacl-2.3.1-4.el9.x86_64.rpm 439 kB/s | 22 kB 00:00 2023-11-27T20:47:28.136 INFO:teuthology.orchestra.run.smithi088.stdout:(166/169): xfsdump-3.1.12-4.el9.x86_64.rpm 6.2 MB/s | 321 kB 00:00 2023-11-27T20:47:28.142 INFO:teuthology.orchestra.run.smithi167.stdout:(29/169): ceph-common-debuginfo-18.0.0-7498.g36 4.0 MB/s | 404 MB 01:42 2023-11-27T20:47:28.370 INFO:teuthology.orchestra.run.smithi088.stdout:(167/169): openssl-3.0.7-25.el9.x86_64.rpm 4.7 MB/s | 1.2 MB 00:00 2023-11-27T20:47:28.428 INFO:teuthology.orchestra.run.smithi088.stdout:(168/169): openssl-libs-3.0.7-25.el9.x86_64.rpm 7.4 MB/s | 2.2 MB 00:00 2023-11-27T20:47:28.434 INFO:teuthology.orchestra.run.smithi167.stdout:(30/169): libradosstriper1-18.0.0-7498.g369173d 1.6 MB/s | 476 kB 00:00 2023-11-27T20:47:36.259 INFO:teuthology.orchestra.run.smithi167.stdout:(31/169): librados2-debuginfo-18.0.0-7498.g3691 4.2 MB/s | 43 MB 00:10 2023-11-27T20:47:37.150 INFO:teuthology.orchestra.run.smithi167.stdout:(32/169): librgw2-18.0.0-7498.g369173db.el9.x86 5.4 MB/s | 4.8 MB 00:00 2023-11-27T20:47:37.225 INFO:teuthology.orchestra.run.smithi167.stdout:(33/169): python3-ceph-argparse-18.0.0-7498.g36 602 kB/s | 45 kB 00:00 2023-11-27T20:47:37.309 INFO:teuthology.orchestra.run.smithi167.stdout:(34/169): python3-ceph-common-18.0.0-7498.g3691 1.5 MB/s | 129 kB 00:00 2023-11-27T20:47:37.392 INFO:teuthology.orchestra.run.smithi167.stdout:(35/169): python3-cephfs-18.0.0-7498.g369173db. 1.9 MB/s | 162 kB 00:00 2023-11-27T20:47:37.559 INFO:teuthology.orchestra.run.smithi167.stdout:(36/169): python3-cephfs-debuginfo-18.0.0-7498. 3.6 MB/s | 615 kB 00:00 2023-11-27T20:47:37.660 INFO:teuthology.orchestra.run.smithi167.stdout:(37/169): python3-rados-18.0.0-7498.g369173db.e 3.1 MB/s | 320 kB 00:00 2023-11-27T20:47:37.827 INFO:teuthology.orchestra.run.smithi167.stdout:(38/169): python3-rados-debuginfo-18.0.0-7498.g 4.5 MB/s | 770 kB 00:00 2023-11-27T20:47:37.927 INFO:teuthology.orchestra.run.smithi167.stdout:(39/169): python3-rbd-18.0.0-7498.g369173db.el9 2.9 MB/s | 297 kB 00:00 2023-11-27T20:47:38.169 INFO:teuthology.orchestra.run.smithi167.stdout:(40/169): python3-rbd-debuginfo-18.0.0-7498.g36 4.7 MB/s | 1.1 MB 00:00 2023-11-27T20:47:38.269 INFO:teuthology.orchestra.run.smithi167.stdout:(41/169): python3-rgw-18.0.0-7498.g369173db.el9 994 kB/s | 99 kB 00:00 2023-11-27T20:47:38.361 INFO:teuthology.orchestra.run.smithi167.stdout:(42/169): python3-rgw-debuginfo-18.0.0-7498.g36 3.6 MB/s | 337 kB 00:00 2023-11-27T20:47:38.436 INFO:teuthology.orchestra.run.smithi167.stdout:(43/169): rbd-fuse-18.0.0-7498.g369173db.el9.x8 1.1 MB/s | 85 kB 00:00 2023-11-27T20:47:38.603 INFO:teuthology.orchestra.run.smithi167.stdout:(44/169): rbd-fuse-debuginfo-18.0.0-7498.g36917 3.0 MB/s | 507 kB 00:00 2023-11-27T20:47:39.220 INFO:teuthology.orchestra.run.smithi167.stdout:(45/169): rbd-mirror-18.0.0-7498.g369173db.el9. 4.9 MB/s | 3.0 MB 00:00 2023-11-27T20:47:40.437 INFO:teuthology.orchestra.run.smithi167.stdout:(46/169): librbd1-debuginfo-18.0.0-7498.g369173 4.1 MB/s | 50 MB 00:12 2023-11-27T20:47:40.571 INFO:teuthology.orchestra.run.smithi167.stdout:(47/169): rbd-nbd-18.0.0-7498.g369173db.el9.x86 1.3 MB/s | 170 kB 00:00 2023-11-27T20:47:40.988 INFO:teuthology.orchestra.run.smithi167.stdout:(48/169): rbd-nbd-debuginfo-18.0.0-7498.g369173 3.0 MB/s | 1.2 MB 00:00 2023-11-27T20:47:41.080 INFO:teuthology.orchestra.run.smithi167.stdout:(49/169): ceph-grafana-dashboards-18.0.0-7498.g 306 kB/s | 28 kB 00:00 2023-11-27T20:47:41.172 INFO:teuthology.orchestra.run.smithi167.stdout:(50/169): ceph-mgr-cephadm-18.0.0-7498.g369173d 1.4 MB/s | 133 kB 00:00 2023-11-27T20:47:41.739 INFO:teuthology.orchestra.run.smithi167.stdout:(51/169): ceph-mgr-dashboard-18.0.0-7498.g36917 3.1 MB/s | 1.8 MB 00:00 2023-11-27T20:47:43.930 INFO:teuthology.orchestra.run.smithi167.stdout:(52/169): ceph-mgr-diskprediction-local-18.0.0- 3.4 MB/s | 7.4 MB 00:02 2023-11-27T20:47:44.055 INFO:teuthology.orchestra.run.smithi167.stdout:(53/169): ceph-mgr-modules-core-18.0.0-7498.g36 1.9 MB/s | 243 kB 00:00 2023-11-27T20:47:44.148 INFO:teuthology.orchestra.run.smithi167.stdout:(54/169): ceph-mgr-rook-18.0.0-7498.g369173db.e 548 kB/s | 50 kB 00:00 2023-11-27T20:47:44.239 INFO:teuthology.orchestra.run.smithi167.stdout:(55/169): ceph-prometheus-alerts-18.0.0-7498.g3 165 kB/s | 15 kB 00:00 2023-11-27T20:47:44.348 INFO:teuthology.orchestra.run.smithi167.stdout:(56/169): ceph-volume-18.0.0-7498.g369173db.el9 2.4 MB/s | 262 kB 00:00 2023-11-27T20:47:44.608 INFO:teuthology.orchestra.run.smithi167.stdout:(57/169): cephadm-18.0.0-7498.g369173db.el9.noa 2.9 MB/s | 774 kB 00:00 2023-11-27T20:47:44.699 INFO:teuthology.orchestra.run.smithi167.stdout:(58/169): cephfs-top-18.0.0-7498.g369173db.el9. 199 kB/s | 18 kB 00:00 2023-11-27T20:47:44.882 INFO:teuthology.orchestra.run.smithi167.stdout:(59/169): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 662 kB 00:00 2023-11-27T20:47:44.941 INFO:teuthology.orchestra.run.smithi167.stdout:(60/169): bison-3.7.4-5.el9.x86_64.rpm 15 MB/s | 920 kB 00:00 2023-11-27T20:47:44.966 INFO:teuthology.orchestra.run.smithi167.stdout:(61/169): boost-program-options-1.75.0-8.el9.x8 4.1 MB/s | 106 kB 00:00 2023-11-27T20:47:45.008 INFO:teuthology.orchestra.run.smithi167.stdout:(62/169): elfutils-libelf-devel-0.190-1.el9.x86 517 kB/s | 21 kB 00:00 2023-11-27T20:47:45.050 INFO:teuthology.orchestra.run.smithi167.stdout:(63/169): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 307 kB 00:00 2023-11-27T20:47:45.075 INFO:teuthology.orchestra.run.smithi167.stdout:(64/169): flexiblas-3.0.4-8.el9.x86_64.rpm 1.2 MB/s | 32 kB 00:00 2023-11-27T20:47:45.186 INFO:teuthology.orchestra.run.smithi167.stdout:(65/169): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2023-11-27T20:47:45.209 INFO:teuthology.orchestra.run.smithi167.stdout:(66/169): flexiblas-openblas-openmp-3.0.4-8.el9 688 kB/s | 17 kB 00:00 2023-11-27T20:47:45.251 INFO:teuthology.orchestra.run.smithi167.stdout:(67/169): jq-1.6-16.el9.x86_64.rpm 4.3 MB/s | 186 kB 00:00 2023-11-27T20:47:45.277 INFO:teuthology.orchestra.run.smithi167.stdout:(68/169): libaio-devel-0.3.111-13.el9.x86_64.rp 405 kB/s | 10 kB 00:00 2023-11-27T20:47:45.318 INFO:teuthology.orchestra.run.smithi167.stdout:(69/169): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2023-11-27T20:47:45.344 INFO:teuthology.orchestra.run.smithi167.stdout:(70/169): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.7 MB/s | 44 kB 00:00 2023-11-27T20:47:45.394 INFO:teuthology.orchestra.run.smithi167.stdout:(71/169): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-11-27T20:47:45.460 INFO:teuthology.orchestra.run.smithi167.stdout:(72/169): libtool-2.4.6-45.el9.x86_64.rpm 8.6 MB/s | 578 kB 00:00 2023-11-27T20:47:45.485 INFO:teuthology.orchestra.run.smithi167.stdout:(73/169): libuuid-devel-2.37.4-15.el9.x86_64.rp 976 kB/s | 24 kB 00:00 2023-11-27T20:47:45.519 INFO:teuthology.orchestra.run.smithi167.stdout:(74/169): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2023-11-27T20:47:45.561 INFO:teuthology.orchestra.run.smithi167.stdout:(75/169): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2023-11-27T20:47:45.603 INFO:teuthology.orchestra.run.smithi167.stdout:(76/169): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.1 MB/s | 217 kB 00:00 2023-11-27T20:47:45.628 INFO:teuthology.orchestra.run.smithi167.stdout:(77/169): openblas-0.3.21-2.el9.x86_64.rpm 1.3 MB/s | 34 kB 00:00 2023-11-27T20:47:45.804 INFO:teuthology.orchestra.run.smithi167.stdout:(78/169): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2023-11-27T20:47:45.879 INFO:teuthology.orchestra.run.smithi167.stdout:(79/169): postgresql-13.11-1.el9.x86_64.rpm 20 MB/s | 1.5 MB 00:00 2023-11-27T20:47:45.930 INFO:teuthology.orchestra.run.smithi167.stdout:(80/169): postgresql-contrib-13.11-1.el9.x86_64 16 MB/s | 811 kB 00:00 2023-11-27T20:47:45.963 INFO:teuthology.orchestra.run.smithi167.stdout:(81/169): postgresql-private-libs-13.11-1.el9.x 3.9 MB/s | 134 kB 00:00 2023-11-27T20:47:46.155 INFO:teuthology.orchestra.run.smithi167.stdout:(82/169): postgresql-server-13.11-1.el9.x86_64. 30 MB/s | 5.7 MB 00:00 2023-11-27T20:47:46.356 INFO:teuthology.orchestra.run.smithi167.stdout:(83/169): python3-babel-2.9.1-2.el9.noarch.rpm 29 MB/s | 5.8 MB 00:00 2023-11-27T20:47:46.397 INFO:teuthology.orchestra.run.smithi167.stdout:(84/169): python3-jinja2-2.11.3-4.el9.noarch.rp 5.4 MB/s | 228 kB 00:00 2023-11-27T20:47:46.439 INFO:teuthology.orchestra.run.smithi167.stdout:(85/169): python3-jsonpatch-1.21-16.el9.noarch. 588 kB/s | 24 kB 00:00 2023-11-27T20:47:46.473 INFO:teuthology.orchestra.run.smithi167.stdout:(86/169): python3-jsonpointer-2.0-4.el9.noarch. 539 kB/s | 18 kB 00:00 2023-11-27T20:47:46.507 INFO:teuthology.orchestra.run.smithi167.stdout:(87/169): python3-mako-1.1.4-6.el9.noarch.rpm 4.2 MB/s | 144 kB 00:00 2023-11-27T20:47:46.540 INFO:teuthology.orchestra.run.smithi167.stdout:(88/169): python3-markupsafe-1.1.1-12.el9.x86_6 952 kB/s | 32 kB 00:00 2023-11-27T20:47:46.691 INFO:teuthology.orchestra.run.smithi167.stdout:(89/169): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 4.8 MB 00:00 2023-11-27T20:47:46.733 INFO:teuthology.orchestra.run.smithi167.stdout:(90/169): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.1 MB/s | 217 kB 00:00 2023-11-27T20:47:46.783 INFO:teuthology.orchestra.run.smithi167.stdout:(91/169): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2023-11-27T20:47:46.825 INFO:teuthology.orchestra.run.smithi167.stdout:(92/169): python3-prettytable-0.7.2-27.el9.noar 984 kB/s | 41 kB 00:00 2023-11-27T20:47:46.859 INFO:teuthology.orchestra.run.smithi167.stdout:(93/169): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.9 MB/s | 132 kB 00:00 2023-11-27T20:47:46.901 INFO:teuthology.orchestra.run.smithi167.stdout:(94/169): python3-pyasn1-modules-0.4.8-6.el9.no 4.9 MB/s | 211 kB 00:00 2023-11-27T20:47:46.943 INFO:teuthology.orchestra.run.smithi167.stdout:(95/169): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2023-11-27T20:47:46.968 INFO:teuthology.orchestra.run.smithi167.stdout:(96/169): python3-requests-oauthlib-1.3.0-12.el 1.7 MB/s | 43 kB 00:00 2023-11-27T20:47:47.460 INFO:teuthology.orchestra.run.smithi167.stdout:(97/169): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2023-11-27T20:47:47.911 INFO:teuthology.orchestra.run.smithi167.stdout:(98/169): rbd-mirror-debuginfo-18.0.0-7498.g369 5.7 MB/s | 50 MB 00:08 2023-11-27T20:47:47.927 INFO:teuthology.orchestra.run.smithi167.stdout:(99/169): python3-toml-0.10.2-6.el9.noarch.rpm 83 kB/s | 39 kB 00:00 2023-11-27T20:47:47.953 INFO:teuthology.orchestra.run.smithi167.stdout:(100/169): socat-1.7.4.1-5.el9.x86_64.rpm 7.1 MB/s | 300 kB 00:00 2023-11-27T20:47:47.970 INFO:teuthology.orchestra.run.smithi167.stdout:(101/169): uuid-1.6.2-55.el9.x86_64.rpm 1.3 MB/s | 56 kB 00:00 2023-11-27T20:47:47.995 INFO:teuthology.orchestra.run.smithi167.stdout:(102/169): xfsprogs-devel-5.19.0-4.el9.x86_64.r 2.0 MB/s | 85 kB 00:00 2023-11-27T20:47:48.012 INFO:teuthology.orchestra.run.smithi167.stdout:(103/169): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2023-11-27T20:47:48.029 INFO:teuthology.orchestra.run.smithi167.stdout:(104/169): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2023-11-27T20:47:48.054 INFO:teuthology.orchestra.run.smithi167.stdout:(105/169): fuse-2.9.9-15.el9.x86_64.rpm 1.8 MB/s | 79 kB 00:00 2023-11-27T20:47:48.096 INFO:teuthology.orchestra.run.smithi167.stdout:(106/169): libgfortran-11.4.1-2.3.el9.x86_64.rp 12 MB/s | 803 kB 00:00 2023-11-27T20:47:48.122 INFO:teuthology.orchestra.run.smithi167.stdout:(107/169): libquadmath-11.4.1-2.3.el9.x86_64.rp 2.9 MB/s | 195 kB 00:00 2023-11-27T20:47:48.147 INFO:teuthology.orchestra.run.smithi167.stdout:(108/169): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2023-11-27T20:47:48.189 INFO:teuthology.orchestra.run.smithi167.stdout:(109/169): python3-cryptography-36.0.1-4.el9.x8 17 MB/s | 1.1 MB 00:00 2023-11-27T20:47:48.206 INFO:teuthology.orchestra.run.smithi167.stdout:(110/169): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2023-11-27T20:47:48.231 INFO:teuthology.orchestra.run.smithi167.stdout:(111/169): python3-pycparser-2.20-6.el9.noarch. 2.9 MB/s | 124 kB 00:00 2023-11-27T20:47:48.256 INFO:teuthology.orchestra.run.smithi167.stdout:(112/169): python3-requests-2.25.1-7.el9.noarch 2.2 MB/s | 113 kB 00:00 2023-11-27T20:47:48.282 INFO:teuthology.orchestra.run.smithi167.stdout:(113/169): python3-urllib3-1.26.5-4.el9.noarch. 3.7 MB/s | 187 kB 00:00 2023-11-27T20:47:49.390 INFO:teuthology.orchestra.run.smithi167.stdout:(114/169): python3-devel-3.9.17-2.el9.x86_64.rp 221 kB/s | 245 kB 00:01 2023-11-27T20:47:49.824 INFO:teuthology.orchestra.run.smithi167.stdout:(115/169): openssl-devel-3.0.7-25.el9.x86_64.rp 2.6 MB/s | 4.1 MB 00:01 2023-11-27T20:47:50.133 INFO:teuthology.orchestra.run.smithi167.stdout:(116/169): gperftools-libs-2.9.1-2.el9.x86_64.r 416 kB/s | 309 kB 00:00 2023-11-27T20:47:50.250 INFO:teuthology.orchestra.run.smithi167.stdout:(117/169): libarrow-doc-9.0.0-9.el9.noarch.rpm 269 kB/s | 24 kB 00:00 2023-11-27T20:47:50.308 INFO:teuthology.orchestra.run.smithi167.stdout:(118/169): liboath-2.6.7-2.el9.x86_64.rpm 854 kB/s | 49 kB 00:00 2023-11-27T20:47:50.359 INFO:teuthology.orchestra.run.smithi167.stdout:(119/169): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2023-11-27T20:47:50.476 INFO:teuthology.orchestra.run.smithi167.stdout:(120/169): parquet-libs-9.0.0-9.el9.x86_64.rpm 7.0 MB/s | 837 kB 00:00 2023-11-27T20:47:50.551 INFO:teuthology.orchestra.run.smithi167.stdout:(121/169): python3-asyncssh-2.13.2-3.el9.noarch 7.2 MB/s | 548 kB 00:00 2023-11-27T20:47:50.610 INFO:teuthology.orchestra.run.smithi167.stdout:(122/169): libarrow-9.0.0-9.el9.x86_64.rpm 5.6 MB/s | 4.4 MB 00:00 2023-11-27T20:47:50.635 INFO:teuthology.orchestra.run.smithi167.stdout:(123/169): python3-bcrypt-3.2.2-1.el9.x86_64.rp 519 kB/s | 43 kB 00:00 2023-11-27T20:47:50.660 INFO:teuthology.orchestra.run.smithi167.stdout:(124/169): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2023-11-27T20:47:50.686 INFO:teuthology.orchestra.run.smithi167.stdout:(125/169): python3-certifi-2021.10.8-2.el9.noar 298 kB/s | 15 kB 00:00 2023-11-27T20:47:50.711 INFO:teuthology.orchestra.run.smithi167.stdout:(126/169): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2023-11-27T20:47:50.736 INFO:teuthology.orchestra.run.smithi167.stdout:(127/169): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2023-11-27T20:47:50.761 INFO:teuthology.orchestra.run.smithi167.stdout:(128/169): python3-google-auth-2.23.4-1.el9.noa 3.9 MB/s | 197 kB 00:00 2023-11-27T20:47:50.778 INFO:teuthology.orchestra.run.smithi167.stdout:(129/169): python3-jaraco-8.2.1-3.el9.noarch.rp 255 kB/s | 11 kB 00:00 2023-11-27T20:47:50.804 INFO:teuthology.orchestra.run.smithi167.stdout:(130/169): python3-jaraco-classes-3.2.1-5.el9.n 420 kB/s | 18 kB 00:00 2023-11-27T20:47:50.821 INFO:teuthology.orchestra.run.smithi167.stdout:(131/169): python3-jaraco-collections-3.0.0-8.e 551 kB/s | 23 kB 00:00 2023-11-27T20:47:50.846 INFO:teuthology.orchestra.run.smithi167.stdout:(132/169): python3-jaraco-functools-3.5.0-2.el9 464 kB/s | 19 kB 00:00 2023-11-27T20:47:50.863 INFO:teuthology.orchestra.run.smithi167.stdout:(133/169): python3-jaraco-text-3.2.0-6.el9.noar 469 kB/s | 20 kB 00:00 2023-11-27T20:47:50.888 INFO:teuthology.orchestra.run.smithi167.stdout:(134/169): python3-jwt+crypto-2.4.0-1.el9.noarc 217 kB/s | 9.0 kB 00:00 2023-11-27T20:47:50.906 INFO:teuthology.orchestra.run.smithi167.stdout:(135/169): python3-jwt-2.4.0-1.el9.noarch.rpm 972 kB/s | 41 kB 00:00 2023-11-27T20:47:50.948 INFO:teuthology.orchestra.run.smithi167.stdout:(136/169): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2023-11-27T20:47:50.981 INFO:teuthology.orchestra.run.smithi167.stdout:(137/169): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2023-11-27T20:47:51.006 INFO:teuthology.orchestra.run.smithi167.stdout:(138/169): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2023-11-27T20:47:51.023 INFO:teuthology.orchestra.run.smithi167.stdout:(139/169): python3-natsort-7.1.1-5.el9.noarch.r 1.3 MB/s | 58 kB 00:00 2023-11-27T20:47:51.057 INFO:teuthology.orchestra.run.smithi167.stdout:(140/169): python3-pecan-1.4.2-3.el9.noarch.rpm 5.2 MB/s | 272 kB 00:00 2023-11-27T20:47:51.074 INFO:teuthology.orchestra.run.smithi167.stdout:(141/169): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2023-11-27T20:47:51.100 INFO:teuthology.orchestra.run.smithi167.stdout:(142/169): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2023-11-27T20:47:51.117 INFO:teuthology.orchestra.run.smithi167.stdout:(143/169): python3-repoze-lru-0.7-16.el9.noarch 733 kB/s | 31 kB 00:00 2023-11-27T20:47:51.150 INFO:teuthology.orchestra.run.smithi167.stdout:(144/169): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2023-11-27T20:47:51.167 INFO:teuthology.orchestra.run.smithi167.stdout:(145/169): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2023-11-27T20:47:51.215 INFO:teuthology.orchestra.run.smithi167.stdout:(146/169): python3-tempora-5.0.0-2.el9.noarch.r 556 kB/s | 36 kB 00:00 2023-11-27T20:47:51.234 INFO:teuthology.orchestra.run.smithi167.stdout:(147/169): python3-typing-extensions-4.4.0-2.el 762 kB/s | 51 kB 00:00 2023-11-27T20:47:51.268 INFO:teuthology.orchestra.run.smithi167.stdout:(148/169): python3-webob-1.8.7-6.el9.noarch.rpm 4.3 MB/s | 230 kB 00:00 2023-11-27T20:47:51.293 INFO:teuthology.orchestra.run.smithi167.stdout:(149/169): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2023-11-27T20:47:51.327 INFO:teuthology.orchestra.run.smithi167.stdout:(150/169): python3-werkzeug-2.0.3-3.el9.1.noarc 7.1 MB/s | 427 kB 00:00 2023-11-27T20:47:51.344 INFO:teuthology.orchestra.run.smithi167.stdout:(151/169): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2023-11-27T20:47:51.378 INFO:teuthology.orchestra.run.smithi167.stdout:(152/169): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2023-11-27T20:47:51.436 INFO:teuthology.orchestra.run.smithi167.stdout:(153/169): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2023-11-27T20:47:52.695 INFO:teuthology.orchestra.run.smithi167.stdout:(154/169): librbd1-18.0.0-7498.g369173db.el9.x8 2.4 MB/s | 3.0 MB 00:01 2023-11-27T20:47:52.729 INFO:teuthology.orchestra.run.smithi167.stdout:(155/169): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-11-27T20:47:52.854 INFO:teuthology.orchestra.run.smithi167.stdout:(156/169): NetworkManager-1.45.6-1.el9.x86_64.r 18 MB/s | 2.2 MB 00:00 2023-11-27T20:47:52.954 INFO:teuthology.orchestra.run.smithi167.stdout:(157/169): NetworkManager-libnm-1.45.6-1.el9.x8 18 MB/s | 1.8 MB 00:00 2023-11-27T20:47:53.013 INFO:teuthology.orchestra.run.smithi167.stdout:(158/169): librados2-18.0.0-7498.g369173db.el9. 2.0 MB/s | 3.3 MB 00:01 2023-11-27T20:47:53.038 INFO:teuthology.orchestra.run.smithi167.stdout:(159/169): NetworkManager-team-1.45.6-1.el9.x86 504 kB/s | 42 kB 00:00 2023-11-27T20:47:53.063 INFO:teuthology.orchestra.run.smithi167.stdout:(160/169): NetworkManager-tui-1.45.6-1.el9.x86_ 4.8 MB/s | 245 kB 00:00 2023-11-27T20:47:53.089 INFO:teuthology.orchestra.run.smithi167.stdout:(161/169): acl-2.3.1-4.el9.x86_64.rpm 1.3 MB/s | 69 kB 00:00 2023-11-27T20:47:53.114 INFO:teuthology.orchestra.run.smithi167.stdout:(162/169): elfutils-debuginfod-client-0.190-1.e 728 kB/s | 36 kB 00:00 2023-11-27T20:47:53.139 INFO:teuthology.orchestra.run.smithi167.stdout:(163/169): elfutils-libelf-0.190-1.el9.x86_64.r 3.7 MB/s | 192 kB 00:00 2023-11-27T20:47:53.165 INFO:teuthology.orchestra.run.smithi167.stdout:(164/169): elfutils-libs-0.190-1.el9.x86_64.rpm 5.0 MB/s | 255 kB 00:00 2023-11-27T20:47:53.190 INFO:teuthology.orchestra.run.smithi167.stdout:(165/169): libacl-2.3.1-4.el9.x86_64.rpm 439 kB/s | 22 kB 00:00 2023-11-27T20:47:53.224 INFO:teuthology.orchestra.run.smithi167.stdout:(166/169): xfsdump-3.1.12-4.el9.x86_64.rpm 5.4 MB/s | 321 kB 00:00 2023-11-27T20:47:53.491 INFO:teuthology.orchestra.run.smithi167.stdout:(167/169): openssl-3.0.7-25.el9.x86_64.rpm 4.0 MB/s | 1.2 MB 00:00 2023-11-27T20:47:53.574 INFO:teuthology.orchestra.run.smithi167.stdout:(168/169): openssl-libs-3.0.7-25.el9.x86_64.rpm 6.2 MB/s | 2.2 MB 00:00 2023-11-27T20:48:08.938 INFO:teuthology.orchestra.run.smithi088.stdout:(169/169): ceph-test-debuginfo-18.0.0-7498.g369 8.9 MB/s | 623 MB 01:09 2023-11-27T20:48:08.943 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-11-27T20:48:08.943 INFO:teuthology.orchestra.run.smithi088.stdout:Total 14 MB/s | 2.1 GB 02:31 2023-11-27T20:48:09.034 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-11-27T20:48:09.222 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-11-27T20:48:09.223 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-11-27T20:48:22.370 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-11-27T20:48:22.370 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-11-27T20:48:23.163 INFO:teuthology.orchestra.run.smithi167.stdout:(169/169): ceph-test-debuginfo-18.0.0-7498.g369 9.4 MB/s | 623 MB 01:06 2023-11-27T20:48:23.169 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2023-11-27T20:48:23.169 INFO:teuthology.orchestra.run.smithi167.stdout:Total 13 MB/s | 2.1 GB 02:42 2023-11-27T20:48:23.263 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2023-11-27T20:48:23.456 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2023-11-27T20:48:23.456 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2023-11-27T20:48:36.736 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2023-11-27T20:48:36.736 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2023-11-27T20:48:42.275 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-11-27T20:48:42.473 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-debuginfo-2:18.0.0-7498.g369173db.el9.x86_6 1/184 2023-11-27T20:48:42.561 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 2/184 2023-11-27T20:48:42.595 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : thrift-0.15.0-2.el9.x86_64 3/184 2023-11-27T20:48:42.642 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/184 2023-11-27T20:48:42.686 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/184 2023-11-27T20:48:42.712 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 6/184 2023-11-27T20:48:42.764 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 7/184 2023-11-27T20:48:43.104 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 8/184 2023-11-27T20:48:43.163 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librados2-2:18.0.0-7498.g369173db.el9.x86_64 9/184 2023-11-27T20:48:43.265 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:18.0.0-7498.g369173db.el9.x86_64 9/184 2023-11-27T20:48:43.314 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs2-2:18.0.0-7498.g369173db.el9.x86_64 10/184 2023-11-27T20:48:43.402 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephfs2-2:18.0.0-7498.g369173db.el9.x86_64 10/184 2023-11-27T20:48:43.443 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rados-2:18.0.0-7498.g369173db.el9.x86_64 11/184 2023-11-27T20:48:43.493 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 12/184 2023-11-27T20:48:43.668 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 13/184 2023-11-27T20:48:43.724 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/184 2023-11-27T20:48:43.752 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephsqlite-2:18.0.0-7498.g369173db.el9.x86_64 15/184 2023-11-27T20:48:43.836 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7498.g369173db.el9.x86_64 15/184 2023-11-27T20:48:43.861 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libradosstriper1-2:18.0.0-7498.g369173db.el9.x86 16/184 2023-11-27T20:48:43.906 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7498.g369173db.el9.x86 16/184 2023-11-27T20:48:44.071 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 17/184 2023-11-27T20:48:44.207 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 18/184 2023-11-27T20:48:44.267 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 18/184 2023-11-27T20:48:44.368 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 19/184 2023-11-27T20:48:44.418 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : NetworkManager-1:1.45.6-1.el9.x86_64 19/184 2023-11-27T20:48:44.691 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 19/184 2023-11-27T20:48:44.722 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/184 2023-11-27T20:48:44.793 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/184 2023-11-27T20:48:44.854 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 22/184 2023-11-27T20:48:44.884 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/184 2023-11-27T20:48:44.928 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 24/184 2023-11-27T20:48:44.968 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 25/184 2023-11-27T20:48:45.042 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/184 2023-11-27T20:48:45.076 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/184 2023-11-27T20:48:45.103 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/184 2023-11-27T20:48:45.173 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/184 2023-11-27T20:48:45.208 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-common-2:18.0.0-7498.g369173db.el9. 30/184 2023-11-27T20:48:45.259 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-argparse-2:18.0.0-7498.g369173db.el 31/184 2023-11-27T20:48:45.344 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cephfs-2:18.0.0-7498.g369173db.el9.x86_6 32/184 2023-11-27T20:48:45.488 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 33/184 2023-11-27T20:48:45.585 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 34/184 2023-11-27T20:48:46.283 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rsa-4.9-2.el9.noarch 35/184 2023-11-27T20:48:46.367 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 36/184 2023-11-27T20:48:46.418 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 37/184 2023-11-27T20:48:46.481 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 38/184 2023-11-27T20:48:46.517 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librados-devel-2:18.0.0-7498.g369173db.el9.x86_6 39/184 2023-11-27T20:48:46.569 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/184 2023-11-27T20:48:46.716 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 41/184 2023-11-27T20:48:46.776 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 42/184 2023-11-27T20:48:46.884 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : re2-1:20211101-3.el9.x86_64 43/184 2023-11-27T20:48:46.963 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 44/184 2023-11-27T20:48:47.027 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/184 2023-11-27T20:48:47.109 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/184 2023-11-27T20:48:47.139 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/184 2023-11-27T20:48:47.175 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 48/184 2023-11-27T20:48:47.222 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/184 2023-11-27T20:48:47.268 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/184 2023-11-27T20:48:47.309 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/184 2023-11-27T20:48:47.448 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/184 2023-11-27T20:48:47.494 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/184 2023-11-27T20:48:47.544 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 54/184 2023-11-27T20:48:47.650 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 55/184 2023-11-27T20:48:47.687 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 56/184 2023-11-27T20:48:47.735 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 57/184 2023-11-27T20:48:47.768 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 58/184 2023-11-27T20:48:47.868 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 59/184 2023-11-27T20:48:47.912 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 60/184 2023-11-27T20:48:47.970 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ply-3.11-14.el9.noarch 61/184 2023-11-27T20:48:48.035 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 62/184 2023-11-27T20:48:48.233 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 63/184 2023-11-27T20:48:48.284 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 64/184 2023-11-27T20:48:48.423 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 65/184 2023-11-27T20:48:48.477 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 66/184 2023-11-27T20:48:48.506 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 67/184 2023-11-27T20:48:48.548 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 68/184 2023-11-27T20:48:48.581 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 69/184 2023-11-27T20:48:48.611 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : fuse-2.9.9-15.el9.x86_64 70/184 2023-11-27T20:48:48.639 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 71/184 2023-11-27T20:48:48.684 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 72/184 2023-11-27T20:48:48.718 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : uuid-1.6.2-55.el9.x86_64 73/184 2023-11-27T20:48:48.749 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/184 2023-11-27T20:48:48.826 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/184 2023-11-27T20:48:48.859 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 76/184 2023-11-27T20:48:48.901 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 77/184 2023-11-27T20:48:48.942 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 78/184 2023-11-27T20:48:48.977 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 79/184 2023-11-27T20:48:49.067 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 80/184 2023-11-27T20:48:49.104 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 81/184 2023-11-27T20:48:49.209 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/184 2023-11-27T20:48:49.263 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/184 2023-11-27T20:48:50.011 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/184 2023-11-27T20:48:50.060 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/184 2023-11-27T20:48:50.094 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/184 2023-11-27T20:48:50.127 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/184 2023-11-27T20:48:50.304 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-0.3.21-2.el9.x86_64 88/184 2023-11-27T20:48:50.333 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 89/184 2023-11-27T20:48:50.415 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 90/184 2023-11-27T20:48:51.088 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 91/184 2023-11-27T20:48:51.207 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 92/184 2023-11-27T20:48:52.481 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 93/184 2023-11-27T20:48:52.583 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 94/184 2023-11-27T20:48:52.614 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 95/184 2023-11-27T20:48:52.645 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : jq-1.6-16.el9.x86_64 96/184 2023-11-27T20:48:52.674 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 97/184 2023-11-27T20:48:52.707 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 98/184 2023-11-27T20:48:53.009 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 99/184 2023-11-27T20:48:53.045 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librbd1-2:18.0.0-7498.g369173db.el9.x86_64 100/184 2023-11-27T20:48:53.117 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:18.0.0-7498.g369173db.el9.x86_64 100/184 2023-11-27T20:48:53.149 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rbd-2:18.0.0-7498.g369173db.el9.x86_64 101/184 2023-11-27T20:48:53.185 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 102/184 2023-11-27T20:48:53.612 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 103/184 2023-11-27T20:48:53.647 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librgw2-2:18.0.0-7498.g369173db.el9.x86_64 104/184 2023-11-27T20:48:53.727 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librgw2-2:18.0.0-7498.g369173db.el9.x86_64 104/184 2023-11-27T20:48:53.749 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rgw-2:18.0.0-7498.g369173db.el9.x86_64 105/184 2023-11-27T20:48:55.873 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 106/184 2023-11-27T20:48:55.905 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 106/184 2023-11-27T20:48:56.443 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 106/184 2023-11-27T20:48:56.474 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-base-2:18.0.0-7498.g369173db.el9.x86_64 107/184 2023-11-27T20:48:56.543 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-base-2:18.0.0-7498.g369173db.el9.x86_64 107/184 2023-11-27T20:48:56.544 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-27T20:48:56.544 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-27T20:48:56.544 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:48:56.590 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-selinux-2:18.0.0-7498.g369173db.el9.x86_64 108/184 2023-11-27T20:48:56.661 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2023-11-27T20:48:56.780 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-debuginfo-2:18.0.0-7498.g369173db.el9.x86_6 1/184 2023-11-27T20:48:56.873 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 2/184 2023-11-27T20:48:56.915 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : thrift-0.15.0-2.el9.x86_64 3/184 2023-11-27T20:48:56.953 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/184 2023-11-27T20:48:56.989 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/184 2023-11-27T20:48:57.015 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 6/184 2023-11-27T20:48:57.065 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 7/184 2023-11-27T20:48:57.399 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 8/184 2023-11-27T20:48:57.458 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librados2-2:18.0.0-7498.g369173db.el9.x86_64 9/184 2023-11-27T20:48:57.560 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:18.0.0-7498.g369173db.el9.x86_64 9/184 2023-11-27T20:48:57.601 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs2-2:18.0.0-7498.g369173db.el9.x86_64 10/184 2023-11-27T20:48:57.690 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephfs2-2:18.0.0-7498.g369173db.el9.x86_64 10/184 2023-11-27T20:48:57.727 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rados-2:18.0.0-7498.g369173db.el9.x86_64 11/184 2023-11-27T20:48:57.775 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 12/184 2023-11-27T20:48:57.945 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 13/184 2023-11-27T20:48:58.006 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/184 2023-11-27T20:48:58.056 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephsqlite-2:18.0.0-7498.g369173db.el9.x86_64 15/184 2023-11-27T20:48:58.158 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7498.g369173db.el9.x86_64 15/184 2023-11-27T20:48:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libradosstriper1-2:18.0.0-7498.g369173db.el9.x86 16/184 2023-11-27T20:48:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7498.g369173db.el9.x86 16/184 2023-11-27T20:48:58.401 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 17/184 2023-11-27T20:48:58.545 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 18/184 2023-11-27T20:48:58.589 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 18/184 2023-11-27T20:48:58.676 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 19/184 2023-11-27T20:48:58.732 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-1:1.45.6-1.el9.x86_64 19/184 2023-11-27T20:48:59.080 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 19/184 2023-11-27T20:48:59.170 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/184 2023-11-27T20:48:59.240 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/184 2023-11-27T20:48:59.302 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 22/184 2023-11-27T20:48:59.332 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/184 2023-11-27T20:48:59.378 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 24/184 2023-11-27T20:48:59.416 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 25/184 2023-11-27T20:48:59.489 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/184 2023-11-27T20:48:59.531 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/184 2023-11-27T20:48:59.559 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/184 2023-11-27T20:48:59.630 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/184 2023-11-27T20:48:59.664 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-common-2:18.0.0-7498.g369173db.el9. 30/184 2023-11-27T20:48:59.716 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-argparse-2:18.0.0-7498.g369173db.el 31/184 2023-11-27T20:48:59.798 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cephfs-2:18.0.0-7498.g369173db.el9.x86_6 32/184 2023-11-27T20:48:59.933 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 33/184 2023-11-27T20:48:59.985 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 34/184 2023-11-27T20:49:00.514 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rsa-4.9-2.el9.noarch 35/184 2023-11-27T20:49:00.598 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 36/184 2023-11-27T20:49:00.635 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 37/184 2023-11-27T20:49:00.691 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 38/184 2023-11-27T20:49:00.732 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librados-devel-2:18.0.0-7498.g369173db.el9.x86_6 39/184 2023-11-27T20:49:00.775 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/184 2023-11-27T20:49:00.911 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 41/184 2023-11-27T20:49:00.958 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 42/184 2023-11-27T20:49:01.073 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : re2-1:20211101-3.el9.x86_64 43/184 2023-11-27T20:49:01.120 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 44/184 2023-11-27T20:49:01.175 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/184 2023-11-27T20:49:01.248 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/184 2023-11-27T20:49:01.279 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/184 2023-11-27T20:49:01.315 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 48/184 2023-11-27T20:49:01.388 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/184 2023-11-27T20:49:01.433 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/184 2023-11-27T20:49:01.476 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/184 2023-11-27T20:49:01.620 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/184 2023-11-27T20:49:01.660 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/184 2023-11-27T20:49:01.702 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 54/184 2023-11-27T20:49:01.796 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 55/184 2023-11-27T20:49:01.836 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 56/184 2023-11-27T20:49:01.876 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 57/184 2023-11-27T20:49:01.909 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 58/184 2023-11-27T20:49:02.005 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 59/184 2023-11-27T20:49:02.063 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 60/184 2023-11-27T20:49:02.128 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ply-3.11-14.el9.noarch 61/184 2023-11-27T20:49:02.190 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 62/184 2023-11-27T20:49:02.380 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 63/184 2023-11-27T20:49:02.432 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 64/184 2023-11-27T20:49:02.570 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 65/184 2023-11-27T20:49:02.618 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 66/184 2023-11-27T20:49:02.647 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 67/184 2023-11-27T20:49:02.681 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 68/184 2023-11-27T20:49:02.713 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 69/184 2023-11-27T20:49:02.744 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : fuse-2.9.9-15.el9.x86_64 70/184 2023-11-27T20:49:02.772 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 71/184 2023-11-27T20:49:02.822 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 72/184 2023-11-27T20:49:02.860 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : uuid-1.6.2-55.el9.x86_64 73/184 2023-11-27T20:49:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/184 2023-11-27T20:49:02.967 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/184 2023-11-27T20:49:03.000 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 76/184 2023-11-27T20:49:03.034 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 77/184 2023-11-27T20:49:03.075 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 78/184 2023-11-27T20:49:03.110 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 79/184 2023-11-27T20:49:03.200 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 80/184 2023-11-27T20:49:03.238 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 81/184 2023-11-27T20:49:03.349 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/184 2023-11-27T20:49:03.431 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/184 2023-11-27T20:49:04.170 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/184 2023-11-27T20:49:04.227 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/184 2023-11-27T20:49:04.261 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/184 2023-11-27T20:49:04.294 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/184 2023-11-27T20:49:04.473 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-0.3.21-2.el9.x86_64 88/184 2023-11-27T20:49:04.509 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 89/184 2023-11-27T20:49:04.589 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 90/184 2023-11-27T20:49:05.266 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 91/184 2023-11-27T20:49:05.383 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 92/184 2023-11-27T20:49:06.650 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 93/184 2023-11-27T20:49:06.745 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 94/184 2023-11-27T20:49:06.776 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 95/184 2023-11-27T20:49:06.807 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : jq-1.6-16.el9.x86_64 96/184 2023-11-27T20:49:06.835 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 97/184 2023-11-27T20:49:06.868 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 98/184 2023-11-27T20:49:07.170 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 99/184 2023-11-27T20:49:07.207 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librbd1-2:18.0.0-7498.g369173db.el9.x86_64 100/184 2023-11-27T20:49:07.297 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:18.0.0-7498.g369173db.el9.x86_64 100/184 2023-11-27T20:49:07.336 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rbd-2:18.0.0-7498.g369173db.el9.x86_64 101/184 2023-11-27T20:49:07.372 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 102/184 2023-11-27T20:49:07.800 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 103/184 2023-11-27T20:49:07.835 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librgw2-2:18.0.0-7498.g369173db.el9.x86_64 104/184 2023-11-27T20:49:07.906 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librgw2-2:18.0.0-7498.g369173db.el9.x86_64 104/184 2023-11-27T20:49:07.928 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rgw-2:18.0.0-7498.g369173db.el9.x86_64 105/184 2023-11-27T20:49:08.614 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7498.g369173db.el9.x86_64 108/184 2023-11-27T20:49:08.614 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /sys 2023-11-27T20:49:08.614 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /proc 2023-11-27T20:49:08.614 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /mnt 2023-11-27T20:49:08.615 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /var/tmp 2023-11-27T20:49:08.615 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /home 2023-11-27T20:49:08.615 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /root 2023-11-27T20:49:08.615 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /tmp 2023-11-27T20:49:08.615 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:49:08.777 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-volume-2:18.0.0-7498.g369173db.el9.noarch 109/184 2023-11-27T20:49:08.792 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-volume-2:18.0.0-7498.g369173db.el9.noarch 109/184 2023-11-27T20:49:08.792 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:49:08.792 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-27T20:49:08.792 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:49:10.006 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 106/184 2023-11-27T20:49:10.050 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 106/184 2023-11-27T20:49:10.363 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-osd-2:18.0.0-7498.g369173db.el9.x86_64 110/184 2023-11-27T20:49:10.388 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-osd-2:18.0.0-7498.g369173db.el9.x86_64 110/184 2023-11-27T20:49:10.388 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:49:10.388 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-27T20:49:10.388 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-27T20:49:10.388 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-27T20:49:10.389 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:49:10.596 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 106/184 2023-11-27T20:49:10.597 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mds-2:18.0.0-7498.g369173db.el9.x86_64 111/184 2023-11-27T20:49:10.619 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mds-2:18.0.0-7498.g369173db.el9.x86_64 111/184 2023-11-27T20:49:10.619 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:49:10.620 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-27T20:49:10.620 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-27T20:49:10.620 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-27T20:49:10.620 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:49:10.629 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-base-2:18.0.0-7498.g369173db.el9.x86_64 107/184 2023-11-27T20:49:10.702 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-base-2:18.0.0-7498.g369173db.el9.x86_64 107/184 2023-11-27T20:49:10.703 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-27T20:49:10.703 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-27T20:49:10.703 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:49:10.738 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-selinux-2:18.0.0-7498.g369173db.el9.x86_64 108/184 2023-11-27T20:49:11.065 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mon-2:18.0.0-7498.g369173db.el9.x86_64 112/184 2023-11-27T20:49:11.087 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mon-2:18.0.0-7498.g369173db.el9.x86_64 112/184 2023-11-27T20:49:11.087 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:49:11.087 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-27T20:49:11.087 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-27T20:49:11.087 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-27T20:49:11.087 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:49:11.191 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : automake-1.16.2-8.el9.noarch 113/184 2023-11-27T20:49:11.611 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephadm-2:18.0.0-7498.g369173db.el9.noarch 114/184 2023-11-27T20:49:11.656 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephadm-2:18.0.0-7498.g369173db.el9.noarch 114/184 2023-11-27T20:49:11.686 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7498.g369173db.e 115/184 2023-11-27T20:49:11.747 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7498.g369173db. 116/184 2023-11-27T20:49:11.771 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el9.noa 117/184 2023-11-27T20:49:11.993 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el9.noa 117/184 2023-11-27T20:49:12.022 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el9.n 118/184 2023-11-27T20:49:12.980 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el9.n 118/184 2023-11-27T20:49:13.006 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7498.g369 119/184 2023-11-27T20:49:13.105 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7498.g369 119/184 2023-11-27T20:49:13.262 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7498.g369173db.el 120/184 2023-11-27T20:49:13.299 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-2:18.0.0-7498.g369173db.el9.x86_64 121/184 2023-11-27T20:49:13.322 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7498.g369173db.el9.x86_64 121/184 2023-11-27T20:49:13.322 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:49:13.322 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-27T20:49:13.322 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-27T20:49:13.322 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-27T20:49:13.323 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:49:13.366 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-rook-2:18.0.0-7498.g369173db.el9.noarch 122/184 2023-11-27T20:49:13.377 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7498.g369173db.el9.noarch 122/184 2023-11-27T20:49:13.427 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-2:18.0.0-7498.g369173db.el9.x86_64 123/184 2023-11-27T20:49:14.204 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libtool-2.4.6-45.el9.x86_64 124/184 2023-11-27T20:49:14.235 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-radosgw-2:18.0.0-7498.g369173db.el9.x86_64 125/184 2023-11-27T20:49:14.257 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7498.g369173db.el9.x86_64 125/184 2023-11-27T20:49:14.257 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:49:14.257 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-27T20:49:14.257 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-27T20:49:14.257 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-27T20:49:14.258 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:49:14.294 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7498.g36917 126/184 2023-11-27T20:49:14.315 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7498.g36917 126/184 2023-11-27T20:49:14.315 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:49:14.315 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-27T20:49:14.316 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:49:14.361 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephfs-mirror-2:18.0.0-7498.g369173db.el9.x86_64 127/184 2023-11-27T20:49:14.383 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7498.g369173db.el9.x86_64 127/184 2023-11-27T20:49:14.383 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:49:14.383 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-27T20:49:14.383 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-27T20:49:14.384 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-27T20:49:14.384 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:49:14.681 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-mirror-2:18.0.0-7498.g369173db.el9.x86_64 128/184 2023-11-27T20:49:14.703 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7498.g369173db.el9.x86_64 128/184 2023-11-27T20:49:14.703 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:49:14.703 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-27T20:49:14.704 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-27T20:49:14.704 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-27T20:49:14.704 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:49:18.517 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-test-2:18.0.0-7498.g369173db.el9.x86_64 129/184 2023-11-27T20:49:18.558 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-fuse-2:18.0.0-7498.g369173db.el9.x86_64 130/184 2023-11-27T20:49:18.599 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-nbd-2:18.0.0-7498.g369173db.el9.x86_64 131/184 2023-11-27T20:49:18.631 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 132/184 2023-11-27T20:49:18.817 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 133/184 2023-11-27T20:49:18.931 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 134/184 2023-11-27T20:49:18.971 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-fuse-2:18.0.0-7498.g369173db.el9.x86_64 135/184 2023-11-27T20:49:19.004 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs-devel-2:18.0.0-7498.g369173db.el9.x86_ 136/184 2023-11-27T20:49:19.044 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 137/184 2023-11-27T20:49:19.073 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : NetworkManager-team-1:1.45.6-1.el9.x86_64 138/184 2023-11-27T20:49:19.146 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : NetworkManager-tui-1:1.45.6-1.el9.x86_64 139/184 2023-11-27T20:49:19.214 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 140/184 2023-11-27T20:49:19.257 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 141/184 2023-11-27T20:49:19.898 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 142/184 2023-11-27T20:49:19.937 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 142/184 2023-11-27T20:49:19.957 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 142/184 2023-11-27T20:49:20.766 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephfs-top-2:18.0.0-7498.g369173db.el9.noarch 143/184 2023-11-27T20:49:22.972 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7498.g369173db.el9.x86_64 108/184 2023-11-27T20:49:22.972 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /sys 2023-11-27T20:49:22.972 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /proc 2023-11-27T20:49:22.972 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /mnt 2023-11-27T20:49:22.972 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /var/tmp 2023-11-27T20:49:22.972 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /home 2023-11-27T20:49:22.973 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /root 2023-11-27T20:49:22.973 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /tmp 2023-11-27T20:49:22.973 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:49:23.149 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-volume-2:18.0.0-7498.g369173db.el9.noarch 109/184 2023-11-27T20:49:23.163 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-volume-2:18.0.0-7498.g369173db.el9.noarch 109/184 2023-11-27T20:49:23.163 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:49:23.163 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-27T20:49:23.163 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:49:24.734 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-osd-2:18.0.0-7498.g369173db.el9.x86_64 110/184 2023-11-27T20:49:24.759 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-osd-2:18.0.0-7498.g369173db.el9.x86_64 110/184 2023-11-27T20:49:24.759 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:49:24.760 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-27T20:49:24.760 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-27T20:49:24.760 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-27T20:49:24.760 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:49:24.960 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mds-2:18.0.0-7498.g369173db.el9.x86_64 111/184 2023-11-27T20:49:24.982 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mds-2:18.0.0-7498.g369173db.el9.x86_64 111/184 2023-11-27T20:49:24.982 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:49:24.982 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-27T20:49:24.982 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-27T20:49:24.982 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-27T20:49:24.982 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:49:25.427 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mon-2:18.0.0-7498.g369173db.el9.x86_64 112/184 2023-11-27T20:49:25.450 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mon-2:18.0.0-7498.g369173db.el9.x86_64 112/184 2023-11-27T20:49:25.450 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:49:25.450 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-27T20:49:25.450 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-27T20:49:25.450 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-27T20:49:25.450 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:49:25.538 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : automake-1.16.2-8.el9.noarch 113/184 2023-11-27T20:49:25.942 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephadm-2:18.0.0-7498.g369173db.el9.noarch 114/184 2023-11-27T20:49:25.970 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephadm-2:18.0.0-7498.g369173db.el9.noarch 114/184 2023-11-27T20:49:25.999 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7498.g369173db.e 115/184 2023-11-27T20:49:26.060 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7498.g369173db. 116/184 2023-11-27T20:49:26.085 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el9.noa 117/184 2023-11-27T20:49:26.306 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el9.noa 117/184 2023-11-27T20:49:26.344 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el9.n 118/184 2023-11-27T20:49:27.311 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el9.n 118/184 2023-11-27T20:49:27.345 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7498.g369 119/184 2023-11-27T20:49:27.443 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7498.g369 119/184 2023-11-27T20:49:27.601 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7498.g369173db.el 120/184 2023-11-27T20:49:27.631 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-2:18.0.0-7498.g369173db.el9.x86_64 121/184 2023-11-27T20:49:27.653 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7498.g369173db.el9.x86_64 121/184 2023-11-27T20:49:27.653 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:49:27.653 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-27T20:49:27.653 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-27T20:49:27.653 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-27T20:49:27.653 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:49:27.698 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-rook-2:18.0.0-7498.g369173db.el9.noarch 122/184 2023-11-27T20:49:27.708 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7498.g369173db.el9.noarch 122/184 2023-11-27T20:49:27.759 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-2:18.0.0-7498.g369173db.el9.x86_64 123/184 2023-11-27T20:49:28.378 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 144/184 2023-11-27T20:49:28.542 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libtool-2.4.6-45.el9.x86_64 124/184 2023-11-27T20:49:28.575 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-radosgw-2:18.0.0-7498.g369173db.el9.x86_64 125/184 2023-11-27T20:49:28.597 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7498.g369173db.el9.x86_64 125/184 2023-11-27T20:49:28.598 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:49:28.598 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-27T20:49:28.598 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-27T20:49:28.598 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-27T20:49:28.598 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:49:28.643 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7498.g36917 126/184 2023-11-27T20:49:28.664 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7498.g36917 126/184 2023-11-27T20:49:28.664 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:49:28.664 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-27T20:49:28.664 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:49:28.718 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-mirror-2:18.0.0-7498.g369173db.el9.x86_64 127/184 2023-11-27T20:49:28.740 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7498.g369173db.el9.x86_64 127/184 2023-11-27T20:49:28.740 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:49:28.740 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-27T20:49:28.741 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-27T20:49:28.741 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-27T20:49:28.741 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:49:29.044 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-mirror-2:18.0.0-7498.g369173db.el9.x86_64 128/184 2023-11-27T20:49:29.066 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7498.g369173db.el9.x86_64 128/184 2023-11-27T20:49:29.066 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:49:29.067 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-27T20:49:29.067 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-27T20:49:29.067 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-27T20:49:29.067 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:49:32.906 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-test-2:18.0.0-7498.g369173db.el9.x86_64 129/184 2023-11-27T20:49:32.947 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-fuse-2:18.0.0-7498.g369173db.el9.x86_64 130/184 2023-11-27T20:49:32.988 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-nbd-2:18.0.0-7498.g369173db.el9.x86_64 131/184 2023-11-27T20:49:33.020 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 132/184 2023-11-27T20:49:33.194 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 133/184 2023-11-27T20:49:33.313 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 134/184 2023-11-27T20:49:33.344 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-fuse-2:18.0.0-7498.g369173db.el9.x86_64 135/184 2023-11-27T20:49:33.369 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs-devel-2:18.0.0-7498.g369173db.el9.x86_ 136/184 2023-11-27T20:49:33.410 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 137/184 2023-11-27T20:49:33.448 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-team-1:1.45.6-1.el9.x86_64 138/184 2023-11-27T20:49:33.516 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-tui-1:1.45.6-1.el9.x86_64 139/184 2023-11-27T20:49:33.589 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 140/184 2023-11-27T20:49:33.630 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 141/184 2023-11-27T20:49:34.241 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 142/184 2023-11-27T20:49:34.280 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 142/184 2023-11-27T20:49:34.299 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 142/184 2023-11-27T20:49:35.116 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-top-2:18.0.0-7498.g369173db.el9.noarch 143/184 2023-11-27T20:49:42.694 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 144/184 2023-11-27T20:50:06.796 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-base-debuginfo-2:18.0.0-7498.g369173db.el9. 145/184 2023-11-27T20:50:07.415 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-common-debuginfo-2:18.0.0-7498.g369173db.el 146/184 2023-11-27T20:50:07.582 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-fuse-debuginfo-2:18.0.0-7498.g369173db.el9. 147/184 2023-11-27T20:50:11.824 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:18.0.0-7 148/184 2023-11-27T20:50:13.789 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mds-debuginfo-2:18.0.0-7498.g369173db.el9.x 149/184 2023-11-27T20:50:21.045 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-base-debuginfo-2:18.0.0-7498.g369173db.el9. 145/184 2023-11-27T20:50:21.657 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-common-debuginfo-2:18.0.0-7498.g369173db.el 146/184 2023-11-27T20:50:21.832 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-fuse-debuginfo-2:18.0.0-7498.g369173db.el9. 147/184 2023-11-27T20:50:24.643 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-debuginfo-2:18.0.0-7498.g369173db.el9.x 150/184 2023-11-27T20:50:26.093 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:18.0.0-7 148/184 2023-11-27T20:50:28.115 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mds-debuginfo-2:18.0.0-7498.g369173db.el9.x 149/184 2023-11-27T20:50:39.030 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-debuginfo-2:18.0.0-7498.g369173db.el9.x 150/184 2023-11-27T20:50:54.524 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mon-debuginfo-2:18.0.0-7498.g369173db.el9.x 151/184 2023-11-27T20:51:09.147 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mon-debuginfo-2:18.0.0-7498.g369173db.el9.x 151/184 2023-11-27T20:51:11.055 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-osd-debuginfo-2:18.0.0-7498.g369173db.el9.x 152/184 2023-11-27T20:51:25.726 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-osd-debuginfo-2:18.0.0-7498.g369173db.el9.x 152/184 2023-11-27T20:52:12.806 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-radosgw-debuginfo-2:18.0.0-7498.g369173db.e 153/184 2023-11-27T20:52:13.342 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-test-debuginfo-2:18.0.0-7498.g369173db.el9. 154/184 2023-11-27T20:52:13.716 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs2-debuginfo-2:18.0.0-7498.g369173db.el9 155/184 2023-11-27T20:52:18.578 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librados-devel-debuginfo-2:18.0.0-7498.g369173db 156/184 2023-11-27T20:52:23.943 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librados2-debuginfo-2:18.0.0-7498.g369173db.el9. 157/184 2023-11-27T20:52:24.026 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librbd1-debuginfo-2:18.0.0-7498.g369173db.el9.x8 158/184 2023-11-27T20:52:24.125 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cephfs-debuginfo-2:18.0.0-7498.g369173db 159/184 2023-11-27T20:52:24.260 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rados-debuginfo-2:18.0.0-7498.g369173db. 160/184 2023-11-27T20:52:24.318 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rbd-debuginfo-2:18.0.0-7498.g369173db.el 161/184 2023-11-27T20:52:24.398 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rgw-debuginfo-2:18.0.0-7498.g369173db.el 162/184 2023-11-27T20:52:27.213 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-radosgw-debuginfo-2:18.0.0-7498.g369173db.e 153/184 2023-11-27T20:52:27.998 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-test-debuginfo-2:18.0.0-7498.g369173db.el9. 154/184 2023-11-27T20:52:28.311 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs2-debuginfo-2:18.0.0-7498.g369173db.el9 155/184 2023-11-27T20:52:29.698 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-fuse-debuginfo-2:18.0.0-7498.g369173db.el9.x 163/184 2023-11-27T20:52:30.130 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-mirror-debuginfo-2:18.0.0-7498.g369173db.el9 164/184 2023-11-27T20:52:30.486 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-nbd-debuginfo-2:18.0.0-7498.g369173db.el9.x8 165/184 2023-11-27T20:52:30.543 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 166/184 2023-11-27T20:52:30.589 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 167/184 2023-11-27T20:52:30.694 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flex-2.6.4-9.el9.x86_64 168/184 2023-11-27T20:52:30.730 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : bison-3.7.4-5.el9.x86_64 169/184 2023-11-27T20:52:30.755 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 170/184 2023-11-27T20:52:30.780 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 171/184 2023-11-27T20:52:30.807 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 172/184 2023-11-27T20:52:30.807 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 173/184 2023-11-27T20:52:30.891 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 173/184 2023-11-27T20:52:30.920 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 174/184 2023-11-27T20:52:30.958 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 175/184 2023-11-27T20:52:30.991 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 176/184 2023-11-27T20:52:30.992 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 177/184 2023-11-27T20:52:31.084 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 177/184 2023-11-27T20:52:31.109 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 178/184 2023-11-27T20:52:31.129 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 179/184 2023-11-27T20:52:31.129 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 179/184 2023-11-27T20:52:31.328 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 179/184 2023-11-27T20:52:31.328 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 180/184 2023-11-27T20:52:31.421 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 180/184 2023-11-27T20:52:31.444 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 181/184 2023-11-27T20:52:31.470 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 182/184 2023-11-27T20:52:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 183/184 2023-11-27T20:52:31.560 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 184/184 2023-11-27T20:52:33.202 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librados-devel-debuginfo-2:18.0.0-7498.g369173db 156/184 2023-11-27T20:52:38.568 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librados2-debuginfo-2:18.0.0-7498.g369173db.el9. 157/184 2023-11-27T20:52:38.648 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librbd1-debuginfo-2:18.0.0-7498.g369173db.el9.x8 158/184 2023-11-27T20:52:38.746 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cephfs-debuginfo-2:18.0.0-7498.g369173db 159/184 2023-11-27T20:52:38.882 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rados-debuginfo-2:18.0.0-7498.g369173db. 160/184 2023-11-27T20:52:38.940 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rbd-debuginfo-2:18.0.0-7498.g369173db.el 161/184 2023-11-27T20:52:39.020 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rgw-debuginfo-2:18.0.0-7498.g369173db.el 162/184 2023-11-27T20:52:40.316 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 184/184 2023-11-27T20:52:40.316 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-2:18.0.0-7498.g369173db.el9.x86_64 1/184 2023-11-27T20:52:40.317 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-base-2:18.0.0-7498.g369173db.el9.x86_64 2/184 2023-11-27T20:52:40.317 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-base-debuginfo-2:18.0.0-7498.g369173db.el9. 3/184 2023-11-27T20:52:40.317 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 4/184 2023-11-27T20:52:40.317 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-common-debuginfo-2:18.0.0-7498.g369173db.el 5/184 2023-11-27T20:52:40.317 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-debuginfo-2:18.0.0-7498.g369173db.el9.x86_6 6/184 2023-11-27T20:52:40.317 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-fuse-2:18.0.0-7498.g369173db.el9.x86_64 7/184 2023-11-27T20:52:40.317 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-fuse-debuginfo-2:18.0.0-7498.g369173db.el9. 8/184 2023-11-27T20:52:40.317 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7498.g36917 9/184 2023-11-27T20:52:40.317 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:18.0.0-7 10/184 2023-11-27T20:52:40.317 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mds-2:18.0.0-7498.g369173db.el9.x86_64 11/184 2023-11-27T20:52:40.317 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mds-debuginfo-2:18.0.0-7498.g369173db.el9.x 12/184 2023-11-27T20:52:40.317 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-2:18.0.0-7498.g369173db.el9.x86_64 13/184 2023-11-27T20:52:40.318 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-debuginfo-2:18.0.0-7498.g369173db.el9.x 14/184 2023-11-27T20:52:40.318 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mon-2:18.0.0-7498.g369173db.el9.x86_64 15/184 2023-11-27T20:52:40.318 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mon-debuginfo-2:18.0.0-7498.g369173db.el9.x 16/184 2023-11-27T20:52:40.318 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-osd-2:18.0.0-7498.g369173db.el9.x86_64 17/184 2023-11-27T20:52:40.318 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-osd-debuginfo-2:18.0.0-7498.g369173db.el9.x 18/184 2023-11-27T20:52:40.318 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-radosgw-2:18.0.0-7498.g369173db.el9.x86_64 19/184 2023-11-27T20:52:40.319 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-radosgw-debuginfo-2:18.0.0-7498.g369173db.e 20/184 2023-11-27T20:52:40.319 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-selinux-2:18.0.0-7498.g369173db.el9.x86_64 21/184 2023-11-27T20:52:40.319 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-test-2:18.0.0-7498.g369173db.el9.x86_64 22/184 2023-11-27T20:52:40.319 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-test-debuginfo-2:18.0.0-7498.g369173db.el9. 23/184 2023-11-27T20:52:40.319 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephfs-mirror-2:18.0.0-7498.g369173db.el9.x86_64 24/184 2023-11-27T20:52:40.319 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs-devel-2:18.0.0-7498.g369173db.el9.x86_ 25/184 2023-11-27T20:52:40.320 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs2-2:18.0.0-7498.g369173db.el9.x86_64 26/184 2023-11-27T20:52:40.320 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs2-debuginfo-2:18.0.0-7498.g369173db.el9 27/184 2023-11-27T20:52:40.341 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephsqlite-2:18.0.0-7498.g369173db.el9.x86_64 28/184 2023-11-27T20:52:40.341 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados-devel-2:18.0.0-7498.g369173db.el9.x86_6 29/184 2023-11-27T20:52:40.342 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados-devel-debuginfo-2:18.0.0-7498.g369173db 30/184 2023-11-27T20:52:40.342 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-debuginfo-2:18.0.0-7498.g369173db.el9. 31/184 2023-11-27T20:52:40.342 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libradosstriper1-2:18.0.0-7498.g369173db.el9.x86 32/184 2023-11-27T20:52:40.342 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-debuginfo-2:18.0.0-7498.g369173db.el9.x8 33/184 2023-11-27T20:52:40.342 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librgw2-2:18.0.0-7498.g369173db.el9.x86_64 34/184 2023-11-27T20:52:40.342 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7498.g369173db.el 35/184 2023-11-27T20:52:40.342 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-common-2:18.0.0-7498.g369173db.el9. 36/184 2023-11-27T20:52:40.342 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cephfs-2:18.0.0-7498.g369173db.el9.x86_6 37/184 2023-11-27T20:52:40.342 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cephfs-debuginfo-2:18.0.0-7498.g369173db 38/184 2023-11-27T20:52:40.342 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rados-2:18.0.0-7498.g369173db.el9.x86_64 39/184 2023-11-27T20:52:40.343 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rados-debuginfo-2:18.0.0-7498.g369173db. 40/184 2023-11-27T20:52:40.343 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rbd-2:18.0.0-7498.g369173db.el9.x86_64 41/184 2023-11-27T20:52:40.343 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rbd-debuginfo-2:18.0.0-7498.g369173db.el 42/184 2023-11-27T20:52:40.343 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rgw-2:18.0.0-7498.g369173db.el9.x86_64 43/184 2023-11-27T20:52:40.343 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rgw-debuginfo-2:18.0.0-7498.g369173db.el 44/184 2023-11-27T20:52:40.343 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-fuse-2:18.0.0-7498.g369173db.el9.x86_64 45/184 2023-11-27T20:52:40.343 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-fuse-debuginfo-2:18.0.0-7498.g369173db.el9.x 46/184 2023-11-27T20:52:40.343 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-mirror-2:18.0.0-7498.g369173db.el9.x86_64 47/184 2023-11-27T20:52:40.343 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-mirror-debuginfo-2:18.0.0-7498.g369173db.el9 48/184 2023-11-27T20:52:40.343 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-nbd-2:18.0.0-7498.g369173db.el9.x86_64 49/184 2023-11-27T20:52:40.344 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-nbd-debuginfo-2:18.0.0-7498.g369173db.el9.x8 50/184 2023-11-27T20:52:40.344 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7498.g369173db. 51/184 2023-11-27T20:52:40.344 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el9.noa 52/184 2023-11-27T20:52:40.344 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el9.n 53/184 2023-11-27T20:52:40.344 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7498.g369 54/184 2023-11-27T20:52:40.344 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7498.g369173db.el 55/184 2023-11-27T20:52:40.344 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7498.g369173db.el9.noarch 56/184 2023-11-27T20:52:40.344 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7498.g369173db.e 57/184 2023-11-27T20:52:40.344 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-volume-2:18.0.0-7498.g369173db.el9.noarch 58/184 2023-11-27T20:52:40.344 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephadm-2:18.0.0-7498.g369173db.el9.noarch 59/184 2023-11-27T20:52:40.344 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephfs-top-2:18.0.0-7498.g369173db.el9.noarch 60/184 2023-11-27T20:52:40.344 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : automake-1.16.2-8.el9.noarch 61/184 2023-11-27T20:52:40.345 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : bison-3.7.4-5.el9.x86_64 62/184 2023-11-27T20:52:40.345 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 63/184 2023-11-27T20:52:40.345 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 64/184 2023-11-27T20:52:40.345 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/184 2023-11-27T20:52:40.345 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/184 2023-11-27T20:52:40.345 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/184 2023-11-27T20:52:40.345 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/184 2023-11-27T20:52:40.346 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : jq-1.6-16.el9.x86_64 69/184 2023-11-27T20:52:40.346 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 70/184 2023-11-27T20:52:40.346 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/184 2023-11-27T20:52:40.346 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/184 2023-11-27T20:52:40.346 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/184 2023-11-27T20:52:40.346 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 74/184 2023-11-27T20:52:40.346 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 75/184 2023-11-27T20:52:40.346 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 76/184 2023-11-27T20:52:40.347 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 77/184 2023-11-27T20:52:40.347 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 78/184 2023-11-27T20:52:40.347 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 79/184 2023-11-27T20:52:40.347 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 80/184 2023-11-27T20:52:40.347 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : postgresql-13.11-1.el9.x86_64 81/184 2023-11-27T20:52:40.347 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 82/184 2023-11-27T20:52:40.347 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 83/184 2023-11-27T20:52:40.348 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 84/184 2023-11-27T20:52:40.348 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 85/184 2023-11-27T20:52:40.348 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 86/184 2023-11-27T20:52:40.348 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 87/184 2023-11-27T20:52:40.348 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 88/184 2023-11-27T20:52:40.348 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 89/184 2023-11-27T20:52:40.348 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 90/184 2023-11-27T20:52:40.349 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 91/184 2023-11-27T20:52:40.349 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/184 2023-11-27T20:52:40.349 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 93/184 2023-11-27T20:52:40.349 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 94/184 2023-11-27T20:52:40.349 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 95/184 2023-11-27T20:52:40.350 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 96/184 2023-11-27T20:52:40.350 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 97/184 2023-11-27T20:52:40.350 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 98/184 2023-11-27T20:52:40.350 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 99/184 2023-11-27T20:52:40.350 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 100/184 2023-11-27T20:52:40.350 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 101/184 2023-11-27T20:52:40.351 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 102/184 2023-11-27T20:52:40.351 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 103/184 2023-11-27T20:52:40.351 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 104/184 2023-11-27T20:52:40.351 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 105/184 2023-11-27T20:52:40.351 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 106/184 2023-11-27T20:52:40.351 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 107/184 2023-11-27T20:52:40.351 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 108/184 2023-11-27T20:52:40.352 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 109/184 2023-11-27T20:52:40.352 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 110/184 2023-11-27T20:52:40.352 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ply-3.11-14.el9.noarch 111/184 2023-11-27T20:52:40.352 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 112/184 2023-11-27T20:52:40.352 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 113/184 2023-11-27T20:52:40.352 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 114/184 2023-11-27T20:52:40.352 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 115/184 2023-11-27T20:52:40.353 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 116/184 2023-11-27T20:52:40.353 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 117/184 2023-11-27T20:52:40.353 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 118/184 2023-11-27T20:52:40.353 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 119/184 2023-11-27T20:52:40.353 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 120/184 2023-11-27T20:52:40.353 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 121/184 2023-11-27T20:52:40.354 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 122/184 2023-11-27T20:52:40.354 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 123/184 2023-11-27T20:52:40.354 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 124/184 2023-11-27T20:52:40.354 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 125/184 2023-11-27T20:52:40.354 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 126/184 2023-11-27T20:52:40.355 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 127/184 2023-11-27T20:52:40.355 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 128/184 2023-11-27T20:52:40.355 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 129/184 2023-11-27T20:52:40.355 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 130/184 2023-11-27T20:52:40.355 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 131/184 2023-11-27T20:52:40.355 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 132/184 2023-11-27T20:52:40.356 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 133/184 2023-11-27T20:52:40.356 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 134/184 2023-11-27T20:52:40.356 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 135/184 2023-11-27T20:52:40.356 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 136/184 2023-11-27T20:52:40.356 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 137/184 2023-11-27T20:52:40.356 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 138/184 2023-11-27T20:52:40.356 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 139/184 2023-11-27T20:52:40.356 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 140/184 2023-11-27T20:52:40.357 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 141/184 2023-11-27T20:52:40.357 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 142/184 2023-11-27T20:52:40.357 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 143/184 2023-11-27T20:52:40.357 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 144/184 2023-11-27T20:52:40.357 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 145/184 2023-11-27T20:52:40.358 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 146/184 2023-11-27T20:52:40.358 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 147/184 2023-11-27T20:52:40.358 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 148/184 2023-11-27T20:52:40.358 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 149/184 2023-11-27T20:52:40.358 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 150/184 2023-11-27T20:52:40.358 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 151/184 2023-11-27T20:52:40.359 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 152/184 2023-11-27T20:52:40.359 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : re2-1:20211101-3.el9.x86_64 153/184 2023-11-27T20:52:40.359 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 154/184 2023-11-27T20:52:40.359 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:18.0.0-7498.g369173db.el9.x86_64 155/184 2023-11-27T20:52:40.359 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 156/184 2023-11-27T20:52:40.359 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:18.0.0-7498.g369173db.el9.x86_64 157/184 2023-11-27T20:52:40.359 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 158/184 2023-11-27T20:52:40.360 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 159/184 2023-11-27T20:52:40.360 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 160/184 2023-11-27T20:52:40.360 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-1:1.45.6-1.el9.x86_64 161/184 2023-11-27T20:52:40.360 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 162/184 2023-11-27T20:52:40.360 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 163/184 2023-11-27T20:52:40.360 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 164/184 2023-11-27T20:52:40.360 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-team-1:1.45.6-1.el9.x86_64 165/184 2023-11-27T20:52:40.360 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 166/184 2023-11-27T20:52:40.361 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-tui-1:1.45.6-1.el9.x86_64 167/184 2023-11-27T20:52:40.361 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 168/184 2023-11-27T20:52:40.361 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : acl-2.3.1-4.el9.x86_64 169/184 2023-11-27T20:52:40.361 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : acl-2.3.1-3.el9.x86_64 170/184 2023-11-27T20:52:40.361 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 171/184 2023-11-27T20:52:40.361 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 172/184 2023-11-27T20:52:40.361 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 173/184 2023-11-27T20:52:40.362 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 174/184 2023-11-27T20:52:40.362 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 175/184 2023-11-27T20:52:40.362 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 176/184 2023-11-27T20:52:40.362 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/184 2023-11-27T20:52:40.362 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/184 2023-11-27T20:52:40.362 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 179/184 2023-11-27T20:52:40.362 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 180/184 2023-11-27T20:52:40.362 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 181/184 2023-11-27T20:52:40.363 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 182/184 2023-11-27T20:52:40.363 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 183/184 2023-11-27T20:52:42.712 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 184/184 2023-11-27T20:52:42.713 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:52:42.713 INFO:teuthology.orchestra.run.smithi088.stdout:Upgraded: 2023-11-27T20:52:42.713 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-1:1.45.6-1.el9.x86_64 2023-11-27T20:52:42.713 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 2023-11-27T20:52:42.713 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-team-1:1.45.6-1.el9.x86_64 2023-11-27T20:52:42.713 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-tui-1:1.45.6-1.el9.x86_64 2023-11-27T20:52:42.714 INFO:teuthology.orchestra.run.smithi088.stdout: acl-2.3.1-4.el9.x86_64 2023-11-27T20:52:42.714 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-27T20:52:42.714 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-27T20:52:42.714 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-27T20:52:42.714 INFO:teuthology.orchestra.run.smithi088.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-27T20:52:42.714 INFO:teuthology.orchestra.run.smithi088.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-27T20:52:42.714 INFO:teuthology.orchestra.run.smithi088.stdout: librados2-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.714 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.714 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-11-27T20:52:42.714 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-11-27T20:52:42.714 INFO:teuthology.orchestra.run.smithi088.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-27T20:52:42.715 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-11-27T20:52:42.715 INFO:teuthology.orchestra.run.smithi088.stdout: automake-1.16.2-8.el9.noarch 2023-11-27T20:52:42.715 INFO:teuthology.orchestra.run.smithi088.stdout: bison-3.7.4-5.el9.x86_64 2023-11-27T20:52:42.715 INFO:teuthology.orchestra.run.smithi088.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-27T20:52:42.715 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.715 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.715 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.715 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.715 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.715 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.715 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.716 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.716 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:52:42.716 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.716 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.716 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.716 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.716 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.716 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:52:42.716 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:52:42.716 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.716 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:52:42.716 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:52:42.717 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:52:42.717 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.717 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.717 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.717 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.717 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:52:42.717 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.717 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.717 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.717 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.718 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.718 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-volume-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:52:42.718 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:52:42.718 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-mirror-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.718 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-top-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:52:42.718 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-27T20:52:42.718 INFO:teuthology.orchestra.run.smithi088.stdout: flex-2.6.4-9.el9.x86_64 2023-11-27T20:52:42.718 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-27T20:52:42.718 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-27T20:52:42.718 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-27T20:52:42.718 INFO:teuthology.orchestra.run.smithi088.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-27T20:52:42.718 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-27T20:52:42.719 INFO:teuthology.orchestra.run.smithi088.stdout: jq-1.6-16.el9.x86_64 2023-11-27T20:52:42.719 INFO:teuthology.orchestra.run.smithi088.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-27T20:52:42.719 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-27T20:52:42.719 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-27T20:52:42.719 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.719 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.719 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.719 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.719 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-27T20:52:42.719 INFO:teuthology.orchestra.run.smithi088.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-27T20:52:42.719 INFO:teuthology.orchestra.run.smithi088.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-27T20:52:42.720 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-27T20:52:42.720 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-27T20:52:42.720 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.720 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.720 INFO:teuthology.orchestra.run.smithi088.stdout: librados2-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.720 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.720 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.720 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-27T20:52:42.720 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.720 INFO:teuthology.orchestra.run.smithi088.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-27T20:52:42.720 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-27T20:52:42.721 INFO:teuthology.orchestra.run.smithi088.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-27T20:52:42.721 INFO:teuthology.orchestra.run.smithi088.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-27T20:52:42.721 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-27T20:52:42.721 INFO:teuthology.orchestra.run.smithi088.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-27T20:52:42.721 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-27T20:52:42.721 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-27T20:52:42.721 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-11-27T20:52:42.721 INFO:teuthology.orchestra.run.smithi088.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-27T20:52:42.721 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-13.11-1.el9.x86_64 2023-11-27T20:52:42.721 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-27T20:52:42.721 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-27T20:52:42.722 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-27T20:52:42.722 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-27T20:52:42.722 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-27T20:52:42.722 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-27T20:52:42.722 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-27T20:52:42.722 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.722 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.722 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.722 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.722 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-27T20:52:42.722 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-27T20:52:42.723 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-27T20:52:42.723 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-27T20:52:42.723 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-27T20:52:42.723 INFO:teuthology.orchestra.run.smithi088.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-27T20:52:42.723 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-27T20:52:42.723 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-27T20:52:42.723 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-27T20:52:42.723 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-27T20:52:42.723 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-27T20:52:42.723 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-27T20:52:42.723 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-27T20:52:42.723 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-27T20:52:42.724 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-27T20:52:42.724 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-27T20:52:42.724 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-27T20:52:42.724 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-27T20:52:42.724 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-27T20:52:42.724 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-27T20:52:42.724 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-27T20:52:42.724 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-27T20:52:42.724 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-27T20:52:42.724 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-27T20:52:42.724 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-27T20:52:42.724 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-27T20:52:42.725 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-27T20:52:42.725 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ply-3.11-14.el9.noarch 2023-11-27T20:52:42.725 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-27T20:52:42.725 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-27T20:52:42.725 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-27T20:52:42.725 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-27T20:52:42.725 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-27T20:52:42.725 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-27T20:52:42.725 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-27T20:52:42.725 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.725 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.725 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.726 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.726 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-27T20:52:42.726 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-27T20:52:42.726 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-27T20:52:42.726 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.726 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.726 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-27T20:52:42.726 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-27T20:52:42.726 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-27T20:52:42.726 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-27T20:52:42.726 INFO:teuthology.orchestra.run.smithi088.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-27T20:52:42.727 INFO:teuthology.orchestra.run.smithi088.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-27T20:52:42.727 INFO:teuthology.orchestra.run.smithi088.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-27T20:52:42.727 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-27T20:52:42.727 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-27T20:52:42.727 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-27T20:52:42.727 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-27T20:52:42.727 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.727 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.727 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.727 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.727 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.727 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:42.728 INFO:teuthology.orchestra.run.smithi088.stdout: re2-1:20211101-3.el9.x86_64 2023-11-27T20:52:42.728 INFO:teuthology.orchestra.run.smithi088.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-27T20:52:42.728 INFO:teuthology.orchestra.run.smithi088.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-27T20:52:42.728 INFO:teuthology.orchestra.run.smithi088.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-27T20:52:42.728 INFO:teuthology.orchestra.run.smithi088.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-27T20:52:42.728 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-27T20:52:42.728 INFO:teuthology.orchestra.run.smithi088.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-27T20:52:42.728 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:52:42.729 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-11-27T20:52:43.361 DEBUG:teuthology.parallel:result is None 2023-11-27T20:52:44.346 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-fuse-debuginfo-2:18.0.0-7498.g369173db.el9.x 163/184 2023-11-27T20:52:44.491 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-mirror-debuginfo-2:18.0.0-7498.g369173db.el9 164/184 2023-11-27T20:52:44.535 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-nbd-debuginfo-2:18.0.0-7498.g369173db.el9.x8 165/184 2023-11-27T20:52:44.581 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 166/184 2023-11-27T20:52:44.636 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 167/184 2023-11-27T20:52:44.729 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flex-2.6.4-9.el9.x86_64 168/184 2023-11-27T20:52:44.769 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : bison-3.7.4-5.el9.x86_64 169/184 2023-11-27T20:52:44.794 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 170/184 2023-11-27T20:52:44.819 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 171/184 2023-11-27T20:52:44.846 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 172/184 2023-11-27T20:52:44.846 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 173/184 2023-11-27T20:52:44.922 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 173/184 2023-11-27T20:52:44.950 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 174/184 2023-11-27T20:52:44.981 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 175/184 2023-11-27T20:52:45.006 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 176/184 2023-11-27T20:52:45.006 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 177/184 2023-11-27T20:52:45.099 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 177/184 2023-11-27T20:52:45.124 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 178/184 2023-11-27T20:52:45.143 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 179/184 2023-11-27T20:52:45.143 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 179/184 2023-11-27T20:52:45.327 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 179/184 2023-11-27T20:52:45.327 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 180/184 2023-11-27T20:52:45.411 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 180/184 2023-11-27T20:52:45.443 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 181/184 2023-11-27T20:52:45.469 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 182/184 2023-11-27T20:52:45.495 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 183/184 2023-11-27T20:52:45.561 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 184/184 2023-11-27T20:52:54.878 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 184/184 2023-11-27T20:52:54.879 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-2:18.0.0-7498.g369173db.el9.x86_64 1/184 2023-11-27T20:52:54.879 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-base-2:18.0.0-7498.g369173db.el9.x86_64 2/184 2023-11-27T20:52:54.879 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-base-debuginfo-2:18.0.0-7498.g369173db.el9. 3/184 2023-11-27T20:52:54.879 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 4/184 2023-11-27T20:52:54.879 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-common-debuginfo-2:18.0.0-7498.g369173db.el 5/184 2023-11-27T20:52:54.879 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-debuginfo-2:18.0.0-7498.g369173db.el9.x86_6 6/184 2023-11-27T20:52:54.879 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-fuse-2:18.0.0-7498.g369173db.el9.x86_64 7/184 2023-11-27T20:52:54.879 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-fuse-debuginfo-2:18.0.0-7498.g369173db.el9. 8/184 2023-11-27T20:52:54.879 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7498.g36917 9/184 2023-11-27T20:52:54.879 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:18.0.0-7 10/184 2023-11-27T20:52:54.879 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mds-2:18.0.0-7498.g369173db.el9.x86_64 11/184 2023-11-27T20:52:54.879 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mds-debuginfo-2:18.0.0-7498.g369173db.el9.x 12/184 2023-11-27T20:52:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-2:18.0.0-7498.g369173db.el9.x86_64 13/184 2023-11-27T20:52:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-debuginfo-2:18.0.0-7498.g369173db.el9.x 14/184 2023-11-27T20:52:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mon-2:18.0.0-7498.g369173db.el9.x86_64 15/184 2023-11-27T20:52:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mon-debuginfo-2:18.0.0-7498.g369173db.el9.x 16/184 2023-11-27T20:52:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-osd-2:18.0.0-7498.g369173db.el9.x86_64 17/184 2023-11-27T20:52:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-osd-debuginfo-2:18.0.0-7498.g369173db.el9.x 18/184 2023-11-27T20:52:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-radosgw-2:18.0.0-7498.g369173db.el9.x86_64 19/184 2023-11-27T20:52:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-radosgw-debuginfo-2:18.0.0-7498.g369173db.e 20/184 2023-11-27T20:52:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-selinux-2:18.0.0-7498.g369173db.el9.x86_64 21/184 2023-11-27T20:52:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-test-2:18.0.0-7498.g369173db.el9.x86_64 22/184 2023-11-27T20:52:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-test-debuginfo-2:18.0.0-7498.g369173db.el9. 23/184 2023-11-27T20:52:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-mirror-2:18.0.0-7498.g369173db.el9.x86_64 24/184 2023-11-27T20:52:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs-devel-2:18.0.0-7498.g369173db.el9.x86_ 25/184 2023-11-27T20:52:54.881 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs2-2:18.0.0-7498.g369173db.el9.x86_64 26/184 2023-11-27T20:52:54.881 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs2-debuginfo-2:18.0.0-7498.g369173db.el9 27/184 2023-11-27T20:52:54.881 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephsqlite-2:18.0.0-7498.g369173db.el9.x86_64 28/184 2023-11-27T20:52:54.881 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados-devel-2:18.0.0-7498.g369173db.el9.x86_6 29/184 2023-11-27T20:52:54.881 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados-devel-debuginfo-2:18.0.0-7498.g369173db 30/184 2023-11-27T20:52:54.881 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-debuginfo-2:18.0.0-7498.g369173db.el9. 31/184 2023-11-27T20:52:54.881 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libradosstriper1-2:18.0.0-7498.g369173db.el9.x86 32/184 2023-11-27T20:52:54.881 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-debuginfo-2:18.0.0-7498.g369173db.el9.x8 33/184 2023-11-27T20:52:54.881 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librgw2-2:18.0.0-7498.g369173db.el9.x86_64 34/184 2023-11-27T20:52:54.881 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7498.g369173db.el 35/184 2023-11-27T20:52:54.881 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-common-2:18.0.0-7498.g369173db.el9. 36/184 2023-11-27T20:52:54.881 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cephfs-2:18.0.0-7498.g369173db.el9.x86_6 37/184 2023-11-27T20:52:54.881 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cephfs-debuginfo-2:18.0.0-7498.g369173db 38/184 2023-11-27T20:52:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rados-2:18.0.0-7498.g369173db.el9.x86_64 39/184 2023-11-27T20:52:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rados-debuginfo-2:18.0.0-7498.g369173db. 40/184 2023-11-27T20:52:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rbd-2:18.0.0-7498.g369173db.el9.x86_64 41/184 2023-11-27T20:52:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rbd-debuginfo-2:18.0.0-7498.g369173db.el 42/184 2023-11-27T20:52:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rgw-2:18.0.0-7498.g369173db.el9.x86_64 43/184 2023-11-27T20:52:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rgw-debuginfo-2:18.0.0-7498.g369173db.el 44/184 2023-11-27T20:52:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-fuse-2:18.0.0-7498.g369173db.el9.x86_64 45/184 2023-11-27T20:52:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-fuse-debuginfo-2:18.0.0-7498.g369173db.el9.x 46/184 2023-11-27T20:52:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-mirror-2:18.0.0-7498.g369173db.el9.x86_64 47/184 2023-11-27T20:52:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-mirror-debuginfo-2:18.0.0-7498.g369173db.el9 48/184 2023-11-27T20:52:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-nbd-2:18.0.0-7498.g369173db.el9.x86_64 49/184 2023-11-27T20:52:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-nbd-debuginfo-2:18.0.0-7498.g369173db.el9.x8 50/184 2023-11-27T20:52:54.882 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7498.g369173db. 51/184 2023-11-27T20:52:54.883 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el9.noa 52/184 2023-11-27T20:52:54.883 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el9.n 53/184 2023-11-27T20:52:54.883 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7498.g369 54/184 2023-11-27T20:52:54.883 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7498.g369173db.el 55/184 2023-11-27T20:52:54.883 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7498.g369173db.el9.noarch 56/184 2023-11-27T20:52:54.883 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7498.g369173db.e 57/184 2023-11-27T20:52:54.883 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-volume-2:18.0.0-7498.g369173db.el9.noarch 58/184 2023-11-27T20:52:54.883 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephadm-2:18.0.0-7498.g369173db.el9.noarch 59/184 2023-11-27T20:52:54.883 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-top-2:18.0.0-7498.g369173db.el9.noarch 60/184 2023-11-27T20:52:54.883 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : automake-1.16.2-8.el9.noarch 61/184 2023-11-27T20:52:54.883 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : bison-3.7.4-5.el9.x86_64 62/184 2023-11-27T20:52:54.883 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 63/184 2023-11-27T20:52:54.883 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 64/184 2023-11-27T20:52:54.883 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/184 2023-11-27T20:52:54.884 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/184 2023-11-27T20:52:54.884 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/184 2023-11-27T20:52:54.884 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/184 2023-11-27T20:52:54.884 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : jq-1.6-16.el9.x86_64 69/184 2023-11-27T20:52:54.884 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 70/184 2023-11-27T20:52:54.884 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/184 2023-11-27T20:52:54.884 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/184 2023-11-27T20:52:54.884 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/184 2023-11-27T20:52:54.884 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 74/184 2023-11-27T20:52:54.884 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 75/184 2023-11-27T20:52:54.884 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 76/184 2023-11-27T20:52:54.884 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 77/184 2023-11-27T20:52:54.885 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 78/184 2023-11-27T20:52:54.885 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 79/184 2023-11-27T20:52:54.885 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 80/184 2023-11-27T20:52:54.885 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-13.11-1.el9.x86_64 81/184 2023-11-27T20:52:54.885 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 82/184 2023-11-27T20:52:54.885 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 83/184 2023-11-27T20:52:54.885 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 84/184 2023-11-27T20:52:54.885 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 85/184 2023-11-27T20:52:54.885 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 86/184 2023-11-27T20:52:54.886 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 87/184 2023-11-27T20:52:54.886 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 88/184 2023-11-27T20:52:54.886 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 89/184 2023-11-27T20:52:54.886 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 90/184 2023-11-27T20:52:54.886 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 91/184 2023-11-27T20:52:54.886 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/184 2023-11-27T20:52:54.886 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 93/184 2023-11-27T20:52:54.886 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 94/184 2023-11-27T20:52:54.886 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 95/184 2023-11-27T20:52:54.886 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 96/184 2023-11-27T20:52:54.886 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 97/184 2023-11-27T20:52:54.887 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 98/184 2023-11-27T20:52:54.887 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 99/184 2023-11-27T20:52:54.887 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 100/184 2023-11-27T20:52:54.887 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 101/184 2023-11-27T20:52:54.887 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 102/184 2023-11-27T20:52:54.887 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 103/184 2023-11-27T20:52:54.887 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 104/184 2023-11-27T20:52:54.887 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 105/184 2023-11-27T20:52:54.887 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 106/184 2023-11-27T20:52:54.887 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 107/184 2023-11-27T20:52:54.887 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 108/184 2023-11-27T20:52:54.887 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 109/184 2023-11-27T20:52:54.887 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 110/184 2023-11-27T20:52:54.888 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ply-3.11-14.el9.noarch 111/184 2023-11-27T20:52:54.888 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 112/184 2023-11-27T20:52:54.888 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 113/184 2023-11-27T20:52:54.888 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 114/184 2023-11-27T20:52:54.888 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 115/184 2023-11-27T20:52:54.888 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 116/184 2023-11-27T20:52:54.888 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 117/184 2023-11-27T20:52:54.888 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 118/184 2023-11-27T20:52:54.888 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 119/184 2023-11-27T20:52:54.888 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 120/184 2023-11-27T20:52:54.888 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 121/184 2023-11-27T20:52:54.888 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 122/184 2023-11-27T20:52:54.888 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 123/184 2023-11-27T20:52:54.889 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 124/184 2023-11-27T20:52:54.889 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 125/184 2023-11-27T20:52:54.889 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 126/184 2023-11-27T20:52:54.889 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 127/184 2023-11-27T20:52:54.889 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 128/184 2023-11-27T20:52:54.889 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 129/184 2023-11-27T20:52:54.889 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 130/184 2023-11-27T20:52:54.889 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 131/184 2023-11-27T20:52:54.889 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 132/184 2023-11-27T20:52:54.889 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 133/184 2023-11-27T20:52:54.889 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 134/184 2023-11-27T20:52:54.889 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 135/184 2023-11-27T20:52:54.890 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 136/184 2023-11-27T20:52:54.890 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 137/184 2023-11-27T20:52:54.890 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 138/184 2023-11-27T20:52:54.890 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 139/184 2023-11-27T20:52:54.891 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 140/184 2023-11-27T20:52:54.891 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 141/184 2023-11-27T20:52:54.891 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 142/184 2023-11-27T20:52:54.891 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 143/184 2023-11-27T20:52:54.891 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 144/184 2023-11-27T20:52:54.891 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 145/184 2023-11-27T20:52:54.892 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 146/184 2023-11-27T20:52:54.892 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 147/184 2023-11-27T20:52:54.892 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 148/184 2023-11-27T20:52:54.893 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 149/184 2023-11-27T20:52:54.893 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 150/184 2023-11-27T20:52:54.893 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 151/184 2023-11-27T20:52:54.893 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 152/184 2023-11-27T20:52:54.894 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : re2-1:20211101-3.el9.x86_64 153/184 2023-11-27T20:52:54.894 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 154/184 2023-11-27T20:52:54.894 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:18.0.0-7498.g369173db.el9.x86_64 155/184 2023-11-27T20:52:54.894 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 156/184 2023-11-27T20:52:54.894 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:18.0.0-7498.g369173db.el9.x86_64 157/184 2023-11-27T20:52:54.894 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 158/184 2023-11-27T20:52:54.895 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 159/184 2023-11-27T20:52:54.895 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 160/184 2023-11-27T20:52:54.895 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-1:1.45.6-1.el9.x86_64 161/184 2023-11-27T20:52:54.895 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 162/184 2023-11-27T20:52:54.895 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 163/184 2023-11-27T20:52:54.895 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 164/184 2023-11-27T20:52:54.895 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-team-1:1.45.6-1.el9.x86_64 165/184 2023-11-27T20:52:54.896 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 166/184 2023-11-27T20:52:54.896 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-tui-1:1.45.6-1.el9.x86_64 167/184 2023-11-27T20:52:54.896 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 168/184 2023-11-27T20:52:54.896 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : acl-2.3.1-4.el9.x86_64 169/184 2023-11-27T20:52:54.896 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : acl-2.3.1-3.el9.x86_64 170/184 2023-11-27T20:52:54.897 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 171/184 2023-11-27T20:52:54.897 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 172/184 2023-11-27T20:52:54.897 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 173/184 2023-11-27T20:52:54.897 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 174/184 2023-11-27T20:52:54.897 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 175/184 2023-11-27T20:52:54.897 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 176/184 2023-11-27T20:52:54.897 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/184 2023-11-27T20:52:54.898 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/184 2023-11-27T20:52:54.898 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 179/184 2023-11-27T20:52:54.898 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 180/184 2023-11-27T20:52:54.898 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 181/184 2023-11-27T20:52:54.898 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 182/184 2023-11-27T20:52:54.898 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 183/184 2023-11-27T20:52:57.537 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 184/184 2023-11-27T20:52:57.537 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:52:57.537 INFO:teuthology.orchestra.run.smithi167.stdout:Upgraded: 2023-11-27T20:52:57.537 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-1:1.45.6-1.el9.x86_64 2023-11-27T20:52:57.537 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 2023-11-27T20:52:57.538 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-team-1:1.45.6-1.el9.x86_64 2023-11-27T20:52:57.538 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-tui-1:1.45.6-1.el9.x86_64 2023-11-27T20:52:57.538 INFO:teuthology.orchestra.run.smithi167.stdout: acl-2.3.1-4.el9.x86_64 2023-11-27T20:52:57.538 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-27T20:52:57.538 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-27T20:52:57.538 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-27T20:52:57.538 INFO:teuthology.orchestra.run.smithi167.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-27T20:52:57.539 INFO:teuthology.orchestra.run.smithi167.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-27T20:52:57.539 INFO:teuthology.orchestra.run.smithi167.stdout: librados2-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.539 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.539 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-11-27T20:52:57.539 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-11-27T20:52:57.540 INFO:teuthology.orchestra.run.smithi167.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-27T20:52:57.540 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2023-11-27T20:52:57.540 INFO:teuthology.orchestra.run.smithi167.stdout: automake-1.16.2-8.el9.noarch 2023-11-27T20:52:57.540 INFO:teuthology.orchestra.run.smithi167.stdout: bison-3.7.4-5.el9.x86_64 2023-11-27T20:52:57.540 INFO:teuthology.orchestra.run.smithi167.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-27T20:52:57.540 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.540 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.541 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.541 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.541 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.541 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.541 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.541 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.542 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:52:57.542 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.542 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.542 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.542 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.542 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.542 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:52:57.543 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:52:57.543 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.543 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:52:57.543 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:52:57.543 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:52:57.543 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.543 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.544 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.544 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.544 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:52:57.544 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.544 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.544 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.544 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.545 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.545 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:52:57.545 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:52:57.545 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.545 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-top-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:52:57.546 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-27T20:52:57.546 INFO:teuthology.orchestra.run.smithi167.stdout: flex-2.6.4-9.el9.x86_64 2023-11-27T20:52:57.546 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-27T20:52:57.546 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-27T20:52:57.546 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-27T20:52:57.546 INFO:teuthology.orchestra.run.smithi167.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-27T20:52:57.546 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-27T20:52:57.547 INFO:teuthology.orchestra.run.smithi167.stdout: jq-1.6-16.el9.x86_64 2023-11-27T20:52:57.547 INFO:teuthology.orchestra.run.smithi167.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-27T20:52:57.547 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-27T20:52:57.547 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-27T20:52:57.547 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.547 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.547 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.547 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.547 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-27T20:52:57.547 INFO:teuthology.orchestra.run.smithi167.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-27T20:52:57.547 INFO:teuthology.orchestra.run.smithi167.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-27T20:52:57.548 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-27T20:52:57.548 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-27T20:52:57.548 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.548 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.548 INFO:teuthology.orchestra.run.smithi167.stdout: librados2-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.548 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.548 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.548 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-27T20:52:57.548 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.548 INFO:teuthology.orchestra.run.smithi167.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-27T20:52:57.549 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-27T20:52:57.549 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-27T20:52:57.549 INFO:teuthology.orchestra.run.smithi167.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-27T20:52:57.549 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-27T20:52:57.549 INFO:teuthology.orchestra.run.smithi167.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-27T20:52:57.549 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-27T20:52:57.549 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-27T20:52:57.549 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-11-27T20:52:57.549 INFO:teuthology.orchestra.run.smithi167.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-27T20:52:57.549 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-13.11-1.el9.x86_64 2023-11-27T20:52:57.549 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-27T20:52:57.549 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-27T20:52:57.550 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-27T20:52:57.550 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-27T20:52:57.550 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-27T20:52:57.550 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-27T20:52:57.550 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-27T20:52:57.550 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.550 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.550 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.550 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.550 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-27T20:52:57.551 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-27T20:52:57.551 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-27T20:52:57.551 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-27T20:52:57.551 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-27T20:52:57.551 INFO:teuthology.orchestra.run.smithi167.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-27T20:52:57.551 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-27T20:52:57.551 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-27T20:52:57.551 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-27T20:52:57.551 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-27T20:52:57.551 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-27T20:52:57.552 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-27T20:52:57.552 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-27T20:52:57.552 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-27T20:52:57.552 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-27T20:52:57.552 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-27T20:52:57.552 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-27T20:52:57.552 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-27T20:52:57.552 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-27T20:52:57.552 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-27T20:52:57.552 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-27T20:52:57.552 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-27T20:52:57.553 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-27T20:52:57.553 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-27T20:52:57.553 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-27T20:52:57.553 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-27T20:52:57.553 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-27T20:52:57.553 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ply-3.11-14.el9.noarch 2023-11-27T20:52:57.553 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-27T20:52:57.553 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-27T20:52:57.554 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-27T20:52:57.554 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-27T20:52:57.554 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-27T20:52:57.554 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-27T20:52:57.554 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-27T20:52:57.554 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.554 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.554 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.554 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.554 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-27T20:52:57.554 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-27T20:52:57.555 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-27T20:52:57.555 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.555 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.555 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-27T20:52:57.555 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-27T20:52:57.555 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-27T20:52:57.555 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-27T20:52:57.555 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-27T20:52:57.555 INFO:teuthology.orchestra.run.smithi167.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-27T20:52:57.555 INFO:teuthology.orchestra.run.smithi167.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-27T20:52:57.555 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-27T20:52:57.556 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-27T20:52:57.556 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-27T20:52:57.556 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-27T20:52:57.556 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.556 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.556 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.556 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.556 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.556 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd-debuginfo-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:52:57.556 INFO:teuthology.orchestra.run.smithi167.stdout: re2-1:20211101-3.el9.x86_64 2023-11-27T20:52:57.557 INFO:teuthology.orchestra.run.smithi167.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-27T20:52:57.557 INFO:teuthology.orchestra.run.smithi167.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-27T20:52:57.557 INFO:teuthology.orchestra.run.smithi167.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-27T20:52:57.557 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-27T20:52:57.557 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-27T20:52:57.557 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-27T20:52:57.558 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:52:57.558 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2023-11-27T20:52:58.165 DEBUG:teuthology.parallel:result is None 2023-11-27T20:52:58.166 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T20:52:58.379 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-27T20:52:58.405 INFO:teuthology.orchestra.run.smithi088.stdout:18.0.0-7498.g369173db.el9 2023-11-27T20:52:58.405 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7498.g369173db.el9 2023-11-27T20:52:58.405 INFO:teuthology.task.install:The correct ceph version 18.0.0-7498.g369173db is installed. 2023-11-27T20:52:58.406 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T20:52:58.615 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-27T20:52:58.636 INFO:teuthology.orchestra.run.smithi167.stdout:18.0.0-7498.g369173db.el9 2023-11-27T20:52:58.636 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7498.g369173db.el9 2023-11-27T20:52:58.637 INFO:teuthology.task.install:The correct ceph version 18.0.0-7498.g369173db is installed. 2023-11-27T20:52:58.637 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-27T20:52:58.637 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:52:58.637 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-27T20:52:58.671 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-27T20:52:58.672 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-27T20:52:58.706 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-27T20:52:58.706 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:52:58.706 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/daemon-helper 2023-11-27T20:52:58.743 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-27T20:52:58.813 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-27T20:52:58.813 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/daemon-helper 2023-11-27T20:52:58.840 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-27T20:52:58.907 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-27T20:52:58.907 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:52:58.907 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-27T20:52:58.936 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-27T20:52:59.006 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-27T20:52:59.006 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-27T20:52:59.033 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-27T20:52:59.100 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-27T20:52:59.100 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:52:59.100 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/stdin-killer 2023-11-27T20:52:59.129 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-27T20:52:59.197 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-27T20:52:59.198 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/stdin-killer 2023-11-27T20:52:59.224 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-27T20:52:59.292 INFO:teuthology.run_tasks:Running task ceph... 2023-11-27T20:52:59.361 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-27T20:52:59.362 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 777 /var/log/ceph 2023-11-27T20:52:59.364 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 777 /var/log/ceph 2023-11-27T20:52:59.391 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-27T20:52:59.391 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-27T20:52:59.434 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-27T20:52:59.460 INFO:tasks.ceph:Creating extra log directories... 2023-11-27T20:52:59.460 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-27T20:52:59.501 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-27T20:52:59.534 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-27T20:52:59.535 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-27T20:52:59.535 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-27T20:52:59.535 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:52:59.535 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-27T20:52:59.582 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-27T20:52:59.700 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-27T20:52:59.730 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-27T20:52:59.730 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-27T20:52:59.746 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-27T20:52:59.866 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-27T20:52:59.898 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-27T20:52:59.898 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-27T20:52:59.898 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468107', 'branch': 'wip-yuri10-testing-2023-11-22-1112', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7468107', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri10-testing-2023-11-22-1112'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri10-testing-2023-11-22-1112', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 8541, 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri10-testing-2023-11-22-1112', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi088.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL71wxUxtJbDOuVa26K1cK6t4mjPRN/Qcu2tsvDxg8Ssg1F5LLsufU8S4hAbUGgJAfRi9Ls89cxfakoIrcqOeEA=', 'smithi167.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHYOIliM6xRMOlzggjF9H50uOouZE9Vxw7Qk4DkaDeLcLy+l2KC+817iNLxXAzJYTkYkWQzYvPjbMdP/a1TehY4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '2442239d2653456406c25ae0c71b689c8f2657b6', 'timestamp': '2023-11-27_17:14:24', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-27T20:52:59.899 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-27T20:52:59.901 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-27T20:52:59.948 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/run/ceph 2023-11-27T20:52:59.956 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/run/ceph 2023-11-27T20:53:00.015 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:53:00.015 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/scratch_devs of=/dev/stdout 2023-11-27T20:53:00.036 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-27T20:53:00.036 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_1 2023-11-27T20:53:00.091 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-27T20:53:00.091 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T20:53:00.091 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 662 Links: 1 2023-11-27T20:53:00.091 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T20:53:00.092 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T20:53:00.092 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-11-27 20:52:31.890818378 +0000 2023-11-27T20:53:00.092 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-11-27 20:44:34.151230288 +0000 2023-11-27T20:53:00.092 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-11-27 20:44:34.151230288 +0000 2023-11-27T20:53:00.092 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-11-27 20:44:34.151230288 +0000 2023-11-27T20:53:00.092 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-27T20:53:00.157 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-11-27T20:53:00.157 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-11-27T20:53:00.157 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.0001963 s, 2.6 MB/s 2023-11-27T20:53:00.158 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-27T20:53:00.213 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_2 2023-11-27T20:53:00.268 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-27T20:53:00.269 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T20:53:00.269 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 682 Links: 1 2023-11-27T20:53:00.269 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T20:53:00.269 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T20:53:00.269 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-11-27 20:52:31.891818356 +0000 2023-11-27T20:53:00.269 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-11-27 20:44:34.643219446 +0000 2023-11-27T20:53:00.269 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-11-27 20:44:34.643219446 +0000 2023-11-27T20:53:00.269 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-11-27 20:44:34.643219446 +0000 2023-11-27T20:53:00.270 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-27T20:53:00.335 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-11-27T20:53:00.335 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-11-27T20:53:00.336 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000195007 s, 2.6 MB/s 2023-11-27T20:53:00.336 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-27T20:53:00.391 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_3 2023-11-27T20:53:00.447 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-27T20:53:00.447 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T20:53:00.447 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 700 Links: 1 2023-11-27T20:53:00.447 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T20:53:00.447 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T20:53:00.447 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-11-27 20:52:31.891818356 +0000 2023-11-27T20:53:00.447 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-11-27 20:44:35.140208494 +0000 2023-11-27T20:53:00.447 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-11-27 20:44:35.140208494 +0000 2023-11-27T20:53:00.448 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-11-27 20:44:35.140208494 +0000 2023-11-27T20:53:00.448 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-27T20:53:00.512 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-11-27T20:53:00.512 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-11-27T20:53:00.512 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000228565 s, 2.2 MB/s 2023-11-27T20:53:00.513 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-27T20:53:00.568 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_4 2023-11-27T20:53:00.625 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-27T20:53:00.625 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T20:53:00.625 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 719 Links: 1 2023-11-27T20:53:00.625 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T20:53:00.625 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T20:53:00.625 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-11-27 20:52:31.891818356 +0000 2023-11-27T20:53:00.626 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-11-27 20:44:35.634197607 +0000 2023-11-27T20:53:00.626 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-11-27 20:44:35.634197607 +0000 2023-11-27T20:53:00.626 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-11-27 20:44:35.634197607 +0000 2023-11-27T20:53:00.626 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-27T20:53:00.688 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-11-27T20:53:00.688 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-11-27T20:53:00.688 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000211795 s, 2.4 MB/s 2023-11-27T20:53:00.689 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-27T20:53:00.745 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T20:53:00.745 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-27T20:53:00.745 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/scratch_devs of=/dev/stdout 2023-11-27T20:53:00.762 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-27T20:53:00.762 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_1 2023-11-27T20:53:00.819 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-27T20:53:00.819 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T20:53:00.819 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 664 Links: 1 2023-11-27T20:53:00.819 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T20:53:00.819 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T20:53:00.819 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2023-11-27 20:52:45.880850174 +0000 2023-11-27T20:53:00.819 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2023-11-27 20:44:34.144571294 +0000 2023-11-27T20:53:00.819 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2023-11-27 20:44:34.144571294 +0000 2023-11-27T20:53:00.819 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2023-11-27 20:44:34.144571294 +0000 2023-11-27T20:53:00.820 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-27T20:53:00.888 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2023-11-27T20:53:00.888 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2023-11-27T20:53:00.888 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000215379 s, 2.4 MB/s 2023-11-27T20:53:00.890 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-27T20:53:00.946 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_2 2023-11-27T20:53:01.003 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-27T20:53:01.003 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T20:53:01.003 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 684 Links: 1 2023-11-27T20:53:01.003 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T20:53:01.003 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T20:53:01.003 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2023-11-27 20:52:45.880850174 +0000 2023-11-27T20:53:01.004 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2023-11-27 20:44:34.648562161 +0000 2023-11-27T20:53:01.004 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2023-11-27 20:44:34.648562161 +0000 2023-11-27T20:53:01.004 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2023-11-27 20:44:34.648562161 +0000 2023-11-27T20:53:01.004 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-27T20:53:01.070 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2023-11-27T20:53:01.070 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2023-11-27T20:53:01.070 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000216127 s, 2.4 MB/s 2023-11-27T20:53:01.071 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-27T20:53:01.127 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_3 2023-11-27T20:53:01.182 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-27T20:53:01.182 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T20:53:01.182 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 703 Links: 1 2023-11-27T20:53:01.182 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T20:53:01.182 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T20:53:01.183 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2023-11-27 20:52:45.881850156 +0000 2023-11-27T20:53:01.183 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2023-11-27 20:44:35.129553444 +0000 2023-11-27T20:53:01.183 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2023-11-27 20:44:35.129553444 +0000 2023-11-27T20:53:01.183 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2023-11-27 20:44:35.129553444 +0000 2023-11-27T20:53:01.183 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-27T20:53:01.247 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2023-11-27T20:53:01.248 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2023-11-27T20:53:01.248 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000182407 s, 2.8 MB/s 2023-11-27T20:53:01.249 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-27T20:53:01.306 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_4 2023-11-27T20:53:01.361 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-27T20:53:01.361 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T20:53:01.361 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 722 Links: 1 2023-11-27T20:53:01.361 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T20:53:01.362 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T20:53:01.362 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2023-11-27 20:52:45.881850156 +0000 2023-11-27T20:53:01.362 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2023-11-27 20:44:35.631544347 +0000 2023-11-27T20:53:01.362 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2023-11-27 20:44:35.631544347 +0000 2023-11-27T20:53:01.362 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2023-11-27 20:44:35.631544347 +0000 2023-11-27T20:53:01.363 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-27T20:53:01.426 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2023-11-27T20:53:01.426 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2023-11-27T20:53:01.426 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000213904 s, 2.4 MB/s 2023-11-27T20:53:01.427 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-27T20:53:01.484 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T20:53:01.485 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi167.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-27T20:53:01.485 INFO:tasks.ceph:Generating config... 2023-11-27T20:53:01.486 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-27T20:53:01.486 INFO:tasks.ceph:[client] debug client = 20 2023-11-27T20:53:01.486 INFO:tasks.ceph:[client] debug ms = 1 2023-11-27T20:53:01.487 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-27T20:53:01.487 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-27T20:53:01.487 INFO:tasks.ceph:[global] mds beacon grace = 60 2023-11-27T20:53:01.487 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2023-11-27T20:53:01.487 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2023-11-27T20:53:01.487 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-27T20:53:01.488 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-27T20:53:01.488 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-27T20:53:01.488 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-27T20:53:01.489 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-27T20:53:01.489 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-27T20:53:01.490 INFO:tasks.ceph:[mds] mds valgrind exit = True 2023-11-27T20:53:01.490 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-27T20:53:01.490 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-27T20:53:01.490 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-27T20:53:01.490 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-27T20:53:01.490 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-27T20:53:01.490 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-27T20:53:01.491 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-27T20:53:01.492 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-27T20:53:01.492 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-27T20:53:01.492 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-27T20:53:01.492 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2023-11-27T20:53:01.493 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-27T20:53:01.494 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-27T20:53:01.494 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-11-27T20:53:01.494 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-11-27T20:53:01.494 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-27T20:53:01.494 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-27T20:53:01.494 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-11-27T20:53:01.495 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-27T20:53:01.495 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-27T20:53:01.495 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-27T20:53:01.495 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-27T20:53:01.495 INFO:tasks.ceph:[osd] osd fast shutdown = False 2023-11-27T20:53:01.496 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-27T20:53:01.496 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-27T20:53:01.497 INFO:tasks.ceph:Setting up mon.a... 2023-11-27T20:53:01.497 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-27T20:53:01.553 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.keyring 2023-11-27T20:53:01.555 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-27T20:53:01.601 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-27T20:53:01.682 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.88'), ('mon.b', '172.21.15.167'), ('mon.c', '[v2:172.21.15.167:3301,v1:172.21.15.167:6790]')] 2023-11-27T20:53:01.683 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.88,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-27T20:53:01.684 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:53:01.684 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-27T20:53:01.739 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.88 --add b 172.21.15.167 --addv c '[v2:172.21.15.167:3301,v1:172.21.15.167:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:53:01.825 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:53:01.825 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: generated fsid ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc 2023-11-27T20:53:01.826 INFO:teuthology.orchestra.run.smithi088.stdout:setting min_mon_release = quincy 2023-11-27T20:53:01.826 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 0 2023-11-27T20:53:01.826 INFO:teuthology.orchestra.run.smithi088.stdout:fsid ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc 2023-11-27T20:53:01.826 INFO:teuthology.orchestra.run.smithi088.stdout:last_changed 2023-11-27T20:53:01.824152+0000 2023-11-27T20:53:01.826 INFO:teuthology.orchestra.run.smithi088.stdout:created 2023-11-27T20:53:01.824152+0000 2023-11-27T20:53:01.826 INFO:teuthology.orchestra.run.smithi088.stdout:min_mon_release 17 (quincy) 2023-11-27T20:53:01.826 INFO:teuthology.orchestra.run.smithi088.stdout:election_strategy: 1 2023-11-27T20:53:01.826 INFO:teuthology.orchestra.run.smithi088.stdout:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2023-11-27T20:53:01.826 INFO:teuthology.orchestra.run.smithi088.stdout:1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.b 2023-11-27T20:53:01.826 INFO:teuthology.orchestra.run.smithi088.stdout:2: [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] mon.c 2023-11-27T20:53:01.826 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-27T20:53:01.827 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-27T20:53:01.842 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc... 2023-11-27T20:53:01.843 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-27T20:53:01.888 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-27T20:53:01.933 INFO:teuthology.orchestra.run.smithi088.stdout:[global] 2023-11-27T20:53:01.933 INFO:teuthology.orchestra.run.smithi088.stdout: chdir = "" 2023-11-27T20:53:01.934 INFO:teuthology.orchestra.run.smithi088.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-27T20:53:01.934 INFO:teuthology.orchestra.run.smithi088.stdout: auth supported = cephx 2023-11-27T20:53:01.934 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.934 INFO:teuthology.orchestra.run.smithi088.stdout: filestore xattr use omap = true 2023-11-27T20:53:01.934 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.934 INFO:teuthology.orchestra.run.smithi088.stdout: mon clock drift allowed = 1.000 2023-11-27T20:53:01.934 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.934 INFO:teuthology.orchestra.run.smithi088.stdout: osd crush chooseleaf type = 0 2023-11-27T20:53:01.934 INFO:teuthology.orchestra.run.smithi088.stdout: auth debug = true 2023-11-27T20:53:01.934 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.934 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on old message = true 2023-11-27T20:53:01.934 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on bug = true 2023-11-27T20:53:01.935 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.935 INFO:teuthology.orchestra.run.smithi088.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-27T20:53:01.935 INFO:teuthology.orchestra.run.smithi088.stdout: mon pg warn max object skew = 0 2023-11-27T20:53:01.935 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.935 INFO:teuthology.orchestra.run.smithi088.stdout: # disable pg_autoscaler by default for new pools 2023-11-27T20:53:01.935 INFO:teuthology.orchestra.run.smithi088.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-27T20:53:01.935 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.935 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default size = 2 2023-11-27T20:53:01.935 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.936 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow primary affinity = true 2023-11-27T20:53:01.936 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow pg remap = true 2023-11-27T20:53:01.936 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on legacy crush tunables = false 2023-11-27T20:53:01.936 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on crush straw calc version zero = false 2023-11-27T20:53:01.936 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on no sortbitwise = false 2023-11-27T20:53:01.936 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on osd down out interval zero = false 2023-11-27T20:53:01.936 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on too few osds = false 2023-11-27T20:53:01.936 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-27T20:53:01.936 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-27T20:53:01.936 INFO:teuthology.orchestra.run.smithi088.stdout: mon_allow_pool_size_one = true 2023-11-27T20:53:01.936 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.937 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-27T20:53:01.937 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.937 INFO:teuthology.orchestra.run.smithi088.stdout: osd default data pool replay window = 5 2023-11-27T20:53:01.937 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.937 INFO:teuthology.orchestra.run.smithi088.stdout: mon allow pool delete = true 2023-11-27T20:53:01.937 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.937 INFO:teuthology.orchestra.run.smithi088.stdout: mon cluster log file level = debug 2023-11-27T20:53:01.937 INFO:teuthology.orchestra.run.smithi088.stdout: debug asserts on shutdown = true 2023-11-27T20:53:01.937 INFO:teuthology.orchestra.run.smithi088.stdout: mon health detail to clog = false 2023-11-27T20:53:01.937 INFO:teuthology.orchestra.run.smithi088.stdout: mon host = "172.21.15.88,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2023-11-27T20:53:01.937 INFO:teuthology.orchestra.run.smithi088.stdout: mds beacon grace = 60 2023-11-27T20:53:01.937 INFO:teuthology.orchestra.run.smithi088.stdout: mds heartbeat grace = 60 2023-11-27T20:53:01.938 INFO:teuthology.orchestra.run.smithi088.stdout: osd heartbeat grace = 60 2023-11-27T20:53:01.938 INFO:teuthology.orchestra.run.smithi088.stdout: fsid = ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc 2023-11-27T20:53:01.938 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.938 INFO:teuthology.orchestra.run.smithi088.stdout:[osd] 2023-11-27T20:53:01.938 INFO:teuthology.orchestra.run.smithi088.stdout: osd journal size = 100 2023-11-27T20:53:01.938 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.938 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub load threshold = 5.0 2023-11-27T20:53:01.938 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub max interval = 600 2023-11-27T20:53:01.938 INFO:teuthology.orchestra.run.smithi088.stdout: osd mclock profile = high_recovery_ops 2023-11-27T20:53:01.938 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.938 INFO:teuthology.orchestra.run.smithi088.stdout: osd recover clone overlap = true 2023-11-27T20:53:01.939 INFO:teuthology.orchestra.run.smithi088.stdout: osd recovery max chunk = 1048576 2023-11-27T20:53:01.939 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.939 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug shutdown = true 2023-11-27T20:53:01.939 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug op order = true 2023-11-27T20:53:01.939 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug verify stray on activate = true 2023-11-27T20:53:01.939 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug trim objects = true 2023-11-27T20:53:01.939 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.939 INFO:teuthology.orchestra.run.smithi088.stdout: osd open classes on start = true 2023-11-27T20:53:01.939 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug pg log writeout = true 2023-11-27T20:53:01.939 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.939 INFO:teuthology.orchestra.run.smithi088.stdout: osd deep scrub update digest min age = 30 2023-11-27T20:53:01.940 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.940 INFO:teuthology.orchestra.run.smithi088.stdout: osd map max advance = 10 2023-11-27T20:53:01.940 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.940 INFO:teuthology.orchestra.run.smithi088.stdout: journal zero on create = true 2023-11-27T20:53:01.940 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.940 INFO:teuthology.orchestra.run.smithi088.stdout: filestore ondisk finisher threads = 3 2023-11-27T20:53:01.940 INFO:teuthology.orchestra.run.smithi088.stdout: filestore apply finisher threads = 3 2023-11-27T20:53:01.940 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.940 INFO:teuthology.orchestra.run.smithi088.stdout: bdev debug aio = true 2023-11-27T20:53:01.940 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug misdirected ops = true 2023-11-27T20:53:01.940 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore block size = 96636764160 2023-11-27T20:53:01.940 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore fsck on mount = True 2023-11-27T20:53:01.941 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluefs = 20 2023-11-27T20:53:01.941 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluestore = 20 2023-11-27T20:53:01.941 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-11-27T20:53:01.941 INFO:teuthology.orchestra.run.smithi088.stdout: debug osd = 20 2023-11-27T20:53:01.941 INFO:teuthology.orchestra.run.smithi088.stdout: debug rocksdb = 10 2023-11-27T20:53:01.941 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd backfillfull_ratio = 0.85 2023-11-27T20:53:01.941 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd full ratio = 0.9 2023-11-27T20:53:01.941 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd nearfull ratio = 0.8 2023-11-27T20:53:01.941 INFO:teuthology.orchestra.run.smithi088.stdout: osd failsafe full ratio = 0.95 2023-11-27T20:53:01.941 INFO:teuthology.orchestra.run.smithi088.stdout: osd fast shutdown = False 2023-11-27T20:53:01.941 INFO:teuthology.orchestra.run.smithi088.stdout: osd objectstore = bluestore 2023-11-27T20:53:01.941 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2023-11-27T20:53:01.941 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.942 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr] 2023-11-27T20:53:01.942 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-11-27T20:53:01.942 INFO:teuthology.orchestra.run.smithi088.stdout: debug mgr = 20 2023-11-27T20:53:01.942 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2023-11-27T20:53:01.942 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2023-11-27T20:53:01.942 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2023-11-27T20:53:01.942 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2023-11-27T20:53:01.942 INFO:teuthology.orchestra.run.smithi088.stdout: mgr/telemetry/nag = false 2023-11-27T20:53:01.943 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.943 INFO:teuthology.orchestra.run.smithi088.stdout:[mon] 2023-11-27T20:53:01.943 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-11-27T20:53:01.943 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2023-11-27T20:53:01.943 INFO:teuthology.orchestra.run.smithi088.stdout: debug paxos = 20 2023-11-27T20:53:01.943 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2023-11-27T20:53:01.943 INFO:teuthology.orchestra.run.smithi088.stdout: mon data avail warn = 5 2023-11-27T20:53:01.943 INFO:teuthology.orchestra.run.smithi088.stdout: mon mgr mkfs grace = 240 2023-11-27T20:53:01.943 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2023-11-27T20:53:01.943 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd reporter subtree level = osd 2023-11-27T20:53:01.943 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd prime pg temp = true 2023-11-27T20:53:01.943 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2023-11-27T20:53:01.944 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.944 INFO:teuthology.orchestra.run.smithi088.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-27T20:53:01.944 INFO:teuthology.orchestra.run.smithi088.stdout: auth mon ticket ttl = 660 # 11m 2023-11-27T20:53:01.944 INFO:teuthology.orchestra.run.smithi088.stdout: auth service ticket ttl = 240 # 4m 2023-11-27T20:53:01.944 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.944 INFO:teuthology.orchestra.run.smithi088.stdout: # don't complain about insecure global_id in the test suite 2023-11-27T20:53:01.944 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-27T20:53:01.944 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-27T20:53:01.944 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.944 INFO:teuthology.orchestra.run.smithi088.stdout: # 1m isn't quite enough 2023-11-27T20:53:01.944 INFO:teuthology.orchestra.run.smithi088.stdout: mon_down_mkfs_grace = 2m 2023-11-27T20:53:01.945 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.945 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_filestore_osds = false 2023-11-27T20:53:01.945 INFO:teuthology.orchestra.run.smithi088.stdout: mon op complaint time = 120 2023-11-27T20:53:01.945 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd crush smoke test = False 2023-11-27T20:53:01.945 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:01.945 INFO:teuthology.orchestra.run.smithi088.stdout:[client] 2023-11-27T20:53:01.945 INFO:teuthology.orchestra.run.smithi088.stdout: rgw cache enabled = true 2023-11-27T20:53:01.945 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable ops log = true 2023-11-27T20:53:01.945 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable usage log = true 2023-11-27T20:53:01.945 INFO:teuthology.orchestra.run.smithi088.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-27T20:53:01.945 INFO:teuthology.orchestra.run.smithi088.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-27T20:53:01.945 INFO:teuthology.orchestra.run.smithi088.stdout: client mount timeout = 600 2023-11-27T20:53:01.946 INFO:teuthology.orchestra.run.smithi088.stdout: debug client = 20 2023-11-27T20:53:01.946 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-11-27T20:53:01.946 INFO:teuthology.orchestra.run.smithi088.stdout: rados mon op timeout = 900 2023-11-27T20:53:01.946 INFO:teuthology.orchestra.run.smithi088.stdout: rados osd op timeout = 900 2023-11-27T20:53:01.946 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.a] 2023-11-27T20:53:01.946 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.b] 2023-11-27T20:53:01.946 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.c] 2023-11-27T20:53:01.946 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2023-11-27T20:53:01.946 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.c] 2023-11-27T20:53:01.946 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.e] 2023-11-27T20:53:01.946 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.b] 2023-11-27T20:53:01.947 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.d] 2023-11-27T20:53:01.947 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.f] 2023-11-27T20:53:01.947 INFO:teuthology.orchestra.run.smithi088.stdout:[mds] 2023-11-27T20:53:01.947 INFO:teuthology.orchestra.run.smithi088.stdout: debug mds = 20 2023-11-27T20:53:01.947 INFO:teuthology.orchestra.run.smithi088.stdout: debug mds balancer = 20 2023-11-27T20:53:01.947 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-11-27T20:53:01.947 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug frag = True 2023-11-27T20:53:01.947 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug scatterstat = True 2023-11-27T20:53:01.947 INFO:teuthology.orchestra.run.smithi088.stdout: mds op complaint time = 180 2023-11-27T20:53:01.947 INFO:teuthology.orchestra.run.smithi088.stdout: mds valgrind exit = True 2023-11-27T20:53:01.947 INFO:teuthology.orchestra.run.smithi088.stdout: mds verify scatter = True 2023-11-27T20:53:01.947 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2023-11-27T20:53:01.948 INFO:teuthology.orchestra.run.smithi088.stdout: rados mon op timeout = 900 2023-11-27T20:53:01.948 INFO:teuthology.orchestra.run.smithi088.stdout: rados osd op timeout = 900 2023-11-27T20:53:01.948 INFO:teuthology.orchestra.run.smithi167.stdout:[global] 2023-11-27T20:53:01.948 INFO:teuthology.orchestra.run.smithi167.stdout: chdir = "" 2023-11-27T20:53:01.949 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-27T20:53:01.949 INFO:teuthology.orchestra.run.smithi167.stdout: auth supported = cephx 2023-11-27T20:53:01.949 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.949 INFO:teuthology.orchestra.run.smithi167.stdout: filestore xattr use omap = true 2023-11-27T20:53:01.949 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.949 INFO:teuthology.orchestra.run.smithi167.stdout: mon clock drift allowed = 1.000 2023-11-27T20:53:01.949 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.949 INFO:teuthology.orchestra.run.smithi167.stdout: osd crush chooseleaf type = 0 2023-11-27T20:53:01.949 INFO:teuthology.orchestra.run.smithi167.stdout: auth debug = true 2023-11-27T20:53:01.949 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.949 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on old message = true 2023-11-27T20:53:01.950 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on bug = true 2023-11-27T20:53:01.950 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.950 INFO:teuthology.orchestra.run.smithi167.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-27T20:53:01.950 INFO:teuthology.orchestra.run.smithi167.stdout: mon pg warn max object skew = 0 2023-11-27T20:53:01.950 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.950 INFO:teuthology.orchestra.run.smithi167.stdout: # disable pg_autoscaler by default for new pools 2023-11-27T20:53:01.950 INFO:teuthology.orchestra.run.smithi167.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-27T20:53:01.950 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.950 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default size = 2 2023-11-27T20:53:01.950 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.950 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow primary affinity = true 2023-11-27T20:53:01.951 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow pg remap = true 2023-11-27T20:53:01.951 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on legacy crush tunables = false 2023-11-27T20:53:01.951 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on crush straw calc version zero = false 2023-11-27T20:53:01.951 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on no sortbitwise = false 2023-11-27T20:53:01.951 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on osd down out interval zero = false 2023-11-27T20:53:01.951 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on too few osds = false 2023-11-27T20:53:01.951 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-27T20:53:01.951 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-27T20:53:01.951 INFO:teuthology.orchestra.run.smithi167.stdout: mon_allow_pool_size_one = true 2023-11-27T20:53:01.952 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.952 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-27T20:53:01.952 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.952 INFO:teuthology.orchestra.run.smithi167.stdout: osd default data pool replay window = 5 2023-11-27T20:53:01.952 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.952 INFO:teuthology.orchestra.run.smithi167.stdout: mon allow pool delete = true 2023-11-27T20:53:01.952 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.952 INFO:teuthology.orchestra.run.smithi167.stdout: mon cluster log file level = debug 2023-11-27T20:53:01.952 INFO:teuthology.orchestra.run.smithi167.stdout: debug asserts on shutdown = true 2023-11-27T20:53:01.953 INFO:teuthology.orchestra.run.smithi167.stdout: mon health detail to clog = false 2023-11-27T20:53:01.953 INFO:teuthology.orchestra.run.smithi167.stdout: mon host = "172.21.15.88,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2023-11-27T20:53:01.953 INFO:teuthology.orchestra.run.smithi167.stdout: mds beacon grace = 60 2023-11-27T20:53:01.953 INFO:teuthology.orchestra.run.smithi167.stdout: mds heartbeat grace = 60 2023-11-27T20:53:01.953 INFO:teuthology.orchestra.run.smithi167.stdout: osd heartbeat grace = 60 2023-11-27T20:53:01.953 INFO:teuthology.orchestra.run.smithi167.stdout: fsid = ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc 2023-11-27T20:53:01.954 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.955 INFO:teuthology.orchestra.run.smithi167.stdout:[osd] 2023-11-27T20:53:01.955 INFO:teuthology.orchestra.run.smithi167.stdout: osd journal size = 100 2023-11-27T20:53:01.955 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.955 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub load threshold = 5.0 2023-11-27T20:53:01.955 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub max interval = 600 2023-11-27T20:53:01.955 INFO:teuthology.orchestra.run.smithi167.stdout: osd mclock profile = high_recovery_ops 2023-11-27T20:53:01.955 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.955 INFO:teuthology.orchestra.run.smithi167.stdout: osd recover clone overlap = true 2023-11-27T20:53:01.956 INFO:teuthology.orchestra.run.smithi167.stdout: osd recovery max chunk = 1048576 2023-11-27T20:53:01.956 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.956 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug shutdown = true 2023-11-27T20:53:01.956 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug op order = true 2023-11-27T20:53:01.956 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug verify stray on activate = true 2023-11-27T20:53:01.956 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug trim objects = true 2023-11-27T20:53:01.956 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.956 INFO:teuthology.orchestra.run.smithi167.stdout: osd open classes on start = true 2023-11-27T20:53:01.956 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug pg log writeout = true 2023-11-27T20:53:01.956 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.957 INFO:teuthology.orchestra.run.smithi167.stdout: osd deep scrub update digest min age = 30 2023-11-27T20:53:01.957 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.957 INFO:teuthology.orchestra.run.smithi167.stdout: osd map max advance = 10 2023-11-27T20:53:01.957 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.957 INFO:teuthology.orchestra.run.smithi167.stdout: journal zero on create = true 2023-11-27T20:53:01.957 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.957 INFO:teuthology.orchestra.run.smithi167.stdout: filestore ondisk finisher threads = 3 2023-11-27T20:53:01.957 INFO:teuthology.orchestra.run.smithi167.stdout: filestore apply finisher threads = 3 2023-11-27T20:53:01.957 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.957 INFO:teuthology.orchestra.run.smithi167.stdout: bdev debug aio = true 2023-11-27T20:53:01.957 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug misdirected ops = true 2023-11-27T20:53:01.957 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore block size = 96636764160 2023-11-27T20:53:01.958 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore fsck on mount = True 2023-11-27T20:53:01.958 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluefs = 20 2023-11-27T20:53:01.958 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluestore = 20 2023-11-27T20:53:01.958 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-11-27T20:53:01.958 INFO:teuthology.orchestra.run.smithi167.stdout: debug osd = 20 2023-11-27T20:53:01.958 INFO:teuthology.orchestra.run.smithi167.stdout: debug rocksdb = 10 2023-11-27T20:53:01.958 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd backfillfull_ratio = 0.85 2023-11-27T20:53:01.958 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd full ratio = 0.9 2023-11-27T20:53:01.958 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd nearfull ratio = 0.8 2023-11-27T20:53:01.958 INFO:teuthology.orchestra.run.smithi167.stdout: osd failsafe full ratio = 0.95 2023-11-27T20:53:01.959 INFO:teuthology.orchestra.run.smithi167.stdout: osd fast shutdown = False 2023-11-27T20:53:01.959 INFO:teuthology.orchestra.run.smithi167.stdout: osd objectstore = bluestore 2023-11-27T20:53:01.959 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2023-11-27T20:53:01.959 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.959 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr] 2023-11-27T20:53:01.959 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-11-27T20:53:01.959 INFO:teuthology.orchestra.run.smithi167.stdout: debug mgr = 20 2023-11-27T20:53:01.959 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2023-11-27T20:53:01.959 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2023-11-27T20:53:01.959 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2023-11-27T20:53:01.959 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2023-11-27T20:53:01.959 INFO:teuthology.orchestra.run.smithi167.stdout: mgr/telemetry/nag = false 2023-11-27T20:53:01.960 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.960 INFO:teuthology.orchestra.run.smithi167.stdout:[mon] 2023-11-27T20:53:01.960 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-11-27T20:53:01.960 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2023-11-27T20:53:01.960 INFO:teuthology.orchestra.run.smithi167.stdout: debug paxos = 20 2023-11-27T20:53:01.960 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2023-11-27T20:53:01.960 INFO:teuthology.orchestra.run.smithi167.stdout: mon data avail warn = 5 2023-11-27T20:53:01.960 INFO:teuthology.orchestra.run.smithi167.stdout: mon mgr mkfs grace = 240 2023-11-27T20:53:01.960 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2023-11-27T20:53:01.961 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd reporter subtree level = osd 2023-11-27T20:53:01.961 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd prime pg temp = true 2023-11-27T20:53:01.961 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2023-11-27T20:53:01.961 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.961 INFO:teuthology.orchestra.run.smithi167.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-27T20:53:01.961 INFO:teuthology.orchestra.run.smithi167.stdout: auth mon ticket ttl = 660 # 11m 2023-11-27T20:53:01.961 INFO:teuthology.orchestra.run.smithi167.stdout: auth service ticket ttl = 240 # 4m 2023-11-27T20:53:01.961 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.961 INFO:teuthology.orchestra.run.smithi167.stdout: # don't complain about insecure global_id in the test suite 2023-11-27T20:53:01.961 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-27T20:53:01.962 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-27T20:53:01.962 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.962 INFO:teuthology.orchestra.run.smithi167.stdout: # 1m isn't quite enough 2023-11-27T20:53:01.962 INFO:teuthology.orchestra.run.smithi167.stdout: mon_down_mkfs_grace = 2m 2023-11-27T20:53:01.962 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.962 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_filestore_osds = false 2023-11-27T20:53:01.962 INFO:teuthology.orchestra.run.smithi167.stdout: mon op complaint time = 120 2023-11-27T20:53:01.962 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd crush smoke test = False 2023-11-27T20:53:01.962 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-27T20:53:01.962 INFO:teuthology.orchestra.run.smithi167.stdout:[client] 2023-11-27T20:53:01.962 INFO:teuthology.orchestra.run.smithi167.stdout: rgw cache enabled = true 2023-11-27T20:53:01.963 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable ops log = true 2023-11-27T20:53:01.963 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable usage log = true 2023-11-27T20:53:01.963 INFO:teuthology.orchestra.run.smithi167.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-27T20:53:01.963 INFO:teuthology.orchestra.run.smithi167.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-27T20:53:01.963 INFO:teuthology.orchestra.run.smithi167.stdout: client mount timeout = 600 2023-11-27T20:53:01.963 INFO:teuthology.orchestra.run.smithi167.stdout: debug client = 20 2023-11-27T20:53:01.963 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-11-27T20:53:01.963 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2023-11-27T20:53:01.963 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2023-11-27T20:53:01.963 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.a] 2023-11-27T20:53:01.964 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.b] 2023-11-27T20:53:01.964 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.c] 2023-11-27T20:53:01.964 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2023-11-27T20:53:01.964 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.c] 2023-11-27T20:53:01.964 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.e] 2023-11-27T20:53:01.964 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2023-11-27T20:53:01.964 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.d] 2023-11-27T20:53:01.964 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.f] 2023-11-27T20:53:01.964 INFO:teuthology.orchestra.run.smithi167.stdout:[mds] 2023-11-27T20:53:01.964 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds = 20 2023-11-27T20:53:01.964 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds balancer = 20 2023-11-27T20:53:01.964 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-11-27T20:53:01.965 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug frag = True 2023-11-27T20:53:01.965 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug scatterstat = True 2023-11-27T20:53:01.965 INFO:teuthology.orchestra.run.smithi167.stdout: mds op complaint time = 180 2023-11-27T20:53:01.965 INFO:teuthology.orchestra.run.smithi167.stdout: mds valgrind exit = True 2023-11-27T20:53:01.965 INFO:teuthology.orchestra.run.smithi167.stdout: mds verify scatter = True 2023-11-27T20:53:01.965 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2023-11-27T20:53:01.965 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2023-11-27T20:53:01.965 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2023-11-27T20:53:01.967 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-27T20:53:01.967 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-27T20:53:02.062 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-27T20:53:02.063 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:53:02.063 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-27T20:53:02.078 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:53:02.078 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-27T20:53:02.139 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi088.front.sepia.ceph.com 2023-11-27T20:53:02.141 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:53:02.142 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-27T20:53:02.142 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-27T20:53:02.220 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:53:02.220 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:53:02.277 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi167.front.sepia.ceph.com 2023-11-27T20:53:02.278 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-27T20:53:02.278 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-27T20:53:02.278 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-27T20:53:02.318 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-27T20:53:02.318 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:53:02.373 INFO:tasks.ceph:Setting up mon nodes... 2023-11-27T20:53:02.373 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-27T20:53:02.373 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-27T20:53:02.428 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-27T20:53:02.431 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-27T20:53:02.503 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-27T20:53:02.504 INFO:tasks.ceph:Setting up mds nodes... 2023-11-27T20:53:02.505 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-27T20:53:02.562 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-27T20:53:02.565 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-27T20:53:02.591 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-27T20:53:02.688 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-27T20:53:02.690 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-27T20:53:02.717 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2023-11-27T20:53:02.812 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2023-11-27T20:53:02.815 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2023-11-27T20:53:02.841 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-27T20:53:02.897 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-27T20:53:02.900 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-27T20:53:02.927 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-27T20:53:03.021 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-27T20:53:03.024 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-27T20:53:03.051 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2023-11-27T20:53:03.146 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2023-11-27T20:53:03.148 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2023-11-27T20:53:03.175 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-27T20:53:03.175 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-27T20:53:03.219 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-27T20:53:03.234 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-27T20:53:03.234 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi167.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-27T20:53:03.235 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-27T20:53:03.261 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T20:53:03.261 INFO:tasks.ceph:role: osd.0 2023-11-27T20:53:03.261 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com 2023-11-27T20:53:03.261 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-27T20:53:03.335 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T20:53:03.335 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T20:53:03.335 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T20:53:03.335 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-27T20:53:03.335 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T20:53:03.336 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-11-27T20:53:03.336 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T20:53:03.336 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-27T20:53:03.336 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T20:53:03.336 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T20:53:03.839 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-11-27T20:53:03.841 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-11-27T20:53:03.841 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-27T20:53:03.968 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-27T20:53:04.002 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-27T20:53:04.069 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T20:53:04.069 INFO:tasks.ceph:role: osd.1 2023-11-27T20:53:04.069 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com 2023-11-27T20:53:04.070 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-27T20:53:04.144 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T20:53:04.144 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T20:53:04.144 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T20:53:04.144 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-27T20:53:04.144 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T20:53:04.144 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-11-27T20:53:04.144 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T20:53:04.144 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-27T20:53:04.144 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T20:53:04.144 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T20:53:04.587 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-11-27T20:53:04.590 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-11-27T20:53:04.590 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-27T20:53:04.688 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-27T20:53:04.718 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-27T20:53:04.786 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T20:53:04.786 INFO:tasks.ceph:role: osd.2 2023-11-27T20:53:04.786 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com 2023-11-27T20:53:04.786 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-27T20:53:04.861 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T20:53:04.861 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T20:53:04.861 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T20:53:04.861 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-27T20:53:04.861 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T20:53:04.861 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-11-27T20:53:04.861 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T20:53:04.861 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-27T20:53:04.861 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T20:53:04.862 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T20:53:05.338 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-11-27T20:53:05.342 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-11-27T20:53:05.342 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-27T20:53:05.467 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-27T20:53:05.500 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-27T20:53:05.568 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T20:53:05.568 INFO:tasks.ceph:role: osd.3 2023-11-27T20:53:05.568 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com 2023-11-27T20:53:05.568 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-27T20:53:05.642 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T20:53:05.643 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T20:53:05.643 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T20:53:05.643 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-27T20:53:05.643 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T20:53:05.643 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-11-27T20:53:05.643 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T20:53:05.643 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-27T20:53:05.643 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T20:53:05.643 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T20:53:06.158 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-11-27T20:53:06.159 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-11-27T20:53:06.159 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-27T20:53:06.281 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-27T20:53:06.315 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:53:06.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:06.411+0000 7f24ef21c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-27T20:53:06.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:06.411+0000 7f24ef21c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-27T20:53:06.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:06.411+0000 7f24ef21c500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-27T20:53:06.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:06.411+0000 7f24ef21c500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-27T20:53:06.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:06.411+0000 7f24ef21c500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-27T20:53:06.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:06.412+0000 7f24ef21c500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-27T20:53:09.266 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-27T20:53:09.297 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:53:09.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:09.390+0000 7f227e0ad500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-27T20:53:09.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:09.390+0000 7f227e0ad500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-27T20:53:09.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:09.390+0000 7f227e0ad500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-27T20:53:09.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:09.390+0000 7f227e0ad500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-27T20:53:09.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:09.390+0000 7f227e0ad500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-27T20:53:09.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:09.390+0000 7f227e0ad500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-27T20:53:12.237 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-27T20:53:12.267 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:53:12.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:12.359+0000 7feff61be500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-27T20:53:12.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:12.359+0000 7feff61be500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-27T20:53:12.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:12.359+0000 7feff61be500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-27T20:53:12.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:12.359+0000 7feff61be500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-27T20:53:12.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:12.359+0000 7feff61be500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-27T20:53:12.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:12.360+0000 7feff61be500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-27T20:53:15.211 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-27T20:53:15.242 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:53:15.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:15.331+0000 7fd9051be500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-27T20:53:15.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:15.332+0000 7fd9051be500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-27T20:53:15.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:15.332+0000 7fd9051be500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-27T20:53:15.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:15.332+0000 7fd9051be500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-27T20:53:15.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:15.332+0000 7fd9051be500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-27T20:53:15.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:15.332+0000 7fd9051be500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-27T20:53:18.188 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-27T20:53:18.219 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-27T20:53:18.251 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T20:53:18.251 INFO:tasks.ceph:role: osd.4 2023-11-27T20:53:18.251 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi167.front.sepia.ceph.com 2023-11-27T20:53:18.251 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-27T20:53:18.329 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T20:53:18.329 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T20:53:18.330 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T20:53:18.330 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-27T20:53:18.330 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T20:53:18.330 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2023-11-27T20:53:18.330 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T20:53:18.330 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-27T20:53:18.330 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T20:53:18.331 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T20:53:18.860 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2023-11-27T20:53:18.863 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2023-11-27T20:53:18.863 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-27T20:53:19.012 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-27T20:53:19.052 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-27T20:53:19.122 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T20:53:19.122 INFO:tasks.ceph:role: osd.5 2023-11-27T20:53:19.122 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi167.front.sepia.ceph.com 2023-11-27T20:53:19.122 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-27T20:53:19.197 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T20:53:19.197 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T20:53:19.198 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T20:53:19.198 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-27T20:53:19.198 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T20:53:19.198 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2023-11-27T20:53:19.198 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T20:53:19.198 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-27T20:53:19.198 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T20:53:19.198 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T20:53:19.640 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2023-11-27T20:53:19.641 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2023-11-27T20:53:19.641 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-27T20:53:19.732 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-27T20:53:19.764 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-27T20:53:19.831 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T20:53:19.831 INFO:tasks.ceph:role: osd.6 2023-11-27T20:53:19.831 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi167.front.sepia.ceph.com 2023-11-27T20:53:19.831 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-27T20:53:19.906 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T20:53:19.906 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T20:53:19.906 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T20:53:19.906 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-27T20:53:19.906 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T20:53:19.906 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2023-11-27T20:53:19.906 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T20:53:19.907 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-27T20:53:19.907 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T20:53:19.909 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T20:53:20.385 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2023-11-27T20:53:20.386 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2023-11-27T20:53:20.387 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-27T20:53:20.542 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-27T20:53:20.575 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-27T20:53:20.643 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T20:53:20.643 INFO:tasks.ceph:role: osd.7 2023-11-27T20:53:20.643 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi167.front.sepia.ceph.com 2023-11-27T20:53:20.643 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-27T20:53:20.717 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T20:53:20.717 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T20:53:20.717 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T20:53:20.717 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-27T20:53:20.718 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T20:53:20.718 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2023-11-27T20:53:20.718 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T20:53:20.718 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-27T20:53:20.718 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T20:53:20.718 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T20:53:21.227 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2023-11-27T20:53:21.229 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2023-11-27T20:53:21.229 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-27T20:53:21.377 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-27T20:53:21.410 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:53:21.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:21.505+0000 7f188080d500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-27T20:53:21.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:21.506+0000 7f188080d500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-27T20:53:21.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:21.506+0000 7f188080d500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-27T20:53:21.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:21.506+0000 7f188080d500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-27T20:53:21.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:21.506+0000 7f188080d500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-27T20:53:21.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:21.506+0000 7f188080d500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-27T20:53:24.351 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-27T20:53:24.382 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:53:24.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:24.471+0000 7fa8ef19b500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-27T20:53:24.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:24.472+0000 7fa8ef19b500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-27T20:53:24.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:24.472+0000 7fa8ef19b500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-27T20:53:24.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:24.472+0000 7fa8ef19b500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-27T20:53:24.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:24.472+0000 7fa8ef19b500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-27T20:53:24.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:24.472+0000 7fa8ef19b500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-27T20:53:27.320 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-27T20:53:27.352 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:53:27.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:27.444+0000 7fcd3a103500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-27T20:53:27.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:27.444+0000 7fcd3a103500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-27T20:53:27.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:27.444+0000 7fcd3a103500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-27T20:53:27.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:27.445+0000 7fcd3a103500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-27T20:53:27.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:27.445+0000 7fcd3a103500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-27T20:53:27.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:27.445+0000 7fcd3a103500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-27T20:53:29.900 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:53:29.903 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:53:30.292 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-27T20:53:30.323 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:53:30.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:30.412+0000 7f0e43a2a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-27T20:53:30.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:30.412+0000 7f0e43a2a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-27T20:53:30.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:30.412+0000 7f0e43a2a500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-27T20:53:30.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:30.412+0000 7f0e43a2a500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-27T20:53:30.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:30.412+0000 7f0e43a2a500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-27T20:53:30.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:30.412+0000 7f0e43a2a500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-27T20:53:33.270 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-27T20:53:33.301 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-27T20:53:33.301 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:53:33.301 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-27T20:53:33.335 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:53:33.335 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-27T20:53:33.406 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:53:33.406 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-27T20:53:33.476 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:53:33.476 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2023-11-27T20:53:33.545 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:53:33.545 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-27T20:53:33.614 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:53:33.615 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-27T20:53:33.683 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:53:33.683 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-27T20:53:33.752 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:53:33.752 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-27T20:53:33.820 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-27T20:53:33.820 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-27T20:53:33.851 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-27T20:53:33.851 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-27T20:53:33.921 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-27T20:53:33.921 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-27T20:53:33.990 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-27T20:53:33.990 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2023-11-27T20:53:34.059 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-27T20:53:34.059 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-27T20:53:34.128 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-27T20:53:34.129 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-27T20:53:34.197 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-27T20:53:34.197 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-27T20:53:34.264 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-27T20:53:34.264 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-27T20:53:34.332 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:53:34.332 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-27T20:53:34.348 INFO:tasks.ceph:Adding keys to all mons... 2023-11-27T20:53:34.348 DEBUG:teuthology.orchestra.run.smithi088:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-27T20:53:34.390 DEBUG:teuthology.orchestra.run.smithi167:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-27T20:53:34.415 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.y] 2023-11-27T20:53:34.416 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCuAWVlXJSMGRAARIrG4z29cYWhJYJMs6yd9w== 2023-11-27T20:53:34.416 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2023-11-27T20:53:34.416 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCuAWVlnMN9IRAA8d5kM0I5yQcxzzan2ZEqXg== 2023-11-27T20:53:34.416 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.c] 2023-11-27T20:53:34.416 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCuAWVlfy0BKRAAOWyeJBTDg3d3EoyabpjZcg== 2023-11-27T20:53:34.416 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.e] 2023-11-27T20:53:34.416 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCuAWVl7j9xMBAA6WRNQRu5+0R4yyNYSBFy6w== 2023-11-27T20:53:34.416 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.0] 2023-11-27T20:53:34.417 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCyAWVlpmGVGBAANDQCcJ6ZKYDGM55bKOJBGg== 2023-11-27T20:53:34.417 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.1] 2023-11-27T20:53:34.417 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQC1AWVlwMNOFxAAobty9Yh2n+vQ6Ah0UefvYg== 2023-11-27T20:53:34.417 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.2] 2023-11-27T20:53:34.417 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQC4AWVlnEh5FRAA6EmORuquxWnR+9SXzZN4rw== 2023-11-27T20:53:34.417 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.3] 2023-11-27T20:53:34.417 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQC7AWVlymrWExAA7B5ThqabBV1ov+lTnC8UcQ== 2023-11-27T20:53:34.417 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.x] 2023-11-27T20:53:34.417 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCuAWVloXPwHRAAD8SZo1LS8ku7U29GVIZjww== 2023-11-27T20:53:34.418 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.b] 2023-11-27T20:53:34.418 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCuAWVl/sl8NRAAoKO9//P3aVSWPAe16EVd3A== 2023-11-27T20:53:34.418 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.d] 2023-11-27T20:53:34.418 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCvAWVlBTpIARAAY4UTzyWcrI/Hg2t6yTEP0A== 2023-11-27T20:53:34.418 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.f] 2023-11-27T20:53:34.418 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCvAWVlqfi3CBAAkFgJ3ZOJF7zqnMLBRd/KJQ== 2023-11-27T20:53:34.418 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.4] 2023-11-27T20:53:34.418 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDBAWVl3h00HhAAKhb6l0wH/QcbjBgJq6RAyQ== 2023-11-27T20:53:34.418 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.5] 2023-11-27T20:53:34.418 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDEAWVl60YrHBAA/YwjeUfJgb+sO806qAjyIw== 2023-11-27T20:53:34.418 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.6] 2023-11-27T20:53:34.418 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDHAWVlFoKOGhAA2TupJb9IOtSQE8A1kSN04w== 2023-11-27T20:53:34.419 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.7] 2023-11-27T20:53:34.419 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDKAWVlBiWcGBAADHe5HvjqlhEXK3tEggfGsQ== 2023-11-27T20:53:34.419 INFO:teuthology.orchestra.run.smithi088.stdout:[client.0] 2023-11-27T20:53:34.419 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCvAWVl0ycTDRAAY7G5x1PW1fF1b0jVyyK/rA== 2023-11-27T20:53:34.421 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr.y] 2023-11-27T20:53:34.421 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCuAWVlXJSMGRAARIrG4z29cYWhJYJMs6yd9w== 2023-11-27T20:53:34.421 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2023-11-27T20:53:34.421 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCuAWVlnMN9IRAA8d5kM0I5yQcxzzan2ZEqXg== 2023-11-27T20:53:34.421 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.c] 2023-11-27T20:53:34.421 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCuAWVlfy0BKRAAOWyeJBTDg3d3EoyabpjZcg== 2023-11-27T20:53:34.421 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.e] 2023-11-27T20:53:34.422 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCuAWVl7j9xMBAA6WRNQRu5+0R4yyNYSBFy6w== 2023-11-27T20:53:34.422 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.0] 2023-11-27T20:53:34.422 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCyAWVlpmGVGBAANDQCcJ6ZKYDGM55bKOJBGg== 2023-11-27T20:53:34.422 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.1] 2023-11-27T20:53:34.422 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQC1AWVlwMNOFxAAobty9Yh2n+vQ6Ah0UefvYg== 2023-11-27T20:53:34.422 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.2] 2023-11-27T20:53:34.423 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQC4AWVlnEh5FRAA6EmORuquxWnR+9SXzZN4rw== 2023-11-27T20:53:34.423 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.3] 2023-11-27T20:53:34.423 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQC7AWVlymrWExAA7B5ThqabBV1ov+lTnC8UcQ== 2023-11-27T20:53:34.423 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr.x] 2023-11-27T20:53:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCuAWVloXPwHRAAD8SZo1LS8ku7U29GVIZjww== 2023-11-27T20:53:34.424 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2023-11-27T20:53:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCuAWVl/sl8NRAAoKO9//P3aVSWPAe16EVd3A== 2023-11-27T20:53:34.424 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.d] 2023-11-27T20:53:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCvAWVlBTpIARAAY4UTzyWcrI/Hg2t6yTEP0A== 2023-11-27T20:53:34.425 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.f] 2023-11-27T20:53:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCvAWVlqfi3CBAAkFgJ3ZOJF7zqnMLBRd/KJQ== 2023-11-27T20:53:34.425 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.4] 2023-11-27T20:53:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQDBAWVl3h00HhAAKhb6l0wH/QcbjBgJq6RAyQ== 2023-11-27T20:53:34.426 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.5] 2023-11-27T20:53:34.426 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQDEAWVl60YrHBAA/YwjeUfJgb+sO806qAjyIw== 2023-11-27T20:53:34.426 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.6] 2023-11-27T20:53:34.426 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQDHAWVlFoKOGhAA2TupJb9IOtSQE8A1kSN04w== 2023-11-27T20:53:34.426 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.7] 2023-11-27T20:53:34.427 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQDKAWVlBiWcGBAADHe5HvjqlhEXK3tEggfGsQ== 2023-11-27T20:53:34.427 INFO:teuthology.orchestra.run.smithi167.stdout:[client.0] 2023-11-27T20:53:34.427 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCvAWVl0ycTDRAAY7G5x1PW1fF1b0jVyyK/rA== 2023-11-27T20:53:34.427 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-27T20:53:34.463 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-27T20:53:34.517 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T20:53:34.519 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T20:53:34.575 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T20:53:34.577 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T20:53:34.631 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T20:53:34.633 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T20:53:34.691 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:53:34.693 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:53:34.744 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:53:34.747 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:53:34.800 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:53:34.803 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:53:34.855 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:53:34.857 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:53:34.909 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-27T20:53:34.911 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-27T20:53:34.963 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T20:53:34.965 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T20:53:35.020 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T20:53:35.023 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T20:53:35.081 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T20:53:35.085 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T20:53:35.141 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:53:35.143 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:53:35.195 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:53:35.197 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:53:35.249 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:53:35.251 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:53:35.306 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:53:35.308 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:53:35.360 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-27T20:53:35.362 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-27T20:53:35.417 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-27T20:53:35.417 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-27T20:53:35.443 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-27T20:53:35.541 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-27T20:53:35.568 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-27T20:53:35.595 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-27T20:53:35.692 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-27T20:53:35.719 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-27T20:53:35.786 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-27T20:53:35.883 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-27T20:53:35.910 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:53:35.912 DEBUG:teuthology.orchestra.run.smithi167:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:53:35.964 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-27T20:53:35.965 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-11-27T20:53:35.965 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-27T20:53:35.965 DEBUG:teuthology.orchestra.run.smithi088:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2023-11-27T20:53:35.967 INFO:tasks.ceph.mon.a:Started 2023-11-27T20:53:35.968 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-11-27T20:53:35.968 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-27T20:53:35.968 DEBUG:teuthology.orchestra.run.smithi167:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2023-11-27T20:53:36.007 INFO:tasks.ceph.mon.b:Started 2023-11-27T20:53:36.007 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-11-27T20:53:36.008 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-27T20:53:36.008 DEBUG:teuthology.orchestra.run.smithi167:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2023-11-27T20:53:36.010 INFO:tasks.ceph.mon.c:Started 2023-11-27T20:53:36.010 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-27T20:53:36.010 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-27T20:53:36.011 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2023-11-27T20:53:36.013 INFO:tasks.ceph.mgr.y:Started 2023-11-27T20:53:36.013 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-27T20:53:36.013 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2023-11-27T20:53:36.015 INFO:tasks.ceph.mgr.x:Started 2023-11-27T20:53:36.015 INFO:tasks.ceph:Setting crush tunables to default 2023-11-27T20:53:36.015 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd crush tunables default 2023-11-27T20:53:36.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:36.113+0000 7fa95f10f640 1 Processor -- start 2023-11-27T20:53:36.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:36.113+0000 7fa95f10f640 1 -- start start 2023-11-27T20:53:36.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:36.114+0000 7fa95f10f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa958151680 0x7fa9581571d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:36.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:36.114+0000 7fa95f10f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa95806f3f0 0x7fa9580c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:36.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:36.114+0000 7fa95f10f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa95806f810 0x7fa9580ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:36.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:36.114+0000 7fa95f10f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa958157880 con 0x7fa95806f810 2023-11-27T20:53:36.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:36.114+0000 7fa95f10f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa958157b60 con 0x7fa958151680 2023-11-27T20:53:36.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:36.114+0000 7fa95f10f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa958157e40 con 0x7fa95806f3f0 2023-11-27T20:53:36.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:36.114+0000 7fa95d6ac640 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fa95806f810 msgr2=0x7fa9580ccac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2023-11-27T20:53:36.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:36.114+0000 7fa95d6ac640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa95806f810 0x7fa9580ccac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T20:53:36.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:36.114+0000 7fa95ceab640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7fa958151680 msgr2=0x7fa9581571d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-27T20:53:36.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:36.114+0000 7fa957fff640 1 -- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa95806f3f0 msgr2=0x7fa9580c7b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3301/0 2023-11-27T20:53:36.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:36.114+0000 7fa95ceab640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa958151680 0x7fa9581571d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T20:53:36.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:36.114+0000 7fa957fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa95806f3f0 0x7fa9580c7b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T20:53:36.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:36.315+0000 7fa95d6ac640 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fa95806f810 msgr2=0x7fa9580ccac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2023-11-27T20:53:36.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:36.315+0000 7fa95d6ac640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa95806f810 0x7fa9580ccac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T20:53:36.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:36.315+0000 7fa957fff640 1 -- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa95806f3f0 msgr2=0x7fa9580c7b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3301/0 2023-11-27T20:53:36.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:36.315+0000 7fa95ceab640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7fa958151680 msgr2=0x7fa9581571d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-27T20:53:36.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:36.315+0000 7fa957fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa95806f3f0 0x7fa9580c7b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T20:53:36.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:36.315+0000 7fa95ceab640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa958151680 0x7fa9581571d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T20:53:36.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:36.716+0000 7fa95d6ac640 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fa95806f810 msgr2=0x7fa9580ccac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2023-11-27T20:53:36.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:36.716+0000 7fa95d6ac640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa95806f810 0x7fa9580ccac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T20:53:36.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:36.716+0000 7fa95ceab640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7fa958151680 msgr2=0x7fa9581571d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-27T20:53:36.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:36.716+0000 7fa957fff640 1 -- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa95806f3f0 msgr2=0x7fa9580c7b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3301/0 2023-11-27T20:53:36.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:36.716+0000 7fa95ceab640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa958151680 0x7fa9581571d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T20:53:36.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:36.716+0000 7fa957fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa95806f3f0 0x7fa9580c7b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T20:53:37.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:37.517+0000 7fa95d6ac640 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fa95806f810 msgr2=0x7fa9580ccac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2023-11-27T20:53:37.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:37.517+0000 7fa95d6ac640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa95806f810 0x7fa9580ccac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T20:53:37.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:37.517+0000 7fa95ceab640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7fa958151680 msgr2=0x7fa9581571d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-27T20:53:37.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:37.517+0000 7fa957fff640 1 -- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa95806f3f0 msgr2=0x7fa9580c7b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3301/0 2023-11-27T20:53:37.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:37.517+0000 7fa95ceab640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa958151680 0x7fa9581571d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T20:53:37.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:37.517+0000 7fa957fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa95806f3f0 0x7fa9580c7b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T20:53:39.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:39.114+0000 7fa9567fc640 1 -- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa95806f3f0 msgr2=0x7fa9580c7b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T20:53:39.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:39.114+0000 7fa9567fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa95806f3f0 0x7fa9580c7b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:39.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:39.114+0000 7fa9567fc640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7fa958151680 msgr2=0x7fa9581571d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T20:53:39.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:39.114+0000 7fa9567fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa958151680 0x7fa9581571d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:39.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:39.114+0000 7fa9567fc640 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fa95806f810 msgr2=0x7fa9580ccac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T20:53:39.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:39.114+0000 7fa9567fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa95806f810 0x7fa9580ccac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:39.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:39.114+0000 7fa9567fc640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa958158120 con 0x7fa9380036b0 2023-11-27T20:53:39.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:39.114+0000 7fa9567fc640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa93800c160 con 0x7fa9380073f0 2023-11-27T20:53:39.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:39.114+0000 7fa95ceab640 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fa9380036b0 legacy=0x7fa938005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2023-11-27T20:53:39.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:39.114+0000 7fa957fff640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7fa9380073f0 legacy=0x7fa9380098b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-27T20:53:39.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:39.315+0000 7fa95ceab640 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fa9380036b0 legacy=0x7fa938005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2023-11-27T20:53:39.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:39.315+0000 7fa957fff640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7fa9380073f0 legacy=0x7fa9380098b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-27T20:53:39.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:39.716+0000 7fa95ceab640 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fa9380036b0 legacy=0x7fa938005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2023-11-27T20:53:39.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:39.716+0000 7fa957fff640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7fa9380073f0 legacy=0x7fa9380098b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-27T20:53:40.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:40.517+0000 7fa95ceab640 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fa9380036b0 legacy=0x7fa938005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2023-11-27T20:53:40.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:40.517+0000 7fa957fff640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7fa9380073f0 legacy=0x7fa9380098b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-27T20:53:42.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:42.114+0000 7fa9567fc640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7fa9380073f0 legacy=0x7fa9380098b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T20:53:42.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:42.114+0000 7fa9567fc640 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fa9380036b0 legacy=0x7fa938005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T20:53:42.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:42.114+0000 7fa95d6ac640 1 -- reap_dead start 2023-11-27T20:53:42.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:42.114+0000 7fa9567fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa93800cef0 0x7fa938005b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:42.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:42.114+0000 7fa9567fc640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa93800d360 con 0x7fa93800c320 2023-11-27T20:53:42.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:42.114+0000 7fa9567fc640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa958158120 con 0x7fa9380073f0 2023-11-27T20:53:42.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:42.114+0000 7fa9567fc640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa958157880 con 0x7fa93800cef0 2023-11-27T20:53:42.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:42.114+0000 7fa95ceab640 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fa93800c320 legacy=0x7fa93800c700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2023-11-27T20:53:42.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:42.114+0000 7fa95d6ac640 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fa93800cef0 msgr2=0x7fa938005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2023-11-27T20:53:42.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:42.114+0000 7fa95d6ac640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa93800cef0 0x7fa938005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T20:53:42.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:42.114+0000 7fa957fff640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7fa9380073f0 legacy=0x7fa9380098b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-27T20:53:42.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:42.315+0000 7fa95ceab640 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fa93800c320 legacy=0x7fa93800c700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2023-11-27T20:53:42.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:42.315+0000 7fa95d6ac640 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fa93800cef0 msgr2=0x7fa938005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2023-11-27T20:53:42.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:42.315+0000 7fa95d6ac640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa93800cef0 0x7fa938005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T20:53:42.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:42.315+0000 7fa957fff640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7fa9380073f0 legacy=0x7fa9380098b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-27T20:53:42.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:42.716+0000 7fa95ceab640 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fa93800c320 legacy=0x7fa93800c700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2023-11-27T20:53:42.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:42.716+0000 7fa95d6ac640 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fa93800cef0 msgr2=0x7fa938005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2023-11-27T20:53:42.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:42.716+0000 7fa95d6ac640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa93800cef0 0x7fa938005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T20:53:42.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:42.716+0000 7fa957fff640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7fa9380073f0 legacy=0x7fa9380098b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-27T20:53:43.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:43.517+0000 7fa95ceab640 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fa93800c320 legacy=0x7fa93800c700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2023-11-27T20:53:43.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:43.517+0000 7fa95d6ac640 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fa93800cef0 msgr2=0x7fa938005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2023-11-27T20:53:43.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:43.517+0000 7fa95d6ac640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa93800cef0 0x7fa938005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T20:53:43.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:43.517+0000 7fa957fff640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7fa9380073f0 legacy=0x7fa9380098b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-27T20:53:43.550 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:00:07.460 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T20:53:43.864 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:00:07.774 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T20:53:43.983 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:00:07.869 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T20:53:43.983 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:00:07.869 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T20:53:44.309 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:00:08.195 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T20:53:44.310 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:00:08.195 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T20:53:45.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.114+0000 7fa9567fc640 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fa93800cef0 msgr2=0x7fa938005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T20:53:45.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.114+0000 7fa9567fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa93800cef0 0x7fa938005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:45.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.114+0000 7fa9567fc640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7fa9380073f0 legacy=0x7fa9380098b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T20:53:45.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.115+0000 7fa9567fc640 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fa93800c320 legacy=0x7fa93800c700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T20:53:45.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.115+0000 7fa9567fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938006360 0x7fa938006740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:45.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.115+0000 7fa9567fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa938006db0 0x7fa938013680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:45.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.115+0000 7fa9567fc640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa958157880 con 0x7fa938006db0 2023-11-27T20:53:45.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.115+0000 7fa9567fc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa958157b60 con 0x7fa938006360 2023-11-27T20:53:45.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.115+0000 7fa95ceab640 1 -- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938006360 msgr2=0x7fa938006740 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3301/0 2023-11-27T20:53:45.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.115+0000 7fa95ceab640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938006360 0x7fa938006740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T20:53:45.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.115+0000 7fa957fff640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7fa938006db0 msgr2=0x7fa938013680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-27T20:53:45.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.115+0000 7fa957fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa938006db0 0x7fa938013680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T20:53:45.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.316+0000 7fa957fff640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7fa938006db0 msgr2=0x7fa938013680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-27T20:53:45.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.316+0000 7fa95ceab640 1 -- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938006360 msgr2=0x7fa938006740 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3301/0 2023-11-27T20:53:45.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.316+0000 7fa957fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa938006db0 0x7fa938013680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T20:53:45.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.316+0000 7fa95ceab640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938006360 0x7fa938006740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T20:53:45.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.853+0000 7fa957fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa938006db0 0x7fa938013680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:45.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.855+0000 7fa95ceab640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938006360 0x7fa938006740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:45.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.933+0000 7fa957fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa938006db0 0x7fa938013680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:52928/0 (socket says 172.21.15.88:52928) 2023-11-27T20:53:45.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.933+0000 7fa957fff640 1 -- 172.21.15.88:0/1674611619 learned_addr learned my addr 172.21.15.88:0/1674611619 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:53:45.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.937+0000 7fa957fff640 1 -- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa938006db0 msgr2=0x7fa938013680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T20:53:45.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.937+0000 7fa957fff640 1 -- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa938006db0 msgr2=0x7fa938013680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:53:45.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.937+0000 7fa957fff640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa938006db0 0x7fa938013680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:53:45.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.937+0000 7fa957fff640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa938006db0 0x7fa938013680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T20:53:45.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.970+0000 7fa95ceab640 1 -- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938006360 msgr2=0x7fa938006740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-27T20:53:45.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.970+0000 7fa95ceab640 1 -- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938006360 msgr2=0x7fa938006740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:53:45.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.970+0000 7fa95ceab640 1 --2- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938006360 0x7fa938006740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:53:45.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:45.970+0000 7fa95ceab640 1 --2- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938006360 0x7fa938006740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T20:53:46.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:46.738+0000 7fa957fff640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa938006db0 0x7fa938013680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:46.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:46.739+0000 7fa957fff640 1 -- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa938006db0 msgr2=0x7fa938013680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T20:53:46.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:46.739+0000 7fa957fff640 1 -- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa938006db0 msgr2=0x7fa938013680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:53:46.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:46.739+0000 7fa957fff640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa938006db0 0x7fa938013680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:53:46.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:46.739+0000 7fa957fff640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa938006db0 0x7fa938013680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T20:53:46.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:46.794+0000 7fa95ceab640 1 --2- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938006360 0x7fa938006740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:46.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:46.820+0000 7fa95ceab640 1 -- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938006360 msgr2=0x7fa938006740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T20:53:46.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:46.820+0000 7fa95ceab640 1 -- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938006360 msgr2=0x7fa938006740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:53:46.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:46.820+0000 7fa95ceab640 1 --2- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938006360 0x7fa938006740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:53:46.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:46.820+0000 7fa95ceab640 1 --2- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938006360 0x7fa938006740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T20:53:48.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:48.115+0000 7fa9567fc640 1 -- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938006360 msgr2=0x7fa938006740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T20:53:48.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:48.115+0000 7fa9567fc640 1 --2- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938006360 0x7fa938006740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:48.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:48.115+0000 7fa9567fc640 1 -- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa938006db0 msgr2=0x7fa938013680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T20:53:48.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:48.115+0000 7fa9567fc640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa938006db0 0x7fa938013680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:48.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:48.115+0000 7fa95d6ac640 1 -- 172.21.15.88:0/1674611619 reap_dead start 2023-11-27T20:53:48.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:48.115+0000 7fa9567fc640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 0x7fa93800fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:48.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:48.115+0000 7fa9567fc640 1 -- 172.21.15.88:0/1674611619 --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa93800c160 con 0x7fa938005af0 2023-11-27T20:53:48.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:48.115+0000 7fa9567fc640 1 -- 172.21.15.88:0/1674611619 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa93800d360 con 0x7fa93800c700 2023-11-27T20:53:48.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:48.115+0000 7fa9567fc640 1 -- 172.21.15.88:0/1674611619 --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa958157880 con 0x7fa93800d650 2023-11-27T20:53:48.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:48.115+0000 7fa95d6ac640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 0x7fa93800fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:48.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:48.118+0000 7fa95d6ac640 1 -- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 msgr2=0x7fa93800fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-27T20:53:48.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:48.118+0000 7fa95d6ac640 1 -- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 msgr2=0x7fa93800fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:53:48.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:48.118+0000 7fa95d6ac640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 0x7fa93800fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:53:48.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:48.118+0000 7fa95d6ac640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 0x7fa93800fa60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T20:53:48.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:48.319+0000 7fa95d6ac640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 0x7fa93800fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:48.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:48.320+0000 7fa95d6ac640 1 -- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 msgr2=0x7fa93800fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-27T20:53:48.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:48.320+0000 7fa95d6ac640 1 -- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 msgr2=0x7fa93800fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:53:48.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:48.320+0000 7fa95d6ac640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 0x7fa93800fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:53:48.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:48.320+0000 7fa95d6ac640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 0x7fa93800fa60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T20:53:48.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:48.721+0000 7fa95d6ac640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 0x7fa93800fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:48.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:48.722+0000 7fa95d6ac640 1 -- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 msgr2=0x7fa93800fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-27T20:53:48.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:48.722+0000 7fa95d6ac640 1 -- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 msgr2=0x7fa93800fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:53:48.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:48.722+0000 7fa95d6ac640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 0x7fa93800fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:53:48.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:48.722+0000 7fa95d6ac640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 0x7fa93800fa60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T20:53:49.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:49.523+0000 7fa95d6ac640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 0x7fa93800fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:49.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:49.524+0000 7fa95d6ac640 1 -- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 msgr2=0x7fa93800fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-27T20:53:49.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:49.524+0000 7fa95d6ac640 1 -- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 msgr2=0x7fa93800fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:53:49.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:49.524+0000 7fa95d6ac640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 0x7fa93800fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:53:49.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:49.524+0000 7fa95d6ac640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 0x7fa93800fa60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T20:53:51.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.115+0000 7fa9567fc640 1 -- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 msgr2=0x7fa93800fa60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T20:53:51.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.115+0000 7fa9567fc640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 0x7fa93800fa60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:51.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.115+0000 7fa9567fc640 1 -- 172.21.15.88:0/1674611619 >> v1:172.21.15.167:6789/0 conn(0x7fa93800c700 legacy=0x7fa938006330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:51.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.115+0000 7fa9567fc640 1 -- 172.21.15.88:0/1674611619 >> v1:172.21.15.88:6789/0 conn(0x7fa938005af0 legacy=0x7fa9380098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:51.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.115+0000 7fa9567fc640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa93800ffa0 0x7fa9380123c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:51.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.115+0000 7fa9567fc640 1 --2- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938012900 0x7fa938012d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:51.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.115+0000 7fa9567fc640 1 -- 172.21.15.88:0/1674611619 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa958157880 con 0x7fa93800ffa0 2023-11-27T20:53:51.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.115+0000 7fa9567fc640 1 -- 172.21.15.88:0/1674611619 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa958157b60 con 0x7fa938012900 2023-11-27T20:53:51.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.116+0000 7fa957fff640 1 --2- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938012900 0x7fa938012d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:51.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.117+0000 7fa957fff640 1 -- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938012900 msgr2=0x7fa938012d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-27T20:53:51.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.117+0000 7fa957fff640 1 -- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938012900 msgr2=0x7fa938012d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:53:51.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.117+0000 7fa957fff640 1 --2- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938012900 0x7fa938012d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:53:51.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.117+0000 7fa957fff640 1 --2- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938012900 0x7fa938012d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T20:53:51.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.123+0000 7fa95ceab640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa93800ffa0 0x7fa9380123c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:51.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.129+0000 7fa95ceab640 1 -- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa93800ffa0 msgr2=0x7fa9380123c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T20:53:51.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.129+0000 7fa95ceab640 1 -- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa93800ffa0 msgr2=0x7fa9380123c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:53:51.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.129+0000 7fa95ceab640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa93800ffa0 0x7fa9380123c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:53:51.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.129+0000 7fa95ceab640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa93800ffa0 0x7fa9380123c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T20:53:51.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.318+0000 7fa957fff640 1 --2- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938012900 0x7fa938012d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:51.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.319+0000 7fa957fff640 1 -- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938012900 msgr2=0x7fa938012d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T20:53:51.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.319+0000 7fa957fff640 1 -- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938012900 msgr2=0x7fa938012d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:53:51.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.319+0000 7fa957fff640 1 --2- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938012900 0x7fa938012d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:53:51.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.319+0000 7fa957fff640 1 --2- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938012900 0x7fa938012d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T20:53:51.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.330+0000 7fa95ceab640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa93800ffa0 0x7fa9380123c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:51.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.332+0000 7fa95ceab640 1 -- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa93800ffa0 msgr2=0x7fa9380123c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T20:53:51.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.332+0000 7fa95ceab640 1 -- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa93800ffa0 msgr2=0x7fa9380123c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:53:51.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.332+0000 7fa95ceab640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa93800ffa0 0x7fa9380123c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:53:51.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.332+0000 7fa95ceab640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa93800ffa0 0x7fa9380123c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T20:53:51.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.721+0000 7fa957fff640 1 --2- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938012900 0x7fa938012d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:51.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.722+0000 7fa957fff640 1 -- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938012900 msgr2=0x7fa938012d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T20:53:51.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.722+0000 7fa957fff640 1 -- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938012900 msgr2=0x7fa938012d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:53:51.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.722+0000 7fa957fff640 1 --2- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938012900 0x7fa938012d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:53:51.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.722+0000 7fa957fff640 1 --2- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938012900 0x7fa938012d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T20:53:51.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.733+0000 7fa95ceab640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa93800ffa0 0x7fa9380123c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:51.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.735+0000 7fa95ceab640 1 -- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa93800ffa0 msgr2=0x7fa9380123c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T20:53:51.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.735+0000 7fa95ceab640 1 -- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa93800ffa0 msgr2=0x7fa9380123c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:53:51.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.735+0000 7fa95ceab640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa93800ffa0 0x7fa9380123c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:53:51.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:51.735+0000 7fa95ceab640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa93800ffa0 0x7fa9380123c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T20:53:52.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:52.523+0000 7fa957fff640 1 --2- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938012900 0x7fa938012d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:52.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:52.524+0000 7fa957fff640 1 -- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938012900 msgr2=0x7fa938012d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T20:53:52.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:52.524+0000 7fa957fff640 1 -- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938012900 msgr2=0x7fa938012d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:53:52.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:52.524+0000 7fa957fff640 1 --2- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938012900 0x7fa938012d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:53:52.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:52.524+0000 7fa957fff640 1 --2- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938012900 0x7fa938012d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T20:53:52.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:52.537+0000 7fa95ceab640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa93800ffa0 0x7fa9380123c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:52.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:52.538+0000 7fa95ceab640 1 -- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa93800ffa0 msgr2=0x7fa9380123c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T20:53:52.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:52.538+0000 7fa95ceab640 1 -- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa93800ffa0 msgr2=0x7fa9380123c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:53:52.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:52.538+0000 7fa95ceab640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa93800ffa0 0x7fa9380123c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:53:52.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:52.538+0000 7fa95ceab640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa93800ffa0 0x7fa9380123c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T20:53:54.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.115+0000 7fa9567fc640 1 -- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938012900 msgr2=0x7fa938012d10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T20:53:54.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.115+0000 7fa9567fc640 1 --2- 172.21.15.88:0/1674611619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa938012900 0x7fa938012d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:54.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.115+0000 7fa9567fc640 1 -- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa93800ffa0 msgr2=0x7fa9380123c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T20:53:54.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.115+0000 7fa9567fc640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.167:3300/0 conn(0x7fa93800ffa0 0x7fa9380123c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:54.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.115+0000 7fa9567fc640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 0x7fa93800fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:54.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.115+0000 7fa95d6ac640 1 -- 172.21.15.88:0/1674611619 reap_dead start 2023-11-27T20:53:54.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.116+0000 7fa9567fc640 1 -- 172.21.15.88:0/1674611619 --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa958158120 con 0x7fa93800ffa0 2023-11-27T20:53:54.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.116+0000 7fa9567fc640 1 -- 172.21.15.88:0/1674611619 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa938005b90 con 0x7fa93800c700 2023-11-27T20:53:54.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.116+0000 7fa9567fc640 1 -- 172.21.15.88:0/1674611619 --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa958157880 con 0x7fa93800d650 2023-11-27T20:53:54.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.187+0000 7fa957fff640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 0x7fa93800fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:54.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.192+0000 7fa957fff640 1 -- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 msgr2=0x7fa93800fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-27T20:53:54.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.192+0000 7fa957fff640 1 -- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 msgr2=0x7fa93800fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:53:54.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.192+0000 7fa957fff640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 0x7fa93800fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:53:54.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.193+0000 7fa957fff640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 0x7fa93800fa60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T20:53:54.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.394+0000 7fa957fff640 1 --2- 172.21.15.88:0/1674611619 >> v2:172.21.15.88:3300/0 conn(0x7fa93800d650 0x7fa93800fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:54.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.399+0000 7fa957fff640 1 -- 172.21.15.88:0/1674611619 >> v1:172.21.15.167:6789/0 conn(0x7fa93800c700 legacy=0x7fa938006330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:54.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.399+0000 7fa957fff640 1 -- 172.21.15.88:0/1674611619 >> v1:172.21.15.88:6789/0 conn(0x7fa93800ffa0 legacy=0x7fa938013480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:54.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.399+0000 7fa957fff640 1 -- 172.21.15.88:0/1674611619 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa938005d20 con 0x7fa93800d650 2023-11-27T20:53:54.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.402+0000 7fa957fff640 1 --2- 172.21.15.88:0/1674611619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa93800d650 0x7fa93800fa60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa948003e80 tx=0x7fa94802d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b5beaa271a35830 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:53:54.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.406+0000 7fa9577fe640 1 -- 172.21.15.88:0/1674611619 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94800b040 con 0x7fa93800d650 2023-11-27T20:53:54.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.406+0000 7fa9577fe640 1 -- 172.21.15.88:0/1674611619 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9480347a0 con 0x7fa93800d650 2023-11-27T20:53:54.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.406+0000 7fa9577fe640 1 -- 172.21.15.88:0/1674611619 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa948034b50 con 0x7fa93800d650 2023-11-27T20:53:54.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.407+0000 7fa95f10f640 1 -- 172.21.15.88:0/1674611619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa93800d650 msgr2=0x7fa93800fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:54.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.407+0000 7fa95f10f640 1 --2- 172.21.15.88:0/1674611619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa93800d650 0x7fa93800fa60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa948003e80 tx=0x7fa94802d8d0 comp rx=0 tx=0).stop 2023-11-27T20:53:54.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.407+0000 7fa95f10f640 1 -- 172.21.15.88:0/1674611619 shutdown_connections 2023-11-27T20:53:54.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.407+0000 7fa95f10f640 1 --2- 172.21.15.88:0/1674611619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa93800d650 0x7fa93800fa60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:54.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.407+0000 7fa95f10f640 1 -- 172.21.15.88:0/1674611619 >> 172.21.15.88:0/1674611619 conn(0x7fa9580707f0 msgr2=0x7fa958070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:53:54.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.407+0000 7fa95f10f640 1 -- 172.21.15.88:0/1674611619 shutdown_connections 2023-11-27T20:53:54.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.407+0000 7fa95f10f640 1 -- 172.21.15.88:0/1674611619 wait complete. 2023-11-27T20:53:54.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.409+0000 7fa95f10f640 1 Processor -- start 2023-11-27T20:53:54.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.409+0000 7fa95f10f640 1 -- start start 2023-11-27T20:53:54.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.410+0000 7fa95f10f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93800c700 0x7fa9581edbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:54.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.410+0000 7fa95f10f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa93800d650 0x7fa9580c5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:54.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.410+0000 7fa95f10f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa93800ffa0 0x7fa95815a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:54.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.410+0000 7fa95f10f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9581ed700 con 0x7fa93800d650 2023-11-27T20:53:54.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.410+0000 7fa95f10f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9581efac0 con 0x7fa93800c700 2023-11-27T20:53:54.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.410+0000 7fa95f10f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9580c55a0 con 0x7fa93800ffa0 2023-11-27T20:53:54.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.410+0000 7fa957fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa93800d650 0x7fa9580c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:54.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.410+0000 7fa95ceab640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93800c700 0x7fa9581edbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:54.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.410+0000 7fa957fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa93800d650 0x7fa9580c5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46682/0 (socket says 172.21.15.88:46682) 2023-11-27T20:53:54.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.410+0000 7fa957fff640 1 -- 172.21.15.88:0/1271227414 learned_addr learned my addr 172.21.15.88:0/1271227414 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:53:54.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.416+0000 7fa95ceab640 1 -- 172.21.15.88:0/1271227414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa93800ffa0 msgr2=0x7fa95815a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:54.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.416+0000 7fa95ceab640 1 --2- 172.21.15.88:0/1271227414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa93800ffa0 0x7fa95815a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:54.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.416+0000 7fa95ceab640 1 -- 172.21.15.88:0/1271227414 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa93800d650 msgr2=0x7fa9580c5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:54.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.416+0000 7fa95ceab640 1 --2- 172.21.15.88:0/1271227414 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa93800d650 0x7fa9580c5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:54.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.416+0000 7fa95ceab640 1 -- 172.21.15.88:0/1271227414 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93800c160 con 0x7fa93800c700 2023-11-27T20:53:54.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.419+0000 7fa95ceab640 1 --2- 172.21.15.88:0/1271227414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93800c700 0x7fa9581edbd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa938007270 tx=0x7fa950005b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:53:54.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.424+0000 7fa9557fa640 1 -- 172.21.15.88:0/1271227414 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95000e040 con 0x7fa93800c700 2023-11-27T20:53:54.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.424+0000 7fa9557fa640 1 -- 172.21.15.88:0/1271227414 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95000f040 con 0x7fa93800c700 2023-11-27T20:53:54.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.424+0000 7fa95f10f640 1 -- 172.21.15.88:0/1271227414 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9580cc490 con 0x7fa93800c700 2023-11-27T20:53:54.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.424+0000 7fa9557fa640 1 -- 172.21.15.88:0/1271227414 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa950014890 con 0x7fa93800c700 2023-11-27T20:53:54.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.424+0000 7fa95f10f640 1 -- 172.21.15.88:0/1271227414 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9581ed160 con 0x7fa93800c700 2023-11-27T20:53:54.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.425+0000 7fa95f10f640 1 -- 172.21.15.88:0/1271227414 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa958073dc0 con 0x7fa93800c700 2023-11-27T20:53:54.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.601+0000 7fa9557fa640 1 -- 172.21.15.88:0/1271227414 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fa950014d70 con 0x7fa93800c700 2023-11-27T20:53:54.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.611+0000 7fa9557fa640 1 -- 172.21.15.88:0/1271227414 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa95001e9b0 con 0x7fa93800c700 2023-11-27T20:53:54.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.612+0000 7fa9557fa640 1 -- 172.21.15.88:0/1271227414 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7fa9500095a0 con 0x7fa93800c700 2023-11-27T20:53:54.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:54.678+0000 7fa95f10f640 1 -- 172.21.15.88:0/1271227414 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fa9580c8400 con 0x7fa93800c700 2023-11-27T20:53:54.856 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T20:53:54.855+0000 7f9c3ee2e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-27T20:53:54.895 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-27T20:53:54.894+0000 7f5a03c2e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-27T20:53:54.910 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T20:53:54.908+0000 7f9c3ee2e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-27T20:53:54.947 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-27T20:53:54.946+0000 7f5a03c2e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-27T20:53:55.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:55.029+0000 7fa9557fa640 1 -- 172.21.15.88:0/1271227414 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa95001ebd0 con 0x7fa93800c700 2023-11-27T20:53:55.030 INFO:teuthology.orchestra.run.smithi088.stderr:adjusted tunables profile to default 2023-11-27T20:53:55.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:55.030+0000 7fa95f10f640 1 -- 172.21.15.88:0/1271227414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93800c700 msgr2=0x7fa9581edbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:55.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:55.030+0000 7fa95f10f640 1 --2- 172.21.15.88:0/1271227414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93800c700 0x7fa9581edbd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa938007270 tx=0x7fa950005b00 comp rx=0 tx=0).stop 2023-11-27T20:53:55.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:55.030+0000 7fa95f10f640 1 -- 172.21.15.88:0/1271227414 shutdown_connections 2023-11-27T20:53:55.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:55.030+0000 7fa95f10f640 1 --2- 172.21.15.88:0/1271227414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa93800ffa0 0x7fa95815a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:55.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:55.030+0000 7fa95f10f640 1 --2- 172.21.15.88:0/1271227414 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa93800d650 0x7fa9580c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:55.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:55.030+0000 7fa95f10f640 1 --2- 172.21.15.88:0/1271227414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93800c700 0x7fa9581edbd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:55.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:55.030+0000 7fa95f10f640 1 -- 172.21.15.88:0/1271227414 >> 172.21.15.88:0/1271227414 conn(0x7fa9580707f0 msgr2=0x7fa958150c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:53:55.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:55.030+0000 7fa95f10f640 1 -- 172.21.15.88:0/1271227414 shutdown_connections 2023-11-27T20:53:55.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:55.030+0000 7fa95f10f640 1 -- 172.21.15.88:0/1271227414 wait complete. 2023-11-27T20:53:55.042 INFO:tasks.ceph:check_enable_crimson: False 2023-11-27T20:53:55.042 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-27T20:53:55.043 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:53:55.043 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-27T20:53:55.070 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:53:55.070 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-27T20:53:55.137 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:53:55.137 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-27T20:53:55.205 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:53:55.205 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-27T20:53:55.272 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-27T20:53:55.272 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-27T20:53:55.299 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-27T20:53:55.299 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-27T20:53:55.369 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-27T20:53:55.370 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-27T20:53:55.437 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-27T20:53:55.438 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-27T20:53:55.472 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T20:53:55.471+0000 7f9c3ee2e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-27T20:53:55.505 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 1207ca0f-bef1-44c6-b66b-58bf0e080ca9 0 2023-11-27T20:53:55.522 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-27T20:53:55.521+0000 7f5a03c2e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-27T20:53:55.523 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T20:53:55.522+0000 7f9c3ee2e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-27T20:53:55.567 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T20:53:55.566+0000 7f9c3ee2e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-27T20:53:55.577 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-27T20:53:55.576+0000 7f5a03c2e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-27T20:53:55.620 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T20:53:55.618+0000 7f9c3ee2e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-27T20:53:55.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.622+0000 7ff6b767c640 1 Processor -- start 2023-11-27T20:53:55.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.622+0000 7ff6b767c640 1 -- start start 2023-11-27T20:53:55.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.623+0000 7ff6b767c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff6b0157240 0x7ff6b00c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:55.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.623+0000 7ff6b767c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b01577f0 con 0x7ff6b0151220 2023-11-27T20:53:55.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.623+0000 7ff6b767c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b0157a90 con 0x7ff6b00c4610 2023-11-27T20:53:55.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.623+0000 7ff6b767c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b006f470 con 0x7ff6b0157240 2023-11-27T20:53:55.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.623+0000 7ff6b5418640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff6b0151220 0x7ff6b006ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.167:48630/0 (socket says 172.21.15.167:48630) 2023-11-27T20:53:55.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.623+0000 7ff6b5418640 1 -- 172.21.15.167:0/3262577430 learned_addr learned my addr 172.21.15.167:0/3262577430 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-27T20:53:55.625 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-27T20:53:55.624+0000 7f5a03c2e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-27T20:53:55.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.637+0000 7ff6a7fff640 1 -- 172.21.15.167:0/3262577430 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842854104 0 0) 0x7ff6b01577f0 con 0x7ff6b0151220 2023-11-27T20:53:55.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.637+0000 7ff6a7fff640 1 -- 172.21.15.167:0/3262577430 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff69c003520 con 0x7ff6b0151220 2023-11-27T20:53:55.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.643+0000 7ff6a7fff640 1 -- 172.21.15.167:0/3262577430 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1488047755 0 0) 0x7ff69c003520 con 0x7ff6b0151220 2023-11-27T20:53:55.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.643+0000 7ff6a7fff640 1 -- 172.21.15.167:0/3262577430 >> v2:172.21.15.167:3300/0 conn(0x7ff6b0157240 msgr2=0x7ff6b00c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:53:55.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.643+0000 7ff6a7fff640 1 --2- 172.21.15.167:0/3262577430 >> v2:172.21.15.167:3300/0 conn(0x7ff6b0157240 0x7ff6b00c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:55.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.643+0000 7ff6a7fff640 1 -- 172.21.15.167:0/3262577430 >> v1:172.21.15.167:6789/0 conn(0x7ff6b00c4610 legacy=0x7ff6b00710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:53:55.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.643+0000 7ff6a7fff640 1 -- 172.21.15.167:0/3262577430 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b0157d30 con 0x7ff6b0151220 2023-11-27T20:53:55.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.643+0000 7ff6a7fff640 1 -- 172.21.15.167:0/3262577430 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1067350109 0 0) 0x7ff6ac001670 con 0x7ff6b0151220 2023-11-27T20:53:55.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.643+0000 7ff6a7fff640 1 -- 172.21.15.167:0/3262577430 >> v1:172.21.15.88:6789/0 conn(0x7ff6b0151220 legacy=0x7ff6b006ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:55.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.643+0000 7ff6a7fff640 1 --2- 172.21.15.167:0/3262577430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff69c0039e0 0x7ff69c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:55.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.643+0000 7ff6a7fff640 1 --2- 172.21.15.167:0/3262577430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff69c0047c0 0x7ff69c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:55.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.643+0000 7ff6a7fff640 1 --2- 172.21.15.167:0/3262577430 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff69c0052d0 0x7ff69c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:55.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.643+0000 7ff6a7fff640 1 -- 172.21.15.167:0/3262577430 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b006f470 con 0x7ff69c0039e0 2023-11-27T20:53:55.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.643+0000 7ff6a7fff640 1 -- 172.21.15.167:0/3262577430 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c00c200 con 0x7ff69c0047c0 2023-11-27T20:53:55.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.643+0000 7ff6a7fff640 1 -- 172.21.15.167:0/3262577430 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c00c3c0 con 0x7ff69c0052d0 2023-11-27T20:53:55.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.644+0000 7ff6b5c19640 1 --2- 172.21.15.167:0/3262577430 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff69c0052d0 0x7ff69c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:55.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.646+0000 7ff6b5418640 1 --2- 172.21.15.167:0/3262577430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff69c0039e0 0x7ff69c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:55.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.649+0000 7ff6b4c17640 1 --2- 172.21.15.167:0/3262577430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff69c0047c0 0x7ff69c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:55.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.650+0000 7ff6b5418640 1 -- 172.21.15.167:0/3262577430 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff69c0052d0 msgr2=0x7ff69c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:53:55.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.650+0000 7ff6b5418640 1 --2- 172.21.15.167:0/3262577430 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff69c0052d0 0x7ff69c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:55.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.650+0000 7ff6b5418640 1 -- 172.21.15.167:0/3262577430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff69c0047c0 msgr2=0x7ff69c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:53:55.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.650+0000 7ff6b5418640 1 --2- 172.21.15.167:0/3262577430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff69c0047c0 0x7ff69c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:55.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.650+0000 7ff6b5418640 1 -- 172.21.15.167:0/3262577430 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c003520 con 0x7ff69c0039e0 2023-11-27T20:53:55.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.650+0000 7ff6b5c19640 1 -- 172.21.15.167:0/3262577430 reap_dead start 2023-11-27T20:53:55.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.652+0000 7ff6b5418640 1 --2- 172.21.15.167:0/3262577430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff69c0039e0 0x7ff69c003e00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00c240 tx=0x7ff69c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd43e20ef24fd4aa server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:53:55.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.655+0000 7ff6a7fff640 1 -- 172.21.15.167:0/3262577430 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac005ad0 con 0x7ff69c0039e0 2023-11-27T20:53:55.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.655+0000 7ff6a7fff640 1 -- 172.21.15.167:0/3262577430 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ac005c30 con 0x7ff69c0039e0 2023-11-27T20:53:55.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.655+0000 7ff6a7fff640 1 -- 172.21.15.167:0/3262577430 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac02cb10 con 0x7ff69c0039e0 2023-11-27T20:53:55.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.656+0000 7ff6b767c640 1 -- 172.21.15.167:0/3262577430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff69c0039e0 msgr2=0x7ff69c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:55.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.656+0000 7ff6b767c640 1 --2- 172.21.15.167:0/3262577430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff69c0039e0 0x7ff69c003e00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00c240 tx=0x7ff69c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:53:55.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.656+0000 7ff6b767c640 1 -- 172.21.15.167:0/3262577430 shutdown_connections 2023-11-27T20:53:55.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.656+0000 7ff6b767c640 1 --2- 172.21.15.167:0/3262577430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff69c0039e0 0x7ff69c003e00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:55.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.656+0000 7ff6b767c640 1 -- 172.21.15.167:0/3262577430 >> 172.21.15.167:0/3262577430 conn(0x7ff6b006c5f0 msgr2=0x7ff6b006c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:53:55.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.656+0000 7ff6b767c640 1 -- 172.21.15.167:0/3262577430 shutdown_connections 2023-11-27T20:53:55.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.656+0000 7ff6b767c640 1 -- 172.21.15.167:0/3262577430 wait complete. 2023-11-27T20:53:55.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.658+0000 7ff6b767c640 1 Processor -- start 2023-11-27T20:53:55.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.658+0000 7ff6b767c640 1 -- start start 2023-11-27T20:53:55.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.659+0000 7ff6b767c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff69c0039e0 0x7ff6b013a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:55.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.659+0000 7ff6b767c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6b015b440 0x7ff6b013e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:55.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.659+0000 7ff6b767c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6b013fe90 0x7ff6b013e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:55.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.659+0000 7ff6b767c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b01ed240 con 0x7ff6b013fe90 2023-11-27T20:53:55.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.659+0000 7ff6b767c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b01ed770 con 0x7ff6b015b440 2023-11-27T20:53:55.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.659+0000 7ff6b767c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b0158c40 con 0x7ff69c0039e0 2023-11-27T20:53:55.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.660+0000 7ff6b4c17640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6b015b440 0x7ff6b013e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:55.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.660+0000 7ff6b5418640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff69c0039e0 0x7ff6b013a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:55.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.660+0000 7ff6b5c19640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6b013fe90 0x7ff6b013e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:55.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.660+0000 7ff6b4c17640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6b015b440 0x7ff6b013e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52710/0 (socket says 172.21.15.167:52710) 2023-11-27T20:53:55.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.660+0000 7ff6b4c17640 1 -- 172.21.15.167:0/1915890885 learned_addr learned my addr 172.21.15.167:0/1915890885 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-27T20:53:55.665 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T20:53:55.664+0000 7f9c3ee2e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-27T20:53:55.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.664+0000 7ff6b4c17640 1 -- 172.21.15.167:0/1915890885 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff69c0039e0 msgr2=0x7ff6b013a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:55.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.664+0000 7ff6b4c17640 1 --2- 172.21.15.167:0/1915890885 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff69c0039e0 0x7ff6b013a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:55.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.664+0000 7ff6b4c17640 1 -- 172.21.15.167:0/1915890885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6b013fe90 msgr2=0x7ff6b013e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:55.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.664+0000 7ff6b4c17640 1 --2- 172.21.15.167:0/1915890885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6b013fe90 0x7ff6b013e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:55.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.664+0000 7ff6b4c17640 1 -- 172.21.15.167:0/1915890885 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b013ee50 con 0x7ff6b015b440 2023-11-27T20:53:55.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.664+0000 7ff6b5c19640 1 --2- 172.21.15.167:0/1915890885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6b013fe90 0x7ff6b013e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:53:55.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.666+0000 7ff6b4c17640 1 --2- 172.21.15.167:0/1915890885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6b015b440 0x7ff6b013e330 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000d800 tx=0x7ff6a000dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:53:55.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.669+0000 7ff6a5ffb640 1 -- 172.21.15.167:0/1915890885 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0018070 con 0x7ff6b015b440 2023-11-27T20:53:55.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.669+0000 7ff6a5ffb640 1 -- 172.21.15.167:0/1915890885 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a0004020 con 0x7ff6b015b440 2023-11-27T20:53:55.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.669+0000 7ff6b767c640 1 -- 172.21.15.167:0/1915890885 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b0156b00 con 0x7ff6b015b440 2023-11-27T20:53:55.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.669+0000 7ff6a5ffb640 1 -- 172.21.15.167:0/1915890885 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a00041d0 con 0x7ff6b015b440 2023-11-27T20:53:55.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.669+0000 7ff6b767c640 1 -- 172.21.15.167:0/1915890885 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b01ed490 con 0x7ff6b015b440 2023-11-27T20:53:55.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.671+0000 7ff6b767c640 1 -- 172.21.15.167:0/1915890885 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b0072020 con 0x7ff6b015b440 2023-11-27T20:53:55.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.673+0000 7ff6a5ffb640 1 -- 172.21.15.167:0/1915890885 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7ff6a00099c0 con 0x7ff6b015b440 2023-11-27T20:53:55.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.673+0000 7ff6a5ffb640 1 -- 172.21.15.167:0/1915890885 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff6a0003c80 con 0x7ff6b015b440 2023-11-27T20:53:55.698 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-27T20:53:55.697+0000 7f5a03c2e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-27T20:53:55.752 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-27T20:53:55.751+0000 7f5a03c2e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-27T20:53:55.767 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T20:53:55.766+0000 7f9c3ee2e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-27T20:53:55.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.793+0000 7ff6a5ffb640 1 -- 172.21.15.167:0/1915890885 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7ff6a0004330 con 0x7ff6b015b440 2023-11-27T20:53:55.841 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T20:53:55.839+0000 7f9c3ee2e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-27T20:53:55.869 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-27T20:53:55.867+0000 7f5a03c2e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-27T20:53:55.887 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T20:53:55.885+0000 7f9c3ee2e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-27T20:53:55.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:55.911+0000 7ff6b767c640 1 -- 172.21.15.167:0/1915890885 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1207ca0f-bef1-44c6-b66b-58bf0e080ca9", "id": 0} v 0) v1 -- 0x7ff6b0067470 con 0x7ff6b015b440 2023-11-27T20:53:55.940 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T20:53:55.937+0000 7f9c3ee2e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-27T20:53:55.941 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-27T20:53:55.940+0000 7f5a03c2e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-27T20:53:55.986 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-27T20:53:55.985+0000 7f5a03c2e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-27T20:53:55.987 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T20:53:55.985+0000 7f9c3ee2e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-27T20:53:56.041 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-27T20:53:56.040+0000 7f5a03c2e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-27T20:53:56.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.064+0000 7ff6a5ffb640 1 -- 172.21.15.167:0/1915890885 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1207ca0f-bef1-44c6-b66b-58bf0e080ca9", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff6a0009c70 con 0x7ff6b015b440 2023-11-27T20:53:56.066 INFO:teuthology.orchestra.run.smithi167.stdout:0 2023-11-27T20:53:56.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.066+0000 7ff6b767c640 1 -- 172.21.15.167:0/1915890885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6b015b440 msgr2=0x7ff6b013e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:56.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.066+0000 7ff6b767c640 1 --2- 172.21.15.167:0/1915890885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6b015b440 0x7ff6b013e330 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000d800 tx=0x7ff6a000dcc0 comp rx=0 tx=0).stop 2023-11-27T20:53:56.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.066+0000 7ff6b767c640 1 -- 172.21.15.167:0/1915890885 shutdown_connections 2023-11-27T20:53:56.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.066+0000 7ff6b767c640 1 --2- 172.21.15.167:0/1915890885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6b013fe90 0x7ff6b013e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:56.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.066+0000 7ff6b767c640 1 --2- 172.21.15.167:0/1915890885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6b015b440 0x7ff6b013e330 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:56.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.066+0000 7ff6b767c640 1 --2- 172.21.15.167:0/1915890885 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff69c0039e0 0x7ff6b013a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:56.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.066+0000 7ff6b767c640 1 -- 172.21.15.167:0/1915890885 >> 172.21.15.167:0/1915890885 conn(0x7ff6b006c5f0 msgr2=0x7ff6b01464b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:53:56.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.066+0000 7ff6b767c640 1 -- 172.21.15.167:0/1915890885 shutdown_connections 2023-11-27T20:53:56.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.066+0000 7ff6b767c640 1 -- 172.21.15.167:0/1915890885 wait complete. 2023-11-27T20:53:56.082 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 8d1be479-4241-4335-9633-1394311fde76 1 2023-11-27T20:53:56.095 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-27T20:53:56.094+0000 7f5a03c2e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-27T20:53:56.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.181+0000 7f66e62e5640 1 Processor -- start 2023-11-27T20:53:56.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.181+0000 7f66e62e5640 1 -- start start 2023-11-27T20:53:56.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.183+0000 7f66e62e5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66e014ffa0 0x7f66e00c1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:56.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.183+0000 7f66e62e5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f66e0150380 0x7f66e006fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:56.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.183+0000 7f66e62e5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e0157160 con 0x7f66e006ffc0 2023-11-27T20:53:56.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.183+0000 7f66e62e5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e0156270 con 0x7f66e0150380 2023-11-27T20:53:56.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.183+0000 7f66e62e5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e0156550 con 0x7f66e014ffa0 2023-11-27T20:53:56.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.183+0000 7f66dffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66e014ffa0 0x7f66e00c1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:56.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.183+0000 7f66df7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f66e0150380 0x7f66e006fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:56.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.183+0000 7f66dffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66e014ffa0 0x7f66e00c1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:41050/0 (socket says 172.21.15.167:41050) 2023-11-27T20:53:56.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.183+0000 7f66dffff640 1 -- 172.21.15.167:0/1434936071 learned_addr learned my addr 172.21.15.167:0/1434936071 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-27T20:53:56.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.186+0000 7f66dffff640 1 -- 172.21.15.167:0/1434936071 >> v2:172.21.15.88:3300/0 conn(0x7f66e0150380 msgr2=0x7f66e006fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:53:56.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.186+0000 7f66dffff640 1 --2- 172.21.15.167:0/1434936071 >> v2:172.21.15.88:3300/0 conn(0x7f66e0150380 0x7f66e006fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:56.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.186+0000 7f66dffff640 1 -- 172.21.15.167:0/1434936071 >> v1:172.21.15.88:6789/0 conn(0x7f66e006ffc0 legacy=0x7f66e00c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:56.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.186+0000 7f66dffff640 1 -- 172.21.15.167:0/1434936071 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e0156830 con 0x7f66e014ffa0 2023-11-27T20:53:56.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.189+0000 7f66dffff640 1 --2- 172.21.15.167:0/1434936071 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66e014ffa0 0x7f66e00c1900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f66d4009870 tx=0x7f66d402ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af7c2742c1fd21ea server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:53:56.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.225+0000 7f66deffd640 1 -- 172.21.15.167:0/1434936071 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d402f840 con 0x7f66e014ffa0 2023-11-27T20:53:56.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.225+0000 7f66deffd640 1 -- 172.21.15.167:0/1434936071 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d402f9a0 con 0x7f66e014ffa0 2023-11-27T20:53:56.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.225+0000 7f66deffd640 1 -- 172.21.15.167:0/1434936071 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d402fd30 con 0x7f66e014ffa0 2023-11-27T20:53:56.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.226+0000 7f66e62e5640 1 -- 172.21.15.167:0/1434936071 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66e014ffa0 msgr2=0x7f66e00c1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:56.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.226+0000 7f66e62e5640 1 --2- 172.21.15.167:0/1434936071 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66e014ffa0 0x7f66e00c1900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f66d4009870 tx=0x7f66d402ba20 comp rx=0 tx=0).stop 2023-11-27T20:53:56.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.226+0000 7f66e62e5640 1 -- 172.21.15.167:0/1434936071 shutdown_connections 2023-11-27T20:53:56.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.226+0000 7f66e62e5640 1 --2- 172.21.15.167:0/1434936071 >> v2:172.21.15.88:3300/0 conn(0x7f66e0150380 0x7f66e006fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:56.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.226+0000 7f66e62e5640 1 --2- 172.21.15.167:0/1434936071 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66e014ffa0 0x7f66e00c1900 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:56.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.226+0000 7f66e62e5640 1 -- 172.21.15.167:0/1434936071 >> 172.21.15.167:0/1434936071 conn(0x7f66e006b5c0 msgr2=0x7f66e006b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:53:56.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.226+0000 7f66e62e5640 1 -- 172.21.15.167:0/1434936071 shutdown_connections 2023-11-27T20:53:56.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.226+0000 7f66e62e5640 1 -- 172.21.15.167:0/1434936071 wait complete. 2023-11-27T20:53:56.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.227+0000 7f66e62e5640 1 Processor -- start 2023-11-27T20:53:56.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.227+0000 7f66e62e5640 1 -- start start 2023-11-27T20:53:56.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.228+0000 7f66e62e5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66e006ffc0 0x7f66e01e3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:56.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.228+0000 7f66e62e5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66e014ffa0 0x7f66e00c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:56.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.228+0000 7f66e62e5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66e0150380 0x7f66e0146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:56.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.228+0000 7f66e62e5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e01f24b0 con 0x7f66e006ffc0 2023-11-27T20:53:56.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.228+0000 7f66e62e5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e00c34a0 con 0x7f66e0150380 2023-11-27T20:53:56.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.228+0000 7f66e62e5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e006b3d0 con 0x7f66e014ffa0 2023-11-27T20:53:56.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.229+0000 7f66e4882640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66e0150380 0x7f66e0146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:56.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.229+0000 7f66dffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66e006ffc0 0x7f66e01e3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:56.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.229+0000 7f66e4882640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66e0150380 0x7f66e0146450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52724/0 (socket says 172.21.15.167:52724) 2023-11-27T20:53:56.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.229+0000 7f66e4882640 1 -- 172.21.15.167:0/3080266554 learned_addr learned my addr 172.21.15.167:0/3080266554 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-27T20:53:56.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.232+0000 7f66df7fe640 1 --2- 172.21.15.167:0/3080266554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66e014ffa0 0x7f66e00c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:56.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.233+0000 7f66e4882640 1 -- 172.21.15.167:0/3080266554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66e014ffa0 msgr2=0x7f66e00c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:56.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.233+0000 7f66e4882640 1 --2- 172.21.15.167:0/3080266554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66e014ffa0 0x7f66e00c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:56.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.233+0000 7f66e4882640 1 -- 172.21.15.167:0/3080266554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66e006ffc0 msgr2=0x7f66e01e3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:56.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.233+0000 7f66e4882640 1 --2- 172.21.15.167:0/3080266554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66e006ffc0 0x7f66e01e3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:56.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.233+0000 7f66e4882640 1 -- 172.21.15.167:0/3080266554 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d40094d0 con 0x7f66e0150380 2023-11-27T20:53:56.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.235+0000 7f66e4882640 1 --2- 172.21.15.167:0/3080266554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66e0150380 0x7f66e0146450 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f66d800c7a0 tx=0x7f66d800cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:53:56.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.238+0000 7f66dcff9640 1 -- 172.21.15.167:0/3080266554 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d8003b70 con 0x7f66e0150380 2023-11-27T20:53:56.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.239+0000 7f66dcff9640 1 -- 172.21.15.167:0/3080266554 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d8003cf0 con 0x7f66e0150380 2023-11-27T20:53:56.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.239+0000 7f66dcff9640 1 -- 172.21.15.167:0/3080266554 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d8003ea0 con 0x7f66e0150380 2023-11-27T20:53:56.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.239+0000 7f66e62e5640 1 -- 172.21.15.167:0/3080266554 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e0154d80 con 0x7f66e0150380 2023-11-27T20:53:56.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.239+0000 7f66e62e5640 1 -- 172.21.15.167:0/3080266554 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e00cb470 con 0x7f66e0150380 2023-11-27T20:53:56.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.240+0000 7f66e62e5640 1 -- 172.21.15.167:0/3080266554 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e0073dc0 con 0x7f66e0150380 2023-11-27T20:53:56.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.241+0000 7f66dcff9640 1 -- 172.21.15.167:0/3080266554 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f66d80050d0 con 0x7f66e0150380 2023-11-27T20:53:56.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.242+0000 7f66dcff9640 1 -- 172.21.15.167:0/3080266554 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f66d8025740 con 0x7f66e0150380 2023-11-27T20:53:56.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.341+0000 7f66dcff9640 1 -- 172.21.15.167:0/3080266554 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f66e0157160 con 0x7f66e0150380 2023-11-27T20:53:56.369 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T20:53:56.367+0000 7f9c3ee2e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-27T20:53:56.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.414+0000 7f66e62e5640 1 -- 172.21.15.167:0/3080266554 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8d1be479-4241-4335-9633-1394311fde76", "id": 1} v 0) v1 -- 0x7f66e00c19c0 con 0x7f66e0150380 2023-11-27T20:53:56.498 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-27T20:53:56.497+0000 7f5a03c2e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-27T20:53:56.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.502+0000 7f66dcff9640 1 -- 172.21.15.167:0/3080266554 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8d1be479-4241-4335-9633-1394311fde76", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f66d80054c0 con 0x7f66e0150380 2023-11-27T20:53:56.503 INFO:teuthology.orchestra.run.smithi167.stdout:1 2023-11-27T20:53:56.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.503+0000 7f66e62e5640 1 -- 172.21.15.167:0/3080266554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66e0150380 msgr2=0x7f66e0146450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:56.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.503+0000 7f66e62e5640 1 --2- 172.21.15.167:0/3080266554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66e0150380 0x7f66e0146450 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f66d800c7a0 tx=0x7f66d800cc60 comp rx=0 tx=0).stop 2023-11-27T20:53:56.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.503+0000 7f66e62e5640 1 -- 172.21.15.167:0/3080266554 shutdown_connections 2023-11-27T20:53:56.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.503+0000 7f66e62e5640 1 --2- 172.21.15.167:0/3080266554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66e0150380 0x7f66e0146450 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:56.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.503+0000 7f66e62e5640 1 --2- 172.21.15.167:0/3080266554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66e014ffa0 0x7f66e00c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:56.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.503+0000 7f66e62e5640 1 --2- 172.21.15.167:0/3080266554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66e006ffc0 0x7f66e01e3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:56.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.503+0000 7f66e62e5640 1 -- 172.21.15.167:0/3080266554 >> 172.21.15.167:0/3080266554 conn(0x7f66e006b5c0 msgr2=0x7f66e00c70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:53:56.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.503+0000 7f66e62e5640 1 -- 172.21.15.167:0/3080266554 shutdown_connections 2023-11-27T20:53:56.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.503+0000 7f66e62e5640 1 -- 172.21.15.167:0/3080266554 wait complete. 2023-11-27T20:53:56.506 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T20:53:56.503+0000 7f9c3ee2e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-27T20:53:56.515 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 7536b008-05dd-40eb-9d4a-bdac4b1c38c8 2 2023-11-27T20:53:56.627 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T20:53:56.624+0000 7f9c3ee2e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-27T20:53:56.639 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-27T20:53:56.638+0000 7f5a03c2e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-27T20:53:56.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.655+0000 7f46ad4c6640 1 Processor -- start 2023-11-27T20:53:56.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.655+0000 7f46ad4c6640 1 -- start start 2023-11-27T20:53:56.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.656+0000 7f46ad4c6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46a80c9620 0x7f46a80c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:56.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.656+0000 7f46ad4c6640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a80cbda0 con 0x7f46a80cc420 2023-11-27T20:53:56.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.656+0000 7f46ad4c6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a80cea60 con 0x7f46a80cda70 2023-11-27T20:53:56.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.656+0000 7f46ad4c6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a80cc230 con 0x7f46a80c9620 2023-11-27T20:53:56.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.656+0000 7f46a77fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46a80c9620 0x7f46a80c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:56.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.656+0000 7f46a6ffd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f46a80cda70 0x7f46a80ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:39852/0 (socket says 172.21.15.167:39852) 2023-11-27T20:53:56.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.656+0000 7f46a67fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f46a80cc420 0x7f46a8159610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.167:48644/0 (socket says 172.21.15.167:48644) 2023-11-27T20:53:56.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.656+0000 7f46a6ffd640 1 -- 172.21.15.167:0/2005801018 learned_addr learned my addr 172.21.15.167:0/2005801018 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-27T20:53:56.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.659+0000 7f46a5ffb640 1 -- 172.21.15.167:0/2005801018 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 867500097 0 0) 0x7f46a80cbda0 con 0x7f46a80cc420 2023-11-27T20:53:56.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.659+0000 7f46a5ffb640 1 -- 172.21.15.167:0/2005801018 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4690003520 con 0x7f46a80cc420 2023-11-27T20:53:56.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.659+0000 7f46a77fe640 1 -- 172.21.15.167:0/2005801018 >> v1:172.21.15.167:6789/0 conn(0x7f46a80cda70 legacy=0x7f46a80ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:56.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.659+0000 7f46a77fe640 1 -- 172.21.15.167:0/2005801018 >> v1:172.21.15.88:6789/0 conn(0x7f46a80cc420 legacy=0x7f46a8159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:56.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.659+0000 7f46a77fe640 1 -- 172.21.15.167:0/2005801018 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a80cb4e0 con 0x7f46a80c9620 2023-11-27T20:53:56.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.662+0000 7f46a77fe640 1 --2- 172.21.15.167:0/2005801018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46a80c9620 0x7f46a80c9a70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f46a0009dc0 tx=0x7f46a002bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51c7c4e5dd81f6f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:53:56.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.666+0000 7f46a5ffb640 1 -- 172.21.15.167:0/2005801018 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a002cd50 con 0x7f46a80c9620 2023-11-27T20:53:56.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.666+0000 7f46a5ffb640 1 -- 172.21.15.167:0/2005801018 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a0034440 con 0x7f46a80c9620 2023-11-27T20:53:56.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.666+0000 7f46a5ffb640 1 -- 172.21.15.167:0/2005801018 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a00347d0 con 0x7f46a80c9620 2023-11-27T20:53:56.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.667+0000 7f46ad4c6640 1 -- 172.21.15.167:0/2005801018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46a80c9620 msgr2=0x7f46a80c9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:56.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.667+0000 7f46ad4c6640 1 --2- 172.21.15.167:0/2005801018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46a80c9620 0x7f46a80c9a70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f46a0009dc0 tx=0x7f46a002bfa0 comp rx=0 tx=0).stop 2023-11-27T20:53:56.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.667+0000 7f46ad4c6640 1 -- 172.21.15.167:0/2005801018 shutdown_connections 2023-11-27T20:53:56.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.667+0000 7f46ad4c6640 1 --2- 172.21.15.167:0/2005801018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46a80c9620 0x7f46a80c9a70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:56.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.667+0000 7f46ad4c6640 1 -- 172.21.15.167:0/2005801018 >> 172.21.15.167:0/2005801018 conn(0x7f46a80b07b0 msgr2=0x7f46a80b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:53:56.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.667+0000 7f46ad4c6640 1 -- 172.21.15.167:0/2005801018 shutdown_connections 2023-11-27T20:53:56.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.667+0000 7f46ad4c6640 1 -- 172.21.15.167:0/2005801018 wait complete. 2023-11-27T20:53:56.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.668+0000 7f46ad4c6640 1 Processor -- start 2023-11-27T20:53:56.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.668+0000 7f46ad4c6640 1 -- start start 2023-11-27T20:53:56.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.669+0000 7f46ad4c6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46a80c9620 0x7f46a8156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:56.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.669+0000 7f46ad4c6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46a80cc420 0x7f46a8159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:56.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.669+0000 7f46ad4c6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46a80cda70 0x7f46a80b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:56.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.669+0000 7f46ad4c6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a8156040 con 0x7f46a80c9620 2023-11-27T20:53:56.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.669+0000 7f46ad4c6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a8156940 con 0x7f46a80cda70 2023-11-27T20:53:56.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.669+0000 7f46ad4c6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a8154f70 con 0x7f46a80cc420 2023-11-27T20:53:56.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.669+0000 7f46a67fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46a80cc420 0x7f46a8159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:56.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.669+0000 7f46a6ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46a80c9620 0x7f46a8156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:56.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.669+0000 7f46a77fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46a80cda70 0x7f46a80b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:56.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.670+0000 7f46a67fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46a80cc420 0x7f46a8159890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:41070/0 (socket says 172.21.15.167:41070) 2023-11-27T20:53:56.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.670+0000 7f46a67fc640 1 -- 172.21.15.167:0/4147614934 learned_addr learned my addr 172.21.15.167:0/4147614934 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-27T20:53:56.672 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T20:53:56.670+0000 7f9c3ee2e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-27T20:53:56.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.673+0000 7f46a6ffd640 1 -- 172.21.15.167:0/4147614934 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46a80cc420 msgr2=0x7f46a8159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:56.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.673+0000 7f46a6ffd640 1 --2- 172.21.15.167:0/4147614934 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46a80cc420 0x7f46a8159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:56.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.673+0000 7f46a6ffd640 1 -- 172.21.15.167:0/4147614934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46a80cda70 msgr2=0x7f46a80b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:56.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.673+0000 7f46a6ffd640 1 --2- 172.21.15.167:0/4147614934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46a80cda70 0x7f46a80b2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:56.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.673+0000 7f46a6ffd640 1 -- 172.21.15.167:0/4147614934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a0009a70 con 0x7f46a80c9620 2023-11-27T20:53:56.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.675+0000 7f46a6ffd640 1 --2- 172.21.15.167:0/4147614934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46a80c9620 0x7f46a8156c00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f469c00c440 tx=0x7f469c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:53:56.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.679+0000 7f468f7fe640 1 -- 172.21.15.167:0/4147614934 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c005ce0 con 0x7f46a80c9620 2023-11-27T20:53:56.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.679+0000 7f468f7fe640 1 -- 172.21.15.167:0/4147614934 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c005e40 con 0x7f46a80c9620 2023-11-27T20:53:56.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.679+0000 7f46ad4c6640 1 -- 172.21.15.167:0/4147614934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a80b2670 con 0x7f46a80c9620 2023-11-27T20:53:56.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.679+0000 7f468f7fe640 1 -- 172.21.15.167:0/4147614934 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c0072f0 con 0x7f46a80c9620 2023-11-27T20:53:56.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.679+0000 7f46ad4c6640 1 -- 172.21.15.167:0/4147614934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a8154920 con 0x7f46a80c9620 2023-11-27T20:53:56.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.680+0000 7f46ad4c6640 1 -- 172.21.15.167:0/4147614934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a8067470 con 0x7f46a80c9620 2023-11-27T20:53:56.759 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-27T20:53:56.757+0000 7f5a03c2e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-27T20:53:56.774 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T20:53:56.771+0000 7f9c3ee2e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-27T20:53:56.803 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-27T20:53:56.802+0000 7f5a03c2e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-27T20:53:56.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.809+0000 7f468f7fe640 1 -- 172.21.15.167:0/4147614934 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f469c01c440 con 0x7f46a80c9620 2023-11-27T20:53:56.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.815+0000 7f468f7fe640 1 -- 172.21.15.167:0/4147614934 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f469c01b7d0 con 0x7f46a80c9620 2023-11-27T20:53:56.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.815+0000 7f468f7fe640 1 -- 172.21.15.167:0/4147614934 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f469c017070 con 0x7f46a80c9620 2023-11-27T20:53:56.872 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T20:53:56.870+0000 7f9c3ee2e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-27T20:53:56.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.890+0000 7f46ad4c6640 1 -- 172.21.15.167:0/4147614934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7536b008-05dd-40eb-9d4a-bdac4b1c38c8", "id": 2} v 0) v1 -- 0x7f46a80b4c20 con 0x7f46a80c9620 2023-11-27T20:53:56.914 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-27T20:53:56.913+0000 7f5a03c2e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-27T20:53:56.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.920+0000 7f468f7fe640 1 -- 172.21.15.167:0/4147614934 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7536b008-05dd-40eb-9d4a-bdac4b1c38c8", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f469c01b4e0 con 0x7f46a80c9620 2023-11-27T20:53:56.921 INFO:teuthology.orchestra.run.smithi167.stdout:2 2023-11-27T20:53:56.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.921+0000 7f46ad4c6640 1 -- 172.21.15.167:0/4147614934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46a80c9620 msgr2=0x7f46a8156c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:56.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.921+0000 7f46ad4c6640 1 --2- 172.21.15.167:0/4147614934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46a80c9620 0x7f46a8156c00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f469c00c440 tx=0x7f469c00c900 comp rx=0 tx=0).stop 2023-11-27T20:53:56.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.921+0000 7f46ad4c6640 1 -- 172.21.15.167:0/4147614934 shutdown_connections 2023-11-27T20:53:56.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.921+0000 7f46ad4c6640 1 --2- 172.21.15.167:0/4147614934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46a80cda70 0x7f46a80b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:56.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.921+0000 7f46ad4c6640 1 --2- 172.21.15.167:0/4147614934 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46a80cc420 0x7f46a8159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:56.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.921+0000 7f46ad4c6640 1 --2- 172.21.15.167:0/4147614934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46a80c9620 0x7f46a8156c00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:56.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.921+0000 7f46ad4c6640 1 -- 172.21.15.167:0/4147614934 >> 172.21.15.167:0/4147614934 conn(0x7f46a80b07b0 msgr2=0x7f46a80aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:53:56.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.921+0000 7f46ad4c6640 1 -- 172.21.15.167:0/4147614934 shutdown_connections 2023-11-27T20:53:56.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:56.921+0000 7f46ad4c6640 1 -- 172.21.15.167:0/4147614934 wait complete. 2023-11-27T20:53:56.934 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 47edd4d7-e99c-4ce3-851b-cc9c8e2d4480 3 2023-11-27T20:53:57.015 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T20:53:57.013+0000 7f9c3ee2e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-27T20:53:57.018 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-27T20:53:57.016+0000 7f5a03c2e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-27T20:53:57.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.035+0000 7f75c3f73640 1 Processor -- start 2023-11-27T20:53:57.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.035+0000 7f75c3f73640 1 -- start start 2023-11-27T20:53:57.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.036+0000 7f75c3f73640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f75bc06f1d0 0x7f75bc0723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:57.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.036+0000 7f75c3f73640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75bc0c8370 0x7f75bc0c8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:57.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.036+0000 7f75c3f73640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75bc06fe60 con 0x7f75bc153620 2023-11-27T20:53:57.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.036+0000 7f75c3f73640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75bc0c8d40 con 0x7f75bc06f1d0 2023-11-27T20:53:57.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.036+0000 7f75c3f73640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc0c2e00 con 0x7f75bc0c8370 2023-11-27T20:53:57.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.036+0000 7f75c2510640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75bc0c8370 0x7f75bc0c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:57.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.036+0000 7f75c150e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f75bc06f1d0 0x7f75bc0723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:57.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.036+0000 7f75c2510640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75bc0c8370 0x7f75bc0c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:41080/0 (socket says 172.21.15.167:41080) 2023-11-27T20:53:57.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.036+0000 7f75c2510640 1 -- 172.21.15.167:0/1592618221 learned_addr learned my addr 172.21.15.167:0/1592618221 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-27T20:53:57.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.039+0000 7f75c2510640 1 -- 172.21.15.167:0/1592618221 >> v2:172.21.15.167:3300/0 conn(0x7f75bc06f1d0 msgr2=0x7f75bc0723f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:53:57.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.039+0000 7f75c2510640 1 --2- 172.21.15.167:0/1592618221 >> v2:172.21.15.167:3300/0 conn(0x7f75bc06f1d0 0x7f75bc0723f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:57.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.039+0000 7f75c2510640 1 -- 172.21.15.167:0/1592618221 >> v1:172.21.15.167:6789/0 conn(0x7f75bc153620 legacy=0x7f75bc159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:53:57.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.039+0000 7f75c2510640 1 -- 172.21.15.167:0/1592618221 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc1597d0 con 0x7f75bc0c8370 2023-11-27T20:53:57.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.041+0000 7f75c2510640 1 --2- 172.21.15.167:0/1592618221 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75bc0c8370 0x7f75bc0c8800 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009e50 tx=0x7f75b402be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f407f0bb1a7f1381 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:53:57.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.044+0000 7f75c0d0d640 1 -- 172.21.15.167:0/1592618221 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b402c9e0 con 0x7f75bc0c8370 2023-11-27T20:53:57.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.044+0000 7f75c0d0d640 1 -- 172.21.15.167:0/1592618221 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b402cb40 con 0x7f75bc0c8370 2023-11-27T20:53:57.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.044+0000 7f75c0d0d640 1 -- 172.21.15.167:0/1592618221 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b40343f0 con 0x7f75bc0c8370 2023-11-27T20:53:57.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.045+0000 7f75c3f73640 1 -- 172.21.15.167:0/1592618221 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75bc0c8370 msgr2=0x7f75bc0c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:57.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.045+0000 7f75c3f73640 1 --2- 172.21.15.167:0/1592618221 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75bc0c8370 0x7f75bc0c8800 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009e50 tx=0x7f75b402be40 comp rx=0 tx=0).stop 2023-11-27T20:53:57.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.045+0000 7f75c3f73640 1 -- 172.21.15.167:0/1592618221 shutdown_connections 2023-11-27T20:53:57.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.045+0000 7f75c3f73640 1 --2- 172.21.15.167:0/1592618221 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75bc0c8370 0x7f75bc0c8800 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:57.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.045+0000 7f75c3f73640 1 --2- 172.21.15.167:0/1592618221 >> v2:172.21.15.167:3300/0 conn(0x7f75bc06f1d0 0x7f75bc0723f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:57.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.045+0000 7f75c3f73640 1 -- 172.21.15.167:0/1592618221 >> 172.21.15.167:0/1592618221 conn(0x7f75bc06b5c0 msgr2=0x7f75bc06b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:53:57.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.045+0000 7f75c3f73640 1 -- 172.21.15.167:0/1592618221 shutdown_connections 2023-11-27T20:53:57.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.045+0000 7f75c3f73640 1 -- 172.21.15.167:0/1592618221 wait complete. 2023-11-27T20:53:57.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.046+0000 7f75c3f73640 1 Processor -- start 2023-11-27T20:53:57.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.046+0000 7f75c3f73640 1 -- start start 2023-11-27T20:53:57.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.047+0000 7f75c3f73640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75bc06f1d0 0x7f75bc0cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:57.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.047+0000 7f75c3f73640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75bc0c8370 0x7f75bc1ef6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:57.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.047+0000 7f75c3f73640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75bc153620 0x7f75bc14c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:57.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.047+0000 7f75c3f73640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc0c9970 con 0x7f75bc06f1d0 2023-11-27T20:53:57.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.047+0000 7f75c3f73640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc14efa0 con 0x7f75bc153620 2023-11-27T20:53:57.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.047+0000 7f75c3f73640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc1efc20 con 0x7f75bc0c8370 2023-11-27T20:53:57.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.048+0000 7f75c150e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75bc0c8370 0x7f75bc1ef6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:57.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.048+0000 7f75c2510640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75bc153620 0x7f75bc14c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:57.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.048+0000 7f75c1d0f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75bc06f1d0 0x7f75bc0cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:57.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.048+0000 7f75c150e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75bc0c8370 0x7f75bc1ef6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:41092/0 (socket says 172.21.15.167:41092) 2023-11-27T20:53:57.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.048+0000 7f75c150e640 1 -- 172.21.15.167:0/2650765818 learned_addr learned my addr 172.21.15.167:0/2650765818 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-27T20:53:57.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.051+0000 7f75c150e640 1 -- 172.21.15.167:0/2650765818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75bc153620 msgr2=0x7f75bc14c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:57.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.051+0000 7f75c150e640 1 --2- 172.21.15.167:0/2650765818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75bc153620 0x7f75bc14c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:57.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.051+0000 7f75c150e640 1 -- 172.21.15.167:0/2650765818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75bc06f1d0 msgr2=0x7f75bc0cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:57.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.051+0000 7f75c150e640 1 --2- 172.21.15.167:0/2650765818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75bc06f1d0 0x7f75bc0cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:57.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.051+0000 7f75c150e640 1 -- 172.21.15.167:0/2650765818 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b4009b30 con 0x7f75bc0c8370 2023-11-27T20:53:57.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.053+0000 7f75c150e640 1 --2- 172.21.15.167:0/2650765818 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75bc0c8370 0x7f75bc1ef6e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00d800 tx=0x7f75ac00dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:53:57.058 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T20:53:57.056+0000 7f9c3ee2e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-27T20:53:57.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.057+0000 7f75b27fc640 1 -- 172.21.15.167:0/2650765818 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac00b6c0 con 0x7f75bc0c8370 2023-11-27T20:53:57.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.057+0000 7f75b27fc640 1 -- 172.21.15.167:0/2650765818 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ac00b820 con 0x7f75bc0c8370 2023-11-27T20:53:57.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.057+0000 7f75c3f73640 1 -- 172.21.15.167:0/2650765818 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75bc0ca160 con 0x7f75bc0c8370 2023-11-27T20:53:57.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.057+0000 7f75b27fc640 1 -- 172.21.15.167:0/2650765818 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac00bbb0 con 0x7f75bc0c8370 2023-11-27T20:53:57.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.058+0000 7f75c3f73640 1 -- 172.21.15.167:0/2650765818 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75bc0c9e80 con 0x7f75bc0c8370 2023-11-27T20:53:57.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.059+0000 7f75c3f73640 1 -- 172.21.15.167:0/2650765818 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75bc073dc0 con 0x7f75bc0c8370 2023-11-27T20:53:57.168 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-27T20:53:57.167+0000 7f5a03c2e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-27T20:53:57.198 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T20:53:57.195+0000 7f9c3ee2e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-27T20:53:57.211 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-27T20:53:57.210+0000 7f5a03c2e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-27T20:53:57.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.258+0000 7f75b27fc640 1 -- 172.21.15.167:0/2650765818 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f75ac01e7e0 con 0x7f75bc0c8370 2023-11-27T20:53:57.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.258+0000 7f75b27fc640 1 -- 172.21.15.167:0/2650765818 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f75ac028da0 con 0x7f75bc0c8370 2023-11-27T20:53:57.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.259+0000 7f75b27fc640 1 -- 172.21.15.167:0/2650765818 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f75ac014430 con 0x7f75bc0c8370 2023-11-27T20:53:57.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.331+0000 7f75c3f73640 1 -- 172.21.15.167:0/2650765818 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd new", "uuid": "47edd4d7-e99c-4ce3-851b-cc9c8e2d4480", "id": 3} v 0) v1 -- 0x7f75bc0cb6e0 con 0x7f75bc0c8370 2023-11-27T20:53:57.358 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-27T20:53:57.357+0000 7f5a03c2e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-27T20:53:57.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.447+0000 7f75b27fc640 1 -- 172.21.15.167:0/2650765818 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "47edd4d7-e99c-4ce3-851b-cc9c8e2d4480", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f75ac00bd10 con 0x7f75bc0c8370 2023-11-27T20:53:57.449 INFO:teuthology.orchestra.run.smithi167.stdout:3 2023-11-27T20:53:57.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.448+0000 7f75c3f73640 1 -- 172.21.15.167:0/2650765818 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75bc0c8370 msgr2=0x7f75bc1ef6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:57.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.448+0000 7f75c3f73640 1 --2- 172.21.15.167:0/2650765818 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75bc0c8370 0x7f75bc1ef6e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00d800 tx=0x7f75ac00dcc0 comp rx=0 tx=0).stop 2023-11-27T20:53:57.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.448+0000 7f75c3f73640 1 -- 172.21.15.167:0/2650765818 shutdown_connections 2023-11-27T20:53:57.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.448+0000 7f75c3f73640 1 --2- 172.21.15.167:0/2650765818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75bc153620 0x7f75bc14c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:57.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.448+0000 7f75c3f73640 1 --2- 172.21.15.167:0/2650765818 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75bc0c8370 0x7f75bc1ef6e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:57.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.448+0000 7f75c3f73640 1 --2- 172.21.15.167:0/2650765818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75bc06f1d0 0x7f75bc0cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:57.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.448+0000 7f75c3f73640 1 -- 172.21.15.167:0/2650765818 >> 172.21.15.167:0/2650765818 conn(0x7f75bc06b5c0 msgr2=0x7f75bc159c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:53:57.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.448+0000 7f75c3f73640 1 -- 172.21.15.167:0/2650765818 shutdown_connections 2023-11-27T20:53:57.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.449+0000 7f75c3f73640 1 -- 172.21.15.167:0/2650765818 wait complete. 2023-11-27T20:53:57.460 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 0a81dd31-1a8b-41af-b933-d74aae63f3e8 4 2023-11-27T20:53:57.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.559+0000 7f78eb568640 1 Processor -- start 2023-11-27T20:53:57.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.559+0000 7f78eb568640 1 -- start start 2023-11-27T20:53:57.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.560+0000 7f78eb568640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f78e40ca890 0x7f78e415cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:57.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.560+0000 7f78eb568640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78e4159520 con 0x7f78e40cc150 2023-11-27T20:53:57.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.560+0000 7f78eb568640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78e4159780 con 0x7f78e40cbd70 2023-11-27T20:53:57.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.560+0000 7f78eb568640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e415a390 con 0x7f78e40ca890 2023-11-27T20:53:57.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.560+0000 7f78e9b05640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f78e40ca890 0x7f78e415cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:57.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.560+0000 7f78e9304640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f78e40cbd70 0x7f78e406fa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:39868/0 (socket says 172.21.15.167:39868) 2023-11-27T20:53:57.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.560+0000 7f78e9304640 1 -- 172.21.15.167:0/1707414062 learned_addr learned my addr 172.21.15.167:0/1707414062 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-27T20:53:57.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.563+0000 7f78e9b05640 1 -- 172.21.15.167:0/1707414062 >> v1:172.21.15.167:6789/0 conn(0x7f78e40cbd70 legacy=0x7f78e406fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:57.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.563+0000 7f78e9b05640 1 -- 172.21.15.167:0/1707414062 >> v1:172.21.15.88:6789/0 conn(0x7f78e40cc150 legacy=0x7f78e4153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:57.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.563+0000 7f78dbfff640 1 -- 172.21.15.167:0/1707414062 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604297913 0 0) 0x7f78e4159520 con 0x7f78e40cc150 2023-11-27T20:53:57.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.563+0000 7f78e9b05640 1 -- 172.21.15.167:0/1707414062 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e4159a60 con 0x7f78e40ca890 2023-11-27T20:53:57.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.565+0000 7f78e9b05640 1 --2- 172.21.15.167:0/1707414062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f78e40ca890 0x7f78e415cc70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009dc0 tx=0x7f78dc02bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=302d82fd37310f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:53:57.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.568+0000 7f78dbfff640 1 -- 172.21.15.167:0/1707414062 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc02cd50 con 0x7f78e40ca890 2023-11-27T20:53:57.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.568+0000 7f78dbfff640 1 -- 172.21.15.167:0/1707414062 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78dc034440 con 0x7f78e40ca890 2023-11-27T20:53:57.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.568+0000 7f78dbfff640 1 -- 172.21.15.167:0/1707414062 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc0347d0 con 0x7f78e40ca890 2023-11-27T20:53:57.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.569+0000 7f78eb568640 1 -- 172.21.15.167:0/1707414062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f78e40ca890 msgr2=0x7f78e415cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:57.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.569+0000 7f78eb568640 1 --2- 172.21.15.167:0/1707414062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f78e40ca890 0x7f78e415cc70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009dc0 tx=0x7f78dc02bfa0 comp rx=0 tx=0).stop 2023-11-27T20:53:57.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.569+0000 7f78eb568640 1 -- 172.21.15.167:0/1707414062 shutdown_connections 2023-11-27T20:53:57.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.569+0000 7f78eb568640 1 --2- 172.21.15.167:0/1707414062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f78e40ca890 0x7f78e415cc70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:57.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.569+0000 7f78eb568640 1 -- 172.21.15.167:0/1707414062 >> 172.21.15.167:0/1707414062 conn(0x7f78e4061370 msgr2=0x7f78e4061780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:53:57.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.569+0000 7f78eb568640 1 -- 172.21.15.167:0/1707414062 shutdown_connections 2023-11-27T20:53:57.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.569+0000 7f78eb568640 1 -- 172.21.15.167:0/1707414062 wait complete. 2023-11-27T20:53:57.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.570+0000 7f78eb568640 1 Processor -- start 2023-11-27T20:53:57.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.570+0000 7f78eb568640 1 -- start start 2023-11-27T20:53:57.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.571+0000 7f78eb568640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f78e40ca890 0x7f78e41eee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:57.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.571+0000 7f78eb568640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78e40cbd70 0x7f78e40c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:57.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.571+0000 7f78eb568640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78e40cc150 0x7f78e4151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:57.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.571+0000 7f78eb568640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e41e2bb0 con 0x7f78e40cc150 2023-11-27T20:53:57.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.571+0000 7f78eb568640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e40c4eb0 con 0x7f78e40cbd70 2023-11-27T20:53:57.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.571+0000 7f78eb568640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e40c5190 con 0x7f78e40ca890 2023-11-27T20:53:57.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.572+0000 7f78e9304640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f78e40ca890 0x7f78e41eee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:57.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.572+0000 7f78e8b03640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78e40cbd70 0x7f78e40c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:57.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.572+0000 7f78e9304640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f78e40ca890 0x7f78e41eee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:41106/0 (socket says 172.21.15.167:41106) 2023-11-27T20:53:57.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.572+0000 7f78e9b05640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78e40cc150 0x7f78e4151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:57.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.572+0000 7f78e9304640 1 -- 172.21.15.167:0/4041107283 learned_addr learned my addr 172.21.15.167:0/4041107283 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-27T20:53:57.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.575+0000 7f78e9304640 1 -- 172.21.15.167:0/4041107283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78e40cbd70 msgr2=0x7f78e40c6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:57.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.575+0000 7f78e9304640 1 --2- 172.21.15.167:0/4041107283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78e40cbd70 0x7f78e40c6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:57.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.575+0000 7f78e9304640 1 -- 172.21.15.167:0/4041107283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78e40cc150 msgr2=0x7f78e4151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:57.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.575+0000 7f78e9304640 1 --2- 172.21.15.167:0/4041107283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78e40cc150 0x7f78e4151f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:57.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.575+0000 7f78e9304640 1 -- 172.21.15.167:0/4041107283 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78dc009a70 con 0x7f78e40ca890 2023-11-27T20:53:57.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.578+0000 7f78e9304640 1 --2- 172.21.15.167:0/4041107283 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f78e40ca890 0x7f78e41eee00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f78e000c450 tx=0x7f78e000c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:53:57.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.581+0000 7f78d9ffb640 1 -- 172.21.15.167:0/4041107283 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e0005ce0 con 0x7f78e40ca890 2023-11-27T20:53:57.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.582+0000 7f78d9ffb640 1 -- 172.21.15.167:0/4041107283 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e0005e40 con 0x7f78e40ca890 2023-11-27T20:53:57.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.582+0000 7f78eb568640 1 -- 172.21.15.167:0/4041107283 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e40c5470 con 0x7f78e40ca890 2023-11-27T20:53:57.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.582+0000 7f78d9ffb640 1 -- 172.21.15.167:0/4041107283 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e00072b0 con 0x7f78e40ca890 2023-11-27T20:53:57.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.582+0000 7f78eb568640 1 -- 172.21.15.167:0/4041107283 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e40c5a30 con 0x7f78e40ca890 2023-11-27T20:53:57.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.583+0000 7f78eb568640 1 -- 172.21.15.167:0/4041107283 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e4073dc0 con 0x7f78e40ca890 2023-11-27T20:53:57.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.687+0000 7f78d9ffb640 1 -- 172.21.15.167:0/4041107283 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f78e001c440 con 0x7f78e40ca890 2023-11-27T20:53:57.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.687+0000 7f78d9ffb640 1 -- 172.21.15.167:0/4041107283 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f78e001b8c0 con 0x7f78e40ca890 2023-11-27T20:53:57.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.687+0000 7f78d9ffb640 1 -- 172.21.15.167:0/4041107283 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f78e0017070 con 0x7f78e40ca890 2023-11-27T20:53:57.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.759+0000 7f78eb568640 1 -- 172.21.15.167:0/4041107283 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0a81dd31-1a8b-41af-b933-d74aae63f3e8", "id": 4} v 0) v1 -- 0x7f78e4158fa0 con 0x7f78e40ca890 2023-11-27T20:53:57.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.819+0000 7f78d9ffb640 1 -- 172.21.15.167:0/4041107283 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0a81dd31-1a8b-41af-b933-d74aae63f3e8", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f78e001bbd0 con 0x7f78e40ca890 2023-11-27T20:53:57.820 INFO:teuthology.orchestra.run.smithi167.stdout:4 2023-11-27T20:53:57.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.820+0000 7f78eb568640 1 -- 172.21.15.167:0/4041107283 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f78e40ca890 msgr2=0x7f78e41eee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:57.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.820+0000 7f78eb568640 1 --2- 172.21.15.167:0/4041107283 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f78e40ca890 0x7f78e41eee00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f78e000c450 tx=0x7f78e000c910 comp rx=0 tx=0).stop 2023-11-27T20:53:57.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.820+0000 7f78eb568640 1 -- 172.21.15.167:0/4041107283 shutdown_connections 2023-11-27T20:53:57.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.820+0000 7f78eb568640 1 --2- 172.21.15.167:0/4041107283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78e40cc150 0x7f78e4151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:57.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.820+0000 7f78eb568640 1 --2- 172.21.15.167:0/4041107283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78e40cbd70 0x7f78e40c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:57.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.820+0000 7f78eb568640 1 --2- 172.21.15.167:0/4041107283 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f78e40ca890 0x7f78e41eee00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:57.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.820+0000 7f78eb568640 1 -- 172.21.15.167:0/4041107283 >> 172.21.15.167:0/4041107283 conn(0x7f78e4061370 msgr2=0x7f78e41577e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:53:57.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.820+0000 7f78eb568640 1 -- 172.21.15.167:0/4041107283 shutdown_connections 2023-11-27T20:53:57.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.820+0000 7f78eb568640 1 -- 172.21.15.167:0/4041107283 wait complete. 2023-11-27T20:53:57.833 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 1c462d0d-3361-48b3-a82a-86a920539e7a 5 2023-11-27T20:53:57.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.935+0000 7f9c8a541640 1 Processor -- start 2023-11-27T20:53:57.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.935+0000 7f9c8a541640 1 -- start start 2023-11-27T20:53:57.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.936+0000 7f9c8a541640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9c8406a720 0x7f9c84072430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:57.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.936+0000 7f9c8a541640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c8406b3f0 con 0x7f9c8406ab00 2023-11-27T20:53:57.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.936+0000 7f9c8a541640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c8415a350 con 0x7f9c840c4230 2023-11-27T20:53:57.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.936+0000 7f9c8a541640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c8415d700 con 0x7f9c8406a720 2023-11-27T20:53:57.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.937+0000 7f9c83fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9c8406a720 0x7f9c84072430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:57.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.937+0000 7f9c837fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9c8406ab00 0x7f9c84153320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.167:48660/0 (socket says 172.21.15.167:48660) 2023-11-27T20:53:57.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.937+0000 7f9c837fe640 1 -- 172.21.15.167:0/3960499445 learned_addr learned my addr 172.21.15.167:0/3960499445 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-27T20:53:57.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.939+0000 7f9c82ffd640 1 -- 172.21.15.167:0/3960499445 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3060556498 0 0) 0x7f9c78001110 con 0x7f9c8406ab00 2023-11-27T20:53:57.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.939+0000 7f9c82ffd640 1 -- 172.21.15.167:0/3960499445 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c6c003520 con 0x7f9c8406ab00 2023-11-27T20:53:57.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.940+0000 7f9c83fff640 1 -- 172.21.15.167:0/3960499445 >> v1:172.21.15.167:6789/0 conn(0x7f9c840c4230 legacy=0x7f9c84163e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:53:57.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.940+0000 7f9c83fff640 1 -- 172.21.15.167:0/3960499445 >> v1:172.21.15.88:6789/0 conn(0x7f9c8406ab00 legacy=0x7f9c84153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:57.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.940+0000 7f9c83fff640 1 -- 172.21.15.167:0/3960499445 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8415ca80 con 0x7f9c8406a720 2023-11-27T20:53:57.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.942+0000 7f9c83fff640 1 --2- 172.21.15.167:0/3960499445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c8406a720 0x7f9c84072430 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9c740097a0 tx=0x7f9c7402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cff886cfcad6cdf1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:53:57.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.946+0000 7f9c82ffd640 1 -- 172.21.15.167:0/3960499445 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c74030610 con 0x7f9c8406a720 2023-11-27T20:53:57.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.946+0000 7f9c82ffd640 1 -- 172.21.15.167:0/3960499445 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c74030770 con 0x7f9c8406a720 2023-11-27T20:53:57.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.946+0000 7f9c82ffd640 1 -- 172.21.15.167:0/3960499445 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c74030b00 con 0x7f9c8406a720 2023-11-27T20:53:57.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.947+0000 7f9c8a541640 1 -- 172.21.15.167:0/3960499445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c8406a720 msgr2=0x7f9c84072430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:57.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.947+0000 7f9c8a541640 1 --2- 172.21.15.167:0/3960499445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c8406a720 0x7f9c84072430 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9c740097a0 tx=0x7f9c7402b960 comp rx=0 tx=0).stop 2023-11-27T20:53:57.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.947+0000 7f9c8a541640 1 -- 172.21.15.167:0/3960499445 shutdown_connections 2023-11-27T20:53:57.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.947+0000 7f9c8a541640 1 --2- 172.21.15.167:0/3960499445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c8406a720 0x7f9c84072430 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:57.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.947+0000 7f9c8a541640 1 -- 172.21.15.167:0/3960499445 >> 172.21.15.167:0/3960499445 conn(0x7f9c8406b5c0 msgr2=0x7f9c8406b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:53:57.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.947+0000 7f9c8a541640 1 -- 172.21.15.167:0/3960499445 shutdown_connections 2023-11-27T20:53:57.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.947+0000 7f9c8a541640 1 -- 172.21.15.167:0/3960499445 wait complete. 2023-11-27T20:53:57.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.949+0000 7f9c8a541640 1 Processor -- start 2023-11-27T20:53:57.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.949+0000 7f9c8a541640 1 -- start start 2023-11-27T20:53:57.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.949+0000 7f9c8a541640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c8406a720 0x7f9c840c2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:57.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.949+0000 7f9c8a541640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8406ab00 0x7f9c841585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:57.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.949+0000 7f9c8a541640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c840c4230 0x7f9c841f2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:57.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.949+0000 7f9c8a541640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c841f2800 con 0x7f9c8406a720 2023-11-27T20:53:57.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.949+0000 7f9c8a541640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c841ef010 con 0x7f9c840c4230 2023-11-27T20:53:57.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.949+0000 7f9c8a541640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c84154120 con 0x7f9c8406ab00 2023-11-27T20:53:57.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.950+0000 7f9c88ade640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c840c4230 0x7f9c841f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:57.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.950+0000 7f9c837fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8406ab00 0x7f9c841585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:57.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.950+0000 7f9c83fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c8406a720 0x7f9c840c2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:57.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.950+0000 7f9c837fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8406ab00 0x7f9c841585d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:41118/0 (socket says 172.21.15.167:41118) 2023-11-27T20:53:57.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.950+0000 7f9c837fe640 1 -- 172.21.15.167:0/3990873831 learned_addr learned my addr 172.21.15.167:0/3990873831 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-27T20:53:57.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.954+0000 7f9c83fff640 1 -- 172.21.15.167:0/3990873831 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8406ab00 msgr2=0x7f9c841585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:57.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.954+0000 7f9c83fff640 1 --2- 172.21.15.167:0/3990873831 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8406ab00 0x7f9c841585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:57.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.954+0000 7f9c83fff640 1 -- 172.21.15.167:0/3990873831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c840c4230 msgr2=0x7f9c841f2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:57.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.954+0000 7f9c83fff640 1 --2- 172.21.15.167:0/3990873831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c840c4230 0x7f9c841f2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:57.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.954+0000 7f9c83fff640 1 -- 172.21.15.167:0/3990873831 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c74009400 con 0x7f9c8406a720 2023-11-27T20:53:57.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.956+0000 7f9c83fff640 1 --2- 172.21.15.167:0/3990873831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c8406a720 0x7f9c840c2740 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9c74033000 tx=0x7f9c74004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:53:57.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.959+0000 7f9c80ff9640 1 -- 172.21.15.167:0/3990873831 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7403e040 con 0x7f9c8406a720 2023-11-27T20:53:57.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.959+0000 7f9c80ff9640 1 -- 172.21.15.167:0/3990873831 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c74039c30 con 0x7f9c8406a720 2023-11-27T20:53:57.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.959+0000 7f9c80ff9640 1 -- 172.21.15.167:0/3990873831 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c740443f0 con 0x7f9c8406a720 2023-11-27T20:53:57.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.959+0000 7f9c8a541640 1 -- 172.21.15.167:0/3990873831 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c84154400 con 0x7f9c8406a720 2023-11-27T20:53:57.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.959+0000 7f9c8a541640 1 -- 172.21.15.167:0/3990873831 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c841549c0 con 0x7f9c8406a720 2023-11-27T20:53:57.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:57.960+0000 7f9c8a541640 1 -- 172.21.15.167:0/3990873831 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c841f2940 con 0x7f9c8406a720 2023-11-27T20:53:58.019 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T20:53:58.015+0000 7f9c3ee2e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-27T20:53:58.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.054+0000 7f9c80ff9640 1 -- 172.21.15.167:0/3990873831 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f9c740448f0 con 0x7f9c8406a720 2023-11-27T20:53:58.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.059+0000 7f9c80ff9640 1 -- 172.21.15.167:0/3990873831 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f9c7404d930 con 0x7f9c8406a720 2023-11-27T20:53:58.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.059+0000 7f9c80ff9640 1 -- 172.21.15.167:0/3990873831 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f9c841f2940 con 0x7f9c8406a720 2023-11-27T20:53:58.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.154+0000 7f9c8a541640 1 -- 172.21.15.167:0/3990873831 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1c462d0d-3361-48b3-a82a-86a920539e7a", "id": 5} v 0) v1 -- 0x7f9c84070390 con 0x7f9c8406a720 2023-11-27T20:53:58.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.188+0000 7f9c80ff9640 1 -- 172.21.15.167:0/3990873831 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1c462d0d-3361-48b3-a82a-86a920539e7a", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9c74049070 con 0x7f9c8406a720 2023-11-27T20:53:58.189 INFO:teuthology.orchestra.run.smithi167.stdout:5 2023-11-27T20:53:58.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.189+0000 7f9c8a541640 1 -- 172.21.15.167:0/3990873831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c8406a720 msgr2=0x7f9c840c2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:58.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.189+0000 7f9c8a541640 1 --2- 172.21.15.167:0/3990873831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c8406a720 0x7f9c840c2740 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9c74033000 tx=0x7f9c74004730 comp rx=0 tx=0).stop 2023-11-27T20:53:58.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.189+0000 7f9c8a541640 1 -- 172.21.15.167:0/3990873831 shutdown_connections 2023-11-27T20:53:58.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.189+0000 7f9c8a541640 1 --2- 172.21.15.167:0/3990873831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c840c4230 0x7f9c841f2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:58.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.189+0000 7f9c8a541640 1 --2- 172.21.15.167:0/3990873831 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8406ab00 0x7f9c841585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:58.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.189+0000 7f9c8a541640 1 --2- 172.21.15.167:0/3990873831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c8406a720 0x7f9c840c2740 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:58.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.189+0000 7f9c8a541640 1 -- 172.21.15.167:0/3990873831 >> 172.21.15.167:0/3990873831 conn(0x7f9c8406b5c0 msgr2=0x7f9c840c5850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:53:58.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.189+0000 7f9c8a541640 1 -- 172.21.15.167:0/3990873831 shutdown_connections 2023-11-27T20:53:58.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.189+0000 7f9c8a541640 1 -- 172.21.15.167:0/3990873831 wait complete. 2023-11-27T20:53:58.202 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new d687c5ad-6c88-4a15-8120-0cdbc5610535 6 2023-11-27T20:53:58.218 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-27T20:53:58.217+0000 7f5a03c2e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-27T20:53:58.292 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T20:53:58.289+0000 7f9c3ee2e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-27T20:53:58.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.302+0000 7f62a909b640 1 Processor -- start 2023-11-27T20:53:58.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.302+0000 7f62a909b640 1 -- start start 2023-11-27T20:53:58.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.302+0000 7f62a909b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62a40c58d0 0x7f62a4157300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:58.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.302+0000 7f62a909b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f62a406aeb0 0x7f62a4157840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:58.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.302+0000 7f62a909b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a415a930 con 0x7f62a40c54f0 2023-11-27T20:53:58.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.302+0000 7f62a909b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a40c7ed0 con 0x7f62a406aeb0 2023-11-27T20:53:58.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.302+0000 7f62a909b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a4072220 con 0x7f62a40c58d0 2023-11-27T20:53:58.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.303+0000 7f629bfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62a40c58d0 0x7f62a4157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:58.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.303+0000 7f62a359e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f62a406aeb0 0x7f62a4157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:58.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.303+0000 7f629bfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62a40c58d0 0x7f62a4157300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:41128/0 (socket says 172.21.15.167:41128) 2023-11-27T20:53:58.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.303+0000 7f629bfff640 1 -- 172.21.15.167:0/3242175825 learned_addr learned my addr 172.21.15.167:0/3242175825 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-27T20:53:58.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.305+0000 7f629bfff640 1 -- 172.21.15.167:0/3242175825 >> v2:172.21.15.167:3300/0 conn(0x7f62a406aeb0 msgr2=0x7f62a4157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:53:58.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.305+0000 7f629bfff640 1 --2- 172.21.15.167:0/3242175825 >> v2:172.21.15.167:3300/0 conn(0x7f62a406aeb0 0x7f62a4157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:58.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.305+0000 7f629bfff640 1 -- 172.21.15.167:0/3242175825 >> v1:172.21.15.167:6789/0 conn(0x7f62a40c54f0 legacy=0x7f62a4071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:53:58.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.305+0000 7f629bfff640 1 -- 172.21.15.167:0/3242175825 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a4157f00 con 0x7f62a40c58d0 2023-11-27T20:53:58.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.307+0000 7f629bfff640 1 --2- 172.21.15.167:0/3242175825 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62a40c58d0 0x7f62a4157300 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f628c009870 tx=0x7f628c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47c4ae0463e7eb04 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:53:58.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.311+0000 7f62a259c640 1 -- 172.21.15.167:0/3242175825 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c030840 con 0x7f62a40c58d0 2023-11-27T20:53:58.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.311+0000 7f62a259c640 1 -- 172.21.15.167:0/3242175825 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c0309a0 con 0x7f62a40c58d0 2023-11-27T20:53:58.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.311+0000 7f62a259c640 1 -- 172.21.15.167:0/3242175825 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c030d30 con 0x7f62a40c58d0 2023-11-27T20:53:58.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.312+0000 7f62a909b640 1 -- 172.21.15.167:0/3242175825 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62a40c58d0 msgr2=0x7f62a4157300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:58.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.312+0000 7f62a909b640 1 --2- 172.21.15.167:0/3242175825 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62a40c58d0 0x7f62a4157300 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f628c009870 tx=0x7f628c02b980 comp rx=0 tx=0).stop 2023-11-27T20:53:58.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.312+0000 7f62a909b640 1 -- 172.21.15.167:0/3242175825 shutdown_connections 2023-11-27T20:53:58.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.312+0000 7f62a909b640 1 --2- 172.21.15.167:0/3242175825 >> v2:172.21.15.167:3300/0 conn(0x7f62a406aeb0 0x7f62a4157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:58.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.312+0000 7f62a909b640 1 --2- 172.21.15.167:0/3242175825 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62a40c58d0 0x7f62a4157300 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:58.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.312+0000 7f62a909b640 1 -- 172.21.15.167:0/3242175825 >> 172.21.15.167:0/3242175825 conn(0x7f62a406b5c0 msgr2=0x7f62a406b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:53:58.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.312+0000 7f62a909b640 1 -- 172.21.15.167:0/3242175825 shutdown_connections 2023-11-27T20:53:58.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.312+0000 7f62a909b640 1 -- 172.21.15.167:0/3242175825 wait complete. 2023-11-27T20:53:58.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.313+0000 7f62a909b640 1 Processor -- start 2023-11-27T20:53:58.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.313+0000 7f62a909b640 1 -- start start 2023-11-27T20:53:58.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.314+0000 7f62a909b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62a406aeb0 0x7f62a4149f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:58.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.314+0000 7f62a909b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62a40c54f0 0x7f62a4159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:58.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.314+0000 7f62a909b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62a40c58d0 0x7f62a41595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:58.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.314+0000 7f62a909b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a41e1dc0 con 0x7f62a40c54f0 2023-11-27T20:53:58.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.314+0000 7f62a909b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a41e1800 con 0x7f62a406aeb0 2023-11-27T20:53:58.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.314+0000 7f62a909b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a41e1ae0 con 0x7f62a40c58d0 2023-11-27T20:53:58.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.314+0000 7f62a359e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62a40c58d0 0x7f62a41595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:58.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.314+0000 7f62a2d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62a406aeb0 0x7f62a4149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:58.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.315+0000 7f629bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62a40c54f0 0x7f62a4159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:58.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.315+0000 7f62a359e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62a40c58d0 0x7f62a41595b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:41134/0 (socket says 172.21.15.167:41134) 2023-11-27T20:53:58.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.315+0000 7f62a359e640 1 -- 172.21.15.167:0/3329488975 learned_addr learned my addr 172.21.15.167:0/3329488975 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-27T20:53:58.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.318+0000 7f629bfff640 1 -- 172.21.15.167:0/3329488975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62a40c58d0 msgr2=0x7f62a41595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:58.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.318+0000 7f629bfff640 1 --2- 172.21.15.167:0/3329488975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62a40c58d0 0x7f62a41595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:58.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.318+0000 7f629bfff640 1 -- 172.21.15.167:0/3329488975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62a406aeb0 msgr2=0x7f62a4149f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:58.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.318+0000 7f629bfff640 1 --2- 172.21.15.167:0/3329488975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62a406aeb0 0x7f62a4149f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:58.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.318+0000 7f629bfff640 1 -- 172.21.15.167:0/3329488975 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628c0094d0 con 0x7f62a40c54f0 2023-11-27T20:53:58.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.320+0000 7f629bfff640 1 --2- 172.21.15.167:0/3329488975 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62a40c54f0 0x7f62a4159070 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f62a40c9730 tx=0x7f628c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:53:58.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.324+0000 7f629b7fe640 1 -- 172.21.15.167:0/3329488975 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c039c90 con 0x7f62a40c54f0 2023-11-27T20:53:58.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.324+0000 7f629b7fe640 1 -- 172.21.15.167:0/3329488975 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c039e10 con 0x7f62a40c54f0 2023-11-27T20:53:58.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.324+0000 7f62a909b640 1 -- 172.21.15.167:0/3329488975 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a4158590 con 0x7f62a40c54f0 2023-11-27T20:53:58.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.324+0000 7f629b7fe640 1 -- 172.21.15.167:0/3329488975 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c043640 con 0x7f62a40c54f0 2023-11-27T20:53:58.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.324+0000 7f62a909b640 1 -- 172.21.15.167:0/3329488975 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a4158b50 con 0x7f62a40c54f0 2023-11-27T20:53:58.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.325+0000 7f62a909b640 1 -- 172.21.15.167:0/3329488975 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a4073dc0 con 0x7f62a40c54f0 2023-11-27T20:53:58.344 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T20:53:58.342+0000 7f9c3ee2e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-27T20:53:58.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.423+0000 7f629b7fe640 1 -- 172.21.15.167:0/3329488975 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f628c043b20 con 0x7f62a40c54f0 2023-11-27T20:53:58.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.427+0000 7f629b7fe640 1 -- 172.21.15.167:0/3329488975 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f628c03e070 con 0x7f62a40c54f0 2023-11-27T20:53:58.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.427+0000 7f629b7fe640 1 -- 172.21.15.167:0/3329488975 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f628c034070 con 0x7f62a40c54f0 2023-11-27T20:53:58.447 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T20:53:58.446+0000 7f9c3ee2e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-27T20:53:58.496 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-27T20:53:58.494+0000 7f5a03c2e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-27T20:53:58.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.519+0000 7f62a909b640 1 -- 172.21.15.167:0/3329488975 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d687c5ad-6c88-4a15-8120-0cdbc5610535", "id": 6} v 0) v1 -- 0x7f62a406bc80 con 0x7f62a40c54f0 2023-11-27T20:53:58.548 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-27T20:53:58.546+0000 7f5a03c2e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-27T20:53:58.649 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-27T20:53:58.648+0000 7f5a03c2e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-27T20:53:58.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.650+0000 7f629b7fe640 1 -- 172.21.15.167:0/3329488975 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d687c5ad-6c88-4a15-8120-0cdbc5610535", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f628c04dd50 con 0x7f62a40c54f0 2023-11-27T20:53:58.653 INFO:teuthology.orchestra.run.smithi167.stdout:6 2023-11-27T20:53:58.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.651+0000 7f62a909b640 1 -- 172.21.15.167:0/3329488975 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62a40c54f0 msgr2=0x7f62a4159070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:58.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.651+0000 7f62a909b640 1 --2- 172.21.15.167:0/3329488975 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62a40c54f0 0x7f62a4159070 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f62a40c9730 tx=0x7f628c004730 comp rx=0 tx=0).stop 2023-11-27T20:53:58.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.651+0000 7f62a909b640 1 -- 172.21.15.167:0/3329488975 shutdown_connections 2023-11-27T20:53:58.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.651+0000 7f62a909b640 1 --2- 172.21.15.167:0/3329488975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62a40c58d0 0x7f62a41595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:58.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.651+0000 7f62a909b640 1 --2- 172.21.15.167:0/3329488975 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62a40c54f0 0x7f62a4159070 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:58.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.651+0000 7f62a909b640 1 --2- 172.21.15.167:0/3329488975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62a406aeb0 0x7f62a4149f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:58.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.651+0000 7f62a909b640 1 -- 172.21.15.167:0/3329488975 >> 172.21.15.167:0/3329488975 conn(0x7f62a406b5c0 msgr2=0x7f62a40c9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:53:58.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.651+0000 7f62a909b640 1 -- 172.21.15.167:0/3329488975 shutdown_connections 2023-11-27T20:53:58.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.651+0000 7f62a909b640 1 -- 172.21.15.167:0/3329488975 wait complete. 2023-11-27T20:53:58.663 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new c9a50596-4981-4bd8-a8ef-d7679f8d9559 7 2023-11-27T20:53:58.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.803+0000 7fd702de5640 1 Processor -- start 2023-11-27T20:53:58.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.803+0000 7fd702de5640 1 -- start start 2023-11-27T20:53:58.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.804+0000 7fd702de5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd6fc06f1d0 0x7fd6fc0723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:58.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.804+0000 7fd702de5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6fc0c8370 0x7fd6fc0c8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:58.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.804+0000 7fd702de5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6fc06fe60 con 0x7fd6fc153620 2023-11-27T20:53:58.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.804+0000 7fd702de5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6fc0c8d40 con 0x7fd6fc06f1d0 2023-11-27T20:53:58.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.804+0000 7fd702de5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc0c2e00 con 0x7fd6fc0c8370 2023-11-27T20:53:58.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.805+0000 7fd700b81640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd6fc153620 0x7fd6fc159c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.167:48674/0 (socket says 172.21.15.167:48674) 2023-11-27T20:53:58.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.805+0000 7fd700b81640 1 -- 172.21.15.167:0/1952251988 learned_addr learned my addr 172.21.15.167:0/1952251988 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-27T20:53:58.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.807+0000 7fd6fb7fe640 1 -- 172.21.15.167:0/1952251988 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3724647551 0 0) 0x7fd6fc06fe60 con 0x7fd6fc153620 2023-11-27T20:53:58.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.807+0000 7fd6fb7fe640 1 -- 172.21.15.167:0/1952251988 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6ec003520 con 0x7fd6fc153620 2023-11-27T20:53:58.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.810+0000 7fd6fb7fe640 1 -- 172.21.15.167:0/1952251988 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 597173900 0 0) 0x7fd6ec003520 con 0x7fd6fc153620 2023-11-27T20:53:58.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.810+0000 7fd6fb7fe640 1 -- 172.21.15.167:0/1952251988 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6fc0c8370 msgr2=0x7fd6fc0c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:53:58.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.810+0000 7fd6fb7fe640 1 --2- 172.21.15.167:0/1952251988 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6fc0c8370 0x7fd6fc0c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:58.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.810+0000 7fd6fb7fe640 1 -- 172.21.15.167:0/1952251988 >> v2:172.21.15.167:3300/0 conn(0x7fd6fc06f1d0 msgr2=0x7fd6fc0723f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:53:58.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.810+0000 7fd6fb7fe640 1 --2- 172.21.15.167:0/1952251988 >> v2:172.21.15.167:3300/0 conn(0x7fd6fc06f1d0 0x7fd6fc0723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:58.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.810+0000 7fd6fb7fe640 1 -- 172.21.15.167:0/1952251988 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc1597d0 con 0x7fd6fc153620 2023-11-27T20:53:58.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.810+0000 7fd6fb7fe640 1 -- 172.21.15.167:0/1952251988 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1067350109 0 0) 0x7fd6f0001670 con 0x7fd6fc153620 2023-11-27T20:53:58.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.810+0000 7fd6fb7fe640 1 -- 172.21.15.167:0/1952251988 >> v1:172.21.15.88:6789/0 conn(0x7fd6fc153620 legacy=0x7fd6fc159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:58.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.810+0000 7fd6fb7fe640 1 --2- 172.21.15.167:0/1952251988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6ec0039e0 0x7fd6ec003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:58.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.810+0000 7fd6fb7fe640 1 --2- 172.21.15.167:0/1952251988 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6fc0c8370 0x7fd6ec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:58.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.810+0000 7fd6fb7fe640 1 --2- 172.21.15.167:0/1952251988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6ec004e20 0x7fd6ec00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:58.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.810+0000 7fd6fb7fe640 1 -- 172.21.15.167:0/1952251988 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc0c8d40 con 0x7fd6ec0039e0 2023-11-27T20:53:58.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.810+0000 7fd6fb7fe640 1 -- 172.21.15.167:0/1952251988 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc0c2e00 con 0x7fd6ec004e20 2023-11-27T20:53:58.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.810+0000 7fd6fb7fe640 1 -- 172.21.15.167:0/1952251988 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec005660 con 0x7fd6fc0c8370 2023-11-27T20:53:58.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.813+0000 7fd700b81640 1 --2- 172.21.15.167:0/1952251988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6ec0039e0 0x7fd6ec003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:58.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.816+0000 7fd700b81640 1 -- 172.21.15.167:0/1952251988 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6fc0c8370 msgr2=0x7fd6ec0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:53:58.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.816+0000 7fd700b81640 1 --2- 172.21.15.167:0/1952251988 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6fc0c8370 0x7fd6ec0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:58.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.816+0000 7fd700b81640 1 -- 172.21.15.167:0/1952251988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6ec004e20 msgr2=0x7fd6ec00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:53:58.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.816+0000 7fd700b81640 1 --2- 172.21.15.167:0/1952251988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6ec004e20 0x7fd6ec00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:58.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.816+0000 7fd700b81640 1 -- 172.21.15.167:0/1952251988 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec003520 con 0x7fd6ec0039e0 2023-11-27T20:53:58.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.817+0000 7fd700b81640 1 --2- 172.21.15.167:0/1952251988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6ec0039e0 0x7fd6ec003e00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd6f000c210 tx=0x7fd6ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4806548d8f1a29e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:53:58.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.821+0000 7fd6fb7fe640 1 -- 172.21.15.167:0/1952251988 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0005ad0 con 0x7fd6ec0039e0 2023-11-27T20:53:58.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.821+0000 7fd6fb7fe640 1 -- 172.21.15.167:0/1952251988 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f0005c30 con 0x7fd6ec0039e0 2023-11-27T20:53:58.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.821+0000 7fd6fb7fe640 1 -- 172.21.15.167:0/1952251988 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f002caf0 con 0x7fd6ec0039e0 2023-11-27T20:53:58.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.822+0000 7fd702de5640 1 -- 172.21.15.167:0/1952251988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6ec0039e0 msgr2=0x7fd6ec003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:58.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.822+0000 7fd702de5640 1 --2- 172.21.15.167:0/1952251988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6ec0039e0 0x7fd6ec003e00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd6f000c210 tx=0x7fd6ec0057f0 comp rx=0 tx=0).stop 2023-11-27T20:53:58.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.822+0000 7fd701382640 1 -- 172.21.15.167:0/1952251988 reap_dead start 2023-11-27T20:53:58.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.822+0000 7fd702de5640 1 -- 172.21.15.167:0/1952251988 shutdown_connections 2023-11-27T20:53:58.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.822+0000 7fd702de5640 1 -- 172.21.15.167:0/1952251988 >> 172.21.15.167:0/1952251988 conn(0x7fd6fc06b5c0 msgr2=0x7fd6fc06b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:53:58.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.822+0000 7fd702de5640 1 -- 172.21.15.167:0/1952251988 shutdown_connections 2023-11-27T20:53:58.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.822+0000 7fd702de5640 1 -- 172.21.15.167:0/1952251988 wait complete. 2023-11-27T20:53:58.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.823+0000 7fd702de5640 1 Processor -- start 2023-11-27T20:53:58.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.824+0000 7fd702de5640 1 -- start start 2023-11-27T20:53:58.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.825+0000 7fd702de5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6ec0039e0 0x7fd6fc1ef940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:58.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.825+0000 7fd702de5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6fc1e2a80 0x7fd6fc0cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:58.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.825+0000 7fd702de5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6fc15ba70 0x7fd6fc14b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:58.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.825+0000 7fd702de5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc1efe80 con 0x7fd6fc1e2a80 2023-11-27T20:53:58.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.825+0000 7fd702de5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc1e35a0 con 0x7fd6fc15ba70 2023-11-27T20:53:58.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.825+0000 7fd702de5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc1e32c0 con 0x7fd6ec0039e0 2023-11-27T20:53:58.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.826+0000 7fd6fbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6fc1e2a80 0x7fd6fc0cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:58.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.826+0000 7fd6fbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6fc1e2a80 0x7fd6fc0cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.167:52836/0 (socket says 172.21.15.167:52836) 2023-11-27T20:53:58.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.826+0000 7fd6fbfff640 1 -- 172.21.15.167:0/2539553856 learned_addr learned my addr 172.21.15.167:0/2539553856 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-27T20:53:58.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.829+0000 7fd6fbfff640 1 -- 172.21.15.167:0/2539553856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6ec0039e0 msgr2=0x7fd6fc1ef940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:58.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.829+0000 7fd6fbfff640 1 --2- 172.21.15.167:0/2539553856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6ec0039e0 0x7fd6fc1ef940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:58.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.829+0000 7fd6fbfff640 1 -- 172.21.15.167:0/2539553856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6fc15ba70 msgr2=0x7fd6fc14b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:58.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.829+0000 7fd6fbfff640 1 --2- 172.21.15.167:0/2539553856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6fc15ba70 0x7fd6fc14b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:58.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.829+0000 7fd6fbfff640 1 -- 172.21.15.167:0/2539553856 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc1e3e10 con 0x7fd6fc1e2a80 2023-11-27T20:53:58.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.831+0000 7fd6fbfff640 1 --2- 172.21.15.167:0/2539553856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6fc1e2a80 0x7fd6fc0cad60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800b500 tx=0x7fd6e800b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:53:58.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.834+0000 7fd6f97fa640 1 -- 172.21.15.167:0/2539553856 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8010870 con 0x7fd6fc1e2a80 2023-11-27T20:53:58.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.834+0000 7fd6f97fa640 1 -- 172.21.15.167:0/2539553856 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e80109d0 con 0x7fd6fc1e2a80 2023-11-27T20:53:58.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.834+0000 7fd6f97fa640 1 -- 172.21.15.167:0/2539553856 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8010d80 con 0x7fd6fc1e2a80 2023-11-27T20:53:58.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.834+0000 7fd702de5640 1 -- 172.21.15.167:0/2539553856 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6fc1e40f0 con 0x7fd6fc1e2a80 2023-11-27T20:53:58.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.834+0000 7fd702de5640 1 -- 172.21.15.167:0/2539553856 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6fc1e46b0 con 0x7fd6fc1e2a80 2023-11-27T20:53:58.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.835+0000 7fd702de5640 1 -- 172.21.15.167:0/2539553856 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6fc073dc0 con 0x7fd6fc1e2a80 2023-11-27T20:53:58.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.844+0000 7fd6f97fa640 1 -- 172.21.15.167:0/2539553856 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 2) v1 ==== 44706+0+0 (secure 0 0 0) 0x7fd6e8023480 con 0x7fd6fc1e2a80 2023-11-27T20:53:58.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.845+0000 7fd6f97fa640 1 -- 172.21.15.167:0/2539553856 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fd6e800dd30 con 0x7fd6fc1e2a80 2023-11-27T20:53:58.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:58.947+0000 7fd6f97fa640 1 -- 172.21.15.167:0/2539553856 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7fd6e8021350 con 0x7fd6fc1e2a80 2023-11-27T20:53:59.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:59.017+0000 7fd702de5640 1 -- 172.21.15.167:0/2539553856 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c9a50596-4981-4bd8-a8ef-d7679f8d9559", "id": 7} v 0) v1 -- 0x7fd6fc072a40 con 0x7fd6fc1e2a80 2023-11-27T20:53:59.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:59.282+0000 7fd6f97fa640 1 -- 172.21.15.167:0/2539553856 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c9a50596-4981-4bd8-a8ef-d7679f8d9559", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd6e801e030 con 0x7fd6fc1e2a80 2023-11-27T20:53:59.284 INFO:teuthology.orchestra.run.smithi167.stdout:7 2023-11-27T20:53:59.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:59.283+0000 7fd702de5640 1 -- 172.21.15.167:0/2539553856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6fc1e2a80 msgr2=0x7fd6fc0cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:59.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:59.283+0000 7fd702de5640 1 --2- 172.21.15.167:0/2539553856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6fc1e2a80 0x7fd6fc0cad60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800b500 tx=0x7fd6e800b9c0 comp rx=0 tx=0).stop 2023-11-27T20:53:59.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:59.283+0000 7fd702de5640 1 -- 172.21.15.167:0/2539553856 shutdown_connections 2023-11-27T20:53:59.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:59.283+0000 7fd702de5640 1 --2- 172.21.15.167:0/2539553856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6fc15ba70 0x7fd6fc14b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:59.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:59.283+0000 7fd702de5640 1 --2- 172.21.15.167:0/2539553856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6fc1e2a80 0x7fd6fc0cad60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:59.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:59.283+0000 7fd702de5640 1 --2- 172.21.15.167:0/2539553856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6ec0039e0 0x7fd6fc1ef940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:59.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:59.283+0000 7fd702de5640 1 -- 172.21.15.167:0/2539553856 >> 172.21.15.167:0/2539553856 conn(0x7fd6fc06b5c0 msgr2=0x7fd6fc157d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:53:59.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:59.283+0000 7fd702de5640 1 -- 172.21.15.167:0/2539553856 shutdown_connections 2023-11-27T20:53:59.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-27T20:53:59.283+0000 7fd702de5640 1 -- 172.21.15.167:0/2539553856 wait complete. 2023-11-27T20:53:59.295 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-27T20:53:59.295 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2023-11-27T20:53:59.297 INFO:tasks.ceph.osd.0:Started 2023-11-27T20:53:59.298 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-27T20:53:59.298 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2023-11-27T20:53:59.300 INFO:tasks.ceph.osd.1:Started 2023-11-27T20:53:59.300 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-27T20:53:59.301 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2023-11-27T20:53:59.303 INFO:tasks.ceph.osd.2:Started 2023-11-27T20:53:59.303 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-27T20:53:59.303 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2023-11-27T20:53:59.305 INFO:tasks.ceph.osd.3:Started 2023-11-27T20:53:59.306 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-27T20:53:59.306 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2023-11-27T20:53:59.308 INFO:tasks.ceph.osd.4:Started 2023-11-27T20:53:59.308 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-27T20:53:59.308 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2023-11-27T20:53:59.310 INFO:tasks.ceph.osd.5:Started 2023-11-27T20:53:59.310 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-27T20:53:59.310 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2023-11-27T20:53:59.314 INFO:tasks.ceph.osd.6:Started 2023-11-27T20:53:59.314 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-27T20:53:59.314 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2023-11-27T20:53:59.317 INFO:tasks.ceph.osd.7:Started 2023-11-27T20:53:59.317 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:53:59.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.439+0000 7fd23a6da640 1 Processor -- start 2023-11-27T20:53:59.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.439+0000 7fd23a6da640 1 -- start start 2023-11-27T20:53:59.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.440+0000 7fd23a6da640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd2340c58d0 0x7fd234157300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:59.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.440+0000 7fd23a6da640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd23406aeb0 0x7fd234157840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:59.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.440+0000 7fd23a6da640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23415a930 con 0x7fd2340c54f0 2023-11-27T20:53:59.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.440+0000 7fd23a6da640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2340c7ed0 con 0x7fd23406aeb0 2023-11-27T20:53:59.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.440+0000 7fd23a6da640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd234072220 con 0x7fd2340c58d0 2023-11-27T20:53:59.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.446+0000 7fd2337fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd2340c58d0 0x7fd234157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:59.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.447+0000 7fd2337fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd2340c58d0 0x7fd234157300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:33020/0 (socket says 172.21.15.88:33020) 2023-11-27T20:53:59.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.447+0000 7fd2337fe640 1 -- 172.21.15.88:0/326483712 learned_addr learned my addr 172.21.15.88:0/326483712 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:53:59.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.451+0000 7fd2337fe640 1 -- 172.21.15.88:0/326483712 >> v2:172.21.15.88:3300/0 conn(0x7fd23406aeb0 msgr2=0x7fd234157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:53:59.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.451+0000 7fd2337fe640 1 --2- 172.21.15.88:0/326483712 >> v2:172.21.15.88:3300/0 conn(0x7fd23406aeb0 0x7fd234157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:59.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.451+0000 7fd2337fe640 1 -- 172.21.15.88:0/326483712 >> v1:172.21.15.88:6789/0 conn(0x7fd2340c54f0 legacy=0x7fd234071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:53:59.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.451+0000 7fd2337fe640 1 -- 172.21.15.88:0/326483712 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd234157f00 con 0x7fd2340c58d0 2023-11-27T20:53:59.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.457+0000 7fd2337fe640 1 --2- 172.21.15.88:0/326483712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2340c58d0 0x7fd234157300 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd2340717b0 tx=0x7fd22802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e524fd4e2a57353 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:53:59.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.461+0000 7fd232ffd640 1 -- 172.21.15.88:0/326483712 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd228030860 con 0x7fd2340c58d0 2023-11-27T20:53:59.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.461+0000 7fd232ffd640 1 -- 172.21.15.88:0/326483712 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2280309c0 con 0x7fd2340c58d0 2023-11-27T20:53:59.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.461+0000 7fd232ffd640 1 -- 172.21.15.88:0/326483712 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd228030d50 con 0x7fd2340c58d0 2023-11-27T20:53:59.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.462+0000 7fd23a6da640 1 -- 172.21.15.88:0/326483712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2340c58d0 msgr2=0x7fd234157300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:59.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.462+0000 7fd23a6da640 1 --2- 172.21.15.88:0/326483712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2340c58d0 0x7fd234157300 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd2340717b0 tx=0x7fd22802b9a0 comp rx=0 tx=0).stop 2023-11-27T20:53:59.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.462+0000 7fd23a6da640 1 -- 172.21.15.88:0/326483712 shutdown_connections 2023-11-27T20:53:59.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.462+0000 7fd23a6da640 1 --2- 172.21.15.88:0/326483712 >> v2:172.21.15.88:3300/0 conn(0x7fd23406aeb0 0x7fd234157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:59.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.462+0000 7fd23a6da640 1 --2- 172.21.15.88:0/326483712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2340c58d0 0x7fd234157300 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:59.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.462+0000 7fd23a6da640 1 -- 172.21.15.88:0/326483712 >> 172.21.15.88:0/326483712 conn(0x7fd23406b5c0 msgr2=0x7fd23406b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:53:59.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.462+0000 7fd23a6da640 1 -- 172.21.15.88:0/326483712 shutdown_connections 2023-11-27T20:53:59.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.462+0000 7fd23a6da640 1 -- 172.21.15.88:0/326483712 wait complete. 2023-11-27T20:53:59.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.463+0000 7fd23a6da640 1 Processor -- start 2023-11-27T20:53:59.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.463+0000 7fd23a6da640 1 -- start start 2023-11-27T20:53:59.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.464+0000 7fd23a6da640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23406aeb0 0x7fd2341eda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:59.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.464+0000 7fd23a6da640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2340c54f0 0x7fd23414a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:59.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.464+0000 7fd23a6da640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2340c58d0 0x7fd2340cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:53:59.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.464+0000 7fd23a6da640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd234157550 con 0x7fd2340c58d0 2023-11-27T20:53:59.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.464+0000 7fd23a6da640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23414b740 con 0x7fd2340c54f0 2023-11-27T20:53:59.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.464+0000 7fd23a6da640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd234156f90 con 0x7fd23406aeb0 2023-11-27T20:53:59.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.464+0000 7fd238c77640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2340c58d0 0x7fd2340cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:59.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.465+0000 7fd2337fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2340c54f0 0x7fd23414a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:53:59.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.465+0000 7fd238c77640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2340c58d0 0x7fd2340cbc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46784/0 (socket says 172.21.15.88:46784) 2023-11-27T20:53:59.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.465+0000 7fd2337fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2340c54f0 0x7fd23414a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:33036/0 (socket says 172.21.15.88:33036) 2023-11-27T20:53:59.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.465+0000 7fd238c77640 1 -- 172.21.15.88:0/3905662720 learned_addr learned my addr 172.21.15.88:0/3905662720 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:53:59.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.468+0000 7fd2337fe640 1 -- 172.21.15.88:0/3905662720 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23406aeb0 msgr2=0x7fd2341eda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:59.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.468+0000 7fd2337fe640 1 --2- 172.21.15.88:0/3905662720 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23406aeb0 0x7fd2341eda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:59.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.468+0000 7fd2337fe640 1 -- 172.21.15.88:0/3905662720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2340c58d0 msgr2=0x7fd2340cbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:59.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.468+0000 7fd2337fe640 1 --2- 172.21.15.88:0/3905662720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2340c58d0 0x7fd2340cbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:59.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.468+0000 7fd2337fe640 1 -- 172.21.15.88:0/3905662720 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2280094d0 con 0x7fd2340c54f0 2023-11-27T20:53:59.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.470+0000 7fd2337fe640 1 --2- 172.21.15.88:0/3905662720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2340c54f0 0x7fd23414a120 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd228033000 tx=0x7fd228004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:53:59.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.472+0000 7fd230ff9640 1 -- 172.21.15.88:0/3905662720 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22803e040 con 0x7fd2340c54f0 2023-11-27T20:53:59.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.472+0000 7fd23a6da640 1 -- 172.21.15.88:0/3905662720 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd234157270 con 0x7fd2340c54f0 2023-11-27T20:53:59.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.472+0000 7fd23a6da640 1 -- 172.21.15.88:0/3905662720 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2341520f0 con 0x7fd2340c54f0 2023-11-27T20:53:59.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.473+0000 7fd23a6da640 1 -- 172.21.15.88:0/3905662720 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd234151c70 con 0x7fd2340c54f0 2023-11-27T20:53:59.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.577+0000 7fd230ff9640 1 -- 172.21.15.88:0/3905662720 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd228030800 con 0x7fd2340c54f0 2023-11-27T20:53:59.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.577+0000 7fd230ff9640 1 -- 172.21.15.88:0/3905662720 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22804e660 con 0x7fd2340c54f0 2023-11-27T20:53:59.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.578+0000 7fd230ff9640 1 -- 172.21.15.88:0/3905662720 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 2) v1 ==== 44706+0+0 (secure 0 0 0) 0x7fd2280443f0 con 0x7fd2340c54f0 2023-11-27T20:53:59.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.583+0000 7fd230ff9640 1 -- 172.21.15.88:0/3905662720 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fd22802fc60 con 0x7fd2340c54f0 2023-11-27T20:53:59.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.583+0000 7fd230ff9640 1 -- 172.21.15.88:0/3905662720 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7fd22804c950 con 0x7fd2340c54f0 2023-11-27T20:53:59.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.645+0000 7fd23a6da640 1 -- 172.21.15.88:0/3905662720 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd234151c70 con 0x7fd2340c54f0 2023-11-27T20:53:59.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.693+0000 7fd230ff9640 1 -- 172.21.15.88:0/3905662720 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fd234151c70 con 0x7fd2340c54f0 2023-11-27T20:53:59.696 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:53:59.698 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":10,"fsid":"ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc","created":"2023-11-27T20:53:53.110827+0000","modified":"2023-11-27T20:53:59.022798+0000","last_up_change":"0.000000","last_in_change":"2023-11-27T20:53:59.022798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1207ca0f-bef1-44c6-b66b-58bf0e080ca9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8d1be479-4241-4335-9633-1394311fde76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7536b008-05dd-40eb-9d4a-bdac4b1c38c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"47edd4d7-e99c-4ce3-851b-cc9c8e2d4480","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0a81dd31-1a8b-41af-b933-d74aae63f3e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1c462d0d-3361-48b3-a82a-86a920539e7a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d687c5ad-6c88-4a15-8120-0cdbc5610535","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c9a50596-4981-4bd8-a8ef-d7679f8d9559","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:53:59.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.694+0000 7fd23a6da640 1 -- 172.21.15.88:0/3905662720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2340c54f0 msgr2=0x7fd23414a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:53:59.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.694+0000 7fd23a6da640 1 --2- 172.21.15.88:0/3905662720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2340c54f0 0x7fd23414a120 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd228033000 tx=0x7fd228004730 comp rx=0 tx=0).stop 2023-11-27T20:53:59.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.694+0000 7fd23a6da640 1 -- 172.21.15.88:0/3905662720 shutdown_connections 2023-11-27T20:53:59.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.694+0000 7fd23a6da640 1 --2- 172.21.15.88:0/3905662720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2340c58d0 0x7fd2340cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:59.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.694+0000 7fd23a6da640 1 --2- 172.21.15.88:0/3905662720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2340c54f0 0x7fd23414a120 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:59.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.694+0000 7fd23a6da640 1 --2- 172.21.15.88:0/3905662720 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23406aeb0 0x7fd2341eda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:53:59.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.694+0000 7fd23a6da640 1 -- 172.21.15.88:0/3905662720 >> 172.21.15.88:0/3905662720 conn(0x7fd23406b5c0 msgr2=0x7fd2340ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:53:59.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.694+0000 7fd23a6da640 1 -- 172.21.15.88:0/3905662720 shutdown_connections 2023-11-27T20:53:59.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:53:59.694+0000 7fd23a6da640 1 -- 172.21.15.88:0/3905662720 wait complete. 2023-11-27T20:53:59.706 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-27T20:53:59.707 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-27T20:53:59.936 INFO:tasks.ceph.osd.4.smithi167.stderr:2023-11-27T20:53:59.934+0000 7fe0c9212500 -1 Falling back to public interface 2023-11-27T20:53:59.949 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-11-27T20:53:59.947+0000 7fdb604af500 -1 Falling back to public interface 2023-11-27T20:53:59.952 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-11-27T20:53:59.951+0000 7f8ebecbe500 -1 Falling back to public interface 2023-11-27T20:53:59.958 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-11-27T20:53:59.957+0000 7fc10d186500 -1 Falling back to public interface 2023-11-27T20:53:59.962 INFO:tasks.ceph.osd.6.smithi167.stderr:2023-11-27T20:53:59.961+0000 7f932e8fa500 -1 Falling back to public interface 2023-11-27T20:53:59.963 INFO:tasks.ceph.osd.7.smithi167.stderr:2023-11-27T20:53:59.962+0000 7f4766625500 -1 Falling back to public interface 2023-11-27T20:53:59.980 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-11-27T20:53:59.979+0000 7f513c170500 -1 Falling back to public interface 2023-11-27T20:53:59.983 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-11-27T20:53:59.982+0000 7fb5b5f70500 -1 Falling back to public interface 2023-11-27T20:54:00.042 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:54:00.044 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:54:00.153 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T20:54:00.152+0000 7f9bdfa9c640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-27T20:54:00.206 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T20:54:00.205+0000 7f9bdfa9c640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-27T20:54:00.512 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-27T20:54:00.602 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.600+0000 7eff99f39640 1 Processor -- start 2023-11-27T20:54:00.602 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.600+0000 7eff99f39640 1 -- start start 2023-11-27T20:54:00.603 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.601+0000 7eff99f39640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff940cdc10 0x7eff940cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:00.603 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.601+0000 7eff99f39640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7eff940cd710 0x7eff940ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:00.603 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.601+0000 7eff99f39640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff94159b80 con 0x7eff941538b0 2023-11-27T20:54:00.603 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.601+0000 7eff99f39640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff940cc050 con 0x7eff940cd710 2023-11-27T20:54:00.603 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.601+0000 7eff99f39640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff940cb4d0 con 0x7eff940cdc10 2023-11-27T20:54:00.604 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.602+0000 7eff92ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff940cdc10 0x7eff940cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:00.604 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.602+0000 7eff93fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7eff940cd710 0x7eff940ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:00.604 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.602+0000 7eff92ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff940cdc10 0x7eff940cd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:43624/0 (socket says 172.21.15.88:43624) 2023-11-27T20:54:00.604 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.602+0000 7eff92ffd640 1 -- 172.21.15.88:0/1233816918 learned_addr learned my addr 172.21.15.88:0/1233816918 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:00.606 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.605+0000 7eff92ffd640 1 -- 172.21.15.88:0/1233816918 >> v2:172.21.15.167:3300/0 conn(0x7eff940cd710 msgr2=0x7eff940ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:00.606 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.605+0000 7eff92ffd640 1 --2- 172.21.15.88:0/1233816918 >> v2:172.21.15.167:3300/0 conn(0x7eff940cd710 0x7eff940ce0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:00.606 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.605+0000 7eff92ffd640 1 -- 172.21.15.88:0/1233816918 >> v1:172.21.15.88:6789/0 conn(0x7eff941538b0 legacy=0x7eff9415a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:00.606 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.605+0000 7eff92ffd640 1 -- 172.21.15.88:0/1233816918 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff940cb7b0 con 0x7eff940cdc10 2023-11-27T20:54:00.608 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.607+0000 7eff92ffd640 1 --2- 172.21.15.88:0/1233816918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff940cdc10 0x7eff940cd1d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7eff84009870 tx=0x7eff8402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be465afb00e78deb server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:00.612 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.611+0000 7eff927fc640 1 -- 172.21.15.88:0/1233816918 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff84031640 con 0x7eff940cdc10 2023-11-27T20:54:00.612 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.611+0000 7eff927fc640 1 -- 172.21.15.88:0/1233816918 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff840317a0 con 0x7eff940cdc10 2023-11-27T20:54:00.613 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.611+0000 7eff927fc640 1 -- 172.21.15.88:0/1233816918 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff84031b30 con 0x7eff940cdc10 2023-11-27T20:54:00.614 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.612+0000 7eff99f39640 1 -- 172.21.15.88:0/1233816918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff940cdc10 msgr2=0x7eff940cd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:00.615 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.612+0000 7eff99f39640 1 --2- 172.21.15.88:0/1233816918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff940cdc10 0x7eff940cd1d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7eff84009870 tx=0x7eff8402b8f0 comp rx=0 tx=0).stop 2023-11-27T20:54:00.615 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.612+0000 7eff99f39640 1 -- 172.21.15.88:0/1233816918 shutdown_connections 2023-11-27T20:54:00.616 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.612+0000 7eff99f39640 1 --2- 172.21.15.88:0/1233816918 >> v2:172.21.15.167:3300/0 conn(0x7eff940cd710 0x7eff940ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:00.617 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.612+0000 7eff99f39640 1 --2- 172.21.15.88:0/1233816918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff940cdc10 0x7eff940cd1d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:00.617 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.612+0000 7eff99f39640 1 -- 172.21.15.88:0/1233816918 >> 172.21.15.88:0/1233816918 conn(0x7eff940b0810 msgr2=0x7eff940b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:00.617 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.612+0000 7eff99f39640 1 -- 172.21.15.88:0/1233816918 shutdown_connections 2023-11-27T20:54:00.618 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.612+0000 7eff99f39640 1 -- 172.21.15.88:0/1233816918 wait complete. 2023-11-27T20:54:00.618 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.613+0000 7eff99f39640 1 Processor -- start 2023-11-27T20:54:00.618 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.613+0000 7eff99f39640 1 -- start start 2023-11-27T20:54:00.620 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.614+0000 7eff99f39640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff940cd710 0x7eff94158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:00.620 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.614+0000 7eff99f39640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff940cdc10 0x7eff9414d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:00.620 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.614+0000 7eff99f39640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff941538b0 0x7eff9414dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:00.621 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.614+0000 7eff99f39640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9414cc20 con 0x7eff940cdc10 2023-11-27T20:54:00.621 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.614+0000 7eff99f39640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff94159620 con 0x7eff940cd710 2023-11-27T20:54:00.622 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.614+0000 7eff99f39640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff940c6f00 con 0x7eff941538b0 2023-11-27T20:54:00.622 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.614+0000 7eff93fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff941538b0 0x7eff9414dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:00.623 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.615+0000 7eff93fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff941538b0 0x7eff9414dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:43634/0 (socket says 172.21.15.88:43634) 2023-11-27T20:54:00.623 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.615+0000 7eff93fff640 1 -- 172.21.15.88:0/2789623507 learned_addr learned my addr 172.21.15.88:0/2789623507 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:00.623 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.618+0000 7eff93fff640 1 -- 172.21.15.88:0/2789623507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff940cd710 msgr2=0x7eff94158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:00.623 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.618+0000 7eff93fff640 1 --2- 172.21.15.88:0/2789623507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff940cd710 0x7eff94158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:00.623 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.618+0000 7eff93fff640 1 -- 172.21.15.88:0/2789623507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff940cdc10 msgr2=0x7eff9414d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:00.624 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.618+0000 7eff93fff640 1 --2- 172.21.15.88:0/2789623507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff940cdc10 0x7eff9414d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:00.624 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.618+0000 7eff93fff640 1 -- 172.21.15.88:0/2789623507 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff840094d0 con 0x7eff941538b0 2023-11-27T20:54:00.624 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.621+0000 7eff93fff640 1 --2- 172.21.15.88:0/2789623507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff941538b0 0x7eff9414dde0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00ef90 tx=0x7eff8c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:00.678 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.677+0000 7eff8bfff640 1 -- 172.21.15.88:0/2789623507 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c009b20 con 0x7eff941538b0 2023-11-27T20:54:00.679 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.677+0000 7eff8bfff640 1 -- 172.21.15.88:0/2789623507 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8c00f040 con 0x7eff941538b0 2023-11-27T20:54:00.679 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.677+0000 7eff8bfff640 1 -- 172.21.15.88:0/2789623507 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c0146c0 con 0x7eff941538b0 2023-11-27T20:54:00.679 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.677+0000 7eff99f39640 1 -- 172.21.15.88:0/2789623507 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff940c71e0 con 0x7eff941538b0 2023-11-27T20:54:00.679 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.677+0000 7eff99f39640 1 -- 172.21.15.88:0/2789623507 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff9414d0a0 con 0x7eff941538b0 2023-11-27T20:54:00.680 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.678+0000 7eff99f39640 1 -- 172.21.15.88:0/2789623507 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff940c7700 con 0x7eff941538b0 2023-11-27T20:54:00.698 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.697+0000 7eff8bfff640 1 -- 172.21.15.88:0/2789623507 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 3) v1 ==== 89208+0+0 (secure 0 0 0) 0x7eff8c014820 con 0x7eff941538b0 2023-11-27T20:54:00.699 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.697+0000 7eff8bfff640 1 --2- 172.21.15.88:0/2789623507 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7eff7406b060 0x7eff7406d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:00.699 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.698+0000 7eff937fe640 1 --2- 172.21.15.88:0/2789623507 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7eff7406b060 0x7eff7406d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:00.699 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.698+0000 7eff937fe640 1 --2- 172.21.15.88:0/2789623507 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7eff7406b060 0x7eff7406d520 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7eff941597e0 tx=0x7eff7c007990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:00.700 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.698+0000 7eff8bfff640 1 -- 172.21.15.88:0/2789623507 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7eff8c059db0 con 0x7eff941538b0 2023-11-27T20:54:00.939 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:00.938+0000 7eff8bfff640 1 -- 172.21.15.88:0/2789623507 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7eff8c0559f0 con 0x7eff941538b0 2023-11-27T20:54:01.110 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:01.108+0000 7eff99f39640 1 -- 172.21.15.88:0/2789623507 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff9414cee0 con 0x7eff941538b0 2023-11-27T20:54:01.154 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:01.153+0000 7eff8bfff640 1 -- 172.21.15.88:0/2789623507 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7eff8c018070 con 0x7eff941538b0 2023-11-27T20:54:01.154 INFO:teuthology.misc.health.smithi088.stdout: 2023-11-27T20:54:01.155 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":10,"fsid":"ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc","created":"2023-11-27T20:53:53.110827+0000","modified":"2023-11-27T20:53:59.022798+0000","last_up_change":"0.000000","last_in_change":"2023-11-27T20:53:59.022798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1207ca0f-bef1-44c6-b66b-58bf0e080ca9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8d1be479-4241-4335-9633-1394311fde76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7536b008-05dd-40eb-9d4a-bdac4b1c38c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"47edd4d7-e99c-4ce3-851b-cc9c8e2d4480","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0a81dd31-1a8b-41af-b933-d74aae63f3e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1c462d0d-3361-48b3-a82a-86a920539e7a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d687c5ad-6c88-4a15-8120-0cdbc5610535","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c9a50596-4981-4bd8-a8ef-d7679f8d9559","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:54:01.157 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:01.155+0000 7eff99f39640 1 -- 172.21.15.88:0/2789623507 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7eff7406b060 msgr2=0x7eff7406d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:01.157 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:01.155+0000 7eff99f39640 1 --2- 172.21.15.88:0/2789623507 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7eff7406b060 0x7eff7406d520 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7eff941597e0 tx=0x7eff7c007990 comp rx=0 tx=0).stop 2023-11-27T20:54:01.157 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:01.155+0000 7eff99f39640 1 -- 172.21.15.88:0/2789623507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff941538b0 msgr2=0x7eff9414dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:01.157 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:01.155+0000 7eff99f39640 1 --2- 172.21.15.88:0/2789623507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff941538b0 0x7eff9414dde0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00ef90 tx=0x7eff8c00c490 comp rx=0 tx=0).stop 2023-11-27T20:54:01.157 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:01.155+0000 7eff99f39640 1 -- 172.21.15.88:0/2789623507 shutdown_connections 2023-11-27T20:54:01.157 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:01.155+0000 7eff99f39640 1 --2- 172.21.15.88:0/2789623507 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7eff7406b060 0x7eff7406d520 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:01.157 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:01.155+0000 7eff99f39640 1 --2- 172.21.15.88:0/2789623507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff941538b0 0x7eff9414dde0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:01.157 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:01.155+0000 7eff99f39640 1 --2- 172.21.15.88:0/2789623507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff940cdc10 0x7eff9414d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:01.157 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:01.155+0000 7eff99f39640 1 --2- 172.21.15.88:0/2789623507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff940cd710 0x7eff94158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:01.158 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:01.155+0000 7eff99f39640 1 -- 172.21.15.88:0/2789623507 >> 172.21.15.88:0/2789623507 conn(0x7eff940b0810 msgr2=0x7eff941527d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:01.158 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:01.155+0000 7eff99f39640 1 -- 172.21.15.88:0/2789623507 shutdown_connections 2023-11-27T20:54:01.158 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:01.155+0000 7eff99f39640 1 -- 172.21.15.88:0/2789623507 wait complete. 2023-11-27T20:54:01.167 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-27T20:54:03.370 INFO:tasks.ceph.osd.4.smithi167.stderr:2023-11-27T20:54:03.369+0000 7fe0c9212500 -1 osd.4 0 log_to_monitors true 2023-11-27T20:54:03.418 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-11-27T20:54:03.417+0000 7f8ebecbe500 -1 osd.3 0 log_to_monitors true 2023-11-27T20:54:03.434 INFO:tasks.ceph.osd.7.smithi167.stderr:2023-11-27T20:54:03.433+0000 7f4766625500 -1 osd.7 0 log_to_monitors true 2023-11-27T20:54:03.467 INFO:tasks.ceph.osd.6.smithi167.stderr:2023-11-27T20:54:03.466+0000 7f932e8fa500 -1 osd.6 0 log_to_monitors true 2023-11-27T20:54:03.473 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-11-27T20:54:03.472+0000 7fb5b5f70500 -1 osd.1 0 log_to_monitors true 2023-11-27T20:54:03.474 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-11-27T20:54:03.473+0000 7fc10d186500 -1 osd.0 0 log_to_monitors true 2023-11-27T20:54:03.483 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-11-27T20:54:03.482+0000 7fdb604af500 -1 osd.2 0 log_to_monitors true 2023-11-27T20:54:03.500 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-11-27T20:54:03.499+0000 7f513c170500 -1 osd.5 0 log_to_monitors true 2023-11-27T20:54:05.604 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-11-27T20:54:05.603+0000 7f8ebb460640 -1 osd.3 0 waiting for initial osdmap 2023-11-27T20:54:05.651 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-11-27T20:54:05.650+0000 7f8eb2a72640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T20:54:05.981 INFO:tasks.ceph.osd.4.smithi167.stderr:2023-11-27T20:54:05.980+0000 7fe0c51a0640 -1 osd.4 0 waiting for initial osdmap 2023-11-27T20:54:06.044 INFO:tasks.ceph.osd.7.smithi167.stderr:2023-11-27T20:54:06.043+0000 7f4761ef4640 -1 osd.7 0 waiting for initial osdmap 2023-11-27T20:54:06.183 INFO:tasks.ceph.osd.4.smithi167.stderr:2023-11-27T20:54:06.182+0000 7fe0bcfc6640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T20:54:06.353 INFO:tasks.ceph.osd.7.smithi167.stderr:2023-11-27T20:54:06.351+0000 7f4759d1a640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T20:54:07.310 INFO:tasks.ceph.osd.6.smithi167.stderr:2023-11-27T20:54:07.309+0000 7f932a888640 -1 osd.6 0 waiting for initial osdmap 2023-11-27T20:54:07.346 INFO:tasks.ceph.osd.6.smithi167.stderr:2023-11-27T20:54:07.345+0000 7f93226ae640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T20:54:07.352 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-11-27T20:54:07.351+0000 7f51380fe640 -1 osd.5 0 waiting for initial osdmap 2023-11-27T20:54:07.390 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-11-27T20:54:07.389+0000 7f512ff24640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T20:54:07.730 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-11-27T20:54:07.729+0000 7fc10992a640 -1 osd.0 0 waiting for initial osdmap 2023-11-27T20:54:07.752 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-11-27T20:54:07.751+0000 7fc100f3c640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T20:54:07.756 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-11-27T20:54:07.755+0000 7fdb5c43d640 -1 osd.2 0 waiting for initial osdmap 2023-11-27T20:54:07.770 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-11-27T20:54:07.769+0000 7fb5b1efe640 -1 osd.1 0 waiting for initial osdmap 2023-11-27T20:54:07.773 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-11-27T20:54:07.772+0000 7fdb54263640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T20:54:07.842 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-11-27T20:54:07.841+0000 7fb5a9d24640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T20:54:07.974 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-27T20:54:08.063 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.062+0000 7fbea1dfc640 1 Processor -- start 2023-11-27T20:54:08.063 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.062+0000 7fbea1dfc640 1 -- start start 2023-11-27T20:54:08.064 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.063+0000 7fbea1dfc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe9c153820 0x7fbe9c159e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:08.065 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.063+0000 7fbea1dfc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbe9c0cc460 0x7fbe9c06b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:08.065 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.063+0000 7fbea1dfc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbe9c0cc880 0x7fbe9c06bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:08.065 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.063+0000 7fbea1dfc640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe9c0cbb50 con 0x7fbe9c0cc460 2023-11-27T20:54:08.065 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.063+0000 7fbea1dfc640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe9c0cac60 con 0x7fbe9c0cc880 2023-11-27T20:54:08.065 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.063+0000 7fbea1dfc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c0caf40 con 0x7fbe9c153820 2023-11-27T20:54:08.066 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.064+0000 7fbe9b7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe9c153820 0x7fbe9c159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:08.066 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.064+0000 7fbe9bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbe9c0cc880 0x7fbe9c06bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:08.066 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.064+0000 7fbe9b7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe9c153820 0x7fbe9c159e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:43676/0 (socket says 172.21.15.88:43676) 2023-11-27T20:54:08.066 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.064+0000 7fbe9b7fe640 1 -- 172.21.15.88:0/3179360189 learned_addr learned my addr 172.21.15.88:0/3179360189 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:08.067 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.066+0000 7fbe9b7fe640 1 -- 172.21.15.88:0/3179360189 >> v2:172.21.15.167:3300/0 conn(0x7fbe9c0cc880 msgr2=0x7fbe9c06bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:08.067 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.066+0000 7fbe9b7fe640 1 --2- 172.21.15.88:0/3179360189 >> v2:172.21.15.167:3300/0 conn(0x7fbe9c0cc880 0x7fbe9c06bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:08.067 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.066+0000 7fbe9b7fe640 1 -- 172.21.15.88:0/3179360189 >> v2:172.21.15.88:3300/0 conn(0x7fbe9c0cc460 msgr2=0x7fbe9c06b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:08.067 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.066+0000 7fbe9b7fe640 1 --2- 172.21.15.88:0/3179360189 >> v2:172.21.15.88:3300/0 conn(0x7fbe9c0cc460 0x7fbe9c06b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:08.068 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.066+0000 7fbe9b7fe640 1 -- 172.21.15.88:0/3179360189 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9c0cb220 con 0x7fbe9c153820 2023-11-27T20:54:08.069 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.068+0000 7fbe9b7fe640 1 --2- 172.21.15.88:0/3179360189 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe9c153820 0x7fbe9c159e90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0706e0 tx=0x7fbe9002b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8089e7c5b9af393 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:08.072 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.071+0000 7fbe9a7fc640 1 -- 172.21.15.88:0/3179360189 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe90030860 con 0x7fbe9c153820 2023-11-27T20:54:08.073 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.071+0000 7fbe9a7fc640 1 -- 172.21.15.88:0/3179360189 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe900309c0 con 0x7fbe9c153820 2023-11-27T20:54:08.073 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.071+0000 7fbe9a7fc640 1 -- 172.21.15.88:0/3179360189 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe90030d50 con 0x7fbe9c153820 2023-11-27T20:54:08.074 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.072+0000 7fbea1dfc640 1 -- 172.21.15.88:0/3179360189 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe9c153820 msgr2=0x7fbe9c159e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:08.074 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.072+0000 7fbea1dfc640 1 --2- 172.21.15.88:0/3179360189 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe9c153820 0x7fbe9c159e90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0706e0 tx=0x7fbe9002b9a0 comp rx=0 tx=0).stop 2023-11-27T20:54:08.074 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.072+0000 7fbea1dfc640 1 -- 172.21.15.88:0/3179360189 shutdown_connections 2023-11-27T20:54:08.074 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.072+0000 7fbea1dfc640 1 --2- 172.21.15.88:0/3179360189 >> v2:172.21.15.167:3300/0 conn(0x7fbe9c0cc880 0x7fbe9c06bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:08.074 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.072+0000 7fbea1dfc640 1 --2- 172.21.15.88:0/3179360189 >> v2:172.21.15.88:3300/0 conn(0x7fbe9c0cc460 0x7fbe9c06b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:08.074 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.072+0000 7fbea1dfc640 1 --2- 172.21.15.88:0/3179360189 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe9c153820 0x7fbe9c159e90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:08.074 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.072+0000 7fbea1dfc640 1 -- 172.21.15.88:0/3179360189 >> 172.21.15.88:0/3179360189 conn(0x7fbe9c070960 msgr2=0x7fbe9c070d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:08.074 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.072+0000 7fbea1dfc640 1 -- 172.21.15.88:0/3179360189 shutdown_connections 2023-11-27T20:54:08.074 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.072+0000 7fbea1dfc640 1 -- 172.21.15.88:0/3179360189 wait complete. 2023-11-27T20:54:08.075 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.074+0000 7fbea1dfc640 1 Processor -- start 2023-11-27T20:54:08.075 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.074+0000 7fbea1dfc640 1 -- start start 2023-11-27T20:54:08.077 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.075+0000 7fbea1dfc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe9c0cc460 0x7fbe9c1efc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:08.077 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.075+0000 7fbea1dfc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe9c0cc880 0x7fbe9c155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:08.077 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.075+0000 7fbea1dfc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe9c153820 0x7fbe9c14fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:08.077 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.075+0000 7fbea1dfc640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c0c77a0 con 0x7fbe9c0cc460 2023-11-27T20:54:08.077 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.075+0000 7fbea1dfc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c1f2f00 con 0x7fbe9c0cc880 2023-11-27T20:54:08.077 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.075+0000 7fbea1dfc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c1561f0 con 0x7fbe9c153820 2023-11-27T20:54:08.078 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.076+0000 7fbe9affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe9c0cc880 0x7fbe9c155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:08.078 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.076+0000 7fbe9affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe9c0cc880 0x7fbe9c155cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:60694/0 (socket says 172.21.15.88:60694) 2023-11-27T20:54:08.078 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.076+0000 7fbe9affd640 1 -- 172.21.15.88:0/2941245812 learned_addr learned my addr 172.21.15.88:0/2941245812 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:08.081 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.078+0000 7fbe9bfff640 1 --2- 172.21.15.88:0/2941245812 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe9c153820 0x7fbe9c14fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:08.082 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.079+0000 7fbe9affd640 1 -- 172.21.15.88:0/2941245812 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe9c153820 msgr2=0x7fbe9c14fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:08.082 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.079+0000 7fbe9affd640 1 --2- 172.21.15.88:0/2941245812 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe9c153820 0x7fbe9c14fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:08.082 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.079+0000 7fbe9affd640 1 -- 172.21.15.88:0/2941245812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe9c0cc460 msgr2=0x7fbe9c1efc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:08.082 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.079+0000 7fbe9affd640 1 --2- 172.21.15.88:0/2941245812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe9c0cc460 0x7fbe9c1efc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:08.082 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.079+0000 7fbe9affd640 1 -- 172.21.15.88:0/2941245812 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe900094d0 con 0x7fbe9c0cc880 2023-11-27T20:54:08.083 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.082+0000 7fbe9affd640 1 --2- 172.21.15.88:0/2941245812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe9c0cc880 0x7fbe9c155cb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c00b4a0 tx=0x7fbe8c00b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:08.087 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.085+0000 7fbe83fff640 1 -- 172.21.15.88:0/2941245812 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c010610 con 0x7fbe9c0cc880 2023-11-27T20:54:08.087 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.085+0000 7fbe83fff640 1 -- 172.21.15.88:0/2941245812 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8c010770 con 0x7fbe9c0cc880 2023-11-27T20:54:08.087 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.085+0000 7fbe83fff640 1 -- 172.21.15.88:0/2941245812 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c010b20 con 0x7fbe9c0cc880 2023-11-27T20:54:08.087 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.085+0000 7fbea1dfc640 1 -- 172.21.15.88:0/2941245812 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe9c1554d0 con 0x7fbe9c0cc880 2023-11-27T20:54:08.087 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.085+0000 7fbea1dfc640 1 -- 172.21.15.88:0/2941245812 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe9c1f28b0 con 0x7fbe9c0cc880 2023-11-27T20:54:08.087 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.086+0000 7fbea1dfc640 1 -- 172.21.15.88:0/2941245812 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe9c073dc0 con 0x7fbe9c0cc880 2023-11-27T20:54:08.106 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.105+0000 7fbe83fff640 1 -- 172.21.15.88:0/2941245812 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 4) v1 ==== 89314+0+0 (secure 0 0 0) 0x7fbe8c010c80 con 0x7fbe9c0cc880 2023-11-27T20:54:08.106 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.105+0000 7fbe83fff640 1 --2- 172.21.15.88:0/2941245812 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fbe8806b180 0x7fbe8806d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:08.106 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.105+0000 7fbe9b7fe640 1 --2- 172.21.15.88:0/2941245812 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fbe8806b180 0x7fbe8806d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:08.107 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.105+0000 7fbe9b7fe640 1 --2- 172.21.15.88:0/2941245812 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fbe8806b180 0x7fbe8806d640 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbe90036000 tx=0x7fbe9003b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:08.345 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.344+0000 7fbe83fff640 1 -- 172.21.15.88:0/2941245812 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3071+0+0 (secure 0 0 0) 0x7fbe8c058bc0 con 0x7fbe9c0cc880 2023-11-27T20:54:08.409 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.407+0000 7fbe83fff640 1 -- 172.21.15.88:0/2941245812 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fbe8c054800 con 0x7fbe9c0cc880 2023-11-27T20:54:08.585 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.583+0000 7fbea1dfc640 1 -- 172.21.15.88:0/2941245812 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe9c1f3090 con 0x7fbe9c0cc880 2023-11-27T20:54:08.669 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.667+0000 7fbe83fff640 1 -- 172.21.15.88:0/2941245812 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+10966 (secure 0 0 0) 0x7fbe8c01e070 con 0x7fbe9c0cc880 2023-11-27T20:54:08.669 INFO:teuthology.misc.health.smithi088.stdout: 2023-11-27T20:54:08.669 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":15,"fsid":"ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc","created":"2023-11-27T20:53:53.110827+0000","modified":"2023-11-27T20:54:08.219383+0000","last_up_change":"2023-11-27T20:54:08.219383+0000","last_in_change":"2023-11-27T20:53:59.022798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1207ca0f-bef1-44c6-b66b-58bf0e080ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6819","nonce":3952326022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6821","nonce":3952326022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6825","nonce":3952326022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6823","nonce":3952326022}]},"public_addr":"172.21.15.88:6819/3952326022","cluster_addr":"172.21.15.88:6821/3952326022","heartbeat_back_addr":"172.21.15.88:6825/3952326022","heartbeat_front_addr":"172.21.15.88:6823/3952326022","state":["exists","up"]},{"osd":1,"uuid":"8d1be479-4241-4335-9633-1394311fde76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6827","nonce":1788401966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6829","nonce":1788401966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6833","nonce":1788401966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6831","nonce":1788401966}]},"public_addr":"172.21.15.88:6827/1788401966","cluster_addr":"172.21.15.88:6829/1788401966","heartbeat_back_addr":"172.21.15.88:6833/1788401966","heartbeat_front_addr":"172.21.15.88:6831/1788401966","state":["exists","up"]},{"osd":2,"uuid":"7536b008-05dd-40eb-9d4a-bdac4b1c38c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6803","nonce":1166333913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6805","nonce":1166333913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6809","nonce":1166333913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6807","nonce":1166333913}]},"public_addr":"172.21.15.88:6803/1166333913","cluster_addr":"172.21.15.88:6805/1166333913","heartbeat_back_addr":"172.21.15.88:6809/1166333913","heartbeat_front_addr":"172.21.15.88:6807/1166333913","state":["exists","up"]},{"osd":3,"uuid":"47edd4d7-e99c-4ce3-851b-cc9c8e2d4480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6811","nonce":406887502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6813","nonce":406887502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6817","nonce":406887502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6815","nonce":406887502}]},"public_addr":"172.21.15.88:6811/406887502","cluster_addr":"172.21.15.88:6813/406887502","heartbeat_back_addr":"172.21.15.88:6817/406887502","heartbeat_front_addr":"172.21.15.88:6815/406887502","state":["exists","up"]},{"osd":4,"uuid":"0a81dd31-1a8b-41af-b933-d74aae63f3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6801","nonce":2551293703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6803","nonce":2551293703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6807","nonce":2551293703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6805","nonce":2551293703}]},"public_addr":"172.21.15.167:6801/2551293703","cluster_addr":"172.21.15.167:6803/2551293703","heartbeat_back_addr":"172.21.15.167:6807/2551293703","heartbeat_front_addr":"172.21.15.167:6805/2551293703","state":["exists","up"]},{"osd":5,"uuid":"1c462d0d-3361-48b3-a82a-86a920539e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6825","nonce":866085094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6827","nonce":866085094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6831","nonce":866085094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6829","nonce":866085094}]},"public_addr":"172.21.15.167:6825/866085094","cluster_addr":"172.21.15.167:6827/866085094","heartbeat_back_addr":"172.21.15.167:6831/866085094","heartbeat_front_addr":"172.21.15.167:6829/866085094","state":["exists","up"]},{"osd":6,"uuid":"d687c5ad-6c88-4a15-8120-0cdbc5610535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6809","nonce":2766725538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6811","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6813","nonce":2766725538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6819","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6821","nonce":2766725538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6815","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6817","nonce":2766725538}]},"public_addr":"172.21.15.167:6809/2766725538","cluster_addr":"172.21.15.167:6813/2766725538","heartbeat_back_addr":"172.21.15.167:6821/2766725538","heartbeat_front_addr":"172.21.15.167:6817/2766725538","state":["exists","up"]},{"osd":7,"uuid":"c9a50596-4981-4bd8-a8ef-d7679f8d9559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6812","nonce":2695037266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6816","nonce":2695037266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6823","nonce":2695037266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6820","nonce":2695037266}]},"public_addr":"172.21.15.167:6812/2695037266","cluster_addr":"172.21.15.167:6816/2695037266","heartbeat_back_addr":"172.21.15.167:6823/2695037266","heartbeat_front_addr":"172.21.15.167:6820/2695037266","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.432204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.414964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.460394+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:54:08.671 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.669+0000 7fbea1dfc640 1 -- 172.21.15.88:0/2941245812 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fbe8806b180 msgr2=0x7fbe8806d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:08.671 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.669+0000 7fbea1dfc640 1 --2- 172.21.15.88:0/2941245812 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fbe8806b180 0x7fbe8806d640 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbe90036000 tx=0x7fbe9003b040 comp rx=0 tx=0).stop 2023-11-27T20:54:08.671 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.669+0000 7fbea1dfc640 1 -- 172.21.15.88:0/2941245812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe9c0cc880 msgr2=0x7fbe9c155cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:08.672 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.669+0000 7fbea1dfc640 1 --2- 172.21.15.88:0/2941245812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe9c0cc880 0x7fbe9c155cb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c00b4a0 tx=0x7fbe8c00b960 comp rx=0 tx=0).stop 2023-11-27T20:54:08.672 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.669+0000 7fbea1dfc640 1 -- 172.21.15.88:0/2941245812 shutdown_connections 2023-11-27T20:54:08.672 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.669+0000 7fbea1dfc640 1 --2- 172.21.15.88:0/2941245812 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fbe8806b180 0x7fbe8806d640 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:08.672 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.669+0000 7fbea1dfc640 1 --2- 172.21.15.88:0/2941245812 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe9c153820 0x7fbe9c14fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:08.672 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.669+0000 7fbea1dfc640 1 --2- 172.21.15.88:0/2941245812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe9c0cc880 0x7fbe9c155cb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:08.672 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.669+0000 7fbea1dfc640 1 --2- 172.21.15.88:0/2941245812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe9c0cc460 0x7fbe9c1efc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:08.672 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.669+0000 7fbea1dfc640 1 -- 172.21.15.88:0/2941245812 >> 172.21.15.88:0/2941245812 conn(0x7fbe9c070960 msgr2=0x7fbe9c152540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:08.673 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.669+0000 7fbea1dfc640 1 -- 172.21.15.88:0/2941245812 shutdown_connections 2023-11-27T20:54:08.673 INFO:teuthology.misc.health.smithi088.stderr:2023-11-27T20:54:08.669+0000 7fbea1dfc640 1 -- 172.21.15.88:0/2941245812 wait complete. 2023-11-27T20:54:08.682 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-27T20:54:08.682 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-27T20:54:08.682 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-11-27T20:54:08.683 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-27T20:54:08.683 DEBUG:teuthology.orchestra.run.smithi088:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a 2023-11-27T20:54:08.686 INFO:tasks.ceph.mds.a:Started 2023-11-27T20:54:08.686 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-11-27T20:54:08.686 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-27T20:54:08.686 DEBUG:teuthology.orchestra.run.smithi088:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c 2023-11-27T20:54:08.689 INFO:tasks.ceph.mds.c:Started 2023-11-27T20:54:08.689 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-11-27T20:54:08.689 INFO:tasks.ceph.mds.e:Restarting daemon 2023-11-27T20:54:08.689 DEBUG:teuthology.orchestra.run.smithi088:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e 2023-11-27T20:54:08.691 INFO:tasks.ceph.mds.e:Started 2023-11-27T20:54:08.691 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-11-27T20:54:08.691 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-27T20:54:08.692 DEBUG:teuthology.orchestra.run.smithi167:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b 2023-11-27T20:54:08.694 INFO:tasks.ceph.mds.b:Started 2023-11-27T20:54:08.694 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-11-27T20:54:08.694 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-27T20:54:08.694 DEBUG:teuthology.orchestra.run.smithi167:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d 2023-11-27T20:54:08.698 INFO:tasks.ceph.mds.d:Started 2023-11-27T20:54:08.698 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-11-27T20:54:08.698 INFO:tasks.ceph.mds.f:Restarting daemon 2023-11-27T20:54:08.698 DEBUG:teuthology.orchestra.run.smithi167:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f 2023-11-27T20:54:08.700 INFO:tasks.ceph.mds.f:Started 2023-11-27T20:54:08.701 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-27T20:54:08.701 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:54:08.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.820+0000 7f8bb9153640 1 Processor -- start 2023-11-27T20:54:08.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.820+0000 7f8bb9153640 1 -- start start 2023-11-27T20:54:08.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.821+0000 7f8bb9153640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8bb40cc420 0x7f8bb4159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:08.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.821+0000 7f8bb9153640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb40cbda0 con 0x7f8bb40cda70 2023-11-27T20:54:08.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.821+0000 7f8bb9153640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb40cea60 con 0x7f8bb4159b50 2023-11-27T20:54:08.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.821+0000 7f8bb9153640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb40cc230 con 0x7f8bb40cc420 2023-11-27T20:54:08.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.822+0000 7f8bb2d9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8bb40cda70 0x7f8bb40ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54838/0 (socket says 172.21.15.88:54838) 2023-11-27T20:54:08.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.822+0000 7f8bb2d9d640 1 -- 172.21.15.88:0/3422194721 learned_addr learned my addr 172.21.15.88:0/3422194721 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:54:08.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.822+0000 7f8bb259c640 1 --2- 172.21.15.88:0/3422194721 >> v2:172.21.15.167:3300/0 conn(0x7f8bb40cc420 0x7f8bb4159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:08.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.825+0000 7f8bb1d9b640 1 -- 172.21.15.88:0/3422194721 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518632925 0 0) 0x7f8bb40cbda0 con 0x7f8bb40cda70 2023-11-27T20:54:08.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.825+0000 7f8bb1d9b640 1 -- 172.21.15.88:0/3422194721 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b9c003520 con 0x7f8bb40cda70 2023-11-27T20:54:08.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.829+0000 7f8bb259c640 1 -- 172.21.15.88:0/3422194721 >> v1:172.21.15.167:6789/0 conn(0x7f8bb4159b50 legacy=0x7f8bb40c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:08.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.829+0000 7f8bb259c640 1 -- 172.21.15.88:0/3422194721 >> v1:172.21.15.88:6789/0 conn(0x7f8bb40cda70 legacy=0x7f8bb40ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:08.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.829+0000 7f8bb259c640 1 -- 172.21.15.88:0/3422194721 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb40cb4e0 con 0x7f8bb40cc420 2023-11-27T20:54:08.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.833+0000 7f8bb259c640 1 --2- 172.21.15.88:0/3422194721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bb40cc420 0x7f8bb4159610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80097a0 tx=0x7f8ba802b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=867972450496ac6d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:08.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.836+0000 7f8bb1d9b640 1 -- 172.21.15.88:0/3422194721 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba802f810 con 0x7f8bb40cc420 2023-11-27T20:54:08.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.838+0000 7f8bb1d9b640 1 -- 172.21.15.88:0/3422194721 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba802f970 con 0x7f8bb40cc420 2023-11-27T20:54:08.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.838+0000 7f8bb1d9b640 1 -- 172.21.15.88:0/3422194721 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba802fce0 con 0x7f8bb40cc420 2023-11-27T20:54:08.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.839+0000 7f8bb9153640 1 -- 172.21.15.88:0/3422194721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bb40cc420 msgr2=0x7f8bb4159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:08.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.839+0000 7f8bb9153640 1 --2- 172.21.15.88:0/3422194721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bb40cc420 0x7f8bb4159610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80097a0 tx=0x7f8ba802b9f0 comp rx=0 tx=0).stop 2023-11-27T20:54:08.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.839+0000 7f8bb9153640 1 -- 172.21.15.88:0/3422194721 shutdown_connections 2023-11-27T20:54:08.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.839+0000 7f8bb9153640 1 --2- 172.21.15.88:0/3422194721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bb40cc420 0x7f8bb4159610 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:08.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.839+0000 7f8bb9153640 1 -- 172.21.15.88:0/3422194721 >> 172.21.15.88:0/3422194721 conn(0x7f8bb40b07b0 msgr2=0x7f8bb40b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:08.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.839+0000 7f8bb9153640 1 -- 172.21.15.88:0/3422194721 shutdown_connections 2023-11-27T20:54:08.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.839+0000 7f8bb9153640 1 -- 172.21.15.88:0/3422194721 wait complete. 2023-11-27T20:54:08.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.841+0000 7f8bb9153640 1 Processor -- start 2023-11-27T20:54:08.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.841+0000 7f8bb9153640 1 -- start start 2023-11-27T20:54:08.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.841+0000 7f8bb9153640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8bb40cc420 0x7f8bb41e3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:08.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.841+0000 7f8bb9153640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8bb40cda70 0x7f8bb41f31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:08.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.841+0000 7f8bb9153640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bb4159b50 0x7f8bb41e5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:08.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.841+0000 7f8bb9153640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb41f00f0 con 0x7f8bb40cc420 2023-11-27T20:54:08.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.841+0000 7f8bb9153640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb4150e10 con 0x7f8bb4159b50 2023-11-27T20:54:08.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.841+0000 7f8bb9153640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb41ef220 con 0x7f8bb40cda70 2023-11-27T20:54:08.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.842+0000 7f8bb359e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bb4159b50 0x7f8bb41e5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:08.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.842+0000 7f8bb259c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8bb40cda70 0x7f8bb41f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:08.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.842+0000 7f8bb2d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8bb40cc420 0x7f8bb41e3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:08.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.843+0000 7f8bb359e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bb4159b50 0x7f8bb41e5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:60718/0 (socket says 172.21.15.88:60718) 2023-11-27T20:54:08.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.843+0000 7f8bb359e640 1 -- 172.21.15.88:0/2666562477 learned_addr learned my addr 172.21.15.88:0/2666562477 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:08.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.848+0000 7f8bb2d9d640 1 -- 172.21.15.88:0/2666562477 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8bb40cda70 msgr2=0x7f8bb41f31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:08.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.848+0000 7f8bb2d9d640 1 --2- 172.21.15.88:0/2666562477 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8bb40cda70 0x7f8bb41f31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:08.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.848+0000 7f8bb2d9d640 1 -- 172.21.15.88:0/2666562477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bb4159b50 msgr2=0x7f8bb41e5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:08.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.848+0000 7f8bb2d9d640 1 --2- 172.21.15.88:0/2666562477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bb4159b50 0x7f8bb41e5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:08.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.848+0000 7f8bb2d9d640 1 -- 172.21.15.88:0/2666562477 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba8009400 con 0x7f8bb40cc420 2023-11-27T20:54:08.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.851+0000 7f8bb2d9d640 1 --2- 172.21.15.88:0/2666562477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8bb40cc420 0x7f8bb41e3270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400c430 tx=0x7f8ba400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:08.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.856+0000 7f8b9b7fe640 1 -- 172.21.15.88:0/2666562477 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4005ce0 con 0x7f8bb40cc420 2023-11-27T20:54:08.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.857+0000 7f8b9b7fe640 1 -- 172.21.15.88:0/2666562477 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba4005e40 con 0x7f8bb40cc420 2023-11-27T20:54:08.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.857+0000 7f8bb9153640 1 -- 172.21.15.88:0/2666562477 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb41ef4e0 con 0x7f8bb40cc420 2023-11-27T20:54:08.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.857+0000 7f8b9b7fe640 1 -- 172.21.15.88:0/2666562477 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba40072d0 con 0x7f8bb40cc420 2023-11-27T20:54:08.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.857+0000 7f8bb9153640 1 -- 172.21.15.88:0/2666562477 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb41efaa0 con 0x7f8bb40cc420 2023-11-27T20:54:08.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.858+0000 7f8bb9153640 1 -- 172.21.15.88:0/2666562477 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb4072670 con 0x7f8bb40cc420 2023-11-27T20:54:08.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.888+0000 7f8b9b7fe640 1 -- 172.21.15.88:0/2666562477 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 89314+0+0 (secure 0 0 0) 0x7f8ba4007430 con 0x7f8bb40cc420 2023-11-27T20:54:08.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.888+0000 7f8b9b7fe640 1 --2- 172.21.15.88:0/2666562477 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f8ba006b180 0x7f8ba006d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:08.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.889+0000 7f8bb259c640 1 --2- 172.21.15.88:0/2666562477 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f8ba006b180 0x7f8ba006d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:08.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.889+0000 7f8bb259c640 1 --2- 172.21.15.88:0/2666562477 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f8ba006b180 0x7f8ba006d640 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8036000 tx=0x7f8ba8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:08.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:08.893+0000 7f8b9b7fe640 1 -- 172.21.15.88:0/2666562477 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f8ba4057f10 con 0x7f8bb40cc420 2023-11-27T20:54:09.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.145+0000 7f8b9b7fe640 1 -- 172.21.15.88:0/2666562477 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8ba4054250 con 0x7f8bb40cc420 2023-11-27T20:54:09.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.333+0000 7f8bb9153640 1 -- 172.21.15.88:0/2666562477 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8bb40b0b90 con 0x7f8bb40cc420 2023-11-27T20:54:09.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.398+0000 7f8b9b7fe640 1 -- 172.21.15.88:0/2666562477 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+10966 (secure 0 0 0) 0x7f8ba4057870 con 0x7f8bb40cc420 2023-11-27T20:54:09.399 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:54:09.400 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":15,"fsid":"ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc","created":"2023-11-27T20:53:53.110827+0000","modified":"2023-11-27T20:54:08.219383+0000","last_up_change":"2023-11-27T20:54:08.219383+0000","last_in_change":"2023-11-27T20:53:59.022798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1207ca0f-bef1-44c6-b66b-58bf0e080ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6819","nonce":3952326022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6821","nonce":3952326022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6825","nonce":3952326022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6823","nonce":3952326022}]},"public_addr":"172.21.15.88:6819/3952326022","cluster_addr":"172.21.15.88:6821/3952326022","heartbeat_back_addr":"172.21.15.88:6825/3952326022","heartbeat_front_addr":"172.21.15.88:6823/3952326022","state":["exists","up"]},{"osd":1,"uuid":"8d1be479-4241-4335-9633-1394311fde76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6827","nonce":1788401966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6829","nonce":1788401966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6833","nonce":1788401966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6831","nonce":1788401966}]},"public_addr":"172.21.15.88:6827/1788401966","cluster_addr":"172.21.15.88:6829/1788401966","heartbeat_back_addr":"172.21.15.88:6833/1788401966","heartbeat_front_addr":"172.21.15.88:6831/1788401966","state":["exists","up"]},{"osd":2,"uuid":"7536b008-05dd-40eb-9d4a-bdac4b1c38c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6803","nonce":1166333913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6805","nonce":1166333913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6809","nonce":1166333913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6807","nonce":1166333913}]},"public_addr":"172.21.15.88:6803/1166333913","cluster_addr":"172.21.15.88:6805/1166333913","heartbeat_back_addr":"172.21.15.88:6809/1166333913","heartbeat_front_addr":"172.21.15.88:6807/1166333913","state":["exists","up"]},{"osd":3,"uuid":"47edd4d7-e99c-4ce3-851b-cc9c8e2d4480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6811","nonce":406887502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6813","nonce":406887502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6817","nonce":406887502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6815","nonce":406887502}]},"public_addr":"172.21.15.88:6811/406887502","cluster_addr":"172.21.15.88:6813/406887502","heartbeat_back_addr":"172.21.15.88:6817/406887502","heartbeat_front_addr":"172.21.15.88:6815/406887502","state":["exists","up"]},{"osd":4,"uuid":"0a81dd31-1a8b-41af-b933-d74aae63f3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6801","nonce":2551293703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6803","nonce":2551293703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6807","nonce":2551293703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6805","nonce":2551293703}]},"public_addr":"172.21.15.167:6801/2551293703","cluster_addr":"172.21.15.167:6803/2551293703","heartbeat_back_addr":"172.21.15.167:6807/2551293703","heartbeat_front_addr":"172.21.15.167:6805/2551293703","state":["exists","up"]},{"osd":5,"uuid":"1c462d0d-3361-48b3-a82a-86a920539e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6825","nonce":866085094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6827","nonce":866085094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6831","nonce":866085094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6829","nonce":866085094}]},"public_addr":"172.21.15.167:6825/866085094","cluster_addr":"172.21.15.167:6827/866085094","heartbeat_back_addr":"172.21.15.167:6831/866085094","heartbeat_front_addr":"172.21.15.167:6829/866085094","state":["exists","up"]},{"osd":6,"uuid":"d687c5ad-6c88-4a15-8120-0cdbc5610535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6809","nonce":2766725538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6811","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6813","nonce":2766725538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6819","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6821","nonce":2766725538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6815","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6817","nonce":2766725538}]},"public_addr":"172.21.15.167:6809/2766725538","cluster_addr":"172.21.15.167:6813/2766725538","heartbeat_back_addr":"172.21.15.167:6821/2766725538","heartbeat_front_addr":"172.21.15.167:6817/2766725538","state":["exists","up"]},{"osd":7,"uuid":"c9a50596-4981-4bd8-a8ef-d7679f8d9559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6812","nonce":2695037266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6816","nonce":2695037266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6823","nonce":2695037266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6820","nonce":2695037266}]},"public_addr":"172.21.15.167:6812/2695037266","cluster_addr":"172.21.15.167:6816/2695037266","heartbeat_back_addr":"172.21.15.167:6823/2695037266","heartbeat_front_addr":"172.21.15.167:6820/2695037266","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.432204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.414964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.460394+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:54:09.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.401+0000 7f8bb9153640 1 -- 172.21.15.88:0/2666562477 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f8ba006b180 msgr2=0x7f8ba006d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:09.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.401+0000 7f8bb9153640 1 --2- 172.21.15.88:0/2666562477 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f8ba006b180 0x7f8ba006d640 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8036000 tx=0x7f8ba8008030 comp rx=0 tx=0).stop 2023-11-27T20:54:09.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.401+0000 7f8bb9153640 1 -- 172.21.15.88:0/2666562477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8bb40cc420 msgr2=0x7f8bb41e3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:09.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.401+0000 7f8bb9153640 1 --2- 172.21.15.88:0/2666562477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8bb40cc420 0x7f8bb41e3270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400c430 tx=0x7f8ba400c8f0 comp rx=0 tx=0).stop 2023-11-27T20:54:09.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.401+0000 7f8bb9153640 1 -- 172.21.15.88:0/2666562477 shutdown_connections 2023-11-27T20:54:09.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.401+0000 7f8bb9153640 1 --2- 172.21.15.88:0/2666562477 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f8ba006b180 0x7f8ba006d640 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:09.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.401+0000 7f8bb9153640 1 --2- 172.21.15.88:0/2666562477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bb4159b50 0x7f8bb41e5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:09.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.401+0000 7f8bb9153640 1 --2- 172.21.15.88:0/2666562477 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8bb40cda70 0x7f8bb41f31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:09.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.401+0000 7f8bb9153640 1 --2- 172.21.15.88:0/2666562477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8bb40cc420 0x7f8bb41e3270 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400c430 tx=0x7f8ba400c8f0 comp rx=0 tx=0).stop 2023-11-27T20:54:09.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.401+0000 7f8bb9153640 1 -- 172.21.15.88:0/2666562477 >> 172.21.15.88:0/2666562477 conn(0x7f8bb40b07b0 msgr2=0x7f8bb40b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:09.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.402+0000 7f8bb9153640 1 -- 172.21.15.88:0/2666562477 shutdown_connections 2023-11-27T20:54:09.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.402+0000 7f8bb9153640 1 -- 172.21.15.88:0/2666562477 wait complete. 2023-11-27T20:54:09.420 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-11-27T20:54:09.420 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:54:09.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.521+0000 7f5eaf553640 1 Processor -- start 2023-11-27T20:54:09.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.522+0000 7f5eaf553640 1 -- start start 2023-11-27T20:54:09.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.522+0000 7f5eaf553640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5ea81514a0 0x7f5ea80c3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:09.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.522+0000 7f5eaf553640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea8158340 con 0x7f5ea8157330 2023-11-27T20:54:09.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.522+0000 7f5eaf553640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea8157e50 con 0x7f5ea80c3650 2023-11-27T20:54:09.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.522+0000 7f5eaf553640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea81580a0 con 0x7f5ea81514a0 2023-11-27T20:54:09.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.523+0000 7f5eadaf0640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5ea8157330 0x7f5ea8157740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54846/0 (socket says 172.21.15.88:54846) 2023-11-27T20:54:09.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.523+0000 7f5eadaf0640 1 -- 172.21.15.88:0/3839249011 learned_addr learned my addr 172.21.15.88:0/3839249011 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:54:09.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.524+0000 7f5ead2ef640 1 --2- 172.21.15.88:0/3839249011 >> v2:172.21.15.167:3300/0 conn(0x7f5ea81514a0 0x7f5ea80c3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:09.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.526+0000 7f5e9ffff640 1 -- 172.21.15.88:0/3839249011 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988263430 0 0) 0x7f5ea8158340 con 0x7f5ea8157330 2023-11-27T20:54:09.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.526+0000 7f5e9ffff640 1 -- 172.21.15.88:0/3839249011 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e94003520 con 0x7f5ea8157330 2023-11-27T20:54:09.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.529+0000 7f5ead2ef640 1 -- 172.21.15.88:0/3839249011 >> v1:172.21.15.167:6789/0 conn(0x7f5ea80c3650 legacy=0x7f5ea80ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:09.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.530+0000 7f5ead2ef640 1 -- 172.21.15.88:0/3839249011 >> v1:172.21.15.88:6789/0 conn(0x7f5ea8157330 legacy=0x7f5ea8157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:09.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.530+0000 7f5ead2ef640 1 -- 172.21.15.88:0/3839249011 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea80c2370 con 0x7f5ea81514a0 2023-11-27T20:54:09.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.534+0000 7f5ead2ef640 1 --2- 172.21.15.88:0/3839249011 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea81514a0 0x7f5ea80c3110 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40097a0 tx=0x7f5ea402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9766ca42dd392736 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:09.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.539+0000 7f5e9ffff640 1 -- 172.21.15.88:0/3839249011 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea4030610 con 0x7f5ea81514a0 2023-11-27T20:54:09.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.539+0000 7f5e9ffff640 1 -- 172.21.15.88:0/3839249011 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea4030770 con 0x7f5ea81514a0 2023-11-27T20:54:09.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.539+0000 7f5e9ffff640 1 -- 172.21.15.88:0/3839249011 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea4030b00 con 0x7f5ea81514a0 2023-11-27T20:54:09.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.539+0000 7f5eaf553640 1 -- 172.21.15.88:0/3839249011 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea81514a0 msgr2=0x7f5ea80c3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:09.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.539+0000 7f5eaf553640 1 --2- 172.21.15.88:0/3839249011 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea81514a0 0x7f5ea80c3110 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40097a0 tx=0x7f5ea402b960 comp rx=0 tx=0).stop 2023-11-27T20:54:09.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.540+0000 7f5eaf553640 1 -- 172.21.15.88:0/3839249011 shutdown_connections 2023-11-27T20:54:09.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.540+0000 7f5eaf553640 1 --2- 172.21.15.88:0/3839249011 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea81514a0 0x7f5ea80c3110 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:09.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.540+0000 7f5eaf553640 1 -- 172.21.15.88:0/3839249011 >> 172.21.15.88:0/3839249011 conn(0x7f5ea8070790 msgr2=0x7f5ea8070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:09.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.540+0000 7f5eaf553640 1 -- 172.21.15.88:0/3839249011 shutdown_connections 2023-11-27T20:54:09.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.540+0000 7f5eaf553640 1 -- 172.21.15.88:0/3839249011 wait complete. 2023-11-27T20:54:09.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.541+0000 7f5eaf553640 1 Processor -- start 2023-11-27T20:54:09.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.542+0000 7f5eaf553640 1 -- start start 2023-11-27T20:54:09.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.543+0000 7f5eaf553640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ea80c3650 0x7f5ea81f0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:09.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.543+0000 7f5eaf553640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ea81514a0 0x7f5ea81543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:09.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.543+0000 7f5eaf553640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea8157330 0x7f5ea814bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:09.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.543+0000 7f5eaf553640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea81495f0 con 0x7f5ea80c3650 2023-11-27T20:54:09.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.543+0000 7f5eaf553640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea814baf0 con 0x7f5ea8157330 2023-11-27T20:54:09.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.543+0000 7f5eaf553640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea81f0f30 con 0x7f5ea81514a0 2023-11-27T20:54:09.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.543+0000 7f5ead2ef640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ea80c3650 0x7f5ea81f0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:09.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.543+0000 7f5eadaf0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea8157330 0x7f5ea814bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:09.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.543+0000 7f5eacaee640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ea81514a0 0x7f5ea81543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:09.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.544+0000 7f5eadaf0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea8157330 0x7f5ea814bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:60732/0 (socket says 172.21.15.88:60732) 2023-11-27T20:54:09.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.544+0000 7f5eadaf0640 1 -- 172.21.15.88:0/722336875 learned_addr learned my addr 172.21.15.88:0/722336875 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:09.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.547+0000 7f5ead2ef640 1 -- 172.21.15.88:0/722336875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ea81514a0 msgr2=0x7f5ea81543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:09.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.547+0000 7f5ead2ef640 1 --2- 172.21.15.88:0/722336875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ea81514a0 0x7f5ea81543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:09.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.547+0000 7f5ead2ef640 1 -- 172.21.15.88:0/722336875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea8157330 msgr2=0x7f5ea814bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:09.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.547+0000 7f5ead2ef640 1 --2- 172.21.15.88:0/722336875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea8157330 0x7f5ea814bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:09.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.548+0000 7f5ead2ef640 1 -- 172.21.15.88:0/722336875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea4009400 con 0x7f5ea80c3650 2023-11-27T20:54:09.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.550+0000 7f5ead2ef640 1 --2- 172.21.15.88:0/722336875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ea80c3650 0x7f5ea81f0670 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4033000 tx=0x7f5ea4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:09.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.559+0000 7f5e9dffb640 1 -- 172.21.15.88:0/722336875 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea403e040 con 0x7f5ea80c3650 2023-11-27T20:54:09.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.559+0000 7f5e9dffb640 1 -- 172.21.15.88:0/722336875 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea4039cb0 con 0x7f5ea80c3650 2023-11-27T20:54:09.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.559+0000 7f5eaf553640 1 -- 172.21.15.88:0/722336875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea8149820 con 0x7f5ea80c3650 2023-11-27T20:54:09.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.559+0000 7f5e9dffb640 1 -- 172.21.15.88:0/722336875 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea4044630 con 0x7f5ea80c3650 2023-11-27T20:54:09.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.560+0000 7f5eaf553640 1 -- 172.21.15.88:0/722336875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea81f11a0 con 0x7f5ea80c3650 2023-11-27T20:54:09.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.561+0000 7f5eaf553640 1 -- 172.21.15.88:0/722336875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea80c33d0 con 0x7f5ea80c3650 2023-11-27T20:54:09.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.713+0000 7f5e9dffb640 1 -- 172.21.15.88:0/722336875 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 89314+0+0 (secure 0 0 0) 0x7f5ea402f370 con 0x7f5ea80c3650 2023-11-27T20:54:09.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.714+0000 7f5e9dffb640 1 --2- 172.21.15.88:0/722336875 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5e8c06b130 0x7f5e8c06d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:09.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.714+0000 7f5eacaee640 1 --2- 172.21.15.88:0/722336875 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5e8c06b130 0x7f5e8c06d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:09.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.714+0000 7f5eacaee640 1 --2- 172.21.15.88:0/722336875 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5e8c06b130 0x7f5e8c06d5f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5ea815ba20 tx=0x7f5e98009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:09.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:09.719+0000 7f5e9dffb640 1 -- 172.21.15.88:0/722336875 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f5ea4039e20 con 0x7f5ea80c3650 2023-11-27T20:54:10.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:10.013+0000 7f5e9dffb640 1 -- 172.21.15.88:0/722336875 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5ea4076c90 con 0x7f5ea80c3650 2023-11-27T20:54:10.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:10.316+0000 7f5eaf553640 1 -- 172.21.15.88:0/722336875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ea8067470 con 0x7f5ea80c3650 2023-11-27T20:54:10.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:10.380+0000 7f5e9dffb640 1 -- 172.21.15.88:0/722336875 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f5ea4049090 con 0x7f5ea80c3650 2023-11-27T20:54:10.382 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:54:10.382 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-11-27T20:54:10.383 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 1 2023-11-27T20:54:10.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:10.384+0000 7f5eaf553640 1 -- 172.21.15.88:0/722336875 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5e8c06b130 msgr2=0x7f5e8c06d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:10.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:10.384+0000 7f5eaf553640 1 --2- 172.21.15.88:0/722336875 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5e8c06b130 0x7f5e8c06d5f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5ea815ba20 tx=0x7f5e98009040 comp rx=0 tx=0).stop 2023-11-27T20:54:10.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:10.384+0000 7f5eaf553640 1 -- 172.21.15.88:0/722336875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ea80c3650 msgr2=0x7f5ea81f0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:10.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:10.384+0000 7f5eaf553640 1 --2- 172.21.15.88:0/722336875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ea80c3650 0x7f5ea81f0670 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4033000 tx=0x7f5ea4004730 comp rx=0 tx=0).stop 2023-11-27T20:54:10.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:10.385+0000 7f5eaf553640 1 -- 172.21.15.88:0/722336875 shutdown_connections 2023-11-27T20:54:10.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:10.385+0000 7f5eaf553640 1 --2- 172.21.15.88:0/722336875 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5e8c06b130 0x7f5e8c06d5f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:10.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:10.385+0000 7f5eaf553640 1 --2- 172.21.15.88:0/722336875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea8157330 0x7f5ea814bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:10.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:10.385+0000 7f5eaf553640 1 --2- 172.21.15.88:0/722336875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ea81514a0 0x7f5ea81543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:10.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:10.385+0000 7f5eaf553640 1 --2- 172.21.15.88:0/722336875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ea80c3650 0x7f5ea81f0670 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:10.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:10.385+0000 7f5eaf553640 1 -- 172.21.15.88:0/722336875 >> 172.21.15.88:0/722336875 conn(0x7f5ea8070790 msgr2=0x7f5ea80c8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:10.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:10.385+0000 7f5eaf553640 1 -- 172.21.15.88:0/722336875 shutdown_connections 2023-11-27T20:54:10.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:10.385+0000 7f5eaf553640 1 -- 172.21.15.88:0/722336875 wait complete. 2023-11-27T20:54:12.404 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:54:12.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.539+0000 7f01fab8a640 1 Processor -- start 2023-11-27T20:54:12.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.539+0000 7f01fab8a640 1 -- start start 2023-11-27T20:54:12.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.541+0000 7f01fab8a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01f415b280 0x7f01f40ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:12.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.541+0000 7f01fab8a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f40cc8a0 con 0x7f01f4151550 2023-11-27T20:54:12.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.541+0000 7f01fab8a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f415b710 con 0x7f01f40ca890 2023-11-27T20:54:12.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.541+0000 7f01fab8a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40cac90 con 0x7f01f415b280 2023-11-27T20:54:12.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.542+0000 7f01f3fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f01f40ca890 0x7f01f41571d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:50312/0 (socket says 172.21.15.88:50312) 2023-11-27T20:54:12.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.542+0000 7f01f3fff640 1 -- 172.21.15.88:0/1625126346 learned_addr learned my addr 172.21.15.88:0/1625126346 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:54:12.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.545+0000 7f01f37fe640 1 -- 172.21.15.88:0/1625126346 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1194307815 0 0) 0x7f01f415b710 con 0x7f01f40ca890 2023-11-27T20:54:12.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.545+0000 7f01f37fe640 1 -- 172.21.15.88:0/1625126346 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01e4003520 con 0x7f01f40ca890 2023-11-27T20:54:12.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.546+0000 7f01f37fe640 1 -- 172.21.15.88:0/1625126346 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 330093012 0 0) 0x7f01f40cc8a0 con 0x7f01f4151550 2023-11-27T20:54:12.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.546+0000 7f01f37fe640 1 -- 172.21.15.88:0/1625126346 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01f415b710 con 0x7f01f4151550 2023-11-27T20:54:12.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.550+0000 7f01f37fe640 1 -- 172.21.15.88:0/1625126346 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2168163282 0 0) 0x7f01e4003520 con 0x7f01f40ca890 2023-11-27T20:54:12.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.550+0000 7f01f37fe640 1 -- 172.21.15.88:0/1625126346 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01f415b280 msgr2=0x7f01f40ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:12.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.550+0000 7f01f37fe640 1 --2- 172.21.15.88:0/1625126346 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01f415b280 0x7f01f40ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:12.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.550+0000 7f01f37fe640 1 -- 172.21.15.88:0/1625126346 >> v1:172.21.15.88:6789/0 conn(0x7f01f4151550 legacy=0x7f01f406fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:12.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.550+0000 7f01f37fe640 1 -- 172.21.15.88:0/1625126346 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f4151930 con 0x7f01f40ca890 2023-11-27T20:54:12.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.550+0000 7f01f37fe640 1 -- 172.21.15.88:0/1625126346 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1067350109 0 0) 0x7f01e0001670 con 0x7f01f40ca890 2023-11-27T20:54:12.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.550+0000 7f01f37fe640 1 -- 172.21.15.88:0/1625126346 >> v1:172.21.15.167:6789/0 conn(0x7f01f40ca890 legacy=0x7f01f41571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:12.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.550+0000 7f01f37fe640 1 --2- 172.21.15.88:0/1625126346 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01f415b280 0x7f01e4003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:12.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.550+0000 7f01f37fe640 1 --2- 172.21.15.88:0/1625126346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01e4004120 0x7f01e40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:12.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.550+0000 7f01f37fe640 1 --2- 172.21.15.88:0/1625126346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01e4004e20 0x7f01e400fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:12.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.550+0000 7f01f37fe640 1 -- 172.21.15.88:0/1625126346 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40cac90 con 0x7f01e4004120 2023-11-27T20:54:12.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.550+0000 7f01f37fe640 1 -- 172.21.15.88:0/1625126346 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e4005580 con 0x7f01e4004e20 2023-11-27T20:54:12.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.550+0000 7f01f37fe640 1 -- 172.21.15.88:0/1625126346 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e40102d0 con 0x7f01f415b280 2023-11-27T20:54:12.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.553+0000 7f01f3fff640 1 --2- 172.21.15.88:0/1625126346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01e4004120 0x7f01e40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:12.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.554+0000 7f01f9127640 1 --2- 172.21.15.88:0/1625126346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01e4004e20 0x7f01e400fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:12.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.556+0000 7f01f3fff640 1 -- 172.21.15.88:0/1625126346 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01f415b280 msgr2=0x7f01e4003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:12.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.556+0000 7f01f3fff640 1 --2- 172.21.15.88:0/1625126346 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01f415b280 0x7f01e4003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:12.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.556+0000 7f01f3fff640 1 -- 172.21.15.88:0/1625126346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01e4004e20 msgr2=0x7f01e400fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:12.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.556+0000 7f01f3fff640 1 --2- 172.21.15.88:0/1625126346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01e4004e20 0x7f01e400fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:12.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.556+0000 7f01f3fff640 1 -- 172.21.15.88:0/1625126346 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e4003520 con 0x7f01e4004120 2023-11-27T20:54:12.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.558+0000 7f01f3fff640 1 --2- 172.21.15.88:0/1625126346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01e4004120 0x7f01e40047c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f01e0007fc0 tx=0x7f01e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23eef9592cad46e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:12.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.561+0000 7f01f37fe640 1 -- 172.21.15.88:0/1625126346 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e0005ad0 con 0x7f01e4004120 2023-11-27T20:54:12.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.563+0000 7f01f37fe640 1 -- 172.21.15.88:0/1625126346 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e0005c30 con 0x7f01e4004120 2023-11-27T20:54:12.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.563+0000 7f01f37fe640 1 -- 172.21.15.88:0/1625126346 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e002c9b0 con 0x7f01e4004120 2023-11-27T20:54:12.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.563+0000 7f01fab8a640 1 -- 172.21.15.88:0/1625126346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01e4004120 msgr2=0x7f01e40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:12.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.563+0000 7f01fab8a640 1 --2- 172.21.15.88:0/1625126346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01e4004120 0x7f01e40047c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f01e0007fc0 tx=0x7f01e40057f0 comp rx=0 tx=0).stop 2023-11-27T20:54:12.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.563+0000 7f01f9127640 1 -- 172.21.15.88:0/1625126346 reap_dead start 2023-11-27T20:54:12.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.564+0000 7f01fab8a640 1 -- 172.21.15.88:0/1625126346 shutdown_connections 2023-11-27T20:54:12.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.564+0000 7f01fab8a640 1 -- 172.21.15.88:0/1625126346 >> 172.21.15.88:0/1625126346 conn(0x7f01f4061370 msgr2=0x7f01f4061780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:12.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.564+0000 7f01fab8a640 1 -- 172.21.15.88:0/1625126346 shutdown_connections 2023-11-27T20:54:12.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.564+0000 7f01fab8a640 1 -- 172.21.15.88:0/1625126346 wait complete. 2023-11-27T20:54:12.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.565+0000 7f01fab8a640 1 Processor -- start 2023-11-27T20:54:12.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.565+0000 7f01fab8a640 1 -- start start 2023-11-27T20:54:12.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.566+0000 7f01fab8a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01e4004120 0x7f01f41f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:12.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.566+0000 7f01fab8a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01f4156ad0 0x7f01f406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:12.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.566+0000 7f01fab8a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01f406d000 0x7f01f40cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:12.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.566+0000 7f01fab8a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f41f39c0 con 0x7f01f4156ad0 2023-11-27T20:54:12.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.566+0000 7f01fab8a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f4151cc0 con 0x7f01e4004120 2023-11-27T20:54:12.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.566+0000 7f01fab8a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f4151f80 con 0x7f01f406d000 2023-11-27T20:54:12.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.566+0000 7f01f3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01f4156ad0 0x7f01f406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:12.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.567+0000 7f01f8926640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01e4004120 0x7f01f41f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:12.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.567+0000 7f01f3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01f4156ad0 0x7f01f406b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35812/0 (socket says 172.21.15.88:35812) 2023-11-27T20:54:12.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.567+0000 7f01f3fff640 1 -- 172.21.15.88:0/4268617227 learned_addr learned my addr 172.21.15.88:0/4268617227 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:12.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.571+0000 7f01f3fff640 1 -- 172.21.15.88:0/4268617227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01f406d000 msgr2=0x7f01f40cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:12.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.571+0000 7f01f3fff640 1 --2- 172.21.15.88:0/4268617227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01f406d000 0x7f01f40cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:12.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.571+0000 7f01f3fff640 1 -- 172.21.15.88:0/4268617227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01e4004120 msgr2=0x7f01f41f3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:12.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.571+0000 7f01f3fff640 1 --2- 172.21.15.88:0/4268617227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01e4004120 0x7f01f41f3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:12.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.571+0000 7f01f3fff640 1 -- 172.21.15.88:0/4268617227 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f41f3370 con 0x7f01f4156ad0 2023-11-27T20:54:12.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.573+0000 7f01f3fff640 1 --2- 172.21.15.88:0/4268617227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01f4156ad0 0x7f01f406b5c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f01e000c1d0 tx=0x7f01e0001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:12.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.577+0000 7f01f17fa640 1 -- 172.21.15.88:0/4268617227 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e002cba0 con 0x7f01f4156ad0 2023-11-27T20:54:12.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.577+0000 7f01f17fa640 1 -- 172.21.15.88:0/4268617227 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e002cd00 con 0x7f01f4156ad0 2023-11-27T20:54:12.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.577+0000 7f01f17fa640 1 -- 172.21.15.88:0/4268617227 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e0007290 con 0x7f01f4156ad0 2023-11-27T20:54:12.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.577+0000 7f01fab8a640 1 -- 172.21.15.88:0/4268617227 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f41f3650 con 0x7f01f4156ad0 2023-11-27T20:54:12.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.577+0000 7f01fab8a640 1 -- 172.21.15.88:0/4268617227 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f4152260 con 0x7f01f4156ad0 2023-11-27T20:54:12.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.579+0000 7f01fab8a640 1 -- 172.21.15.88:0/4268617227 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f41f37e0 con 0x7f01f4156ad0 2023-11-27T20:54:12.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.881+0000 7f01f17fa640 1 -- 172.21.15.88:0/4268617227 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 89314+0+0 (secure 0 0 0) 0x7f01e0032070 con 0x7f01f4156ad0 2023-11-27T20:54:12.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.882+0000 7f01f17fa640 1 --2- 172.21.15.88:0/4268617227 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f01d806b130 0x7f01d806d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:12.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.882+0000 7f01f8926640 1 --2- 172.21.15.88:0/4268617227 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f01d806b130 0x7f01d806d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:12.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.882+0000 7f01f8926640 1 --2- 172.21.15.88:0/4268617227 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f01d806b130 0x7f01d806d5f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f01e8000f60 tx=0x7f01e8007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:12.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.895+0000 7f01f17fa640 1 -- 172.21.15.88:0/4268617227 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f01e003c040 con 0x7f01f4156ad0 2023-11-27T20:54:12.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:12.895+0000 7f01f17fa640 1 -- 172.21.15.88:0/4268617227 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f01e0075b60 con 0x7f01f4156ad0 2023-11-27T20:54:13.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:13.199+0000 7f01fab8a640 1 -- 172.21.15.88:0/4268617227 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01f4073dc0 con 0x7f01f4156ad0 2023-11-27T20:54:13.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:13.206+0000 7f01f17fa640 1 -- 172.21.15.88:0/4268617227 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f01e0045070 con 0x7f01f4156ad0 2023-11-27T20:54:13.208 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:54:13.208 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-11-27T20:54:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 1 2023-11-27T20:54:13.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:13.209+0000 7f01fab8a640 1 -- 172.21.15.88:0/4268617227 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f01d806b130 msgr2=0x7f01d806d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:13.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:13.209+0000 7f01fab8a640 1 --2- 172.21.15.88:0/4268617227 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f01d806b130 0x7f01d806d5f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f01e8000f60 tx=0x7f01e8007d30 comp rx=0 tx=0).stop 2023-11-27T20:54:13.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:13.209+0000 7f01fab8a640 1 -- 172.21.15.88:0/4268617227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01f4156ad0 msgr2=0x7f01f406b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:13.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:13.209+0000 7f01fab8a640 1 --2- 172.21.15.88:0/4268617227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01f4156ad0 0x7f01f406b5c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f01e000c1d0 tx=0x7f01e0001930 comp rx=0 tx=0).stop 2023-11-27T20:54:13.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:13.209+0000 7f01fab8a640 1 -- 172.21.15.88:0/4268617227 shutdown_connections 2023-11-27T20:54:13.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:13.209+0000 7f01fab8a640 1 --2- 172.21.15.88:0/4268617227 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f01d806b130 0x7f01d806d5f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:13.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:13.209+0000 7f01fab8a640 1 --2- 172.21.15.88:0/4268617227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01f406d000 0x7f01f40cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:13.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:13.209+0000 7f01fab8a640 1 --2- 172.21.15.88:0/4268617227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01f4156ad0 0x7f01f406b5c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:13.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:13.209+0000 7f01fab8a640 1 --2- 172.21.15.88:0/4268617227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01e4004120 0x7f01f41f3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:13.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:13.209+0000 7f01fab8a640 1 -- 172.21.15.88:0/4268617227 >> 172.21.15.88:0/4268617227 conn(0x7f01f4061370 msgr2=0x7f01f4070df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:13.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:13.209+0000 7f01fab8a640 1 -- 172.21.15.88:0/4268617227 shutdown_connections 2023-11-27T20:54:13.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:13.209+0000 7f01fab8a640 1 -- 172.21.15.88:0/4268617227 wait complete. 2023-11-27T20:54:15.079 INFO:tasks.ceph.mds.e.smithi088.stdout:starting mds.e at 2023-11-27T20:54:15.083 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2023-11-27T20:54:15.163 INFO:tasks.ceph.mds.a.smithi088.stdout:starting mds.a at 2023-11-27T20:54:15.194 INFO:tasks.ceph.mds.c.smithi088.stdout:starting mds.c at 2023-11-27T20:54:15.198 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2023-11-27T20:54:15.224 INFO:tasks.ceph.mds.f.smithi167.stdout:starting mds.f at 2023-11-27T20:54:15.225 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:54:15.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.328+0000 7f53901ce640 1 Processor -- start 2023-11-27T20:54:15.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.328+0000 7f53901ce640 1 -- start start 2023-11-27T20:54:15.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.329+0000 7f53901ce640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53880cda70 0x7f53880ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:15.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.329+0000 7f53901ce640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f53880c9620 0x7f53880c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:15.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.329+0000 7f53901ce640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53880cbda0 con 0x7f53880cc420 2023-11-27T20:54:15.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.329+0000 7f53901ce640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53880cc230 con 0x7f53880c9620 2023-11-27T20:54:15.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.329+0000 7f53901ce640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53880cb4e0 con 0x7f53880cda70 2023-11-27T20:54:15.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.330+0000 7f538e76b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f53880c9620 0x7f53880c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:15.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.330+0000 7f538df6a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53880cda70 0x7f53880ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:15.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.330+0000 7f538e76b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f53880c9620 0x7f53880c9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35854/0 (socket says 172.21.15.88:35854) 2023-11-27T20:54:15.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.330+0000 7f538e76b640 1 -- 172.21.15.88:0/984224605 learned_addr learned my addr 172.21.15.88:0/984224605 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:15.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.334+0000 7f538df6a640 1 -- 172.21.15.88:0/984224605 >> v2:172.21.15.88:3300/0 conn(0x7f53880c9620 msgr2=0x7f53880c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:15.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.334+0000 7f538df6a640 1 --2- 172.21.15.88:0/984224605 >> v2:172.21.15.88:3300/0 conn(0x7f53880c9620 0x7f53880c9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:15.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.334+0000 7f538df6a640 1 -- 172.21.15.88:0/984224605 >> v1:172.21.15.88:6789/0 conn(0x7f53880cc420 legacy=0x7f5388159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:15.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.334+0000 7f538df6a640 1 -- 172.21.15.88:0/984224605 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53880cce00 con 0x7f53880cda70 2023-11-27T20:54:15.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.334+0000 7f538e76b640 1 --2- 172.21.15.88:0/984224605 >> v2:172.21.15.88:3300/0 conn(0x7f53880c9620 0x7f53880c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:54:15.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.337+0000 7f538df6a640 1 --2- 172.21.15.88:0/984224605 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53880cda70 0x7f53880ce350 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f53840097a0 tx=0x7f538402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7840429ca4ab5bfa server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:15.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.342+0000 7f538cf68640 1 -- 172.21.15.88:0/984224605 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5384031830 con 0x7f53880cda70 2023-11-27T20:54:15.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.342+0000 7f538cf68640 1 -- 172.21.15.88:0/984224605 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5384031990 con 0x7f53880cda70 2023-11-27T20:54:15.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.342+0000 7f538cf68640 1 -- 172.21.15.88:0/984224605 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5384031d20 con 0x7f53880cda70 2023-11-27T20:54:15.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.343+0000 7f53901ce640 1 -- 172.21.15.88:0/984224605 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53880cda70 msgr2=0x7f53880ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:15.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.343+0000 7f53901ce640 1 --2- 172.21.15.88:0/984224605 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53880cda70 0x7f53880ce350 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f53840097a0 tx=0x7f538402b8d0 comp rx=0 tx=0).stop 2023-11-27T20:54:15.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.343+0000 7f53901ce640 1 -- 172.21.15.88:0/984224605 shutdown_connections 2023-11-27T20:54:15.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.343+0000 7f53901ce640 1 --2- 172.21.15.88:0/984224605 >> v2:172.21.15.88:3300/0 conn(0x7f53880c9620 0x7f53880c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:15.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.343+0000 7f53901ce640 1 --2- 172.21.15.88:0/984224605 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53880cda70 0x7f53880ce350 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:15.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.343+0000 7f53901ce640 1 -- 172.21.15.88:0/984224605 >> 172.21.15.88:0/984224605 conn(0x7f53880b07b0 msgr2=0x7f53880b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:15.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.343+0000 7f53901ce640 1 -- 172.21.15.88:0/984224605 shutdown_connections 2023-11-27T20:54:15.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.343+0000 7f53901ce640 1 -- 172.21.15.88:0/984224605 wait complete. 2023-11-27T20:54:15.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.344+0000 7f53901ce640 1 Processor -- start 2023-11-27T20:54:15.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.344+0000 7f53901ce640 1 -- start start 2023-11-27T20:54:15.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.345+0000 7f53901ce640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53880c9620 0x7f53880c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:15.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.345+0000 7f53901ce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53880cc420 0x7f53881e2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:15.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.345+0000 7f53901ce640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53880cda70 0x7f5388153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:15.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.345+0000 7f53901ce640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5388155c50 con 0x7f53880c9620 2023-11-27T20:54:15.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.345+0000 7f53901ce640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53881e47e0 con 0x7f53880cc420 2023-11-27T20:54:15.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.345+0000 7f53901ce640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5388156f30 con 0x7f53880cda70 2023-11-27T20:54:15.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.345+0000 7f538df6a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53880c9620 0x7f53880c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:15.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.346+0000 7f538d769640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53880cc420 0x7f53881e2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:15.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.346+0000 7f538e76b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53880cda70 0x7f5388153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:15.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.346+0000 7f538df6a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53880c9620 0x7f53880c52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35856/0 (socket says 172.21.15.88:35856) 2023-11-27T20:54:15.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.346+0000 7f538df6a640 1 -- 172.21.15.88:0/3138860397 learned_addr learned my addr 172.21.15.88:0/3138860397 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:15.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.349+0000 7f538df6a640 1 -- 172.21.15.88:0/3138860397 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53880cda70 msgr2=0x7f5388153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:15.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.349+0000 7f538df6a640 1 --2- 172.21.15.88:0/3138860397 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53880cda70 0x7f5388153090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:15.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.349+0000 7f538df6a640 1 -- 172.21.15.88:0/3138860397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53880cc420 msgr2=0x7f53881e2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:15.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.349+0000 7f538df6a640 1 --2- 172.21.15.88:0/3138860397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53880cc420 0x7f53881e2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:15.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.349+0000 7f538df6a640 1 -- 172.21.15.88:0/3138860397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5380009b30 con 0x7f53880c9620 2023-11-27T20:54:15.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.352+0000 7f538df6a640 1 --2- 172.21.15.88:0/3138860397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53880c9620 0x7f53880c52a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f53840098c0 tx=0x7f53840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:15.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.356+0000 7f537e7fc640 1 -- 172.21.15.88:0/3138860397 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538403b970 con 0x7f53880c9620 2023-11-27T20:54:15.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.356+0000 7f537e7fc640 1 -- 172.21.15.88:0/3138860397 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538403baf0 con 0x7f53880c9620 2023-11-27T20:54:15.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.356+0000 7f53901ce640 1 -- 172.21.15.88:0/3138860397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5384009400 con 0x7f53880c9620 2023-11-27T20:54:15.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.356+0000 7f537e7fc640 1 -- 172.21.15.88:0/3138860397 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538403bea0 con 0x7f53880c9620 2023-11-27T20:54:15.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.356+0000 7f53901ce640 1 -- 172.21.15.88:0/3138860397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53881e3eb0 con 0x7f53880c9620 2023-11-27T20:54:15.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.357+0000 7f53901ce640 1 -- 172.21.15.88:0/3138860397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5388067470 con 0x7f53880c9620 2023-11-27T20:54:15.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.376+0000 7f537e7fc640 1 -- 172.21.15.88:0/3138860397 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f538404e450 con 0x7f53880c9620 2023-11-27T20:54:15.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.377+0000 7f537e7fc640 1 --2- 172.21.15.88:0/3138860397 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f536c06b1f0 0x7f536c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:15.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.377+0000 7f538d769640 1 --2- 172.21.15.88:0/3138860397 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f536c06b1f0 0x7f536c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:15.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.377+0000 7f538d769640 1 --2- 172.21.15.88:0/3138860397 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f536c06b1f0 0x7f536c06d6b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f53881ea390 tx=0x7f5378007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:15.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.379+0000 7f537e7fc640 1 -- 172.21.15.88:0/3138860397 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f538407aa90 con 0x7f53880c9620 2023-11-27T20:54:15.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.643+0000 7f537e7fc640 1 -- 172.21.15.88:0/3138860397 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5384076dd0 con 0x7f53880c9620 2023-11-27T20:54:15.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.855+0000 7f53901ce640 1 -- 172.21.15.88:0/3138860397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5388157260 con 0x7f53880c9620 2023-11-27T20:54:15.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.964+0000 7f537e7fc640 1 -- 172.21.15.88:0/3138860397 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7f5384035020 con 0x7f53880c9620 2023-11-27T20:54:15.966 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:54:15.966 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/1596074914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1596074914},{"type":"v1","addr":"172.21.15.167:6837","nonce":1596074914}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-27T20:54:15.966 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 2 2023-11-27T20:54:15.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.966+0000 7f53901ce640 1 -- 172.21.15.88:0/3138860397 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f536c06b1f0 msgr2=0x7f536c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:15.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.966+0000 7f53901ce640 1 --2- 172.21.15.88:0/3138860397 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f536c06b1f0 0x7f536c06d6b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f53881ea390 tx=0x7f5378007e30 comp rx=0 tx=0).stop 2023-11-27T20:54:15.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.966+0000 7f53901ce640 1 -- 172.21.15.88:0/3138860397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53880c9620 msgr2=0x7f53880c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:15.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.966+0000 7f53901ce640 1 --2- 172.21.15.88:0/3138860397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53880c9620 0x7f53880c52a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f53840098c0 tx=0x7f53840046c0 comp rx=0 tx=0).stop 2023-11-27T20:54:15.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.966+0000 7f53901ce640 1 -- 172.21.15.88:0/3138860397 shutdown_connections 2023-11-27T20:54:15.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.966+0000 7f53901ce640 1 --2- 172.21.15.88:0/3138860397 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f536c06b1f0 0x7f536c06d6b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:15.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.966+0000 7f53901ce640 1 --2- 172.21.15.88:0/3138860397 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53880cda70 0x7f5388153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:15.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.966+0000 7f53901ce640 1 --2- 172.21.15.88:0/3138860397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53880cc420 0x7f53881e2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:15.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.966+0000 7f53901ce640 1 --2- 172.21.15.88:0/3138860397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53880c9620 0x7f53880c52a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:15.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.966+0000 7f53901ce640 1 -- 172.21.15.88:0/3138860397 >> 172.21.15.88:0/3138860397 conn(0x7f53880b07b0 msgr2=0x7f53880c6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:15.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.967+0000 7f53901ce640 1 -- 172.21.15.88:0/3138860397 shutdown_connections 2023-11-27T20:54:15.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:15.967+0000 7f53901ce640 1 -- 172.21.15.88:0/3138860397 wait complete. 2023-11-27T20:54:17.979 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:54:18.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.081+0000 7f1206e48640 1 Processor -- start 2023-11-27T20:54:18.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.081+0000 7f1206e48640 1 -- start start 2023-11-27T20:54:18.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.082+0000 7f1206e48640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f12001571d0 0x7f12000c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:18.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.082+0000 7f1206e48640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12000ccac0 0x7f12000ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:18.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.082+0000 7f1206e48640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12001575f0 con 0x7f1200151680 2023-11-27T20:54:18.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.082+0000 7f1206e48640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f120006fb00 con 0x7f12001571d0 2023-11-27T20:54:18.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.082+0000 7f1206e48640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1200157880 con 0x7f12000ccac0 2023-11-27T20:54:18.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.112+0000 7f1204be4640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f1200151680 0x7f120006f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:50330/0 (socket says 172.21.15.88:50330) 2023-11-27T20:54:18.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.112+0000 7f1204be4640 1 -- 172.21.15.88:0/3008008741 learned_addr learned my addr 172.21.15.88:0/3008008741 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:54:18.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.112+0000 7f11fffff640 1 --2- 172.21.15.88:0/3008008741 >> v2:172.21.15.167:3300/0 conn(0x7f12001571d0 0x7f12000c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:18.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.113+0000 7f12053e5640 1 --2- 172.21.15.88:0/3008008741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12000ccac0 0x7f12000ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:18.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.115+0000 7f11fffff640 1 -- 172.21.15.88:0/3008008741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12000ccac0 msgr2=0x7f12000ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:18.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.115+0000 7f11fffff640 1 --2- 172.21.15.88:0/3008008741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12000ccac0 0x7f12000ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:18.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.115+0000 7f11fffff640 1 -- 172.21.15.88:0/3008008741 >> v1:172.21.15.167:6789/0 conn(0x7f1200151680 legacy=0x7f120006f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:18.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.116+0000 7f11fffff640 1 -- 172.21.15.88:0/3008008741 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1200157b60 con 0x7f12001571d0 2023-11-27T20:54:18.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.120+0000 7f11fffff640 1 --2- 172.21.15.88:0/3008008741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12001571d0 0x7f12000c7b30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f11ec0097a0 tx=0x7f11ec02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a373aca8f0ccd70e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:18.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.123+0000 7f11ff7fe640 1 -- 172.21.15.88:0/3008008741 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec030610 con 0x7f12001571d0 2023-11-27T20:54:18.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.124+0000 7f11ff7fe640 1 -- 172.21.15.88:0/3008008741 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ec030770 con 0x7f12001571d0 2023-11-27T20:54:18.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.124+0000 7f11ff7fe640 1 -- 172.21.15.88:0/3008008741 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec030b00 con 0x7f12001571d0 2023-11-27T20:54:18.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.124+0000 7f1206e48640 1 -- 172.21.15.88:0/3008008741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12001571d0 msgr2=0x7f12000c7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:18.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.124+0000 7f1206e48640 1 --2- 172.21.15.88:0/3008008741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12001571d0 0x7f12000c7b30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f11ec0097a0 tx=0x7f11ec02b960 comp rx=0 tx=0).stop 2023-11-27T20:54:18.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.124+0000 7f1206e48640 1 -- 172.21.15.88:0/3008008741 shutdown_connections 2023-11-27T20:54:18.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.124+0000 7f1206e48640 1 --2- 172.21.15.88:0/3008008741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12000ccac0 0x7f12000ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:18.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.124+0000 7f1206e48640 1 --2- 172.21.15.88:0/3008008741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12001571d0 0x7f12000c7b30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:18.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.124+0000 7f1206e48640 1 -- 172.21.15.88:0/3008008741 >> 172.21.15.88:0/3008008741 conn(0x7f12000707f0 msgr2=0x7f1200070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:18.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.124+0000 7f1206e48640 1 -- 172.21.15.88:0/3008008741 shutdown_connections 2023-11-27T20:54:18.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.124+0000 7f1206e48640 1 -- 172.21.15.88:0/3008008741 wait complete. 2023-11-27T20:54:18.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.125+0000 7f1206e48640 1 Processor -- start 2023-11-27T20:54:18.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.125+0000 7f1206e48640 1 -- start start 2023-11-27T20:54:18.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.126+0000 7f1206e48640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12000ccac0 0x7f1200148740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:18.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.126+0000 7f1206e48640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1200151680 0x7f120014f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:18.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.126+0000 7f1206e48640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12001571d0 0x7f120014da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:18.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.126+0000 7f1206e48640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1200148c80 con 0x7f12000ccac0 2023-11-27T20:54:18.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.126+0000 7f1206e48640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1200147b30 con 0x7f1200151680 2023-11-27T20:54:18.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.126+0000 7f1206e48640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12000cbfa0 con 0x7f12001571d0 2023-11-27T20:54:18.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.127+0000 7f1204be4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12000ccac0 0x7f1200148740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:18.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.127+0000 7f11fffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1200151680 0x7f120014f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:18.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.127+0000 7f12053e5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12001571d0 0x7f120014da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:18.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.127+0000 7f11fffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1200151680 0x7f120014f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:48166/0 (socket says 172.21.15.88:48166) 2023-11-27T20:54:18.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.127+0000 7f1204be4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12000ccac0 0x7f1200148740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35894/0 (socket says 172.21.15.88:35894) 2023-11-27T20:54:18.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.127+0000 7f11fffff640 1 -- 172.21.15.88:0/1138062049 learned_addr learned my addr 172.21.15.88:0/1138062049 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:18.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.130+0000 7f1204be4640 1 -- 172.21.15.88:0/1138062049 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12001571d0 msgr2=0x7f120014da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:18.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.130+0000 7f1204be4640 1 --2- 172.21.15.88:0/1138062049 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12001571d0 0x7f120014da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:18.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.130+0000 7f1204be4640 1 -- 172.21.15.88:0/1138062049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1200151680 msgr2=0x7f120014f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:18.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.130+0000 7f1204be4640 1 --2- 172.21.15.88:0/1138062049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1200151680 0x7f120014f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:18.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.130+0000 7f1204be4640 1 -- 172.21.15.88:0/1138062049 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ec009400 con 0x7f12000ccac0 2023-11-27T20:54:18.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.133+0000 7f1204be4640 1 --2- 172.21.15.88:0/1138062049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12000ccac0 0x7f1200148740 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f11f4000f60 tx=0x7f11f400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:18.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.136+0000 7f11fd7fa640 1 -- 172.21.15.88:0/1138062049 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f4005ce0 con 0x7f12000ccac0 2023-11-27T20:54:18.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.136+0000 7f11fd7fa640 1 -- 172.21.15.88:0/1138062049 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f4005e40 con 0x7f12000ccac0 2023-11-27T20:54:18.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.136+0000 7f1206e48640 1 -- 172.21.15.88:0/1138062049 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12000cc4f0 con 0x7f12000ccac0 2023-11-27T20:54:18.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.136+0000 7f11fd7fa640 1 -- 172.21.15.88:0/1138062049 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f4007310 con 0x7f12000ccac0 2023-11-27T20:54:18.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.136+0000 7f1206e48640 1 -- 172.21.15.88:0/1138062049 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12000cbcc0 con 0x7f12000ccac0 2023-11-27T20:54:18.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.137+0000 7f1206e48640 1 -- 172.21.15.88:0/1138062049 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1200073dc0 con 0x7f12000ccac0 2023-11-27T20:54:18.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.377+0000 7f11fd7fa640 1 -- 172.21.15.88:0/1138062049 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f11f4007470 con 0x7f12000ccac0 2023-11-27T20:54:18.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.377+0000 7f11fd7fa640 1 --2- 172.21.15.88:0/1138062049 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f11e406b210 0x7f11e406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:18.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.377+0000 7f11fffff640 1 --2- 172.21.15.88:0/1138062049 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f11e406b210 0x7f11e406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:18.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.378+0000 7f11fffff640 1 --2- 172.21.15.88:0/1138062049 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f11e406b210 0x7f11e406d6d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f12000c3eb0 tx=0x7f11ec03b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:18.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.395+0000 7f11fd7fa640 1 -- 172.21.15.88:0/1138062049 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f11f4007720 con 0x7f12000ccac0 2023-11-27T20:54:18.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.395+0000 7f11fd7fa640 1 -- 172.21.15.88:0/1138062049 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f11f4054170 con 0x7f12000ccac0 2023-11-27T20:54:18.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.598+0000 7f1206e48640 1 -- 172.21.15.88:0/1138062049 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12000c8400 con 0x7f12000ccac0 2023-11-27T20:54:18.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.614+0000 7f11fd7fa640 1 -- 172.21.15.88:0/1138062049 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5278 (secure 0 0 0) 0x7f11f4017090 con 0x7f12000ccac0 2023-11-27T20:54:18.616 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:54:18.616 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/298325117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":298325117},{"type":"v1","addr":"172.21.15.88:6837","nonce":298325117}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/1596074914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1596074914},{"type":"v1","addr":"172.21.15.167:6837","nonce":1596074914}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":34187,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/256796309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":256796309},{"type":"v1","addr":"172.21.15.88:6835","nonce":256796309}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34190,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1245449675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1245449675},{"type":"v1","addr":"172.21.15.167:6833","nonce":1245449675}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34199,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/327644613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":327644613},{"type":"v1","addr":"172.21.15.167:6835","nonce":327644613}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6839/2120059880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":2120059880},{"type":"v1","addr":"172.21.15.88:6839","nonce":2120059880}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-27T20:54:18.616 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 3 2023-11-27T20:54:18.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.616+0000 7f1206e48640 1 -- 172.21.15.88:0/1138062049 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f11e406b210 msgr2=0x7f11e406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:18.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.616+0000 7f1206e48640 1 --2- 172.21.15.88:0/1138062049 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f11e406b210 0x7f11e406d6d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f12000c3eb0 tx=0x7f11ec03b040 comp rx=0 tx=0).stop 2023-11-27T20:54:18.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.616+0000 7f1206e48640 1 -- 172.21.15.88:0/1138062049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12000ccac0 msgr2=0x7f1200148740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:18.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.616+0000 7f1206e48640 1 --2- 172.21.15.88:0/1138062049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12000ccac0 0x7f1200148740 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f11f4000f60 tx=0x7f11f400c800 comp rx=0 tx=0).stop 2023-11-27T20:54:18.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.616+0000 7f1206e48640 1 -- 172.21.15.88:0/1138062049 shutdown_connections 2023-11-27T20:54:18.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.616+0000 7f1206e48640 1 --2- 172.21.15.88:0/1138062049 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f11e406b210 0x7f11e406d6d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:18.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.616+0000 7f1206e48640 1 --2- 172.21.15.88:0/1138062049 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12001571d0 0x7f120014da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:18.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.616+0000 7f1206e48640 1 --2- 172.21.15.88:0/1138062049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1200151680 0x7f120014f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:18.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.616+0000 7f1206e48640 1 --2- 172.21.15.88:0/1138062049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12000ccac0 0x7f1200148740 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:18.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.616+0000 7f1206e48640 1 -- 172.21.15.88:0/1138062049 >> 172.21.15.88:0/1138062049 conn(0x7f12000707f0 msgr2=0x7f12001566a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:18.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.616+0000 7f1206e48640 1 -- 172.21.15.88:0/1138062049 shutdown_connections 2023-11-27T20:54:18.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.616+0000 7f1206e48640 1 -- 172.21.15.88:0/1138062049 wait complete. 2023-11-27T20:54:18.628 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:54:18.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.726+0000 7f47fe2e5640 1 Processor -- start 2023-11-27T20:54:18.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.726+0000 7f47fe2e5640 1 -- start start 2023-11-27T20:54:18.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.727+0000 7f47fe2e5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47f8153330 0x7f47f806efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:18.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.727+0000 7f47fe2e5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f47f80c1fb0 0x7f47f80c23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:18.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.727+0000 7f47fe2e5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f806c270 con 0x7f47f8159e00 2023-11-27T20:54:18.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.727+0000 7f47fe2e5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f806f630 con 0x7f47f80c1fb0 2023-11-27T20:54:18.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.727+0000 7f47fe2e5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f806b660 con 0x7f47f8153330 2023-11-27T20:54:18.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.727+0000 7f47f7fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47f8153330 0x7f47f806efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:18.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.727+0000 7f47fc882640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f47f80c1fb0 0x7f47f80c23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:18.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.727+0000 7f47f77fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f47f8159e00 0x7f47f80cce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:50338/0 (socket says 172.21.15.88:50338) 2023-11-27T20:54:18.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.727+0000 7f47f77fe640 1 -- 172.21.15.88:0/3931744152 learned_addr learned my addr 172.21.15.88:0/3931744152 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:54:18.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.730+0000 7f47f7fff640 1 -- 172.21.15.88:0/3931744152 >> v2:172.21.15.88:3300/0 conn(0x7f47f80c1fb0 msgr2=0x7f47f80c23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:18.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.730+0000 7f47f7fff640 1 --2- 172.21.15.88:0/3931744152 >> v2:172.21.15.88:3300/0 conn(0x7f47f80c1fb0 0x7f47f80c23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:18.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.730+0000 7f47f7fff640 1 -- 172.21.15.88:0/3931744152 >> v1:172.21.15.167:6789/0 conn(0x7f47f8159e00 legacy=0x7f47f80cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:18.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.730+0000 7f47f7fff640 1 -- 172.21.15.88:0/3931744152 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f806b940 con 0x7f47f8153330 2023-11-27T20:54:18.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.730+0000 7f47f6ffd640 1 -- 172.21.15.88:0/3931744152 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1208905796 0 0) 0x7f47f806c270 con 0x7f47f8159e00 2023-11-27T20:54:18.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.730+0000 7f47fc882640 1 --2- 172.21.15.88:0/3931744152 >> v2:172.21.15.88:3300/0 conn(0x7f47f80c1fb0 0x7f47f80c23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:54:18.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.732+0000 7f47f7fff640 1 --2- 172.21.15.88:0/3931744152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47f8153330 0x7f47f806efa0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f47e80097a0 tx=0x7f47e802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10f4a13c9538e408 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:18.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.736+0000 7f47f6ffd640 1 -- 172.21.15.88:0/3931744152 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e802d040 con 0x7f47f8153330 2023-11-27T20:54:18.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.736+0000 7f47f6ffd640 1 -- 172.21.15.88:0/3931744152 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e8031810 con 0x7f47f8153330 2023-11-27T20:54:18.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.736+0000 7f47f6ffd640 1 -- 172.21.15.88:0/3931744152 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e8031ba0 con 0x7f47f8153330 2023-11-27T20:54:18.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.736+0000 7f47fe2e5640 1 -- 172.21.15.88:0/3931744152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47f8153330 msgr2=0x7f47f806efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:18.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.736+0000 7f47fe2e5640 1 --2- 172.21.15.88:0/3931744152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47f8153330 0x7f47f806efa0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f47e80097a0 tx=0x7f47e802b8b0 comp rx=0 tx=0).stop 2023-11-27T20:54:18.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.736+0000 7f47fe2e5640 1 -- 172.21.15.88:0/3931744152 shutdown_connections 2023-11-27T20:54:18.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.736+0000 7f47fe2e5640 1 --2- 172.21.15.88:0/3931744152 >> v2:172.21.15.88:3300/0 conn(0x7f47f80c1fb0 0x7f47f80c23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:18.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.736+0000 7f47fe2e5640 1 --2- 172.21.15.88:0/3931744152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47f8153330 0x7f47f806efa0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:18.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.736+0000 7f47fe2e5640 1 -- 172.21.15.88:0/3931744152 >> 172.21.15.88:0/3931744152 conn(0x7f47f8070990 msgr2=0x7f47f8070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:18.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.736+0000 7f47fe2e5640 1 -- 172.21.15.88:0/3931744152 shutdown_connections 2023-11-27T20:54:18.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.736+0000 7f47fe2e5640 1 -- 172.21.15.88:0/3931744152 wait complete. 2023-11-27T20:54:18.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.737+0000 7f47fe2e5640 1 Processor -- start 2023-11-27T20:54:18.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.738+0000 7f47fe2e5640 1 -- start start 2023-11-27T20:54:18.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.738+0000 7f47fe2e5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47f80c1fb0 0x7f47f814c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:18.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.738+0000 7f47fe2e5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47f8153330 0x7f47f80ad970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:18.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.738+0000 7f47fe2e5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47f8159e00 0x7f47f80adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:18.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.738+0000 7f47fe2e5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f80aec50 con 0x7f47f8159e00 2023-11-27T20:54:18.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.738+0000 7f47fe2e5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f80af4b0 con 0x7f47f8153330 2023-11-27T20:54:18.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.738+0000 7f47fe2e5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f80af790 con 0x7f47f80c1fb0 2023-11-27T20:54:18.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.739+0000 7f47fc882640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47f8159e00 0x7f47f80adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:18.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.739+0000 7f47f77fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47f8153330 0x7f47f80ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:18.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.739+0000 7f47f7fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47f80c1fb0 0x7f47f814c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:18.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.739+0000 7f47fc882640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47f8159e00 0x7f47f80adeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35906/0 (socket says 172.21.15.88:35906) 2023-11-27T20:54:18.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.739+0000 7f47fc882640 1 -- 172.21.15.88:0/3062994294 learned_addr learned my addr 172.21.15.88:0/3062994294 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:18.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.742+0000 7f47fc882640 1 -- 172.21.15.88:0/3062994294 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47f80c1fb0 msgr2=0x7f47f814c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:18.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.742+0000 7f47fc882640 1 --2- 172.21.15.88:0/3062994294 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47f80c1fb0 0x7f47f814c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:18.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.742+0000 7f47fc882640 1 -- 172.21.15.88:0/3062994294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47f8153330 msgr2=0x7f47f80ad970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:18.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.742+0000 7f47fc882640 1 --2- 172.21.15.88:0/3062994294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47f8153330 0x7f47f80ad970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:18.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.742+0000 7f47fc882640 1 -- 172.21.15.88:0/3062994294 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f0009a70 con 0x7f47f8159e00 2023-11-27T20:54:18.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.742+0000 7f47f7fff640 1 --2- 172.21.15.88:0/3062994294 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47f80c1fb0 0x7f47f814c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:54:18.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.747+0000 7f47fc882640 1 --2- 172.21.15.88:0/3062994294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47f8159e00 0x7f47f80adeb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f47f000efc0 tx=0x7f47f0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:18.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.750+0000 7f47f4ff9640 1 -- 172.21.15.88:0/3062994294 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f0009d70 con 0x7f47f8159e00 2023-11-27T20:54:18.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.750+0000 7f47f4ff9640 1 -- 172.21.15.88:0/3062994294 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f000f040 con 0x7f47f8159e00 2023-11-27T20:54:18.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.750+0000 7f47fe2e5640 1 -- 172.21.15.88:0/3062994294 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e8009400 con 0x7f47f8159e00 2023-11-27T20:54:18.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.750+0000 7f47f4ff9640 1 -- 172.21.15.88:0/3062994294 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f0003990 con 0x7f47f8159e00 2023-11-27T20:54:18.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.750+0000 7f47fe2e5640 1 -- 172.21.15.88:0/3062994294 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f814d5a0 con 0x7f47f8159e00 2023-11-27T20:54:18.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.751+0000 7f47fe2e5640 1 -- 172.21.15.88:0/3062994294 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f80c7130 con 0x7f47f8159e00 2023-11-27T20:54:18.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.770+0000 7f47f4ff9640 1 -- 172.21.15.88:0/3062994294 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f47f0014480 con 0x7f47f8159e00 2023-11-27T20:54:18.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.770+0000 7f47f4ff9640 1 --2- 172.21.15.88:0/3062994294 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f47e406b240 0x7f47e406d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:18.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.770+0000 7f47f7fff640 1 --2- 172.21.15.88:0/3062994294 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f47e406b240 0x7f47e406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:18.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:18.770+0000 7f47f7fff640 1 --2- 172.21.15.88:0/3062994294 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f47e406b240 0x7f47e406d700 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f47e8036000 tx=0x7f47e803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:19.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.020+0000 7f47f4ff9640 1 -- 172.21.15.88:0/3062994294 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f47f0059770 con 0x7f47f8159e00 2023-11-27T20:54:19.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.020+0000 7f47f4ff9640 1 -- 172.21.15.88:0/3062994294 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f47f0055ab0 con 0x7f47f8159e00 2023-11-27T20:54:19.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.199+0000 7f47fe2e5640 1 -- 172.21.15.88:0/3062994294 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47f80ad690 con 0x7f47f8159e00 2023-11-27T20:54:19.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.280+0000 7f47f4ff9640 1 -- 172.21.15.88:0/3062994294 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12839 (secure 0 0 0) 0x7f47f80ad690 con 0x7f47f8159e00 2023-11-27T20:54:19.284 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:54:19.284 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":18,"fsid":"ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc","created":"2023-11-27T20:53:53.110827+0000","modified":"2023-11-27T20:54:12.320731+0000","last_up_change":"2023-11-27T20:54:08.219383+0000","last_in_change":"2023-11-27T20:53:59.022798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:54:09.277670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1207ca0f-bef1-44c6-b66b-58bf0e080ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6819","nonce":3952326022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6821","nonce":3952326022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6825","nonce":3952326022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6823","nonce":3952326022}]},"public_addr":"172.21.15.88:6819/3952326022","cluster_addr":"172.21.15.88:6821/3952326022","heartbeat_back_addr":"172.21.15.88:6825/3952326022","heartbeat_front_addr":"172.21.15.88:6823/3952326022","state":["exists","up"]},{"osd":1,"uuid":"8d1be479-4241-4335-9633-1394311fde76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6827","nonce":1788401966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6829","nonce":1788401966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6833","nonce":1788401966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6831","nonce":1788401966}]},"public_addr":"172.21.15.88:6827/1788401966","cluster_addr":"172.21.15.88:6829/1788401966","heartbeat_back_addr":"172.21.15.88:6833/1788401966","heartbeat_front_addr":"172.21.15.88:6831/1788401966","state":["exists","up"]},{"osd":2,"uuid":"7536b008-05dd-40eb-9d4a-bdac4b1c38c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6803","nonce":1166333913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6805","nonce":1166333913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6809","nonce":1166333913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6807","nonce":1166333913}]},"public_addr":"172.21.15.88:6803/1166333913","cluster_addr":"172.21.15.88:6805/1166333913","heartbeat_back_addr":"172.21.15.88:6809/1166333913","heartbeat_front_addr":"172.21.15.88:6807/1166333913","state":["exists","up"]},{"osd":3,"uuid":"47edd4d7-e99c-4ce3-851b-cc9c8e2d4480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6811","nonce":406887502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6813","nonce":406887502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6817","nonce":406887502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6815","nonce":406887502}]},"public_addr":"172.21.15.88:6811/406887502","cluster_addr":"172.21.15.88:6813/406887502","heartbeat_back_addr":"172.21.15.88:6817/406887502","heartbeat_front_addr":"172.21.15.88:6815/406887502","state":["exists","up"]},{"osd":4,"uuid":"0a81dd31-1a8b-41af-b933-d74aae63f3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6801","nonce":2551293703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6803","nonce":2551293703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6807","nonce":2551293703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6805","nonce":2551293703}]},"public_addr":"172.21.15.167:6801/2551293703","cluster_addr":"172.21.15.167:6803/2551293703","heartbeat_back_addr":"172.21.15.167:6807/2551293703","heartbeat_front_addr":"172.21.15.167:6805/2551293703","state":["exists","up"]},{"osd":5,"uuid":"1c462d0d-3361-48b3-a82a-86a920539e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6825","nonce":866085094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6827","nonce":866085094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6831","nonce":866085094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6829","nonce":866085094}]},"public_addr":"172.21.15.167:6825/866085094","cluster_addr":"172.21.15.167:6827/866085094","heartbeat_back_addr":"172.21.15.167:6831/866085094","heartbeat_front_addr":"172.21.15.167:6829/866085094","state":["exists","up"]},{"osd":6,"uuid":"d687c5ad-6c88-4a15-8120-0cdbc5610535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6809","nonce":2766725538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6811","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6813","nonce":2766725538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6819","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6821","nonce":2766725538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6815","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6817","nonce":2766725538}]},"public_addr":"172.21.15.167:6809/2766725538","cluster_addr":"172.21.15.167:6813/2766725538","heartbeat_back_addr":"172.21.15.167:6821/2766725538","heartbeat_front_addr":"172.21.15.167:6817/2766725538","state":["exists","up"]},{"osd":7,"uuid":"c9a50596-4981-4bd8-a8ef-d7679f8d9559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6812","nonce":2695037266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6816","nonce":2695037266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6823","nonce":2695037266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6820","nonce":2695037266}]},"public_addr":"172.21.15.167:6812/2695037266","cluster_addr":"172.21.15.167:6816/2695037266","heartbeat_back_addr":"172.21.15.167:6823/2695037266","heartbeat_front_addr":"172.21.15.167:6820/2695037266","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.522590+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.483170+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.492504+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.432204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.414964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.459803+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.437250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.460394+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:54:19.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.282+0000 7f47fe2e5640 1 -- 172.21.15.88:0/3062994294 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f47e406b240 msgr2=0x7f47e406d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:19.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.282+0000 7f47fe2e5640 1 --2- 172.21.15.88:0/3062994294 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f47e406b240 0x7f47e406d700 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f47e8036000 tx=0x7f47e803c040 comp rx=0 tx=0).stop 2023-11-27T20:54:19.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.282+0000 7f47fe2e5640 1 -- 172.21.15.88:0/3062994294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47f8159e00 msgr2=0x7f47f80adeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:19.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.282+0000 7f47fe2e5640 1 --2- 172.21.15.88:0/3062994294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47f8159e00 0x7f47f80adeb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f47f000efc0 tx=0x7f47f0009f90 comp rx=0 tx=0).stop 2023-11-27T20:54:19.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.282+0000 7f47fe2e5640 1 -- 172.21.15.88:0/3062994294 shutdown_connections 2023-11-27T20:54:19.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.282+0000 7f47fe2e5640 1 --2- 172.21.15.88:0/3062994294 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f47e406b240 0x7f47e406d700 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:19.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.282+0000 7f47fe2e5640 1 --2- 172.21.15.88:0/3062994294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47f8159e00 0x7f47f80adeb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:19.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.282+0000 7f47fe2e5640 1 --2- 172.21.15.88:0/3062994294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47f8153330 0x7f47f80ad970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:19.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.282+0000 7f47fe2e5640 1 --2- 172.21.15.88:0/3062994294 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47f80c1fb0 0x7f47f814c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:19.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.282+0000 7f47fe2e5640 1 -- 172.21.15.88:0/3062994294 >> 172.21.15.88:0/3062994294 conn(0x7f47f8070990 msgr2=0x7f47f8152100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:19.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.283+0000 7f47fe2e5640 1 -- 172.21.15.88:0/3062994294 shutdown_connections 2023-11-27T20:54:19.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.283+0000 7f47fe2e5640 1 -- 172.21.15.88:0/3062994294 wait complete. 2023-11-27T20:54:19.295 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:54:09.277670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:54:19.296 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:54:19.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.401+0000 7f96edbb0640 1 Processor -- start 2023-11-27T20:54:19.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.401+0000 7f96edbb0640 1 -- start start 2023-11-27T20:54:19.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.402+0000 7f96edbb0640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f96e80cda70 0x7f96e80ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:19.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.402+0000 7f96edbb0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f96e80cc420 0x7f96e8159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:19.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.402+0000 7f96edbb0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96e8159b50 0x7f96e80c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:19.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.402+0000 7f96edbb0640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e80cc230 con 0x7f96e80cda70 2023-11-27T20:54:19.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.402+0000 7f96edbb0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e80cbda0 con 0x7f96e80cc420 2023-11-27T20:54:19.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.402+0000 7f96edbb0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e80cb4e0 con 0x7f96e8159b50 2023-11-27T20:54:19.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.403+0000 7f96e77fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f96e80cda70 0x7f96e80ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:19.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.403+0000 7f96e6ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f96e80cc420 0x7f96e8159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:19.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.403+0000 7f96e77fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f96e80cda70 0x7f96e80ce350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35918/0 (socket says 172.21.15.88:35918) 2023-11-27T20:54:19.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.403+0000 7f96e77fe640 1 -- 172.21.15.88:0/2555488051 learned_addr learned my addr 172.21.15.88:0/2555488051 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:19.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.403+0000 7f96e7fff640 1 --2- 172.21.15.88:0/2555488051 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96e8159b50 0x7f96e80c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:19.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.405+0000 7f96e77fe640 1 -- 172.21.15.88:0/2555488051 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96e8159b50 msgr2=0x7f96e80c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:19.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.405+0000 7f96e77fe640 1 --2- 172.21.15.88:0/2555488051 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96e8159b50 0x7f96e80c9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:19.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.405+0000 7f96e77fe640 1 -- 172.21.15.88:0/2555488051 >> v2:172.21.15.167:3300/0 conn(0x7f96e80cc420 msgr2=0x7f96e8159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:19.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.405+0000 7f96e77fe640 1 --2- 172.21.15.88:0/2555488051 >> v2:172.21.15.167:3300/0 conn(0x7f96e80cc420 0x7f96e8159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:19.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.405+0000 7f96e77fe640 1 -- 172.21.15.88:0/2555488051 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e80cce00 con 0x7f96e80cda70 2023-11-27T20:54:19.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.408+0000 7f96e77fe640 1 --2- 172.21.15.88:0/2555488051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96e80cda70 0x7f96e80ce350 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f96e80cfda0 tx=0x7f96d802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90fbe76ad03fcb3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:19.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.415+0000 7f96e67fc640 1 -- 172.21.15.88:0/2555488051 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d8030860 con 0x7f96e80cda70 2023-11-27T20:54:19.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.415+0000 7f96e67fc640 1 -- 172.21.15.88:0/2555488051 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d80309c0 con 0x7f96e80cda70 2023-11-27T20:54:19.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.415+0000 7f96e67fc640 1 -- 172.21.15.88:0/2555488051 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d8030d50 con 0x7f96e80cda70 2023-11-27T20:54:19.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.415+0000 7f96edbb0640 1 -- 172.21.15.88:0/2555488051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96e80cda70 msgr2=0x7f96e80ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:19.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.415+0000 7f96edbb0640 1 --2- 172.21.15.88:0/2555488051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96e80cda70 0x7f96e80ce350 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f96e80cfda0 tx=0x7f96d802b9a0 comp rx=0 tx=0).stop 2023-11-27T20:54:19.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.415+0000 7f96edbb0640 1 -- 172.21.15.88:0/2555488051 shutdown_connections 2023-11-27T20:54:19.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.415+0000 7f96edbb0640 1 --2- 172.21.15.88:0/2555488051 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96e8159b50 0x7f96e80c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:19.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.415+0000 7f96edbb0640 1 --2- 172.21.15.88:0/2555488051 >> v2:172.21.15.167:3300/0 conn(0x7f96e80cc420 0x7f96e8159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:19.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.415+0000 7f96edbb0640 1 --2- 172.21.15.88:0/2555488051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96e80cda70 0x7f96e80ce350 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:19.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.415+0000 7f96edbb0640 1 -- 172.21.15.88:0/2555488051 >> 172.21.15.88:0/2555488051 conn(0x7f96e80b07b0 msgr2=0x7f96e80b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:19.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.415+0000 7f96edbb0640 1 -- 172.21.15.88:0/2555488051 shutdown_connections 2023-11-27T20:54:19.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.415+0000 7f96edbb0640 1 -- 172.21.15.88:0/2555488051 wait complete. 2023-11-27T20:54:19.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.417+0000 7f96edbb0640 1 Processor -- start 2023-11-27T20:54:19.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.417+0000 7f96edbb0640 1 -- start start 2023-11-27T20:54:19.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.418+0000 7f96edbb0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96e80cc420 0x7f96e80c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:19.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.418+0000 7f96edbb0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96e80cda70 0x7f96e80b4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:19.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.418+0000 7f96edbb0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96e8159b50 0x7f96e81f0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:19.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.418+0000 7f96edbb0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e81e0c40 con 0x7f96e80cda70 2023-11-27T20:54:19.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.418+0000 7f96edbb0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e81e1e20 con 0x7f96e8159b50 2023-11-27T20:54:19.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.418+0000 7f96edbb0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e81e20e0 con 0x7f96e80cc420 2023-11-27T20:54:19.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.418+0000 7f96e6ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96e80cda70 0x7f96e80b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:19.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.418+0000 7f96e7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96e8159b50 0x7f96e81f0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:19.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.418+0000 7f96e77fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96e80cc420 0x7f96e80c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:19.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.418+0000 7f96e6ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96e80cda70 0x7f96e80b4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35928/0 (socket says 172.21.15.88:35928) 2023-11-27T20:54:19.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.418+0000 7f96e6ffd640 1 -- 172.21.15.88:0/667092164 learned_addr learned my addr 172.21.15.88:0/667092164 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:19.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.422+0000 7f96e7fff640 1 -- 172.21.15.88:0/667092164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96e80cc420 msgr2=0x7f96e80c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:19.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.422+0000 7f96e7fff640 1 --2- 172.21.15.88:0/667092164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96e80cc420 0x7f96e80c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:19.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.422+0000 7f96e7fff640 1 -- 172.21.15.88:0/667092164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96e80cda70 msgr2=0x7f96e80b4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:19.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.422+0000 7f96e7fff640 1 --2- 172.21.15.88:0/667092164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96e80cda70 0x7f96e80b4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:19.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.422+0000 7f96e7fff640 1 -- 172.21.15.88:0/667092164 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d80094d0 con 0x7f96e8159b50 2023-11-27T20:54:19.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.422+0000 7f96e6ffd640 1 --2- 172.21.15.88:0/667092164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96e80cda70 0x7f96e80b4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:54:19.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.424+0000 7f96e7fff640 1 --2- 172.21.15.88:0/667092164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96e8159b50 0x7f96e81f0360 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f96e000ccb0 tx=0x7f96e000a5c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:19.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.427+0000 7f96cffff640 1 -- 172.21.15.88:0/667092164 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e000acd0 con 0x7f96e8159b50 2023-11-27T20:54:19.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.428+0000 7f96cffff640 1 -- 172.21.15.88:0/667092164 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e000ae30 con 0x7f96e8159b50 2023-11-27T20:54:19.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.428+0000 7f96cffff640 1 -- 172.21.15.88:0/667092164 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e0003bb0 con 0x7f96e8159b50 2023-11-27T20:54:19.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.428+0000 7f96edbb0640 1 -- 172.21.15.88:0/667092164 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e81e2350 con 0x7f96e8159b50 2023-11-27T20:54:19.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.428+0000 7f96edbb0640 1 -- 172.21.15.88:0/667092164 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e81e2910 con 0x7f96e8159b50 2023-11-27T20:54:19.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.429+0000 7f96edbb0640 1 -- 172.21.15.88:0/667092164 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e8067470 con 0x7f96e8159b50 2023-11-27T20:54:19.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.447+0000 7f96cffff640 1 -- 172.21.15.88:0/667092164 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f96e0022480 con 0x7f96e8159b50 2023-11-27T20:54:19.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.448+0000 7f96cffff640 1 --2- 172.21.15.88:0/667092164 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f96d406b210 0x7f96d406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:19.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.448+0000 7f96e77fe640 1 --2- 172.21.15.88:0/667092164 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f96d406b210 0x7f96d406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:19.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.448+0000 7f96e77fe640 1 --2- 172.21.15.88:0/667092164 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f96d406b210 0x7f96d406d6d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f96d8036000 tx=0x7f96d8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:19.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.677+0000 7f96cffff640 1 -- 172.21.15.88:0/667092164 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f96e00589d0 con 0x7f96e8159b50 2023-11-27T20:54:23.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.689+0000 7f96cffff640 1 -- 172.21.15.88:0/667092164 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f96e0054d10 con 0x7f96e8159b50 2023-11-27T20:54:23.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.856+0000 7f96edbb0640 1 -- 172.21.15.88:0/667092164 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f96e80b4c20 con 0x7f96e8159b50 2023-11-27T20:54:23.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.877+0000 7f96cffff640 1 -- 172.21.15.88:0/667092164 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f96e001d030 con 0x7f96e8159b50 2023-11-27T20:54:23.318 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-27T20:54:23.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.879+0000 7f96edbb0640 1 -- 172.21.15.88:0/667092164 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f96d406b210 msgr2=0x7f96d406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:23.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.879+0000 7f96edbb0640 1 --2- 172.21.15.88:0/667092164 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f96d406b210 0x7f96d406d6d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f96d8036000 tx=0x7f96d8008030 comp rx=0 tx=0).stop 2023-11-27T20:54:23.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.879+0000 7f96edbb0640 1 -- 172.21.15.88:0/667092164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96e8159b50 msgr2=0x7f96e81f0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:23.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.879+0000 7f96edbb0640 1 --2- 172.21.15.88:0/667092164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96e8159b50 0x7f96e81f0360 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f96e000ccb0 tx=0x7f96e000a5c0 comp rx=0 tx=0).stop 2023-11-27T20:54:23.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.879+0000 7f96edbb0640 1 -- 172.21.15.88:0/667092164 shutdown_connections 2023-11-27T20:54:23.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.879+0000 7f96edbb0640 1 --2- 172.21.15.88:0/667092164 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f96d406b210 0x7f96d406d6d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:23.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.879+0000 7f96edbb0640 1 --2- 172.21.15.88:0/667092164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96e8159b50 0x7f96e81f0360 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:23.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.879+0000 7f96edbb0640 1 --2- 172.21.15.88:0/667092164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96e80cda70 0x7f96e80b4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:23.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.879+0000 7f96edbb0640 1 --2- 172.21.15.88:0/667092164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96e80cc420 0x7f96e80c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:23.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.879+0000 7f96edbb0640 1 -- 172.21.15.88:0/667092164 >> 172.21.15.88:0/667092164 conn(0x7f96e80b07b0 msgr2=0x7f96e80cf550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:23.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.879+0000 7f96edbb0640 1 -- 172.21.15.88:0/667092164 shutdown_connections 2023-11-27T20:54:23.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:19.879+0000 7f96edbb0640 1 -- 172.21.15.88:0/667092164 wait complete. 2023-11-27T20:54:23.321 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-27T20:54:23.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.431+0000 7f9e30c17640 1 Processor -- start 2023-11-27T20:54:23.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.431+0000 7f9e30c17640 1 -- start start 2023-11-27T20:54:23.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.432+0000 7f9e30c17640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9e2c06efa0 0x7f9e2c159e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:23.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.432+0000 7f9e30c17640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9e2c0c1fb0 0x7f9e2c0c23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:23.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.432+0000 7f9e30c17640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e2c15a340 con 0x7f9e2c153330 2023-11-27T20:54:23.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.432+0000 7f9e30c17640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e2c06f3f0 con 0x7f9e2c06efa0 2023-11-27T20:54:23.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.432+0000 7f9e30c17640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e2c06c270 con 0x7f9e2c0c1fb0 2023-11-27T20:54:23.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.433+0000 7f9e29d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9e2c06efa0 0x7f9e2c159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:23.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.433+0000 7f9e29d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9e2c06efa0 0x7f9e2c159e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47824/0 (socket says 172.21.15.88:47824) 2023-11-27T20:54:23.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.433+0000 7f9e29d9b640 1 -- 172.21.15.88:0/286676689 learned_addr learned my addr 172.21.15.88:0/286676689 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:23.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.433+0000 7f9e2ad9d640 1 --2- 172.21.15.88:0/286676689 >> v2:172.21.15.167:3300/0 conn(0x7f9e2c0c1fb0 0x7f9e2c0c23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:23.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.435+0000 7f9e29d9b640 1 -- 172.21.15.88:0/286676689 >> v2:172.21.15.167:3300/0 conn(0x7f9e2c0c1fb0 msgr2=0x7f9e2c0c23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:23.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.435+0000 7f9e29d9b640 1 --2- 172.21.15.88:0/286676689 >> v2:172.21.15.167:3300/0 conn(0x7f9e2c0c1fb0 0x7f9e2c0c23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:23.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.435+0000 7f9e29d9b640 1 -- 172.21.15.88:0/286676689 >> v1:172.21.15.167:6789/0 conn(0x7f9e2c153330 legacy=0x7f9e2c0cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:23.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.435+0000 7f9e29d9b640 1 -- 172.21.15.88:0/286676689 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2c06f630 con 0x7f9e2c06efa0 2023-11-27T20:54:23.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.438+0000 7f9e29d9b640 1 --2- 172.21.15.88:0/286676689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e2c06efa0 0x7f9e2c159e00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0afb40 tx=0x7f9e2002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d40d1c470145eb86 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:23.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.441+0000 7f9e2959a640 1 -- 172.21.15.88:0/286676689 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e20030860 con 0x7f9e2c06efa0 2023-11-27T20:54:23.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.441+0000 7f9e2959a640 1 -- 172.21.15.88:0/286676689 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e200309c0 con 0x7f9e2c06efa0 2023-11-27T20:54:23.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.441+0000 7f9e2959a640 1 -- 172.21.15.88:0/286676689 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e20030d50 con 0x7f9e2c06efa0 2023-11-27T20:54:23.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.442+0000 7f9e30c17640 1 -- 172.21.15.88:0/286676689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e2c06efa0 msgr2=0x7f9e2c159e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:23.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.442+0000 7f9e30c17640 1 --2- 172.21.15.88:0/286676689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e2c06efa0 0x7f9e2c159e00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0afb40 tx=0x7f9e2002b9a0 comp rx=0 tx=0).stop 2023-11-27T20:54:23.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.442+0000 7f9e30c17640 1 -- 172.21.15.88:0/286676689 shutdown_connections 2023-11-27T20:54:23.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.442+0000 7f9e30c17640 1 --2- 172.21.15.88:0/286676689 >> v2:172.21.15.167:3300/0 conn(0x7f9e2c0c1fb0 0x7f9e2c0c23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:23.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.442+0000 7f9e30c17640 1 --2- 172.21.15.88:0/286676689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e2c06efa0 0x7f9e2c159e00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:23.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.442+0000 7f9e30c17640 1 -- 172.21.15.88:0/286676689 >> 172.21.15.88:0/286676689 conn(0x7f9e2c070990 msgr2=0x7f9e2c070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:23.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.442+0000 7f9e30c17640 1 -- 172.21.15.88:0/286676689 shutdown_connections 2023-11-27T20:54:23.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.442+0000 7f9e30c17640 1 -- 172.21.15.88:0/286676689 wait complete. 2023-11-27T20:54:23.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.444+0000 7f9e30c17640 1 Processor -- start 2023-11-27T20:54:23.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.444+0000 7f9e30c17640 1 -- start start 2023-11-27T20:54:23.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.444+0000 7f9e30c17640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c06efa0 0x7f9e2c1583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:23.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.444+0000 7f9e30c17640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e2c0c1fb0 0x7f9e2c1f2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:23.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.444+0000 7f9e30c17640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e2c153330 0x7f9e2c14b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:23.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.444+0000 7f9e30c17640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c157f30 con 0x7f9e2c0c1fb0 2023-11-27T20:54:23.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.444+0000 7f9e30c17640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c1f2f10 con 0x7f9e2c153330 2023-11-27T20:54:23.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.444+0000 7f9e30c17640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c158e90 con 0x7f9e2c06efa0 2023-11-27T20:54:23.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.445+0000 7f9e29d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e2c0c1fb0 0x7f9e2c1f2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:23.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.445+0000 7f9e2ad9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e2c153330 0x7f9e2c14b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:23.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.445+0000 7f9e29d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e2c0c1fb0 0x7f9e2c1f2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47838/0 (socket says 172.21.15.88:47838) 2023-11-27T20:54:23.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.445+0000 7f9e29d9b640 1 -- 172.21.15.88:0/3106205603 learned_addr learned my addr 172.21.15.88:0/3106205603 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:23.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.445+0000 7f9e2a59c640 1 --2- 172.21.15.88:0/3106205603 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c06efa0 0x7f9e2c1583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:23.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.448+0000 7f9e29d9b640 1 -- 172.21.15.88:0/3106205603 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c06efa0 msgr2=0x7f9e2c1583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:23.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.448+0000 7f9e29d9b640 1 --2- 172.21.15.88:0/3106205603 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c06efa0 0x7f9e2c1583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:23.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.448+0000 7f9e29d9b640 1 -- 172.21.15.88:0/3106205603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e2c153330 msgr2=0x7f9e2c14b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:23.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.448+0000 7f9e29d9b640 1 --2- 172.21.15.88:0/3106205603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e2c153330 0x7f9e2c14b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:23.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.448+0000 7f9e29d9b640 1 -- 172.21.15.88:0/3106205603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e200094d0 con 0x7f9e2c0c1fb0 2023-11-27T20:54:23.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.451+0000 7f9e29d9b640 1 --2- 172.21.15.88:0/3106205603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e2c0c1fb0 0x7f9e2c1f2570 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9e20000c00 tx=0x7f9e20004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:23.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.455+0000 7f9e1affd640 1 -- 172.21.15.88:0/3106205603 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e20039c90 con 0x7f9e2c0c1fb0 2023-11-27T20:54:23.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.455+0000 7f9e1affd640 1 -- 172.21.15.88:0/3106205603 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e20039df0 con 0x7f9e2c0c1fb0 2023-11-27T20:54:23.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.455+0000 7f9e1affd640 1 -- 172.21.15.88:0/3106205603 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e20043640 con 0x7f9e2c0c1fb0 2023-11-27T20:54:23.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.455+0000 7f9e30c17640 1 -- 172.21.15.88:0/3106205603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e2c159170 con 0x7f9e2c0c1fb0 2023-11-27T20:54:23.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.455+0000 7f9e30c17640 1 -- 172.21.15.88:0/3106205603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e2c153ca0 con 0x7f9e2c0c1fb0 2023-11-27T20:54:23.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.456+0000 7f9e30c17640 1 -- 172.21.15.88:0/3106205603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e2c1580a0 con 0x7f9e2c0c1fb0 2023-11-27T20:54:23.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.474+0000 7f9e1affd640 1 -- 172.21.15.88:0/3106205603 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9e200437a0 con 0x7f9e2c0c1fb0 2023-11-27T20:54:23.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.474+0000 7f9e1affd640 1 --2- 172.21.15.88:0/3106205603 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f9e0c06b1c0 0x7f9e0c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:23.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.474+0000 7f9e2a59c640 1 --2- 172.21.15.88:0/3106205603 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f9e0c06b1c0 0x7f9e0c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:23.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.474+0000 7f9e2a59c640 1 --2- 172.21.15.88:0/3106205603 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f9e0c06b1c0 0x7f9e0c06d680 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c001e70 tx=0x7f9e1c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:23.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.477+0000 7f9e1affd640 1 -- 172.21.15.88:0/3106205603 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9e2003e070 con 0x7f9e2c0c1fb0 2023-11-27T20:54:23.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.714+0000 7f9e1affd640 1 -- 172.21.15.88:0/3106205603 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9e200781c0 con 0x7f9e2c0c1fb0 2023-11-27T20:54:23.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.886+0000 7f9e30c17640 1 -- 172.21.15.88:0/3106205603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9e2c067470 con 0x7f9e2c0c1fb0 2023-11-27T20:54:23.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.892+0000 7f9e1affd640 1 -- 172.21.15.88:0/3106205603 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9e20034090 con 0x7f9e2c0c1fb0 2023-11-27T20:54:23.894 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:54:23.894 INFO:teuthology.orchestra.run.smithi088.stdout:[ 2023-11-27T20:54:23.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-27T20:54:23.894 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 1, 2023-11-27T20:54:23.894 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": ".mgr" 2023-11-27T20:54:23.895 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-27T20:54:23.895 INFO:teuthology.orchestra.run.smithi088.stdout:] 2023-11-27T20:54:23.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.894+0000 7f9e30c17640 1 -- 172.21.15.88:0/3106205603 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f9e0c06b1c0 msgr2=0x7f9e0c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:23.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.894+0000 7f9e30c17640 1 --2- 172.21.15.88:0/3106205603 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f9e0c06b1c0 0x7f9e0c06d680 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c001e70 tx=0x7f9e1c009040 comp rx=0 tx=0).stop 2023-11-27T20:54:23.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.895+0000 7f9e30c17640 1 -- 172.21.15.88:0/3106205603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e2c0c1fb0 msgr2=0x7f9e2c1f2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:23.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.895+0000 7f9e30c17640 1 --2- 172.21.15.88:0/3106205603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e2c0c1fb0 0x7f9e2c1f2570 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9e20000c00 tx=0x7f9e20004730 comp rx=0 tx=0).stop 2023-11-27T20:54:23.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.895+0000 7f9e30c17640 1 -- 172.21.15.88:0/3106205603 shutdown_connections 2023-11-27T20:54:23.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.895+0000 7f9e30c17640 1 --2- 172.21.15.88:0/3106205603 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f9e0c06b1c0 0x7f9e0c06d680 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:23.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.895+0000 7f9e30c17640 1 --2- 172.21.15.88:0/3106205603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e2c153330 0x7f9e2c14b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:23.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.895+0000 7f9e30c17640 1 --2- 172.21.15.88:0/3106205603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e2c0c1fb0 0x7f9e2c1f2570 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:23.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.895+0000 7f9e30c17640 1 --2- 172.21.15.88:0/3106205603 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c06efa0 0x7f9e2c1583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:23.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.895+0000 7f9e30c17640 1 -- 172.21.15.88:0/3106205603 >> 172.21.15.88:0/3106205603 conn(0x7f9e2c070990 msgr2=0x7f9e2c0ccde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:23.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.895+0000 7f9e30c17640 1 -- 172.21.15.88:0/3106205603 shutdown_connections 2023-11-27T20:54:23.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:23.895+0000 7f9e30c17640 1 -- 172.21.15.88:0/3106205603 wait complete. 2023-11-27T20:54:23.907 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-27T20:54:23.907 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-27T20:54:24.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.012+0000 7f69ca6fc640 1 Processor -- start 2023-11-27T20:54:24.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.012+0000 7f69ca6fc640 1 -- start start 2023-11-27T20:54:24.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.013+0000 7f69ca6fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f69c4153200 0x7f69c40c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:24.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.013+0000 7f69ca6fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69c41535e0 0x7f69c40cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:24.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.013+0000 7f69ca6fc640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69c40c2790 con 0x7f69c4072580 2023-11-27T20:54:24.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.013+0000 7f69ca6fc640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69c40c2a30 con 0x7f69c4153200 2023-11-27T20:54:24.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.013+0000 7f69ca6fc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c41595c0 con 0x7f69c41535e0 2023-11-27T20:54:24.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.049+0000 7f69c8c99640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69c41535e0 0x7f69c40cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:24.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.049+0000 7f69c37fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f69c4072580 0x7f69c415caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:60318/0 (socket says 172.21.15.88:60318) 2023-11-27T20:54:24.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.049+0000 7f69c37fe640 1 -- 172.21.15.88:0/1297604494 learned_addr learned my addr 172.21.15.88:0/1297604494 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:54:24.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.049+0000 7f69c3fff640 1 --2- 172.21.15.88:0/1297604494 >> v2:172.21.15.167:3300/0 conn(0x7f69c4153200 0x7f69c40c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:24.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.052+0000 7f69c3fff640 1 -- 172.21.15.88:0/1297604494 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69c41535e0 msgr2=0x7f69c40cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:24.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.052+0000 7f69c3fff640 1 --2- 172.21.15.88:0/1297604494 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69c41535e0 0x7f69c40cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:24.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.052+0000 7f69c3fff640 1 -- 172.21.15.88:0/1297604494 >> v1:172.21.15.167:6789/0 conn(0x7f69c4072580 legacy=0x7f69c415caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:24.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.052+0000 7f69c3fff640 1 -- 172.21.15.88:0/1297604494 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c415a340 con 0x7f69c4153200 2023-11-27T20:54:24.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.056+0000 7f69c3fff640 1 --2- 172.21.15.88:0/1297604494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69c4153200 0x7f69c40c2130 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f69b40097a0 tx=0x7f69b402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bceab9c0b90b9b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:24.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.060+0000 7f69c2ffd640 1 -- 172.21.15.88:0/1297604494 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b4030610 con 0x7f69c4153200 2023-11-27T20:54:24.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.060+0000 7f69c2ffd640 1 -- 172.21.15.88:0/1297604494 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b4030770 con 0x7f69c4153200 2023-11-27T20:54:24.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.060+0000 7f69c2ffd640 1 -- 172.21.15.88:0/1297604494 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b4030b00 con 0x7f69c4153200 2023-11-27T20:54:24.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.061+0000 7f69ca6fc640 1 -- 172.21.15.88:0/1297604494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69c4153200 msgr2=0x7f69c40c2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:24.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.061+0000 7f69ca6fc640 1 --2- 172.21.15.88:0/1297604494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69c4153200 0x7f69c40c2130 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f69b40097a0 tx=0x7f69b402b960 comp rx=0 tx=0).stop 2023-11-27T20:54:24.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.061+0000 7f69ca6fc640 1 -- 172.21.15.88:0/1297604494 shutdown_connections 2023-11-27T20:54:24.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.061+0000 7f69ca6fc640 1 --2- 172.21.15.88:0/1297604494 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69c41535e0 0x7f69c40cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:24.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.061+0000 7f69ca6fc640 1 --2- 172.21.15.88:0/1297604494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69c4153200 0x7f69c40c2130 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:24.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.061+0000 7f69ca6fc640 1 -- 172.21.15.88:0/1297604494 >> 172.21.15.88:0/1297604494 conn(0x7f69c40700e0 msgr2=0x7f69c406b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:24.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.061+0000 7f69ca6fc640 1 -- 172.21.15.88:0/1297604494 shutdown_connections 2023-11-27T20:54:24.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.061+0000 7f69ca6fc640 1 -- 172.21.15.88:0/1297604494 wait complete. 2023-11-27T20:54:24.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.062+0000 7f69ca6fc640 1 Processor -- start 2023-11-27T20:54:24.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.062+0000 7f69ca6fc640 1 -- start start 2023-11-27T20:54:24.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.063+0000 7f69ca6fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69c4072580 0x7f69c41f0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:24.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.063+0000 7f69ca6fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69c4153200 0x7f69c4158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:24.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.063+0000 7f69ca6fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69c41535e0 0x7f69c415b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:24.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.063+0000 7f69ca6fc640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c414feb0 con 0x7f69c4072580 2023-11-27T20:54:24.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.063+0000 7f69ca6fc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c4150ab0 con 0x7f69c41535e0 2023-11-27T20:54:24.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.063+0000 7f69ca6fc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c41f0780 con 0x7f69c4153200 2023-11-27T20:54:24.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.063+0000 7f69c3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69c4072580 0x7f69c41f0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:24.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.063+0000 7f69c37fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69c4153200 0x7f69c4158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:24.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.063+0000 7f69c8c99640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69c41535e0 0x7f69c415b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:24.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.064+0000 7f69c3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69c4072580 0x7f69c41f0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47852/0 (socket says 172.21.15.88:47852) 2023-11-27T20:54:24.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.064+0000 7f69c3fff640 1 -- 172.21.15.88:0/2656353803 learned_addr learned my addr 172.21.15.88:0/2656353803 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:24.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.067+0000 7f69c3fff640 1 -- 172.21.15.88:0/2656353803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69c4153200 msgr2=0x7f69c4158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:24.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.067+0000 7f69c3fff640 1 --2- 172.21.15.88:0/2656353803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69c4153200 0x7f69c4158740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:24.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.067+0000 7f69c3fff640 1 -- 172.21.15.88:0/2656353803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69c41535e0 msgr2=0x7f69c415b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:24.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.067+0000 7f69c3fff640 1 --2- 172.21.15.88:0/2656353803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69c41535e0 0x7f69c415b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:24.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.067+0000 7f69c3fff640 1 -- 172.21.15.88:0/2656353803 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b4009400 con 0x7f69c4072580 2023-11-27T20:54:24.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.069+0000 7f69c3fff640 1 --2- 172.21.15.88:0/2656353803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69c4072580 0x7f69c41f0240 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009890 tx=0x7f69b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:24.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.073+0000 7f69c0ff9640 1 -- 172.21.15.88:0/2656353803 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b403e040 con 0x7f69c4072580 2023-11-27T20:54:24.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.073+0000 7f69c0ff9640 1 -- 172.21.15.88:0/2656353803 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b4039a40 con 0x7f69c4072580 2023-11-27T20:54:24.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.073+0000 7f69c0ff9640 1 -- 172.21.15.88:0/2656353803 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b4039df0 con 0x7f69c4072580 2023-11-27T20:54:24.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.073+0000 7f69ca6fc640 1 -- 172.21.15.88:0/2656353803 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69c4151130 con 0x7f69c4072580 2023-11-27T20:54:24.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.073+0000 7f69ca6fc640 1 -- 172.21.15.88:0/2656353803 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c414f7f0 con 0x7f69c4072580 2023-11-27T20:54:24.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.073+0000 7f69ca6fc640 1 -- 172.21.15.88:0/2656353803 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c40c7580 con 0x7f69c4072580 2023-11-27T20:54:24.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.312+0000 7f69c0ff9640 1 -- 172.21.15.88:0/2656353803 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f69b40423e0 con 0x7f69c4072580 2023-11-27T20:54:24.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.313+0000 7f69c0ff9640 1 --2- 172.21.15.88:0/2656353803 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f69b006b1c0 0x7f69b006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:24.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.313+0000 7f69c37fe640 1 --2- 172.21.15.88:0/2656353803 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f69b006b1c0 0x7f69b006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:24.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.313+0000 7f69c37fe640 1 --2- 172.21.15.88:0/2656353803 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f69b006b1c0 0x7f69b006d680 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f69c41ea100 tx=0x7f69b8007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:24.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.325+0000 7f69c0ff9640 1 -- 172.21.15.88:0/2656353803 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f69b407ac50 con 0x7f69c4072580 2023-11-27T20:54:24.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.325+0000 7f69c0ff9640 1 -- 172.21.15.88:0/2656353803 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f69b4076f90 con 0x7f69c4072580 2023-11-27T20:54:24.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:24.495+0000 7f69ca6fc640 1 -- 172.21.15.88:0/2656353803 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f69c40c1c30 con 0x7f69c4072580 2023-11-27T20:54:25.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.138+0000 7f69c0ff9640 1 -- 172.21.15.88:0/2656353803 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f69b40340b0 con 0x7f69c4072580 2023-11-27T20:54:25.140 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' created 2023-11-27T20:54:25.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.140+0000 7f69ca6fc640 1 -- 172.21.15.88:0/2656353803 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f69b006b1c0 msgr2=0x7f69b006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:25.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.140+0000 7f69ca6fc640 1 --2- 172.21.15.88:0/2656353803 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f69b006b1c0 0x7f69b006d680 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f69c41ea100 tx=0x7f69b8007e80 comp rx=0 tx=0).stop 2023-11-27T20:54:25.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.140+0000 7f69ca6fc640 1 -- 172.21.15.88:0/2656353803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69c4072580 msgr2=0x7f69c41f0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:25.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.140+0000 7f69ca6fc640 1 --2- 172.21.15.88:0/2656353803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69c4072580 0x7f69c41f0240 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009890 tx=0x7f69b4004730 comp rx=0 tx=0).stop 2023-11-27T20:54:25.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.140+0000 7f69ca6fc640 1 -- 172.21.15.88:0/2656353803 shutdown_connections 2023-11-27T20:54:25.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.140+0000 7f69ca6fc640 1 --2- 172.21.15.88:0/2656353803 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f69b006b1c0 0x7f69b006d680 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:25.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.140+0000 7f69ca6fc640 1 --2- 172.21.15.88:0/2656353803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69c41535e0 0x7f69c415b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:25.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.140+0000 7f69ca6fc640 1 --2- 172.21.15.88:0/2656353803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69c4153200 0x7f69c4158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:25.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.140+0000 7f69ca6fc640 1 --2- 172.21.15.88:0/2656353803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69c4072580 0x7f69c41f0240 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:25.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.140+0000 7f69ca6fc640 1 -- 172.21.15.88:0/2656353803 >> 172.21.15.88:0/2656353803 conn(0x7f69c40700e0 msgr2=0x7f69c4157320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:25.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.140+0000 7f69ca6fc640 1 -- 172.21.15.88:0/2656353803 shutdown_connections 2023-11-27T20:54:25.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.140+0000 7f69ca6fc640 1 -- 172.21.15.88:0/2656353803 wait complete. 2023-11-27T20:54:25.153 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-11-27T20:54:25.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.266+0000 7f3bba1f5640 1 Processor -- start 2023-11-27T20:54:25.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.266+0000 7f3bba1f5640 1 -- start start 2023-11-27T20:54:25.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.266+0000 7f3bba1f5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3bb4153770 0x7f3bb4159f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:25.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.266+0000 7f3bba1f5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3bb40c79d0 0x7f3bb40ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:25.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.266+0000 7f3bba1f5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3bb40cd0a0 0x7f3bb40c9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:25.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.266+0000 7f3bba1f5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb40c8380 con 0x7f3bb40c79d0 2023-11-27T20:54:25.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.266+0000 7f3bba1f5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb40c8ee0 con 0x7f3bb4153770 2023-11-27T20:54:25.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.266+0000 7f3bba1f5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb415a480 con 0x7f3bb40cd0a0 2023-11-27T20:54:25.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.267+0000 7f3bb3fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3bb40cd0a0 0x7f3bb40c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:25.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.267+0000 7f3bb37fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3bb4153770 0x7f3bb4159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:25.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.267+0000 7f3bb37fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3bb4153770 0x7f3bb4159f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:55370/0 (socket says 172.21.15.88:55370) 2023-11-27T20:54:25.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.267+0000 7f3bb37fe640 1 -- 172.21.15.88:0/2972135979 learned_addr learned my addr 172.21.15.88:0/2972135979 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:25.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.269+0000 7f3babfff640 1 --2- 172.21.15.88:0/2972135979 >> v2:172.21.15.88:3300/0 conn(0x7f3bb40c79d0 0x7f3bb40ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:25.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.270+0000 7f3bb3fff640 1 -- 172.21.15.88:0/2972135979 >> v2:172.21.15.167:3300/0 conn(0x7f3bb4153770 msgr2=0x7f3bb4159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:25.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.270+0000 7f3bb3fff640 1 --2- 172.21.15.88:0/2972135979 >> v2:172.21.15.167:3300/0 conn(0x7f3bb4153770 0x7f3bb4159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:25.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.270+0000 7f3bb3fff640 1 -- 172.21.15.88:0/2972135979 >> v2:172.21.15.88:3300/0 conn(0x7f3bb40c79d0 msgr2=0x7f3bb40ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:25.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.270+0000 7f3bb3fff640 1 --2- 172.21.15.88:0/2972135979 >> v2:172.21.15.88:3300/0 conn(0x7f3bb40c79d0 0x7f3bb40ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:25.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.270+0000 7f3bb3fff640 1 -- 172.21.15.88:0/2972135979 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb415cdd0 con 0x7f3bb40cd0a0 2023-11-27T20:54:25.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.272+0000 7f3bb3fff640 1 --2- 172.21.15.88:0/2972135979 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3bb40cd0a0 0x7f3bb40c9390 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3bb40c7290 tx=0x7f3bac02be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4b5f621398ebeae server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:25.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.275+0000 7f3bb2ffd640 1 -- 172.21.15.88:0/2972135979 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac02cbd0 con 0x7f3bb40cd0a0 2023-11-27T20:54:25.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.275+0000 7f3bb2ffd640 1 -- 172.21.15.88:0/2972135979 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac02cd30 con 0x7f3bb40cd0a0 2023-11-27T20:54:25.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.275+0000 7f3bb2ffd640 1 -- 172.21.15.88:0/2972135979 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac02cea0 con 0x7f3bb40cd0a0 2023-11-27T20:54:25.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.276+0000 7f3bba1f5640 1 -- 172.21.15.88:0/2972135979 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3bb40cd0a0 msgr2=0x7f3bb40c9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:25.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.276+0000 7f3bba1f5640 1 --2- 172.21.15.88:0/2972135979 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3bb40cd0a0 0x7f3bb40c9390 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3bb40c7290 tx=0x7f3bac02be20 comp rx=0 tx=0).stop 2023-11-27T20:54:25.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.276+0000 7f3bba1f5640 1 -- 172.21.15.88:0/2972135979 shutdown_connections 2023-11-27T20:54:25.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.276+0000 7f3bba1f5640 1 --2- 172.21.15.88:0/2972135979 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3bb40cd0a0 0x7f3bb40c9390 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:25.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.276+0000 7f3bba1f5640 1 --2- 172.21.15.88:0/2972135979 >> v2:172.21.15.88:3300/0 conn(0x7f3bb40c79d0 0x7f3bb40ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:25.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.276+0000 7f3bba1f5640 1 --2- 172.21.15.88:0/2972135979 >> v2:172.21.15.167:3300/0 conn(0x7f3bb4153770 0x7f3bb4159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:25.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.276+0000 7f3bba1f5640 1 -- 172.21.15.88:0/2972135979 >> 172.21.15.88:0/2972135979 conn(0x7f3bb4070790 msgr2=0x7f3bb4070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:25.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.276+0000 7f3bba1f5640 1 -- 172.21.15.88:0/2972135979 shutdown_connections 2023-11-27T20:54:25.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.276+0000 7f3bba1f5640 1 -- 172.21.15.88:0/2972135979 wait complete. 2023-11-27T20:54:25.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.277+0000 7f3bba1f5640 1 Processor -- start 2023-11-27T20:54:25.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.277+0000 7f3bba1f5640 1 -- start start 2023-11-27T20:54:25.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.278+0000 7f3bba1f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bb40c79d0 0x7f3bb41efe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:25.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.278+0000 7f3bba1f5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3bb40cd0a0 0x7f3bb4073530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:25.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.278+0000 7f3bba1f5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb4153770 0x7f3bb4073a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:25.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.278+0000 7f3bba1f5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb40b1e70 con 0x7f3bb4153770 2023-11-27T20:54:25.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.278+0000 7f3bba1f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb40c6bf0 con 0x7f3bb40c79d0 2023-11-27T20:54:25.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.278+0000 7f3bba1f5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb41f2bc0 con 0x7f3bb40cd0a0 2023-11-27T20:54:25.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.278+0000 7f3bb3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb4153770 0x7f3bb4073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:25.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.279+0000 7f3bb37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bb40c79d0 0x7f3bb41efe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:25.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.279+0000 7f3babfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3bb40cd0a0 0x7f3bb4073530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:25.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.279+0000 7f3bb3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb4153770 0x7f3bb4073a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47864/0 (socket says 172.21.15.88:47864) 2023-11-27T20:54:25.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.279+0000 7f3bb37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bb40c79d0 0x7f3bb41efe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:55382/0 (socket says 172.21.15.88:55382) 2023-11-27T20:54:25.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.279+0000 7f3bb3fff640 1 -- 172.21.15.88:0/3619939482 learned_addr learned my addr 172.21.15.88:0/3619939482 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:25.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.282+0000 7f3bb3fff640 1 -- 172.21.15.88:0/3619939482 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3bb40cd0a0 msgr2=0x7f3bb4073530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:25.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.282+0000 7f3bb3fff640 1 --2- 172.21.15.88:0/3619939482 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3bb40cd0a0 0x7f3bb4073530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:25.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.282+0000 7f3bb3fff640 1 -- 172.21.15.88:0/3619939482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bb40c79d0 msgr2=0x7f3bb41efe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:25.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.282+0000 7f3bb3fff640 1 --2- 172.21.15.88:0/3619939482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bb40c79d0 0x7f3bb41efe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:25.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.282+0000 7f3bb3fff640 1 -- 172.21.15.88:0/3619939482 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac009a70 con 0x7f3bb4153770 2023-11-27T20:54:25.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.284+0000 7f3bb3fff640 1 --2- 172.21.15.88:0/3619939482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb4153770 0x7f3bb4073a70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3bac02c430 tx=0x7f3bac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:25.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.288+0000 7f3bb0ff9640 1 -- 172.21.15.88:0/3619939482 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac02cea0 con 0x7f3bb4153770 2023-11-27T20:54:25.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.288+0000 7f3bb0ff9640 1 -- 172.21.15.88:0/3619939482 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac03e610 con 0x7f3bb4153770 2023-11-27T20:54:25.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.288+0000 7f3bb0ff9640 1 -- 172.21.15.88:0/3619939482 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac03e9c0 con 0x7f3bb4153770 2023-11-27T20:54:25.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.288+0000 7f3bba1f5640 1 -- 172.21.15.88:0/3619939482 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb41f2e80 con 0x7f3bb4153770 2023-11-27T20:54:25.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.288+0000 7f3bba1f5640 1 -- 172.21.15.88:0/3619939482 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb41f3440 con 0x7f3bb4153770 2023-11-27T20:54:25.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.289+0000 7f3bba1f5640 1 -- 172.21.15.88:0/3619939482 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb4067470 con 0x7f3bb4153770 2023-11-27T20:54:25.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.532+0000 7f3bb0ff9640 1 -- 172.21.15.88:0/3619939482 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3bac03b050 con 0x7f3bb4153770 2023-11-27T20:54:25.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.532+0000 7f3bb0ff9640 1 --2- 172.21.15.88:0/3619939482 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3b9406b240 0x7f3b9406d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:25.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.533+0000 7f3bb37fe640 1 --2- 172.21.15.88:0/3619939482 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3b9406b240 0x7f3b9406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:25.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.533+0000 7f3bb37fe640 1 --2- 172.21.15.88:0/3619939482 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3b9406b240 0x7f3b9406d700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4009bd0 tx=0x7f3ba4009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:25.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.546+0000 7f3bb0ff9640 1 -- 172.21.15.88:0/3619939482 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f3bac07aee0 con 0x7f3bb4153770 2023-11-27T20:54:25.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.546+0000 7f3bb0ff9640 1 -- 172.21.15.88:0/3619939482 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3bac077220 con 0x7f3bb4153770 2023-11-27T20:54:25.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:25.719+0000 7f3bba1f5640 1 -- 172.21.15.88:0/3619939482 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f3bb40af8f0 con 0x7f3bb4153770 2023-11-27T20:54:26.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.186+0000 7f3bb0ff9640 1 -- 172.21.15.88:0/3619939482 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) v1 ==== 171+0+0 (secure 0 0 0) 0x7f3bac07a840 con 0x7f3bb4153770 2023-11-27T20:54:26.188 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' created 2023-11-27T20:54:26.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.189+0000 7f3bba1f5640 1 -- 172.21.15.88:0/3619939482 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3b9406b240 msgr2=0x7f3b9406d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:26.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.189+0000 7f3bba1f5640 1 --2- 172.21.15.88:0/3619939482 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3b9406b240 0x7f3b9406d700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4009bd0 tx=0x7f3ba4009240 comp rx=0 tx=0).stop 2023-11-27T20:54:26.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.189+0000 7f3bba1f5640 1 -- 172.21.15.88:0/3619939482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb4153770 msgr2=0x7f3bb4073a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:26.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.189+0000 7f3bba1f5640 1 --2- 172.21.15.88:0/3619939482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb4153770 0x7f3bb4073a70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3bac02c430 tx=0x7f3bac004a40 comp rx=0 tx=0).stop 2023-11-27T20:54:26.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.189+0000 7f3bba1f5640 1 -- 172.21.15.88:0/3619939482 shutdown_connections 2023-11-27T20:54:26.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.189+0000 7f3bba1f5640 1 --2- 172.21.15.88:0/3619939482 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3b9406b240 0x7f3b9406d700 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:26.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.189+0000 7f3bba1f5640 1 --2- 172.21.15.88:0/3619939482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb4153770 0x7f3bb4073a70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:26.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.189+0000 7f3bba1f5640 1 --2- 172.21.15.88:0/3619939482 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3bb40cd0a0 0x7f3bb4073530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:26.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.189+0000 7f3bba1f5640 1 --2- 172.21.15.88:0/3619939482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bb40c79d0 0x7f3bb41efe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:26.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.189+0000 7f3bba1f5640 1 -- 172.21.15.88:0/3619939482 >> 172.21.15.88:0/3619939482 conn(0x7f3bb4070790 msgr2=0x7f3bb4151860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:26.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.189+0000 7f3bba1f5640 1 -- 172.21.15.88:0/3619939482 shutdown_connections 2023-11-27T20:54:26.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.189+0000 7f3bba1f5640 1 -- 172.21.15.88:0/3619939482 wait complete. 2023-11-27T20:54:26.202 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-27T20:54:26.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.313+0000 7fbb93c75640 1 Processor -- start 2023-11-27T20:54:26.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.313+0000 7fbb93c75640 1 -- start start 2023-11-27T20:54:26.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.314+0000 7fbb93c75640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbb8c06a4b0 0x7fbb8c06a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:26.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.314+0000 7fbb93c75640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbb8c15c9c0 0x7fbb8c15cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:26.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.314+0000 7fbb93c75640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb8c159f80 con 0x7fbb8c0c59e0 2023-11-27T20:54:26.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.314+0000 7fbb93c75640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb8c15d310 con 0x7fbb8c06a4b0 2023-11-27T20:54:26.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.314+0000 7fbb93c75640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb8c1593d0 con 0x7fbb8c15c9c0 2023-11-27T20:54:26.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.314+0000 7fbb91210640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbb8c06a4b0 0x7fbb8c06a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:26.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.315+0000 7fbb91210640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbb8c06a4b0 0x7fbb8c06a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47868/0 (socket says 172.21.15.88:47868) 2023-11-27T20:54:26.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.315+0000 7fbb91210640 1 -- 172.21.15.88:0/1651129902 learned_addr learned my addr 172.21.15.88:0/1651129902 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:26.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.317+0000 7fbb91210640 1 -- 172.21.15.88:0/1651129902 >> v2:172.21.15.167:3300/0 conn(0x7fbb8c15c9c0 msgr2=0x7fbb8c15cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:26.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.317+0000 7fbb91210640 1 --2- 172.21.15.88:0/1651129902 >> v2:172.21.15.167:3300/0 conn(0x7fbb8c15c9c0 0x7fbb8c15cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:26.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.317+0000 7fbb91210640 1 -- 172.21.15.88:0/1651129902 >> v1:172.21.15.88:6789/0 conn(0x7fbb8c0c59e0 legacy=0x7fbb8c06d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:26.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.317+0000 7fbb91210640 1 -- 172.21.15.88:0/1651129902 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8c072650 con 0x7fbb8c06a4b0 2023-11-27T20:54:26.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.321+0000 7fbb91210640 1 --2- 172.21.15.88:0/1651129902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb8c06a4b0 0x7fbb8c06a8e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c156f10 tx=0x7fbb7c02ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c2705191aeda31 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:26.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.337+0000 7fbb90a0f640 1 -- 172.21.15.88:0/1651129902 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c02f850 con 0x7fbb8c06a4b0 2023-11-27T20:54:26.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.337+0000 7fbb90a0f640 1 -- 172.21.15.88:0/1651129902 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7c02f9b0 con 0x7fbb8c06a4b0 2023-11-27T20:54:26.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.337+0000 7fbb90a0f640 1 -- 172.21.15.88:0/1651129902 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c02fd40 con 0x7fbb8c06a4b0 2023-11-27T20:54:26.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.337+0000 7fbb93c75640 1 -- 172.21.15.88:0/1651129902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb8c06a4b0 msgr2=0x7fbb8c06a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:26.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.337+0000 7fbb93c75640 1 --2- 172.21.15.88:0/1651129902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb8c06a4b0 0x7fbb8c06a8e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c156f10 tx=0x7fbb7c02ba30 comp rx=0 tx=0).stop 2023-11-27T20:54:26.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.338+0000 7fbb93c75640 1 -- 172.21.15.88:0/1651129902 shutdown_connections 2023-11-27T20:54:26.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.338+0000 7fbb93c75640 1 --2- 172.21.15.88:0/1651129902 >> v2:172.21.15.167:3300/0 conn(0x7fbb8c15c9c0 0x7fbb8c15cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:26.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.338+0000 7fbb93c75640 1 --2- 172.21.15.88:0/1651129902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb8c06a4b0 0x7fbb8c06a8e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:26.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.338+0000 7fbb93c75640 1 -- 172.21.15.88:0/1651129902 >> 172.21.15.88:0/1651129902 conn(0x7fbb8c06f6d0 msgr2=0x7fbb8c06fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:26.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.338+0000 7fbb93c75640 1 -- 172.21.15.88:0/1651129902 shutdown_connections 2023-11-27T20:54:26.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.338+0000 7fbb93c75640 1 -- 172.21.15.88:0/1651129902 wait complete. 2023-11-27T20:54:26.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.339+0000 7fbb93c75640 1 Processor -- start 2023-11-27T20:54:26.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.339+0000 7fbb93c75640 1 -- start start 2023-11-27T20:54:26.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.340+0000 7fbb93c75640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb8c06a4b0 0x7fbb8c1e3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:26.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.340+0000 7fbb93c75640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb8c0c59e0 0x7fbb8c15c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:26.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.340+0000 7fbb93c75640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb8c15c9c0 0x7fbb8c14adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:26.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.340+0000 7fbb93c75640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c1ef2e0 con 0x7fbb8c0c59e0 2023-11-27T20:54:26.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.340+0000 7fbb93c75640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c14e070 con 0x7fbb8c15c9c0 2023-11-27T20:54:26.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.340+0000 7fbb93c75640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c14e350 con 0x7fbb8c06a4b0 2023-11-27T20:54:26.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.341+0000 7fbb91a11640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb8c06a4b0 0x7fbb8c1e3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:26.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.341+0000 7fbb91a11640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb8c06a4b0 0x7fbb8c1e3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:56768/0 (socket says 172.21.15.88:56768) 2023-11-27T20:54:26.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.341+0000 7fbb91a11640 1 -- 172.21.15.88:0/2689688503 learned_addr learned my addr 172.21.15.88:0/2689688503 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:26.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.379+0000 7fbb92212640 1 --2- 172.21.15.88:0/2689688503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb8c15c9c0 0x7fbb8c14adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:26.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.382+0000 7fbb92212640 1 -- 172.21.15.88:0/2689688503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb8c06a4b0 msgr2=0x7fbb8c1e3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:26.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.382+0000 7fbb92212640 1 --2- 172.21.15.88:0/2689688503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb8c06a4b0 0x7fbb8c1e3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:26.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.382+0000 7fbb92212640 1 -- 172.21.15.88:0/2689688503 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb8c0c59e0 msgr2=0x7fbb8c15c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:26.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.382+0000 7fbb92212640 1 --2- 172.21.15.88:0/2689688503 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb8c0c59e0 0x7fbb8c15c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:26.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.382+0000 7fbb92212640 1 -- 172.21.15.88:0/2689688503 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7c0094d0 con 0x7fbb8c15c9c0 2023-11-27T20:54:26.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.413+0000 7fbb92212640 1 --2- 172.21.15.88:0/2689688503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb8c15c9c0 0x7fbb8c14adc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400be20 tx=0x7fbb8400bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:26.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.421+0000 7fbb827fc640 1 -- 172.21.15.88:0/2689688503 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8400ce70 con 0x7fbb8c15c9c0 2023-11-27T20:54:26.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.421+0000 7fbb827fc640 1 -- 172.21.15.88:0/2689688503 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb84014440 con 0x7fbb8c15c9c0 2023-11-27T20:54:26.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.421+0000 7fbb827fc640 1 -- 172.21.15.88:0/2689688503 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb84014810 con 0x7fbb8c15c9c0 2023-11-27T20:54:26.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.421+0000 7fbb93c75640 1 -- 172.21.15.88:0/2689688503 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb8c1ef5a0 con 0x7fbb8c15c9c0 2023-11-27T20:54:26.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.422+0000 7fbb93c75640 1 -- 172.21.15.88:0/2689688503 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb8c1efb60 con 0x7fbb8c15c9c0 2023-11-27T20:54:26.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.423+0000 7fbb93c75640 1 -- 172.21.15.88:0/2689688503 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8c1efd50 con 0x7fbb8c15c9c0 2023-11-27T20:54:26.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.675+0000 7fbb827fc640 1 -- 172.21.15.88:0/2689688503 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fbb8401d3b0 con 0x7fbb8c15c9c0 2023-11-27T20:54:26.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.676+0000 7fbb827fc640 1 --2- 172.21.15.88:0/2689688503 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fbb7006b240 0x7fbb7006d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:26.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.676+0000 7fbb91a11640 1 --2- 172.21.15.88:0/2689688503 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fbb7006b240 0x7fbb7006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:26.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.676+0000 7fbb91a11640 1 --2- 172.21.15.88:0/2689688503 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fbb7006b240 0x7fbb7006d700 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbb88001660 tx=0x7fbb88009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:26.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.678+0000 7fbb827fc640 1 -- 172.21.15.88:0/2689688503 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fbb84059140 con 0x7fbb8c15c9c0 2023-11-27T20:54:26.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.688+0000 7fbb827fc640 1 -- 172.21.15.88:0/2689688503 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fbb84054d80 con 0x7fbb8c15c9c0 2023-11-27T20:54:26.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:26.889+0000 7fbb93c75640 1 -- 172.21.15.88:0/2689688503 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbb8c067470 con 0x7fbb8c15c9c0 2023-11-27T20:54:27.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.656+0000 7fbb827fc640 1 -- 172.21.15.88:0/2689688503 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fbb84019070 con 0x7fbb8c15c9c0 2023-11-27T20:54:27.658 INFO:teuthology.orchestra.run.smithi088.stderr:new fs with metadata pool 2 and data pool 3 2023-11-27T20:54:27.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.658+0000 7fbb93c75640 1 -- 172.21.15.88:0/2689688503 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fbb7006b240 msgr2=0x7fbb7006d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:27.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.658+0000 7fbb93c75640 1 --2- 172.21.15.88:0/2689688503 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fbb7006b240 0x7fbb7006d700 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbb88001660 tx=0x7fbb88009040 comp rx=0 tx=0).stop 2023-11-27T20:54:27.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.658+0000 7fbb93c75640 1 -- 172.21.15.88:0/2689688503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb8c15c9c0 msgr2=0x7fbb8c14adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:27.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.658+0000 7fbb93c75640 1 --2- 172.21.15.88:0/2689688503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb8c15c9c0 0x7fbb8c14adc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400be20 tx=0x7fbb8400bf10 comp rx=0 tx=0).stop 2023-11-27T20:54:27.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.658+0000 7fbb93c75640 1 -- 172.21.15.88:0/2689688503 shutdown_connections 2023-11-27T20:54:27.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.658+0000 7fbb93c75640 1 --2- 172.21.15.88:0/2689688503 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fbb7006b240 0x7fbb7006d700 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:27.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.658+0000 7fbb93c75640 1 --2- 172.21.15.88:0/2689688503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb8c15c9c0 0x7fbb8c14adc0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:27.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.658+0000 7fbb93c75640 1 --2- 172.21.15.88:0/2689688503 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb8c0c59e0 0x7fbb8c15c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:27.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.658+0000 7fbb93c75640 1 --2- 172.21.15.88:0/2689688503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb8c06a4b0 0x7fbb8c1e3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:27.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.658+0000 7fbb93c75640 1 -- 172.21.15.88:0/2689688503 >> 172.21.15.88:0/2689688503 conn(0x7fbb8c06f6d0 msgr2=0x7fbb8c14e740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:27.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.658+0000 7fbb93c75640 1 -- 172.21.15.88:0/2689688503 shutdown_connections 2023-11-27T20:54:27.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.658+0000 7fbb93c75640 1 -- 172.21.15.88:0/2689688503 wait complete. 2023-11-27T20:54:27.671 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-11-27T20:54:27.671 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-11-27T20:54:27.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.794+0000 7fa3a8761640 1 Processor -- start 2023-11-27T20:54:27.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.794+0000 7fa3a8761640 1 -- start start 2023-11-27T20:54:27.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.795+0000 7fa3a8761640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa3a0151680 0x7fa3a01571d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:27.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.795+0000 7fa3a8761640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa3a006f810 0x7fa3a00ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:27.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.795+0000 7fa3a8761640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a00c8240 con 0x7fa3a006f3f0 2023-11-27T20:54:27.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.795+0000 7fa3a8761640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a0157880 con 0x7fa3a0151680 2023-11-27T20:54:27.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.795+0000 7fa3a8761640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a0157b60 con 0x7fa3a006f810 2023-11-27T20:54:27.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.796+0000 7fa3a6cfe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa3a006f810 0x7fa3a00ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:27.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.796+0000 7fa3a6cfe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa3a006f810 0x7fa3a00ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:55410/0 (socket says 172.21.15.88:55410) 2023-11-27T20:54:27.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.796+0000 7fa3a6cfe640 1 -- 172.21.15.88:0/3565686129 learned_addr learned my addr 172.21.15.88:0/3565686129 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:27.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.799+0000 7fa3a6cfe640 1 -- 172.21.15.88:0/3565686129 >> v2:172.21.15.88:3300/0 conn(0x7fa3a0151680 msgr2=0x7fa3a01571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:27.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.799+0000 7fa3a6cfe640 1 --2- 172.21.15.88:0/3565686129 >> v2:172.21.15.88:3300/0 conn(0x7fa3a0151680 0x7fa3a01571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:27.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.799+0000 7fa3a6cfe640 1 -- 172.21.15.88:0/3565686129 >> v1:172.21.15.88:6789/0 conn(0x7fa3a006f3f0 legacy=0x7fa3a00c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:27.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.799+0000 7fa3a6cfe640 1 -- 172.21.15.88:0/3565686129 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a0157e40 con 0x7fa3a006f810 2023-11-27T20:54:27.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.801+0000 7fa3a6cfe640 1 --2- 172.21.15.88:0/3565686129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3a006f810 0x7fa3a00ccac0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0154dc0 tx=0x7fa39802bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2268c6e61011d714 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:27.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.805+0000 7fa3a54fb640 1 -- 172.21.15.88:0/3565686129 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39802cb20 con 0x7fa3a006f810 2023-11-27T20:54:27.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.805+0000 7fa3a54fb640 1 -- 172.21.15.88:0/3565686129 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39802cc80 con 0x7fa3a006f810 2023-11-27T20:54:27.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.805+0000 7fa3a54fb640 1 -- 172.21.15.88:0/3565686129 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3980343f0 con 0x7fa3a006f810 2023-11-27T20:54:27.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.805+0000 7fa3a8761640 1 -- 172.21.15.88:0/3565686129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3a006f810 msgr2=0x7fa3a00ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:27.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.805+0000 7fa3a8761640 1 --2- 172.21.15.88:0/3565686129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3a006f810 0x7fa3a00ccac0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0154dc0 tx=0x7fa39802bf80 comp rx=0 tx=0).stop 2023-11-27T20:54:27.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.806+0000 7fa3a8761640 1 -- 172.21.15.88:0/3565686129 shutdown_connections 2023-11-27T20:54:27.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.806+0000 7fa3a8761640 1 --2- 172.21.15.88:0/3565686129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3a006f810 0x7fa3a00ccac0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:27.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.806+0000 7fa3a8761640 1 --2- 172.21.15.88:0/3565686129 >> v2:172.21.15.88:3300/0 conn(0x7fa3a0151680 0x7fa3a01571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:27.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.806+0000 7fa3a8761640 1 -- 172.21.15.88:0/3565686129 >> 172.21.15.88:0/3565686129 conn(0x7fa3a00707f0 msgr2=0x7fa3a0070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:27.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.806+0000 7fa3a8761640 1 -- 172.21.15.88:0/3565686129 shutdown_connections 2023-11-27T20:54:27.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.806+0000 7fa3a8761640 1 -- 172.21.15.88:0/3565686129 wait complete. 2023-11-27T20:54:27.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.807+0000 7fa3a8761640 1 Processor -- start 2023-11-27T20:54:27.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.807+0000 7fa3a8761640 1 -- start start 2023-11-27T20:54:27.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.809+0000 7fa3a8761640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3a006f3f0 0x7fa3a0156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:27.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.809+0000 7fa3a8761640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3a006f810 0x7fa3a01ef470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:27.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.809+0000 7fa3a8761640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3a0151680 0x7fa3a01ef9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:27.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.809+0000 7fa3a8761640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a0148890 con 0x7fa3a0151680 2023-11-27T20:54:27.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.809+0000 7fa3a8761640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a0157210 con 0x7fa3a006f810 2023-11-27T20:54:27.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.809+0000 7fa3a8761640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a0147a90 con 0x7fa3a006f3f0 2023-11-27T20:54:27.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.809+0000 7fa3a5cfc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3a006f810 0x7fa3a01ef470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:27.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.809+0000 7fa3a5cfc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3a006f810 0x7fa3a01ef470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:55418/0 (socket says 172.21.15.88:55418) 2023-11-27T20:54:27.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.809+0000 7fa3a5cfc640 1 -- 172.21.15.88:0/129211002 learned_addr learned my addr 172.21.15.88:0/129211002 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:27.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.809+0000 7fa3a64fd640 1 --2- 172.21.15.88:0/129211002 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3a006f3f0 0x7fa3a0156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:27.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.813+0000 7fa3a5cfc640 1 -- 172.21.15.88:0/129211002 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3a006f3f0 msgr2=0x7fa3a0156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:27.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.813+0000 7fa3a5cfc640 1 --2- 172.21.15.88:0/129211002 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3a006f3f0 0x7fa3a0156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:27.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.813+0000 7fa3a5cfc640 1 -- 172.21.15.88:0/129211002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3a0151680 msgr2=0x7fa3a01ef9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:27.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.813+0000 7fa3a5cfc640 1 --2- 172.21.15.88:0/129211002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3a0151680 0x7fa3a01ef9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:27.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.813+0000 7fa3a5cfc640 1 -- 172.21.15.88:0/129211002 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa398009b30 con 0x7fa3a006f810 2023-11-27T20:54:27.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.817+0000 7fa3a5cfc640 1 --2- 172.21.15.88:0/129211002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3a006f810 0x7fa3a01ef470 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa39000b3e0 tx=0x7fa39000b7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:27.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.820+0000 7fa396ffd640 1 -- 172.21.15.88:0/129211002 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa390011830 con 0x7fa3a006f810 2023-11-27T20:54:27.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.820+0000 7fa396ffd640 1 -- 172.21.15.88:0/129211002 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3900119b0 con 0x7fa3a006f810 2023-11-27T20:54:27.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.820+0000 7fa396ffd640 1 -- 172.21.15.88:0/129211002 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa390011d60 con 0x7fa3a006f810 2023-11-27T20:54:27.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.820+0000 7fa3a8761640 1 -- 172.21.15.88:0/129211002 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a0156bd0 con 0x7fa3a006f810 2023-11-27T20:54:27.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.821+0000 7fa3a8761640 1 -- 172.21.15.88:0/129211002 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a0156ea0 con 0x7fa3a006f810 2023-11-27T20:54:27.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:27.822+0000 7fa3a8761640 1 -- 172.21.15.88:0/129211002 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a0073dc0 con 0x7fa3a006f810 2023-11-27T20:54:28.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.067+0000 7fa396ffd640 1 -- 172.21.15.88:0/129211002 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa39001a400 con 0x7fa3a006f810 2023-11-27T20:54:28.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.068+0000 7fa396ffd640 1 --2- 172.21.15.88:0/129211002 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa38406b210 0x7fa38406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:28.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.068+0000 7fa3a64fd640 1 --2- 172.21.15.88:0/129211002 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa38406b210 0x7fa38406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:28.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.068+0000 7fa3a64fd640 1 --2- 172.21.15.88:0/129211002 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa38406b210 0x7fa38406d6d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009990 tx=0x7fa39c009110 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:28.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.079+0000 7fa396ffd640 1 -- 172.21.15.88:0/129211002 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3900591c0 con 0x7fa3a006f810 2023-11-27T20:54:28.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.089+0000 7fa396ffd640 1 -- 172.21.15.88:0/129211002 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa390054e00 con 0x7fa3a006f810 2023-11-27T20:54:28.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.312+0000 7fa3a8761640 1 -- 172.21.15.88:0/129211002 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fa3a01ef120 con 0x7fa3a006f810 2023-11-27T20:54:28.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.470+0000 7fa396ffd640 1 -- 172.21.15.88:0/129211002 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) v1 ==== 157+0+0 (secure 0 0 0) 0x7fa390015020 con 0x7fa3a006f810 2023-11-27T20:54:28.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.472+0000 7fa3a8761640 1 -- 172.21.15.88:0/129211002 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa38406b210 msgr2=0x7fa38406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:28.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.472+0000 7fa3a8761640 1 --2- 172.21.15.88:0/129211002 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa38406b210 0x7fa38406d6d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009990 tx=0x7fa39c009110 comp rx=0 tx=0).stop 2023-11-27T20:54:28.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.472+0000 7fa3a8761640 1 -- 172.21.15.88:0/129211002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3a006f810 msgr2=0x7fa3a01ef470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:28.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.472+0000 7fa3a8761640 1 --2- 172.21.15.88:0/129211002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3a006f810 0x7fa3a01ef470 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa39000b3e0 tx=0x7fa39000b7e0 comp rx=0 tx=0).stop 2023-11-27T20:54:28.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.472+0000 7fa3a8761640 1 -- 172.21.15.88:0/129211002 shutdown_connections 2023-11-27T20:54:28.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.472+0000 7fa3a8761640 1 --2- 172.21.15.88:0/129211002 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa38406b210 0x7fa38406d6d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:28.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.472+0000 7fa3a8761640 1 --2- 172.21.15.88:0/129211002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3a0151680 0x7fa3a01ef9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:28.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.472+0000 7fa3a8761640 1 --2- 172.21.15.88:0/129211002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3a006f810 0x7fa3a01ef470 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:28.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.472+0000 7fa3a8761640 1 --2- 172.21.15.88:0/129211002 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3a006f3f0 0x7fa3a0156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:28.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.472+0000 7fa3a8761640 1 -- 172.21.15.88:0/129211002 >> 172.21.15.88:0/129211002 conn(0x7fa3a00707f0 msgr2=0x7fa3a0070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:28.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.472+0000 7fa3a8761640 1 -- 172.21.15.88:0/129211002 shutdown_connections 2023-11-27T20:54:28.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.472+0000 7fa3a8761640 1 -- 172.21.15.88:0/129211002 wait complete. 2023-11-27T20:54:28.485 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-11-27T20:54:28.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.598+0000 7f9dc7568640 1 Processor -- start 2023-11-27T20:54:28.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.598+0000 7f9dc7568640 1 -- start start 2023-11-27T20:54:28.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.599+0000 7f9dc7568640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9dc0153240 0x7f9dc00c9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:28.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.599+0000 7f9dc7568640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dc006bdd0 0x7f9dc00c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:28.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.599+0000 7f9dc7568640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc00cac90 con 0x7f9dc0153620 2023-11-27T20:54:28.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.599+0000 7f9dc7568640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc00cc6e0 con 0x7f9dc0153240 2023-11-27T20:54:28.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.599+0000 7f9dc7568640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc00cbad0 con 0x7f9dc006bdd0 2023-11-27T20:54:28.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.606+0000 7f9dc5b05640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dc006bdd0 0x7f9dc00c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:28.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.606+0000 7f9dc5304640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9dc0153240 0x7f9dc00c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:28.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.607+0000 7f9dc5b05640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dc006bdd0 0x7f9dc00c9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:56800/0 (socket says 172.21.15.88:56800) 2023-11-27T20:54:28.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.607+0000 7f9dc5b05640 1 -- 172.21.15.88:0/452747497 learned_addr learned my addr 172.21.15.88:0/452747497 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:28.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.609+0000 7f9dc5b05640 1 -- 172.21.15.88:0/452747497 >> v2:172.21.15.88:3300/0 conn(0x7f9dc0153240 msgr2=0x7f9dc00c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:28.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.609+0000 7f9dc5b05640 1 --2- 172.21.15.88:0/452747497 >> v2:172.21.15.88:3300/0 conn(0x7f9dc0153240 0x7f9dc00c9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:28.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.609+0000 7f9dc5b05640 1 -- 172.21.15.88:0/452747497 >> v1:172.21.15.167:6789/0 conn(0x7f9dc0153620 legacy=0x7f9dc006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:28.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.609+0000 7f9dc5b05640 1 -- 172.21.15.88:0/452747497 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc00cbdb0 con 0x7f9dc006bdd0 2023-11-27T20:54:28.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.612+0000 7f9dc5b05640 1 --2- 172.21.15.88:0/452747497 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dc006bdd0 0x7f9dc00c9a90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9db8009e50 tx=0x7f9db802bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42d5265e64407c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:28.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.616+0000 7f9db7fff640 1 -- 172.21.15.88:0/452747497 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db802cb90 con 0x7f9dc006bdd0 2023-11-27T20:54:28.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.616+0000 7f9db7fff640 1 -- 172.21.15.88:0/452747497 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db802ccf0 con 0x7f9dc006bdd0 2023-11-27T20:54:28.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.616+0000 7f9db7fff640 1 -- 172.21.15.88:0/452747497 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db8034610 con 0x7f9dc006bdd0 2023-11-27T20:54:28.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.616+0000 7f9dc7568640 1 -- 172.21.15.88:0/452747497 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dc006bdd0 msgr2=0x7f9dc00c9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:28.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.616+0000 7f9dc7568640 1 --2- 172.21.15.88:0/452747497 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dc006bdd0 0x7f9dc00c9a90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9db8009e50 tx=0x7f9db802bff0 comp rx=0 tx=0).stop 2023-11-27T20:54:28.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.616+0000 7f9dc7568640 1 -- 172.21.15.88:0/452747497 shutdown_connections 2023-11-27T20:54:28.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.616+0000 7f9dc7568640 1 --2- 172.21.15.88:0/452747497 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dc006bdd0 0x7f9dc00c9a90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:28.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.616+0000 7f9dc7568640 1 --2- 172.21.15.88:0/452747497 >> v2:172.21.15.88:3300/0 conn(0x7f9dc0153240 0x7f9dc00c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:28.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.616+0000 7f9dc7568640 1 -- 172.21.15.88:0/452747497 >> 172.21.15.88:0/452747497 conn(0x7f9dc00615b0 msgr2=0x7f9dc0070780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:28.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.616+0000 7f9dc7568640 1 -- 172.21.15.88:0/452747497 shutdown_connections 2023-11-27T20:54:28.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.616+0000 7f9dc7568640 1 -- 172.21.15.88:0/452747497 wait complete. 2023-11-27T20:54:28.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.618+0000 7f9dc7568640 1 Processor -- start 2023-11-27T20:54:28.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.618+0000 7f9dc7568640 1 -- start start 2023-11-27T20:54:28.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.618+0000 7f9dc7568640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9dc006bdd0 0x7f9dc00b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:28.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.618+0000 7f9dc7568640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dc0153240 0x7f9dc01f2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:28.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.618+0000 7f9dc7568640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc0153620 0x7f9dc01ef740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:28.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.618+0000 7f9dc7568640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc015d5c0 con 0x7f9dc006bdd0 2023-11-27T20:54:28.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.618+0000 7f9dc7568640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc01f32f0 con 0x7f9dc0153620 2023-11-27T20:54:28.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.618+0000 7f9dc7568640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc00b0300 con 0x7f9dc0153240 2023-11-27T20:54:28.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.619+0000 7f9dc5304640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9dc006bdd0 0x7f9dc00b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:28.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.619+0000 7f9dc5b05640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc0153620 0x7f9dc01ef740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:28.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.619+0000 7f9dc5b05640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc0153620 0x7f9dc01ef740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:55422/0 (socket says 172.21.15.88:55422) 2023-11-27T20:54:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.619+0000 7f9dc5b05640 1 -- 172.21.15.88:0/3265916007 learned_addr learned my addr 172.21.15.88:0/3265916007 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:28.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.623+0000 7f9dc5b05640 1 -- 172.21.15.88:0/3265916007 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dc0153240 msgr2=0x7f9dc01f2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:28.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.623+0000 7f9dc5b05640 1 --2- 172.21.15.88:0/3265916007 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dc0153240 0x7f9dc01f2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:28.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.623+0000 7f9dc5b05640 1 -- 172.21.15.88:0/3265916007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9dc006bdd0 msgr2=0x7f9dc00b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:28.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.623+0000 7f9dc5b05640 1 --2- 172.21.15.88:0/3265916007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9dc006bdd0 0x7f9dc00b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:28.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.623+0000 7f9dc5b05640 1 -- 172.21.15.88:0/3265916007 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db8009b30 con 0x7f9dc0153620 2023-11-27T20:54:28.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.626+0000 7f9dc5b05640 1 --2- 172.21.15.88:0/3265916007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc0153620 0x7f9dc01ef740 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9db8009e50 tx=0x7f9db8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:28.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.630+0000 7f9db5ffb640 1 -- 172.21.15.88:0/3265916007 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db8009510 con 0x7f9dc0153620 2023-11-27T20:54:28.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.630+0000 7f9db5ffb640 1 -- 172.21.15.88:0/3265916007 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db803e450 con 0x7f9dc0153620 2023-11-27T20:54:28.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.630+0000 7f9db5ffb640 1 -- 172.21.15.88:0/3265916007 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db803e800 con 0x7f9dc0153620 2023-11-27T20:54:28.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.630+0000 7f9dc7568640 1 -- 172.21.15.88:0/3265916007 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc01ef2b0 con 0x7f9dc0153620 2023-11-27T20:54:28.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.630+0000 7f9dc7568640 1 -- 172.21.15.88:0/3265916007 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc0151ca0 con 0x7f9dc0153620 2023-11-27T20:54:28.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.631+0000 7f9dc7568640 1 -- 172.21.15.88:0/3265916007 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc01ef440 con 0x7f9dc0153620 2023-11-27T20:54:28.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.651+0000 7f9db5ffb640 1 -- 172.21.15.88:0/3265916007 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9db803e960 con 0x7f9dc0153620 2023-11-27T20:54:28.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.651+0000 7f9db5ffb640 1 --2- 172.21.15.88:0/3265916007 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f9da406b1c0 0x7f9da406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:28.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.651+0000 7f9dc5304640 1 --2- 172.21.15.88:0/3265916007 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f9da406b1c0 0x7f9da406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:28.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.651+0000 7f9dc5304640 1 --2- 172.21.15.88:0/3265916007 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f9da406b1c0 0x7f9da406d680 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc009b40 tx=0x7f9dbc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:28.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.882+0000 7f9db5ffb640 1 -- 172.21.15.88:0/3265916007 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f9db807b9f0 con 0x7f9dc0153620 2023-11-27T20:54:28.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:28.892+0000 7f9db5ffb640 1 -- 172.21.15.88:0/3265916007 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9db8077630 con 0x7f9dc0153620 2023-11-27T20:54:29.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:29.063+0000 7f9dc7568640 1 -- 172.21.15.88:0/3265916007 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9dc0073dc0 con 0x7f9dc0153620 2023-11-27T20:54:30.097 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:54:30.100 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:54:30.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.781+0000 7f9db5ffb640 1 -- 172.21.15.88:0/3265916007 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) v1 ==== 228+0+0 (secure 0 0 0) 0x7f9db802ce60 con 0x7f9dc0153620 2023-11-27T20:54:30.783 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data_ec' created 2023-11-27T20:54:30.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.784+0000 7f9dc7568640 1 -- 172.21.15.88:0/3265916007 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f9da406b1c0 msgr2=0x7f9da406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:30.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.784+0000 7f9dc7568640 1 --2- 172.21.15.88:0/3265916007 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f9da406b1c0 0x7f9da406d680 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc009b40 tx=0x7f9dbc009190 comp rx=0 tx=0).stop 2023-11-27T20:54:30.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.784+0000 7f9dc7568640 1 -- 172.21.15.88:0/3265916007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc0153620 msgr2=0x7f9dc01ef740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:30.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.784+0000 7f9dc7568640 1 --2- 172.21.15.88:0/3265916007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc0153620 0x7f9dc01ef740 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9db8009e50 tx=0x7f9db8004a40 comp rx=0 tx=0).stop 2023-11-27T20:54:30.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.784+0000 7f9dc7568640 1 -- 172.21.15.88:0/3265916007 shutdown_connections 2023-11-27T20:54:30.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.784+0000 7f9dc7568640 1 --2- 172.21.15.88:0/3265916007 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f9da406b1c0 0x7f9da406d680 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:30.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.784+0000 7f9dc7568640 1 --2- 172.21.15.88:0/3265916007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc0153620 0x7f9dc01ef740 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:30.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.784+0000 7f9dc7568640 1 --2- 172.21.15.88:0/3265916007 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dc0153240 0x7f9dc01f2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:30.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.784+0000 7f9dc7568640 1 --2- 172.21.15.88:0/3265916007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9dc006bdd0 0x7f9dc00b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:30.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.784+0000 7f9dc7568640 1 -- 172.21.15.88:0/3265916007 >> 172.21.15.88:0/3265916007 conn(0x7f9dc00615b0 msgr2=0x7f9dc006fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:30.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.784+0000 7f9dc7568640 1 -- 172.21.15.88:0/3265916007 shutdown_connections 2023-11-27T20:54:30.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.784+0000 7f9dc7568640 1 -- 172.21.15.88:0/3265916007 wait complete. 2023-11-27T20:54:30.797 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-11-27T20:54:30.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.900+0000 7f4b719a5640 1 Processor -- start 2023-11-27T20:54:30.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.900+0000 7f4b719a5640 1 -- start start 2023-11-27T20:54:30.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.900+0000 7f4b719a5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4b6c151680 0x7f4b6c1571d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:30.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.900+0000 7f4b719a5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b6c0c8240 con 0x7f4b6c06f3f0 2023-11-27T20:54:30.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.900+0000 7f4b719a5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b6c157880 con 0x7f4b6c06f810 2023-11-27T20:54:30.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.900+0000 7f4b719a5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6c157b60 con 0x7f4b6c151680 2023-11-27T20:54:30.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.909+0000 7f4b6affd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4b6c151680 0x7f4b6c1571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.910+0000 7f4b6b7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f4b6c06f810 0x7f4b6c0ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:48090/0 (socket says 172.21.15.88:48090) 2023-11-27T20:54:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.910+0000 7f4b6b7fe640 1 -- 172.21.15.88:0/2000087197 learned_addr learned my addr 172.21.15.88:0/2000087197 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:54:30.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.917+0000 7f4b69ffb640 1 -- 172.21.15.88:0/2000087197 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2968307309 0 0) 0x7f4b6c157880 con 0x7f4b6c06f810 2023-11-27T20:54:30.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.917+0000 7f4b69ffb640 1 -- 172.21.15.88:0/2000087197 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b54003520 con 0x7f4b6c06f810 2023-11-27T20:54:30.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.920+0000 7f4b69ffb640 1 -- 172.21.15.88:0/2000087197 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 56248245 0 0) 0x7f4b54003520 con 0x7f4b6c06f810 2023-11-27T20:54:30.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.920+0000 7f4b69ffb640 1 -- 172.21.15.88:0/2000087197 >> v2:172.21.15.88:3300/0 conn(0x7f4b6c151680 msgr2=0x7f4b6c1571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:30.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.920+0000 7f4b69ffb640 1 --2- 172.21.15.88:0/2000087197 >> v2:172.21.15.88:3300/0 conn(0x7f4b6c151680 0x7f4b6c1571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:30.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.920+0000 7f4b69ffb640 1 -- 172.21.15.88:0/2000087197 >> v1:172.21.15.88:6789/0 conn(0x7f4b6c06f3f0 legacy=0x7f4b6c0c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:30.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.920+0000 7f4b69ffb640 1 -- 172.21.15.88:0/2000087197 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c157e40 con 0x7f4b6c06f810 2023-11-27T20:54:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.920+0000 7f4b69ffb640 1 -- 172.21.15.88:0/2000087197 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1067350109 0 0) 0x7f4b5c001670 con 0x7f4b6c06f810 2023-11-27T20:54:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.920+0000 7f4b69ffb640 1 -- 172.21.15.88:0/2000087197 >> v1:172.21.15.167:6789/0 conn(0x7f4b6c06f810 legacy=0x7f4b6c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.920+0000 7f4b69ffb640 1 --2- 172.21.15.88:0/2000087197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b54003a30 0x7f4b54003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.920+0000 7f4b69ffb640 1 --2- 172.21.15.88:0/2000087197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b540047c0 0x7f4b54004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.920+0000 7f4b69ffb640 1 --2- 172.21.15.88:0/2000087197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b54005180 0x7f4b5400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.920+0000 7f4b69ffb640 1 -- 172.21.15.88:0/2000087197 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c157b60 con 0x7f4b54005180 2023-11-27T20:54:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.920+0000 7f4b69ffb640 1 -- 172.21.15.88:0/2000087197 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5400c100 con 0x7f4b540047c0 2023-11-27T20:54:30.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.920+0000 7f4b69ffb640 1 -- 172.21.15.88:0/2000087197 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5400c2c0 con 0x7f4b54003a30 2023-11-27T20:54:30.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.921+0000 7f4b6affd640 1 --2- 172.21.15.88:0/2000087197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b54003a30 0x7f4b54003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:30.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.923+0000 7f4b6a7fc640 1 --2- 172.21.15.88:0/2000087197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b540047c0 0x7f4b54004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:30.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.924+0000 7f4b6affd640 1 -- 172.21.15.88:0/2000087197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b540047c0 msgr2=0x7f4b54004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:30.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.924+0000 7f4b6affd640 1 --2- 172.21.15.88:0/2000087197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b540047c0 0x7f4b54004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:30.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.924+0000 7f4b6affd640 1 -- 172.21.15.88:0/2000087197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b54005180 msgr2=0x7f4b5400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:30.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.924+0000 7f4b6affd640 1 --2- 172.21.15.88:0/2000087197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b54005180 0x7f4b5400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:30.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.924+0000 7f4b6affd640 1 -- 172.21.15.88:0/2000087197 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b54003520 con 0x7f4b54003a30 2023-11-27T20:54:30.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.924+0000 7f4b6b7fe640 1 -- 172.21.15.88:0/2000087197 reap_dead start 2023-11-27T20:54:30.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.926+0000 7f4b6affd640 1 --2- 172.21.15.88:0/2000087197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b54003a30 0x7f4b54003e30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009fc0 tx=0x7f4b540057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f61292fe229a45f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:30.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.929+0000 7f4b69ffb640 1 -- 172.21.15.88:0/2000087197 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6402cc60 con 0x7f4b54003a30 2023-11-27T20:54:30.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.929+0000 7f4b69ffb640 1 -- 172.21.15.88:0/2000087197 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6400f040 con 0x7f4b54003a30 2023-11-27T20:54:30.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.929+0000 7f4b69ffb640 1 -- 172.21.15.88:0/2000087197 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b64034440 con 0x7f4b54003a30 2023-11-27T20:54:30.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.930+0000 7f4b719a5640 1 -- 172.21.15.88:0/2000087197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b54003a30 msgr2=0x7f4b54003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:30.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.930+0000 7f4b719a5640 1 --2- 172.21.15.88:0/2000087197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b54003a30 0x7f4b54003e30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009fc0 tx=0x7f4b540057f0 comp rx=0 tx=0).stop 2023-11-27T20:54:30.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.930+0000 7f4b719a5640 1 -- 172.21.15.88:0/2000087197 shutdown_connections 2023-11-27T20:54:30.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.930+0000 7f4b719a5640 1 --2- 172.21.15.88:0/2000087197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b54003a30 0x7f4b54003e30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:30.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.930+0000 7f4b719a5640 1 -- 172.21.15.88:0/2000087197 >> 172.21.15.88:0/2000087197 conn(0x7f4b6c0707f0 msgr2=0x7f4b6c070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:30.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.930+0000 7f4b719a5640 1 -- 172.21.15.88:0/2000087197 shutdown_connections 2023-11-27T20:54:30.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.930+0000 7f4b719a5640 1 -- 172.21.15.88:0/2000087197 wait complete. 2023-11-27T20:54:30.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.931+0000 7f4b719a5640 1 Processor -- start 2023-11-27T20:54:30.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.931+0000 7f4b719a5640 1 -- start start 2023-11-27T20:54:30.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.932+0000 7f4b719a5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b54003a30 0x7f4b6c1eda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:30.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.932+0000 7f4b719a5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b6c15b290 0x7f4b6c14e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:30.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.932+0000 7f4b719a5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b6c155020 0x7f4b6c158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:30.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.932+0000 7f4b719a5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c1ed570 con 0x7f4b6c15b290 2023-11-27T20:54:30.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.932+0000 7f4b719a5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c1554a0 con 0x7f4b6c155020 2023-11-27T20:54:30.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.932+0000 7f4b719a5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c14ef10 con 0x7f4b54003a30 2023-11-27T20:54:30.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.933+0000 7f4b6b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b6c155020 0x7f4b6c158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:30.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.933+0000 7f4b6affd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b54003a30 0x7f4b6c1eda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:30.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.933+0000 7f4b6b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b6c155020 0x7f4b6c158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:52752/0 (socket says 172.21.15.88:52752) 2023-11-27T20:54:30.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.933+0000 7f4b6b7fe640 1 -- 172.21.15.88:0/3378563155 learned_addr learned my addr 172.21.15.88:0/3378563155 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:30.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.937+0000 7f4b6affd640 1 -- 172.21.15.88:0/3378563155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b6c155020 msgr2=0x7f4b6c158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:30.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.937+0000 7f4b6affd640 1 --2- 172.21.15.88:0/3378563155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b6c155020 0x7f4b6c158600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:30.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.937+0000 7f4b6affd640 1 -- 172.21.15.88:0/3378563155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b6c15b290 msgr2=0x7f4b6c14e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:30.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.937+0000 7f4b6affd640 1 --2- 172.21.15.88:0/3378563155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b6c15b290 0x7f4b6c14e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:30.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.937+0000 7f4b6affd640 1 -- 172.21.15.88:0/3378563155 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c14e950 con 0x7f4b54003a30 2023-11-27T20:54:30.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.939+0000 7f4b6affd640 1 --2- 172.21.15.88:0/3378563155 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b54003a30 0x7f4b6c1eda00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4b64033000 tx=0x7f4b64009750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:30.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.943+0000 7f4b53fff640 1 -- 172.21.15.88:0/3378563155 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b64035de0 con 0x7f4b54003a30 2023-11-27T20:54:30.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.943+0000 7f4b53fff640 1 -- 172.21.15.88:0/3378563155 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6403e410 con 0x7f4b54003a30 2023-11-27T20:54:30.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.943+0000 7f4b53fff640 1 -- 172.21.15.88:0/3378563155 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6403e780 con 0x7f4b54003a30 2023-11-27T20:54:30.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.943+0000 7f4b719a5640 1 -- 172.21.15.88:0/3378563155 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b6c14ec30 con 0x7f4b54003a30 2023-11-27T20:54:30.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.943+0000 7f4b719a5640 1 -- 172.21.15.88:0/3378563155 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b6c1ed200 con 0x7f4b54003a30 2023-11-27T20:54:30.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:30.944+0000 7f4b719a5640 1 -- 172.21.15.88:0/3378563155 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b6c1ed390 con 0x7f4b54003a30 2023-11-27T20:54:31.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.193+0000 7f4b53fff640 1 -- 172.21.15.88:0/3378563155 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4b6403b050 con 0x7f4b54003a30 2023-11-27T20:54:31.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.193+0000 7f4b53fff640 1 --2- 172.21.15.88:0/3378563155 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4b5806b1c0 0x7f4b5806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:31.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.193+0000 7f4b6a7fc640 1 --2- 172.21.15.88:0/3378563155 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4b5806b1c0 0x7f4b5806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:31.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.193+0000 7f4b6a7fc640 1 --2- 172.21.15.88:0/3378563155 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4b5806b1c0 0x7f4b5806d680 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0c9180 tx=0x7f4b60009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:31.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.195+0000 7f4b53fff640 1 -- 172.21.15.88:0/3378563155 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f4b6407ae60 con 0x7f4b54003a30 2023-11-27T20:54:31.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.206+0000 7f4b53fff640 1 -- 172.21.15.88:0/3378563155 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4b640771a0 con 0x7f4b54003a30 2023-11-27T20:54:31.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.372+0000 7f4b719a5640 1 -- 172.21.15.88:0/3378563155 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f4b6c073dc0 con 0x7f4b54003a30 2023-11-27T20:54:31.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.793+0000 7f4b53fff640 1 -- 172.21.15.88:0/3378563155 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4b6404e020 con 0x7f4b54003a30 2023-11-27T20:54:31.795 INFO:teuthology.orchestra.run.smithi088.stderr:set pool 4 allow_ec_overwrites to true 2023-11-27T20:54:31.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.796+0000 7f4b719a5640 1 -- 172.21.15.88:0/3378563155 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4b5806b1c0 msgr2=0x7f4b5806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:31.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.796+0000 7f4b719a5640 1 --2- 172.21.15.88:0/3378563155 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4b5806b1c0 0x7f4b5806d680 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0c9180 tx=0x7f4b60009040 comp rx=0 tx=0).stop 2023-11-27T20:54:31.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.796+0000 7f4b719a5640 1 -- 172.21.15.88:0/3378563155 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b54003a30 msgr2=0x7f4b6c1eda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:31.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.796+0000 7f4b719a5640 1 --2- 172.21.15.88:0/3378563155 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b54003a30 0x7f4b6c1eda00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4b64033000 tx=0x7f4b64009750 comp rx=0 tx=0).stop 2023-11-27T20:54:31.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.796+0000 7f4b719a5640 1 -- 172.21.15.88:0/3378563155 shutdown_connections 2023-11-27T20:54:31.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.796+0000 7f4b719a5640 1 --2- 172.21.15.88:0/3378563155 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4b5806b1c0 0x7f4b5806d680 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:31.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.796+0000 7f4b719a5640 1 --2- 172.21.15.88:0/3378563155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b6c155020 0x7f4b6c158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:31.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.796+0000 7f4b719a5640 1 --2- 172.21.15.88:0/3378563155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b6c15b290 0x7f4b6c14e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:31.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.796+0000 7f4b719a5640 1 --2- 172.21.15.88:0/3378563155 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b54003a30 0x7f4b6c1eda00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:31.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.796+0000 7f4b719a5640 1 -- 172.21.15.88:0/3378563155 >> 172.21.15.88:0/3378563155 conn(0x7f4b6c0707f0 msgr2=0x7f4b6c0ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:31.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.796+0000 7f4b719a5640 1 -- 172.21.15.88:0/3378563155 shutdown_connections 2023-11-27T20:54:31.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.796+0000 7f4b719a5640 1 -- 172.21.15.88:0/3378563155 wait complete. 2023-11-27T20:54:31.810 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-11-27T20:54:31.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.924+0000 7ff438e87640 1 Processor -- start 2023-11-27T20:54:31.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.924+0000 7ff438e87640 1 -- start start 2023-11-27T20:54:31.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.924+0000 7ff438e87640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff434150380 0x7ff4340c1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:31.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.924+0000 7ff438e87640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4340c6570 0x7ff4340c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:31.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.924+0000 7ff438e87640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4340c6f60 con 0x7ff43414ffa0 2023-11-27T20:54:31.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.924+0000 7ff438e87640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4341570d0 con 0x7ff434150380 2023-11-27T20:54:31.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.924+0000 7ff438e87640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff434156270 con 0x7ff4340c6570 2023-11-27T20:54:31.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.933+0000 7ff432d9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4340c6570 0x7ff4340c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:31.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.935+0000 7ff432d9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4340c6570 0x7ff4340c6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:58570/0 (socket says 172.21.15.88:58570) 2023-11-27T20:54:31.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.935+0000 7ff432d9d640 1 -- 172.21.15.88:0/71712731 learned_addr learned my addr 172.21.15.88:0/71712731 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:31.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.937+0000 7ff432d9d640 1 -- 172.21.15.88:0/71712731 >> v2:172.21.15.88:3300/0 conn(0x7ff434150380 msgr2=0x7ff4340c1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:31.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.937+0000 7ff432d9d640 1 --2- 172.21.15.88:0/71712731 >> v2:172.21.15.88:3300/0 conn(0x7ff434150380 0x7ff4340c1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:31.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.937+0000 7ff432d9d640 1 -- 172.21.15.88:0/71712731 >> v1:172.21.15.88:6789/0 conn(0x7ff43414ffa0 legacy=0x7ff43406fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:31.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.937+0000 7ff432d9d640 1 -- 172.21.15.88:0/71712731 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff434156550 con 0x7ff4340c6570 2023-11-27T20:54:31.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.940+0000 7ff432d9d640 1 --2- 172.21.15.88:0/71712731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4340c6570 0x7ff4340c6a20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff42c009e50 tx=0x7ff42c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f331e23fd335f218 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:31.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.945+0000 7ff431d9b640 1 -- 172.21.15.88:0/71712731 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c02cb00 con 0x7ff4340c6570 2023-11-27T20:54:31.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.945+0000 7ff431d9b640 1 -- 172.21.15.88:0/71712731 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42c02cc60 con 0x7ff4340c6570 2023-11-27T20:54:31.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.945+0000 7ff431d9b640 1 -- 172.21.15.88:0/71712731 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c0343f0 con 0x7ff4340c6570 2023-11-27T20:54:31.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.946+0000 7ff438e87640 1 -- 172.21.15.88:0/71712731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4340c6570 msgr2=0x7ff4340c6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:31.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.946+0000 7ff438e87640 1 --2- 172.21.15.88:0/71712731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4340c6570 0x7ff4340c6a20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff42c009e50 tx=0x7ff42c02bf60 comp rx=0 tx=0).stop 2023-11-27T20:54:31.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.946+0000 7ff438e87640 1 -- 172.21.15.88:0/71712731 shutdown_connections 2023-11-27T20:54:31.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.946+0000 7ff438e87640 1 --2- 172.21.15.88:0/71712731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4340c6570 0x7ff4340c6a20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:31.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.946+0000 7ff438e87640 1 --2- 172.21.15.88:0/71712731 >> v2:172.21.15.88:3300/0 conn(0x7ff434150380 0x7ff4340c1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:31.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.946+0000 7ff438e87640 1 -- 172.21.15.88:0/71712731 >> 172.21.15.88:0/71712731 conn(0x7ff43406b5c0 msgr2=0x7ff43406b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:31.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.946+0000 7ff438e87640 1 -- 172.21.15.88:0/71712731 shutdown_connections 2023-11-27T20:54:31.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.946+0000 7ff438e87640 1 -- 172.21.15.88:0/71712731 wait complete. 2023-11-27T20:54:31.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.947+0000 7ff438e87640 1 Processor -- start 2023-11-27T20:54:31.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.947+0000 7ff438e87640 1 -- start start 2023-11-27T20:54:31.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.948+0000 7ff438e87640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4340c6570 0x7ff434157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:31.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.948+0000 7ff438e87640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff43414ffa0 0x7ff43414abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:31.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.948+0000 7ff438e87640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff434150380 0x7ff43414e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:31.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.948+0000 7ff438e87640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4341eeac0 con 0x7ff43414ffa0 2023-11-27T20:54:31.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.948+0000 7ff438e87640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4340cb8d0 con 0x7ff434150380 2023-11-27T20:54:31.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.948+0000 7ff438e87640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4341ef8c0 con 0x7ff4340c6570 2023-11-27T20:54:31.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.948+0000 7ff432d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff434150380 0x7ff43414e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:31.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.948+0000 7ff43259c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4340c6570 0x7ff434157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:31.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.949+0000 7ff432d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff434150380 0x7ff43414e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:52768/0 (socket says 172.21.15.88:52768) 2023-11-27T20:54:31.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.949+0000 7ff432d9d640 1 -- 172.21.15.88:0/2984726455 learned_addr learned my addr 172.21.15.88:0/2984726455 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:31.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.952+0000 7ff43259c640 1 -- 172.21.15.88:0/2984726455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff434150380 msgr2=0x7ff43414e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:31.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.952+0000 7ff43259c640 1 --2- 172.21.15.88:0/2984726455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff434150380 0x7ff43414e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:31.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.952+0000 7ff43259c640 1 -- 172.21.15.88:0/2984726455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff43414ffa0 msgr2=0x7ff43414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:31.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.952+0000 7ff43259c640 1 --2- 172.21.15.88:0/2984726455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff43414ffa0 0x7ff43414abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:31.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.952+0000 7ff43259c640 1 -- 172.21.15.88:0/2984726455 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42c009b30 con 0x7ff4340c6570 2023-11-27T20:54:31.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.952+0000 7ff432d9d640 1 --2- 172.21.15.88:0/2984726455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff434150380 0x7ff43414e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:54:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.955+0000 7ff43259c640 1 --2- 172.21.15.88:0/2984726455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4340c6570 0x7ff434157320 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff42400b3e0 tx=0x7ff42400b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:31.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.963+0000 7ff42affd640 1 -- 172.21.15.88:0/2984726455 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff424011830 con 0x7ff4340c6570 2023-11-27T20:54:31.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.963+0000 7ff42affd640 1 -- 172.21.15.88:0/2984726455 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff424011990 con 0x7ff4340c6570 2023-11-27T20:54:31.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.963+0000 7ff42affd640 1 -- 172.21.15.88:0/2984726455 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff424011d40 con 0x7ff4340c6570 2023-11-27T20:54:31.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.963+0000 7ff438e87640 1 -- 172.21.15.88:0/2984726455 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff43414b120 con 0x7ff4340c6570 2023-11-27T20:54:31.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.964+0000 7ff438e87640 1 -- 172.21.15.88:0/2984726455 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4341eef90 con 0x7ff4340c6570 2023-11-27T20:54:31.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.964+0000 7ff438e87640 1 -- 172.21.15.88:0/2984726455 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff43414b390 con 0x7ff4340c6570 2023-11-27T20:54:31.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.982+0000 7ff42affd640 1 -- 172.21.15.88:0/2984726455 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff42401a400 con 0x7ff4340c6570 2023-11-27T20:54:31.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.982+0000 7ff42affd640 1 --2- 172.21.15.88:0/2984726455 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff41406b240 0x7ff41406d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:31.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.983+0000 7ff42bfff640 1 --2- 172.21.15.88:0/2984726455 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff41406b240 0x7ff41406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:31.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.983+0000 7ff42bfff640 1 --2- 172.21.15.88:0/2984726455 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff41406b240 0x7ff41406d700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff434154660 tx=0x7ff41c006c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:31.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:31.986+0000 7ff42affd640 1 -- 172.21.15.88:0/2984726455 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6428+0+0 (secure 0 0 0) 0x7ff424058f80 con 0x7ff4340c6570 2023-11-27T20:54:32.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:32.238+0000 7ff42affd640 1 -- 172.21.15.88:0/2984726455 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff424054bc0 con 0x7ff4340c6570 2023-11-27T20:54:32.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:32.446+0000 7ff438e87640 1 -- 172.21.15.88:0/2984726455 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7ff43414b390 con 0x7ff4340c6570 2023-11-27T20:54:33.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.126+0000 7ff42affd640 1 -- 172.21.15.88:0/2984726455 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7ff43414b390 con 0x7ff4340c6570 2023-11-27T20:54:33.128 INFO:teuthology.orchestra.run.smithi088.stderr:added data pool 4 to fsmap 2023-11-27T20:54:33.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.128+0000 7ff438e87640 1 -- 172.21.15.88:0/2984726455 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff41406b240 msgr2=0x7ff41406d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:33.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.128+0000 7ff438e87640 1 --2- 172.21.15.88:0/2984726455 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff41406b240 0x7ff41406d700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff434154660 tx=0x7ff41c006c90 comp rx=0 tx=0).stop 2023-11-27T20:54:33.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.128+0000 7ff438e87640 1 -- 172.21.15.88:0/2984726455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4340c6570 msgr2=0x7ff434157320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:33.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.128+0000 7ff438e87640 1 --2- 172.21.15.88:0/2984726455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4340c6570 0x7ff434157320 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff42400b3e0 tx=0x7ff42400b8a0 comp rx=0 tx=0).stop 2023-11-27T20:54:33.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.128+0000 7ff438e87640 1 -- 172.21.15.88:0/2984726455 shutdown_connections 2023-11-27T20:54:33.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.128+0000 7ff438e87640 1 --2- 172.21.15.88:0/2984726455 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff41406b240 0x7ff41406d700 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:33.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.128+0000 7ff438e87640 1 --2- 172.21.15.88:0/2984726455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff434150380 0x7ff43414e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:33.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.128+0000 7ff438e87640 1 --2- 172.21.15.88:0/2984726455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff43414ffa0 0x7ff43414abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:33.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.128+0000 7ff438e87640 1 --2- 172.21.15.88:0/2984726455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4340c6570 0x7ff434157320 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:33.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.128+0000 7ff438e87640 1 -- 172.21.15.88:0/2984726455 >> 172.21.15.88:0/2984726455 conn(0x7ff43406b5c0 msgr2=0x7ff43406b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:33.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.128+0000 7ff438e87640 1 -- 172.21.15.88:0/2984726455 shutdown_connections 2023-11-27T20:54:33.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.128+0000 7ff438e87640 1 -- 172.21.15.88:0/2984726455 wait complete. 2023-11-27T20:54:33.141 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:54:33.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.240+0000 7fb0a90ee640 1 Processor -- start 2023-11-27T20:54:33.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.240+0000 7fb0a90ee640 1 -- start start 2023-11-27T20:54:33.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.241+0000 7fb0a90ee640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb0a40c4aa0 0x7fb0a414fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:33.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.241+0000 7fb0a90ee640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb0a4150290 0x7fb0a40c1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:33.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.241+0000 7fb0a90ee640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a40c76f0 con 0x7fb0a40c46c0 2023-11-27T20:54:33.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.241+0000 7fb0a90ee640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a40c2bc0 con 0x7fb0a40c4aa0 2023-11-27T20:54:33.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.241+0000 7fb0a90ee640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a40c6dc0 con 0x7fb0a4150290 2023-11-27T20:54:33.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.241+0000 7fb09bfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb0a40c4aa0 0x7fb0a414fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:33.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.242+0000 7fb09bfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb0a40c4aa0 0x7fb0a414fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60098/0 (socket says 172.21.15.88:60098) 2023-11-27T20:54:33.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.242+0000 7fb09bfff640 1 -- 172.21.15.88:0/2851216526 learned_addr learned my addr 172.21.15.88:0/2851216526 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:33.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.242+0000 7fb0a359e640 1 --2- 172.21.15.88:0/2851216526 >> v2:172.21.15.167:3300/0 conn(0x7fb0a4150290 0x7fb0a40c1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:33.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.244+0000 7fb09bfff640 1 -- 172.21.15.88:0/2851216526 >> v2:172.21.15.167:3300/0 conn(0x7fb0a4150290 msgr2=0x7fb0a40c1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:33.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.244+0000 7fb09bfff640 1 --2- 172.21.15.88:0/2851216526 >> v2:172.21.15.167:3300/0 conn(0x7fb0a4150290 0x7fb0a40c1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:33.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.244+0000 7fb09bfff640 1 -- 172.21.15.88:0/2851216526 >> v1:172.21.15.167:6789/0 conn(0x7fb0a40c46c0 legacy=0x7fb0a40c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:33.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.244+0000 7fb09bfff640 1 -- 172.21.15.88:0/2851216526 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a40c70a0 con 0x7fb0a40c4aa0 2023-11-27T20:54:33.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.246+0000 7fb09bfff640 1 --2- 172.21.15.88:0/2851216526 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0a40c4aa0 0x7fb0a414fd50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb0a40c1380 tx=0x7fb08c02e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86905f6fc693fa4d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:33.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.248+0000 7fb0a259c640 1 -- 172.21.15.88:0/2851216526 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c036440 con 0x7fb0a40c4aa0 2023-11-27T20:54:33.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.249+0000 7fb0a259c640 1 -- 172.21.15.88:0/2851216526 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08c0365a0 con 0x7fb0a40c4aa0 2023-11-27T20:54:33.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.249+0000 7fb0a259c640 1 -- 172.21.15.88:0/2851216526 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c036930 con 0x7fb0a40c4aa0 2023-11-27T20:54:33.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.250+0000 7fb0a90ee640 1 -- 172.21.15.88:0/2851216526 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0a40c4aa0 msgr2=0x7fb0a414fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:33.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.250+0000 7fb0a90ee640 1 --2- 172.21.15.88:0/2851216526 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0a40c4aa0 0x7fb0a414fd50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb0a40c1380 tx=0x7fb08c02e170 comp rx=0 tx=0).stop 2023-11-27T20:54:33.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.250+0000 7fb0a90ee640 1 -- 172.21.15.88:0/2851216526 shutdown_connections 2023-11-27T20:54:33.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.250+0000 7fb0a90ee640 1 --2- 172.21.15.88:0/2851216526 >> v2:172.21.15.167:3300/0 conn(0x7fb0a4150290 0x7fb0a40c1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:33.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.250+0000 7fb0a90ee640 1 --2- 172.21.15.88:0/2851216526 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0a40c4aa0 0x7fb0a414fd50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:33.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.250+0000 7fb0a90ee640 1 -- 172.21.15.88:0/2851216526 >> 172.21.15.88:0/2851216526 conn(0x7fb0a406c5f0 msgr2=0x7fb0a406c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:33.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.250+0000 7fb0a90ee640 1 -- 172.21.15.88:0/2851216526 shutdown_connections 2023-11-27T20:54:33.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.250+0000 7fb0a90ee640 1 -- 172.21.15.88:0/2851216526 wait complete. 2023-11-27T20:54:33.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.252+0000 7fb0a90ee640 1 Processor -- start 2023-11-27T20:54:33.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.252+0000 7fb0a90ee640 1 -- start start 2023-11-27T20:54:33.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.252+0000 7fb0a90ee640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0a40c46c0 0x7fb0a40c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:33.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.252+0000 7fb0a90ee640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0a40c4aa0 0x7fb0a40caab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:33.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.252+0000 7fb0a90ee640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0a4150290 0x7fb0a40c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:33.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.252+0000 7fb0a90ee640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a41eb570 con 0x7fb0a4150290 2023-11-27T20:54:33.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.252+0000 7fb0a90ee640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a41eba00 con 0x7fb0a40c4aa0 2023-11-27T20:54:33.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.252+0000 7fb0a90ee640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40c8e70 con 0x7fb0a40c46c0 2023-11-27T20:54:33.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.253+0000 7fb0a359e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0a4150290 0x7fb0a40c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:33.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.253+0000 7fb09bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0a40c4aa0 0x7fb0a40caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:33.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.253+0000 7fb0a2d9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0a40c46c0 0x7fb0a40c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:33.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.253+0000 7fb09bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0a40c4aa0 0x7fb0a40caab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:52794/0 (socket says 172.21.15.88:52794) 2023-11-27T20:54:33.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.253+0000 7fb09bfff640 1 -- 172.21.15.88:0/2619887349 learned_addr learned my addr 172.21.15.88:0/2619887349 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:33.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.256+0000 7fb09bfff640 1 -- 172.21.15.88:0/2619887349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0a40c46c0 msgr2=0x7fb0a40c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:33.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.256+0000 7fb09bfff640 1 --2- 172.21.15.88:0/2619887349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0a40c46c0 0x7fb0a40c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:33.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.256+0000 7fb09bfff640 1 -- 172.21.15.88:0/2619887349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0a4150290 msgr2=0x7fb0a40c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:33.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.256+0000 7fb09bfff640 1 --2- 172.21.15.88:0/2619887349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0a4150290 0x7fb0a40c9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:33.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.256+0000 7fb09bfff640 1 -- 172.21.15.88:0/2619887349 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c00b770 con 0x7fb0a40c4aa0 2023-11-27T20:54:33.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.259+0000 7fb09bfff640 1 --2- 172.21.15.88:0/2619887349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0a40c4aa0 0x7fb0a40caab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb08c02e1b0 tx=0x7fb08c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:33.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.262+0000 7fb09b7fe640 1 -- 172.21.15.88:0/2619887349 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c036440 con 0x7fb0a40c4aa0 2023-11-27T20:54:33.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.262+0000 7fb09b7fe640 1 -- 172.21.15.88:0/2619887349 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08c034900 con 0x7fb0a40c4aa0 2023-11-27T20:54:33.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.262+0000 7fb09b7fe640 1 -- 172.21.15.88:0/2619887349 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c034c90 con 0x7fb0a40c4aa0 2023-11-27T20:54:33.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.262+0000 7fb0a90ee640 1 -- 172.21.15.88:0/2619887349 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a41eac40 con 0x7fb0a40c4aa0 2023-11-27T20:54:33.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.263+0000 7fb0a90ee640 1 -- 172.21.15.88:0/2619887349 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a41eb200 con 0x7fb0a40c4aa0 2023-11-27T20:54:33.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.263+0000 7fb0a90ee640 1 -- 172.21.15.88:0/2619887349 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a41eb390 con 0x7fb0a40c4aa0 2023-11-27T20:54:33.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.506+0000 7fb09b7fe640 1 -- 172.21.15.88:0/2619887349 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb08c053480 con 0x7fb0a40c4aa0 2023-11-27T20:54:33.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.506+0000 7fb09b7fe640 1 --2- 172.21.15.88:0/2619887349 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb08406b1f0 0x7fb08406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:33.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.506+0000 7fb0a2d9d640 1 --2- 172.21.15.88:0/2619887349 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb08406b1f0 0x7fb08406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:33.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.507+0000 7fb0a2d9d640 1 --2- 172.21.15.88:0/2619887349 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb08406b1f0 0x7fb08406d6b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb094001780 tx=0x7fb094009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:33.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.508+0000 7fb09b7fe640 1 -- 172.21.15.88:0/2619887349 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb08c07da10 con 0x7fb0a40c4aa0 2023-11-27T20:54:33.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.521+0000 7fb09b7fe640 1 -- 172.21.15.88:0/2619887349 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb08c079d50 con 0x7fb0a40c4aa0 2023-11-27T20:54:33.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.723+0000 7fb0a90ee640 1 -- 172.21.15.88:0/2619887349 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0a41eb6e0 con 0x7fb0a40c4aa0 2023-11-27T20:54:33.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.751+0000 7fb09b7fe640 1 -- 172.21.15.88:0/2619887349 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6495 (secure 0 0 0) 0x7fb08c04e090 con 0x7fb0a40c4aa0 2023-11-27T20:54:33.753 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:54:33.753 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/298325117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":298325117},{"type":"v1","addr":"172.21.15.88:6837","nonce":298325117}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/1596074914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1596074914},{"type":"v1","addr":"172.21.15.167:6837","nonce":1596074914}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":34187,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/256796309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":256796309},{"type":"v1","addr":"172.21.15.88:6835","nonce":256796309}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34190,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1245449675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1245449675},{"type":"v1","addr":"172.21.15.167:6833","nonce":1245449675}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34199,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/327644613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":327644613},{"type":"v1","addr":"172.21.15.167:6835","nonce":327644613}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:54:26.940968+0000","modified":"2023-11-27T20:54:32.475051+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34205},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34205":{"gid":34205,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.88:6839/2120059880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":2120059880},{"type":"v1","addr":"172.21.15.88:6839","nonce":2120059880}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-27T20:54:33.753 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 7 2023-11-27T20:54:33.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.753+0000 7fb0a90ee640 1 -- 172.21.15.88:0/2619887349 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb08406b1f0 msgr2=0x7fb08406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:33.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.753+0000 7fb0a90ee640 1 --2- 172.21.15.88:0/2619887349 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb08406b1f0 0x7fb08406d6b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb094001780 tx=0x7fb094009040 comp rx=0 tx=0).stop 2023-11-27T20:54:33.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.753+0000 7fb0a90ee640 1 -- 172.21.15.88:0/2619887349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0a40c4aa0 msgr2=0x7fb0a40caab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:33.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.753+0000 7fb0a90ee640 1 --2- 172.21.15.88:0/2619887349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0a40c4aa0 0x7fb0a40caab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb08c02e1b0 tx=0x7fb08c0046c0 comp rx=0 tx=0).stop 2023-11-27T20:54:33.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.753+0000 7fb0a90ee640 1 -- 172.21.15.88:0/2619887349 shutdown_connections 2023-11-27T20:54:33.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.753+0000 7fb0a90ee640 1 --2- 172.21.15.88:0/2619887349 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb08406b1f0 0x7fb08406d6b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:33.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.753+0000 7fb0a90ee640 1 --2- 172.21.15.88:0/2619887349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0a4150290 0x7fb0a40c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:33.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.753+0000 7fb0a90ee640 1 --2- 172.21.15.88:0/2619887349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0a40c4aa0 0x7fb0a40caab0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:33.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.753+0000 7fb0a90ee640 1 --2- 172.21.15.88:0/2619887349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0a40c46c0 0x7fb0a40c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:33.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.753+0000 7fb0a90ee640 1 -- 172.21.15.88:0/2619887349 >> 172.21.15.88:0/2619887349 conn(0x7fb0a406c5f0 msgr2=0x7fb0a406c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:33.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.753+0000 7fb0a90ee640 1 -- 172.21.15.88:0/2619887349 shutdown_connections 2023-11-27T20:54:33.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.753+0000 7fb0a90ee640 1 -- 172.21.15.88:0/2619887349 wait complete. 2023-11-27T20:54:33.765 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:54:33.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.869+0000 7f33b2d53640 1 Processor -- start 2023-11-27T20:54:33.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.869+0000 7f33b2d53640 1 -- start start 2023-11-27T20:54:33.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.870+0000 7f33b2d53640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f33ac0cd430 0x7f33ac0cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:33.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.870+0000 7f33b2d53640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ac0cba70 con 0x7f33ac0c9c70 2023-11-27T20:54:33.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.870+0000 7f33b2d53640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ac153c60 con 0x7f33ac0cbf00 2023-11-27T20:54:33.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.870+0000 7f33b2d53640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ac0cb490 con 0x7f33ac0cd430 2023-11-27T20:54:33.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.904+0000 7f33abfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f33ac0cbf00 0x7f33ac0ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:48118/0 (socket says 172.21.15.88:48118) 2023-11-27T20:54:33.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.904+0000 7f33abfff640 1 -- 172.21.15.88:0/4190936675 learned_addr learned my addr 172.21.15.88:0/4190936675 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:54:33.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.909+0000 7f33ab7fe640 1 -- 172.21.15.88:0/4190936675 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858267458 0 0) 0x7f33ac153c60 con 0x7f33ac0cbf00 2023-11-27T20:54:33.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.909+0000 7f33ab7fe640 1 -- 172.21.15.88:0/4190936675 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f339c003520 con 0x7f33ac0cbf00 2023-11-27T20:54:33.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.911+0000 7f33b12f0640 1 --2- 172.21.15.88:0/4190936675 >> v2:172.21.15.88:3300/0 conn(0x7f33ac0cd430 0x7f33ac0cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:33.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.915+0000 7f33ab7fe640 1 -- 172.21.15.88:0/4190936675 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2164911590 0 0) 0x7f339c003520 con 0x7f33ac0cbf00 2023-11-27T20:54:33.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.915+0000 7f33ab7fe640 1 -- 172.21.15.88:0/4190936675 >> v2:172.21.15.88:3300/0 conn(0x7f33ac0cd430 msgr2=0x7f33ac0cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:33.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.915+0000 7f33ab7fe640 1 --2- 172.21.15.88:0/4190936675 >> v2:172.21.15.88:3300/0 conn(0x7f33ac0cd430 0x7f33ac0cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:33.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.915+0000 7f33ab7fe640 1 -- 172.21.15.88:0/4190936675 >> v1:172.21.15.88:6789/0 conn(0x7f33ac0c9c70 legacy=0x7f33ac1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:33.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.915+0000 7f33ab7fe640 1 -- 172.21.15.88:0/4190936675 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac0ce2f0 con 0x7f33ac0cbf00 2023-11-27T20:54:33.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.915+0000 7f33ab7fe640 1 -- 172.21.15.88:0/4190936675 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1067350109 0 0) 0x7f3398001670 con 0x7f33ac0cbf00 2023-11-27T20:54:33.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.916+0000 7f33ab7fe640 1 -- 172.21.15.88:0/4190936675 >> v1:172.21.15.167:6789/0 conn(0x7f33ac0cbf00 legacy=0x7f33ac0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:33.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.916+0000 7f33ab7fe640 1 --2- 172.21.15.88:0/4190936675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f339c003a30 0x7f339c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:33.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.916+0000 7f33ab7fe640 1 --2- 172.21.15.88:0/4190936675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f339c0047c0 0x7f339c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:33.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.916+0000 7f33ab7fe640 1 --2- 172.21.15.88:0/4190936675 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f339c0051d0 0x7f339c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:33.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.916+0000 7f33ab7fe640 1 -- 172.21.15.88:0/4190936675 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0cb490 con 0x7f339c0047c0 2023-11-27T20:54:33.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.916+0000 7f33ab7fe640 1 -- 172.21.15.88:0/4190936675 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c00c100 con 0x7f339c003a30 2023-11-27T20:54:33.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.916+0000 7f33ab7fe640 1 -- 172.21.15.88:0/4190936675 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339c00c2c0 con 0x7f339c0051d0 2023-11-27T20:54:33.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.918+0000 7f33abfff640 1 --2- 172.21.15.88:0/4190936675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f339c0047c0 0x7f339c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:33.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.919+0000 7f33b0aef640 1 --2- 172.21.15.88:0/4190936675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f339c003a30 0x7f339c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:33.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.921+0000 7f33b0aef640 1 -- 172.21.15.88:0/4190936675 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f339c0051d0 msgr2=0x7f339c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:33.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.921+0000 7f33b0aef640 1 --2- 172.21.15.88:0/4190936675 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f339c0051d0 0x7f339c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:33.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.921+0000 7f33b0aef640 1 -- 172.21.15.88:0/4190936675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f339c0047c0 msgr2=0x7f339c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:33.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.921+0000 7f33b0aef640 1 --2- 172.21.15.88:0/4190936675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f339c0047c0 0x7f339c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:33.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.921+0000 7f33b0aef640 1 -- 172.21.15.88:0/4190936675 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339c003520 con 0x7f339c003a30 2023-11-27T20:54:33.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.921+0000 7f33b12f0640 1 -- 172.21.15.88:0/4190936675 reap_dead start 2023-11-27T20:54:33.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.923+0000 7f33b0aef640 1 --2- 172.21.15.88:0/4190936675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f339c003a30 0x7f339c003e50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f33a0001750 tx=0x7f339c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecf9058e6dd74be7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:33.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.928+0000 7f33ab7fe640 1 -- 172.21.15.88:0/4190936675 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a00052d0 con 0x7f339c003a30 2023-11-27T20:54:33.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.928+0000 7f33ab7fe640 1 -- 172.21.15.88:0/4190936675 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a002e050 con 0x7f339c003a30 2023-11-27T20:54:33.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.928+0000 7f33ab7fe640 1 -- 172.21.15.88:0/4190936675 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a0003830 con 0x7f339c003a30 2023-11-27T20:54:33.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.929+0000 7f33b2d53640 1 -- 172.21.15.88:0/4190936675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f339c003a30 msgr2=0x7f339c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:33.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.929+0000 7f33b2d53640 1 --2- 172.21.15.88:0/4190936675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f339c003a30 0x7f339c003e50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f33a0001750 tx=0x7f339c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:54:33.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.929+0000 7f33b2d53640 1 -- 172.21.15.88:0/4190936675 shutdown_connections 2023-11-27T20:54:33.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.929+0000 7f33b2d53640 1 --2- 172.21.15.88:0/4190936675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f339c003a30 0x7f339c003e50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:33.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.929+0000 7f33b2d53640 1 -- 172.21.15.88:0/4190936675 >> 172.21.15.88:0/4190936675 conn(0x7f33ac0b07d0 msgr2=0x7f33ac0b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:33.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.929+0000 7f33b2d53640 1 -- 172.21.15.88:0/4190936675 shutdown_connections 2023-11-27T20:54:33.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.929+0000 7f33b2d53640 1 -- 172.21.15.88:0/4190936675 wait complete. 2023-11-27T20:54:33.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.930+0000 7f33b2d53640 1 Processor -- start 2023-11-27T20:54:33.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.930+0000 7f33b2d53640 1 -- start start 2023-11-27T20:54:33.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.931+0000 7f33b2d53640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f339c003a30 0x7f33ac15d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:33.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.931+0000 7f33b2d53640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33ac0ae010 0x7f33ac1f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:33.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.931+0000 7f33b2d53640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33ac1f3500 0x7f33ac15c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:33.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.931+0000 7f33b2d53640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac15a9c0 con 0x7f33ac1f3500 2023-11-27T20:54:33.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.931+0000 7f33b2d53640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0abee0 con 0x7f33ac0ae010 2023-11-27T20:54:33.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.931+0000 7f33b2d53640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0af840 con 0x7f339c003a30 2023-11-27T20:54:33.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.932+0000 7f33b12f0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33ac1f3500 0x7f33ac15c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:33.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.932+0000 7f33b12f0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33ac1f3500 0x7f33ac15c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60152/0 (socket says 172.21.15.88:60152) 2023-11-27T20:54:33.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.932+0000 7f33b12f0640 1 -- 172.21.15.88:0/3269911302 learned_addr learned my addr 172.21.15.88:0/3269911302 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:33.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.932+0000 7f33abfff640 1 --2- 172.21.15.88:0/3269911302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33ac0ae010 0x7f33ac1f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:33.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.935+0000 7f33b12f0640 1 -- 172.21.15.88:0/3269911302 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f339c003a30 msgr2=0x7f33ac15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:33.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.935+0000 7f33b12f0640 1 --2- 172.21.15.88:0/3269911302 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f339c003a30 0x7f33ac15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:33.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.935+0000 7f33b12f0640 1 -- 172.21.15.88:0/3269911302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33ac0ae010 msgr2=0x7f33ac1f2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:33.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.935+0000 7f33b12f0640 1 --2- 172.21.15.88:0/3269911302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33ac0ae010 0x7f33ac1f2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:33.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.935+0000 7f33b12f0640 1 -- 172.21.15.88:0/3269911302 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac0afb20 con 0x7f33ac1f3500 2023-11-27T20:54:33.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.938+0000 7f33b12f0640 1 --2- 172.21.15.88:0/3269911302 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33ac1f3500 0x7f33ac15c330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0c27a0 tx=0x7f33a400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:33.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.941+0000 7f33a97fa640 1 -- 172.21.15.88:0/3269911302 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a4010040 con 0x7f33ac1f3500 2023-11-27T20:54:33.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.941+0000 7f33a97fa640 1 -- 172.21.15.88:0/3269911302 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a400bc80 con 0x7f33ac1f3500 2023-11-27T20:54:33.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.941+0000 7f33b2d53640 1 -- 172.21.15.88:0/3269911302 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33ac0afe00 con 0x7f33ac1f3500 2023-11-27T20:54:33.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.941+0000 7f33a97fa640 1 -- 172.21.15.88:0/3269911302 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a4014400 con 0x7f33ac1f3500 2023-11-27T20:54:33.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.941+0000 7f33b2d53640 1 -- 172.21.15.88:0/3269911302 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33ac1f2aa0 con 0x7f33ac1f3500 2023-11-27T20:54:33.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:33.942+0000 7f33b2d53640 1 -- 172.21.15.88:0/3269911302 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ac0c8900 con 0x7f33ac1f3500 2023-11-27T20:54:34.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.181+0000 7f33a97fa640 1 -- 172.21.15.88:0/3269911302 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f33a4014560 con 0x7f33ac1f3500 2023-11-27T20:54:34.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.181+0000 7f33a97fa640 1 --2- 172.21.15.88:0/3269911302 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f339006b210 0x7f339006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:34.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.182+0000 7f33b0aef640 1 --2- 172.21.15.88:0/3269911302 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f339006b210 0x7f339006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:34.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.182+0000 7f33b0aef640 1 --2- 172.21.15.88:0/3269911302 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f339006b210 0x7f339006d6d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f33a0033000 tx=0x7f33a002f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:34.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.195+0000 7f33a97fa640 1 -- 172.21.15.88:0/3269911302 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f33a4059a50 con 0x7f33ac1f3500 2023-11-27T20:54:34.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.195+0000 7f33a97fa640 1 -- 172.21.15.88:0/3269911302 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f33a4055690 con 0x7f33ac1f3500 2023-11-27T20:54:34.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.411+0000 7f33b2d53640 1 -- 172.21.15.88:0/3269911302 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33ac1f2900 con 0x7f33ac1f3500 2023-11-27T20:54:34.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.457+0000 7f33a97fa640 1 -- 172.21.15.88:0/3269911302 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18339 (secure 0 0 0) 0x7f33ac1f2900 con 0x7f33ac1f3500 2023-11-27T20:54:34.459 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:54:34.459 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc","created":"2023-11-27T20:53:53.110827+0000","modified":"2023-11-27T20:54:32.470579+0000","last_up_change":"2023-11-27T20:54:08.219383+0000","last_in_change":"2023-11-27T20:53:59.022798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:54:09.277670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:54:24.503156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:54:25.744043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T20:54:29.704111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1207ca0f-bef1-44c6-b66b-58bf0e080ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6819","nonce":3952326022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6821","nonce":3952326022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6825","nonce":3952326022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6823","nonce":3952326022}]},"public_addr":"172.21.15.88:6819/3952326022","cluster_addr":"172.21.15.88:6821/3952326022","heartbeat_back_addr":"172.21.15.88:6825/3952326022","heartbeat_front_addr":"172.21.15.88:6823/3952326022","state":["exists","up"]},{"osd":1,"uuid":"8d1be479-4241-4335-9633-1394311fde76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6827","nonce":1788401966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6829","nonce":1788401966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6833","nonce":1788401966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6831","nonce":1788401966}]},"public_addr":"172.21.15.88:6827/1788401966","cluster_addr":"172.21.15.88:6829/1788401966","heartbeat_back_addr":"172.21.15.88:6833/1788401966","heartbeat_front_addr":"172.21.15.88:6831/1788401966","state":["exists","up"]},{"osd":2,"uuid":"7536b008-05dd-40eb-9d4a-bdac4b1c38c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6803","nonce":1166333913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6805","nonce":1166333913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6809","nonce":1166333913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6807","nonce":1166333913}]},"public_addr":"172.21.15.88:6803/1166333913","cluster_addr":"172.21.15.88:6805/1166333913","heartbeat_back_addr":"172.21.15.88:6809/1166333913","heartbeat_front_addr":"172.21.15.88:6807/1166333913","state":["exists","up"]},{"osd":3,"uuid":"47edd4d7-e99c-4ce3-851b-cc9c8e2d4480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6811","nonce":406887502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6813","nonce":406887502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6817","nonce":406887502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6815","nonce":406887502}]},"public_addr":"172.21.15.88:6811/406887502","cluster_addr":"172.21.15.88:6813/406887502","heartbeat_back_addr":"172.21.15.88:6817/406887502","heartbeat_front_addr":"172.21.15.88:6815/406887502","state":["exists","up"]},{"osd":4,"uuid":"0a81dd31-1a8b-41af-b933-d74aae63f3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6801","nonce":2551293703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6803","nonce":2551293703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6807","nonce":2551293703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6805","nonce":2551293703}]},"public_addr":"172.21.15.167:6801/2551293703","cluster_addr":"172.21.15.167:6803/2551293703","heartbeat_back_addr":"172.21.15.167:6807/2551293703","heartbeat_front_addr":"172.21.15.167:6805/2551293703","state":["exists","up"]},{"osd":5,"uuid":"1c462d0d-3361-48b3-a82a-86a920539e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6825","nonce":866085094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6827","nonce":866085094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6831","nonce":866085094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6829","nonce":866085094}]},"public_addr":"172.21.15.167:6825/866085094","cluster_addr":"172.21.15.167:6827/866085094","heartbeat_back_addr":"172.21.15.167:6831/866085094","heartbeat_front_addr":"172.21.15.167:6829/866085094","state":["exists","up"]},{"osd":6,"uuid":"d687c5ad-6c88-4a15-8120-0cdbc5610535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6809","nonce":2766725538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6811","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6813","nonce":2766725538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6819","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6821","nonce":2766725538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6815","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6817","nonce":2766725538}]},"public_addr":"172.21.15.167:6809/2766725538","cluster_addr":"172.21.15.167:6813/2766725538","heartbeat_back_addr":"172.21.15.167:6821/2766725538","heartbeat_front_addr":"172.21.15.167:6817/2766725538","state":["exists","up"]},{"osd":7,"uuid":"c9a50596-4981-4bd8-a8ef-d7679f8d9559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6812","nonce":2695037266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6816","nonce":2695037266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6823","nonce":2695037266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6820","nonce":2695037266}]},"public_addr":"172.21.15.167:6812/2695037266","cluster_addr":"172.21.15.167:6816/2695037266","heartbeat_back_addr":"172.21.15.167:6823/2695037266","heartbeat_front_addr":"172.21.15.167:6820/2695037266","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.522590+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.483170+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.492504+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.432204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.414964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.459803+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.437250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.460394+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:54:34.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.459+0000 7f33b2d53640 1 -- 172.21.15.88:0/3269911302 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f339006b210 msgr2=0x7f339006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:34.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.459+0000 7f33b2d53640 1 --2- 172.21.15.88:0/3269911302 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f339006b210 0x7f339006d6d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f33a0033000 tx=0x7f33a002f000 comp rx=0 tx=0).stop 2023-11-27T20:54:34.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.459+0000 7f33b2d53640 1 -- 172.21.15.88:0/3269911302 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33ac1f3500 msgr2=0x7f33ac15c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:34.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.459+0000 7f33b2d53640 1 --2- 172.21.15.88:0/3269911302 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33ac1f3500 0x7f33ac15c330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0c27a0 tx=0x7f33a400b480 comp rx=0 tx=0).stop 2023-11-27T20:54:34.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.459+0000 7f33b2d53640 1 -- 172.21.15.88:0/3269911302 shutdown_connections 2023-11-27T20:54:34.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.459+0000 7f33b2d53640 1 --2- 172.21.15.88:0/3269911302 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f339006b210 0x7f339006d6d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:34.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.459+0000 7f33b2d53640 1 --2- 172.21.15.88:0/3269911302 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33ac1f3500 0x7f33ac15c330 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:34.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.459+0000 7f33b2d53640 1 --2- 172.21.15.88:0/3269911302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33ac0ae010 0x7f33ac1f2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:34.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.459+0000 7f33b2d53640 1 --2- 172.21.15.88:0/3269911302 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f339c003a30 0x7f33ac15d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:34.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.459+0000 7f33b2d53640 1 -- 172.21.15.88:0/3269911302 >> 172.21.15.88:0/3269911302 conn(0x7f33ac0b07d0 msgr2=0x7f33ac0c7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:34.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.459+0000 7f33b2d53640 1 -- 172.21.15.88:0/3269911302 shutdown_connections 2023-11-27T20:54:34.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.459+0000 7f33b2d53640 1 -- 172.21.15.88:0/3269911302 wait complete. 2023-11-27T20:54:34.471 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:54:34.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.571+0000 7f6072210640 1 Processor -- start 2023-11-27T20:54:34.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.571+0000 7f6072210640 1 -- start start 2023-11-27T20:54:34.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.572+0000 7f6072210640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f606c0c7650 0x7f606c15a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:34.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.572+0000 7f6072210640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f606c1560f0 0x7f606c0c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:34.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.572+0000 7f6072210640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f606c159dd0 con 0x7f606c0c7a30 2023-11-27T20:54:34.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.572+0000 7f6072210640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f606c156580 con 0x7f606c0c7650 2023-11-27T20:54:34.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.572+0000 7f6072210640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606c0c5cc0 con 0x7f606c1560f0 2023-11-27T20:54:34.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.572+0000 7f606b7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f606c0c7650 0x7f606c15a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:34.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.573+0000 7f6063fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f606c0c7a30 0x7f606c0c6c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:48124/0 (socket says 172.21.15.88:48124) 2023-11-27T20:54:34.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.573+0000 7f6063fff640 1 -- 172.21.15.88:0/2864011307 learned_addr learned my addr 172.21.15.88:0/2864011307 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:54:34.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.573+0000 7f606bfff640 1 --2- 172.21.15.88:0/2864011307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f606c1560f0 0x7f606c0c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:34.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.575+0000 7f606affd640 1 -- 172.21.15.88:0/2864011307 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829732693 0 0) 0x7f606c159dd0 con 0x7f606c0c7a30 2023-11-27T20:54:34.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.575+0000 7f606affd640 1 -- 172.21.15.88:0/2864011307 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6058003520 con 0x7f606c0c7a30 2023-11-27T20:54:34.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.575+0000 7f606b7fe640 1 -- 172.21.15.88:0/2864011307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f606c1560f0 msgr2=0x7f606c0c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:34.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.575+0000 7f606b7fe640 1 --2- 172.21.15.88:0/2864011307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f606c1560f0 0x7f606c0c53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:34.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.575+0000 7f606b7fe640 1 -- 172.21.15.88:0/2864011307 >> v1:172.21.15.167:6789/0 conn(0x7f606c0c7a30 legacy=0x7f606c0c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:34.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.575+0000 7f606b7fe640 1 -- 172.21.15.88:0/2864011307 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606c0c6260 con 0x7f606c0c7650 2023-11-27T20:54:34.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.577+0000 7f606b7fe640 1 --2- 172.21.15.88:0/2864011307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c0c7650 0x7f606c15a260 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f605c0097a0 tx=0x7f605c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd27a56e3720d0c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:34.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.580+0000 7f606affd640 1 -- 172.21.15.88:0/2864011307 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c02e070 con 0x7f606c0c7650 2023-11-27T20:54:34.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.580+0000 7f606affd640 1 -- 172.21.15.88:0/2864011307 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605c0315a0 con 0x7f606c0c7650 2023-11-27T20:54:34.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.580+0000 7f606affd640 1 -- 172.21.15.88:0/2864011307 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c031930 con 0x7f606c0c7650 2023-11-27T20:54:34.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.581+0000 7f6072210640 1 -- 172.21.15.88:0/2864011307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c0c7650 msgr2=0x7f606c15a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:34.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.581+0000 7f6072210640 1 --2- 172.21.15.88:0/2864011307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c0c7650 0x7f606c15a260 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f605c0097a0 tx=0x7f605c02b840 comp rx=0 tx=0).stop 2023-11-27T20:54:34.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.581+0000 7f6072210640 1 -- 172.21.15.88:0/2864011307 shutdown_connections 2023-11-27T20:54:34.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.581+0000 7f6072210640 1 --2- 172.21.15.88:0/2864011307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f606c1560f0 0x7f606c0c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:34.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.581+0000 7f6072210640 1 --2- 172.21.15.88:0/2864011307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c0c7650 0x7f606c15a260 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:34.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.581+0000 7f6072210640 1 -- 172.21.15.88:0/2864011307 >> 172.21.15.88:0/2864011307 conn(0x7f606c06c5f0 msgr2=0x7f606c06c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:34.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.581+0000 7f6072210640 1 -- 172.21.15.88:0/2864011307 shutdown_connections 2023-11-27T20:54:34.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.581+0000 7f6072210640 1 -- 172.21.15.88:0/2864011307 wait complete. 2023-11-27T20:54:34.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.582+0000 7f6072210640 1 Processor -- start 2023-11-27T20:54:34.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.582+0000 7f6072210640 1 -- start start 2023-11-27T20:54:34.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.583+0000 7f6072210640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f606c0c7650 0x7f606c150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:34.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.583+0000 7f6072210640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f606c0c7a30 0x7f606c06e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:34.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.583+0000 7f6072210640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c1560f0 0x7f606c1524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:34.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.583+0000 7f6072210640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606c150fb0 con 0x7f606c1560f0 2023-11-27T20:54:34.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.583+0000 7f6072210640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606c14cf20 con 0x7f606c0c7650 2023-11-27T20:54:34.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.583+0000 7f6072210640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606c152010 con 0x7f606c0c7a30 2023-11-27T20:54:34.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.584+0000 7f606b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f606c0c7650 0x7f606c150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:34.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.584+0000 7f6063fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f606c0c7a30 0x7f606c06e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:34.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.584+0000 7f606bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c1560f0 0x7f606c1524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:34.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.584+0000 7f606b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f606c0c7650 0x7f606c150a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:52826/0 (socket says 172.21.15.88:52826) 2023-11-27T20:54:34.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.584+0000 7f606b7fe640 1 -- 172.21.15.88:0/2901488018 learned_addr learned my addr 172.21.15.88:0/2901488018 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:34.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.587+0000 7f606b7fe640 1 -- 172.21.15.88:0/2901488018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f606c0c7a30 msgr2=0x7f606c06e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:34.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.587+0000 7f606b7fe640 1 --2- 172.21.15.88:0/2901488018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f606c0c7a30 0x7f606c06e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:34.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.587+0000 7f606b7fe640 1 -- 172.21.15.88:0/2901488018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c1560f0 msgr2=0x7f606c1524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:34.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.587+0000 7f606b7fe640 1 --2- 172.21.15.88:0/2901488018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c1560f0 0x7f606c1524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:34.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.587+0000 7f606b7fe640 1 -- 172.21.15.88:0/2901488018 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605c009400 con 0x7f606c0c7650 2023-11-27T20:54:34.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.590+0000 7f606b7fe640 1 --2- 172.21.15.88:0/2901488018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f606c0c7650 0x7f606c150a70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f605c034040 tx=0x7f605c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:34.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.593+0000 7f6068ff9640 1 -- 172.21.15.88:0/2901488018 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c032840 con 0x7f606c0c7650 2023-11-27T20:54:34.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.593+0000 7f6068ff9640 1 -- 172.21.15.88:0/2901488018 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605c0329c0 con 0x7f606c0c7650 2023-11-27T20:54:34.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.593+0000 7f6068ff9640 1 -- 172.21.15.88:0/2901488018 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c032d70 con 0x7f606c0c7650 2023-11-27T20:54:34.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.593+0000 7f6072210640 1 -- 172.21.15.88:0/2901488018 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f606c14c920 con 0x7f606c0c7650 2023-11-27T20:54:34.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.593+0000 7f6072210640 1 -- 172.21.15.88:0/2901488018 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606c151400 con 0x7f606c0c7650 2023-11-27T20:54:34.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.594+0000 7f6072210640 1 -- 172.21.15.88:0/2901488018 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f606c15a560 con 0x7f606c0c7650 2023-11-27T20:54:34.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.765+0000 7f6068ff9640 1 -- 172.21.15.88:0/2901488018 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f605c04e430 con 0x7f606c0c7650 2023-11-27T20:54:34.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.765+0000 7f6068ff9640 1 --2- 172.21.15.88:0/2901488018 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f604c06b240 0x7f604c06d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:34.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.766+0000 7f6063fff640 1 --2- 172.21.15.88:0/2901488018 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f604c06b240 0x7f604c06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:34.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.766+0000 7f6063fff640 1 --2- 172.21.15.88:0/2901488018 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f604c06b240 0x7f604c06d700 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f606c0c4850 tx=0x7f6054009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:34.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.768+0000 7f6068ff9640 1 -- 172.21.15.88:0/2901488018 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f605c07a710 con 0x7f606c0c7650 2023-11-27T20:54:34.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:34.855+0000 7f6068ff9640 1 -- 172.21.15.88:0/2901488018 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f605c076a50 con 0x7f606c0c7650 2023-11-27T20:54:35.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.025+0000 7f6072210640 1 -- 172.21.15.88:0/2901488018 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f606c1547a0 con 0x7f606c0c7650 2023-11-27T20:54:35.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.135+0000 7f6068ff9640 1 -- 172.21.15.88:0/2901488018 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18339 (secure 0 0 0) 0x7f605c07a070 con 0x7f606c0c7650 2023-11-27T20:54:35.136 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:54:35.136 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc","created":"2023-11-27T20:53:53.110827+0000","modified":"2023-11-27T20:54:32.470579+0000","last_up_change":"2023-11-27T20:54:08.219383+0000","last_in_change":"2023-11-27T20:53:59.022798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:54:09.277670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:54:24.503156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:54:25.744043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T20:54:29.704111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1207ca0f-bef1-44c6-b66b-58bf0e080ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6819","nonce":3952326022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6821","nonce":3952326022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6825","nonce":3952326022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6823","nonce":3952326022}]},"public_addr":"172.21.15.88:6819/3952326022","cluster_addr":"172.21.15.88:6821/3952326022","heartbeat_back_addr":"172.21.15.88:6825/3952326022","heartbeat_front_addr":"172.21.15.88:6823/3952326022","state":["exists","up"]},{"osd":1,"uuid":"8d1be479-4241-4335-9633-1394311fde76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6827","nonce":1788401966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6829","nonce":1788401966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6833","nonce":1788401966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6831","nonce":1788401966}]},"public_addr":"172.21.15.88:6827/1788401966","cluster_addr":"172.21.15.88:6829/1788401966","heartbeat_back_addr":"172.21.15.88:6833/1788401966","heartbeat_front_addr":"172.21.15.88:6831/1788401966","state":["exists","up"]},{"osd":2,"uuid":"7536b008-05dd-40eb-9d4a-bdac4b1c38c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6803","nonce":1166333913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6805","nonce":1166333913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6809","nonce":1166333913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6807","nonce":1166333913}]},"public_addr":"172.21.15.88:6803/1166333913","cluster_addr":"172.21.15.88:6805/1166333913","heartbeat_back_addr":"172.21.15.88:6809/1166333913","heartbeat_front_addr":"172.21.15.88:6807/1166333913","state":["exists","up"]},{"osd":3,"uuid":"47edd4d7-e99c-4ce3-851b-cc9c8e2d4480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6811","nonce":406887502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6813","nonce":406887502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6817","nonce":406887502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6815","nonce":406887502}]},"public_addr":"172.21.15.88:6811/406887502","cluster_addr":"172.21.15.88:6813/406887502","heartbeat_back_addr":"172.21.15.88:6817/406887502","heartbeat_front_addr":"172.21.15.88:6815/406887502","state":["exists","up"]},{"osd":4,"uuid":"0a81dd31-1a8b-41af-b933-d74aae63f3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6801","nonce":2551293703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6803","nonce":2551293703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6807","nonce":2551293703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6805","nonce":2551293703}]},"public_addr":"172.21.15.167:6801/2551293703","cluster_addr":"172.21.15.167:6803/2551293703","heartbeat_back_addr":"172.21.15.167:6807/2551293703","heartbeat_front_addr":"172.21.15.167:6805/2551293703","state":["exists","up"]},{"osd":5,"uuid":"1c462d0d-3361-48b3-a82a-86a920539e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6825","nonce":866085094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6827","nonce":866085094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6831","nonce":866085094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6829","nonce":866085094}]},"public_addr":"172.21.15.167:6825/866085094","cluster_addr":"172.21.15.167:6827/866085094","heartbeat_back_addr":"172.21.15.167:6831/866085094","heartbeat_front_addr":"172.21.15.167:6829/866085094","state":["exists","up"]},{"osd":6,"uuid":"d687c5ad-6c88-4a15-8120-0cdbc5610535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6809","nonce":2766725538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6811","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6813","nonce":2766725538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6819","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6821","nonce":2766725538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6815","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6817","nonce":2766725538}]},"public_addr":"172.21.15.167:6809/2766725538","cluster_addr":"172.21.15.167:6813/2766725538","heartbeat_back_addr":"172.21.15.167:6821/2766725538","heartbeat_front_addr":"172.21.15.167:6817/2766725538","state":["exists","up"]},{"osd":7,"uuid":"c9a50596-4981-4bd8-a8ef-d7679f8d9559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6812","nonce":2695037266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6816","nonce":2695037266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6823","nonce":2695037266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6820","nonce":2695037266}]},"public_addr":"172.21.15.167:6812/2695037266","cluster_addr":"172.21.15.167:6816/2695037266","heartbeat_back_addr":"172.21.15.167:6823/2695037266","heartbeat_front_addr":"172.21.15.167:6820/2695037266","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.522590+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.483170+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.492504+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.432204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.414964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.459803+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.437250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.460394+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:54:35.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.136+0000 7f6072210640 1 -- 172.21.15.88:0/2901488018 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f604c06b240 msgr2=0x7f604c06d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:35.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.136+0000 7f6072210640 1 --2- 172.21.15.88:0/2901488018 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f604c06b240 0x7f604c06d700 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f606c0c4850 tx=0x7f6054009040 comp rx=0 tx=0).stop 2023-11-27T20:54:35.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.136+0000 7f6072210640 1 -- 172.21.15.88:0/2901488018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f606c0c7650 msgr2=0x7f606c150a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:35.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.136+0000 7f6072210640 1 --2- 172.21.15.88:0/2901488018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f606c0c7650 0x7f606c150a70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f605c034040 tx=0x7f605c0046c0 comp rx=0 tx=0).stop 2023-11-27T20:54:35.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.136+0000 7f6072210640 1 -- 172.21.15.88:0/2901488018 shutdown_connections 2023-11-27T20:54:35.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.136+0000 7f6072210640 1 --2- 172.21.15.88:0/2901488018 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f604c06b240 0x7f604c06d700 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:35.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.136+0000 7f6072210640 1 --2- 172.21.15.88:0/2901488018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c1560f0 0x7f606c1524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:35.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.136+0000 7f6072210640 1 --2- 172.21.15.88:0/2901488018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f606c0c7a30 0x7f606c06e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:35.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.136+0000 7f6072210640 1 --2- 172.21.15.88:0/2901488018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f606c0c7650 0x7f606c150a70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:35.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.136+0000 7f6072210640 1 -- 172.21.15.88:0/2901488018 >> 172.21.15.88:0/2901488018 conn(0x7f606c06c5f0 msgr2=0x7f606c0c50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:35.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.136+0000 7f6072210640 1 -- 172.21.15.88:0/2901488018 shutdown_connections 2023-11-27T20:54:35.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.136+0000 7f6072210640 1 -- 172.21.15.88:0/2901488018 wait complete. 2023-11-27T20:54:35.162 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:54:35.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.265+0000 7ff7ff21e640 1 Processor -- start 2023-11-27T20:54:35.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.265+0000 7ff7ff21e640 1 -- start start 2023-11-27T20:54:35.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.265+0000 7ff7ff21e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7f814ffa0 0x7ff7f80c1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:35.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.265+0000 7ff7ff21e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff7f80c6570 0x7ff7f80c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:35.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.265+0000 7ff7ff21e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f80c6f40 con 0x7ff7f8150380 2023-11-27T20:54:35.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.265+0000 7ff7ff21e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f81570d0 con 0x7ff7f80c6570 2023-11-27T20:54:35.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.266+0000 7ff7ff21e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f8156270 con 0x7ff7f814ffa0 2023-11-27T20:54:35.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.267+0000 7ff7fd7bb640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff7f80c6570 0x7ff7f80c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:35.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.267+0000 7ff7fd7bb640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff7f80c6570 0x7ff7f80c6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60178/0 (socket says 172.21.15.88:60178) 2023-11-27T20:54:35.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.267+0000 7ff7fd7bb640 1 -- 172.21.15.88:0/1625749025 learned_addr learned my addr 172.21.15.88:0/1625749025 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:35.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.270+0000 7ff7fd7bb640 1 -- 172.21.15.88:0/1625749025 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7f814ffa0 msgr2=0x7ff7f80c1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:35.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.270+0000 7ff7fd7bb640 1 --2- 172.21.15.88:0/1625749025 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7f814ffa0 0x7ff7f80c1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:35.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.270+0000 7ff7fd7bb640 1 -- 172.21.15.88:0/1625749025 >> v1:172.21.15.167:6789/0 conn(0x7ff7f8150380 legacy=0x7ff7f806fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:35.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.270+0000 7ff7fd7bb640 1 -- 172.21.15.88:0/1625749025 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f8156550 con 0x7ff7f80c6570 2023-11-27T20:54:35.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.271+0000 7ff7fd7bb640 1 --2- 172.21.15.88:0/1625749025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7f80c6570 0x7ff7f80c6a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009e50 tx=0x7ff7f002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f1df60c73a42c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:35.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.275+0000 7ff7f77fe640 1 -- 172.21.15.88:0/1625749025 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f002cb00 con 0x7ff7f80c6570 2023-11-27T20:54:35.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.275+0000 7ff7f77fe640 1 -- 172.21.15.88:0/1625749025 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f002cc60 con 0x7ff7f80c6570 2023-11-27T20:54:35.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.275+0000 7ff7f77fe640 1 -- 172.21.15.88:0/1625749025 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f00343f0 con 0x7ff7f80c6570 2023-11-27T20:54:35.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.276+0000 7ff7ff21e640 1 -- 172.21.15.88:0/1625749025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7f80c6570 msgr2=0x7ff7f80c6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:35.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.276+0000 7ff7ff21e640 1 --2- 172.21.15.88:0/1625749025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7f80c6570 0x7ff7f80c6a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009e50 tx=0x7ff7f002bf60 comp rx=0 tx=0).stop 2023-11-27T20:54:35.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.276+0000 7ff7ff21e640 1 -- 172.21.15.88:0/1625749025 shutdown_connections 2023-11-27T20:54:35.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.276+0000 7ff7ff21e640 1 --2- 172.21.15.88:0/1625749025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7f80c6570 0x7ff7f80c6a00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:35.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.276+0000 7ff7ff21e640 1 --2- 172.21.15.88:0/1625749025 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7f814ffa0 0x7ff7f80c1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:35.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.276+0000 7ff7ff21e640 1 -- 172.21.15.88:0/1625749025 >> 172.21.15.88:0/1625749025 conn(0x7ff7f806b5c0 msgr2=0x7ff7f806b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:35.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.276+0000 7ff7ff21e640 1 -- 172.21.15.88:0/1625749025 shutdown_connections 2023-11-27T20:54:35.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.276+0000 7ff7ff21e640 1 -- 172.21.15.88:0/1625749025 wait complete. 2023-11-27T20:54:35.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.277+0000 7ff7ff21e640 1 Processor -- start 2023-11-27T20:54:35.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.277+0000 7ff7ff21e640 1 -- start start 2023-11-27T20:54:35.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.278+0000 7ff7ff21e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7f80c6570 0x7ff7f8147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:35.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.278+0000 7ff7ff21e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7f814ffa0 0x7ff7f8071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:35.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.278+0000 7ff7ff21e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7f8150380 0x7ff7f8072100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:35.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.278+0000 7ff7ff21e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f80c74b0 con 0x7ff7f80c6570 2023-11-27T20:54:35.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.278+0000 7ff7ff21e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f81eccd0 con 0x7ff7f8150380 2023-11-27T20:54:35.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.278+0000 7ff7ff21e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f81475a0 con 0x7ff7f814ffa0 2023-11-27T20:54:35.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.279+0000 7ff7fcfba640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7f80c6570 0x7ff7f8147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:35.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.279+0000 7ff7fcfba640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7f80c6570 0x7ff7f8147060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60194/0 (socket says 172.21.15.88:60194) 2023-11-27T20:54:35.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.279+0000 7ff7fcfba640 1 -- 172.21.15.88:0/3241210593 learned_addr learned my addr 172.21.15.88:0/3241210593 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:35.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.282+0000 7ff7fcfba640 1 -- 172.21.15.88:0/3241210593 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7f814ffa0 msgr2=0x7ff7f8071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:35.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.282+0000 7ff7fcfba640 1 --2- 172.21.15.88:0/3241210593 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7f814ffa0 0x7ff7f8071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:35.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.282+0000 7ff7fcfba640 1 -- 172.21.15.88:0/3241210593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7f8150380 msgr2=0x7ff7f8072100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:35.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.282+0000 7ff7fcfba640 1 --2- 172.21.15.88:0/3241210593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7f8150380 0x7ff7f8072100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:35.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.282+0000 7ff7fcfba640 1 -- 172.21.15.88:0/3241210593 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f0009b30 con 0x7ff7f80c6570 2023-11-27T20:54:35.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.285+0000 7ff7fcfba640 1 --2- 172.21.15.88:0/3241210593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7f80c6570 0x7ff7f8147060 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec00b440 tx=0x7ff7ec00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:35.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.288+0000 7ff7f57fa640 1 -- 172.21.15.88:0/3241210593 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec011830 con 0x7ff7f80c6570 2023-11-27T20:54:35.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.288+0000 7ff7f57fa640 1 -- 172.21.15.88:0/3241210593 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ec011990 con 0x7ff7f80c6570 2023-11-27T20:54:35.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.288+0000 7ff7f57fa640 1 -- 172.21.15.88:0/3241210593 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec011d40 con 0x7ff7f80c6570 2023-11-27T20:54:35.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.288+0000 7ff7ff21e640 1 -- 172.21.15.88:0/3241210593 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f81f0130 con 0x7ff7f80c6570 2023-11-27T20:54:35.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.288+0000 7ff7ff21e640 1 -- 172.21.15.88:0/3241210593 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f81f06d0 con 0x7ff7f80c6570 2023-11-27T20:54:35.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.290+0000 7ff7ff21e640 1 -- 172.21.15.88:0/3241210593 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f81ecea0 con 0x7ff7f80c6570 2023-11-27T20:54:35.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.309+0000 7ff7f57fa640 1 -- 172.21.15.88:0/3241210593 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff7ec01b460 con 0x7ff7f80c6570 2023-11-27T20:54:35.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.309+0000 7ff7f57fa640 1 --2- 172.21.15.88:0/3241210593 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff7dc06b210 0x7ff7dc06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:35.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.309+0000 7ff7f7fff640 1 --2- 172.21.15.88:0/3241210593 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff7dc06b210 0x7ff7dc06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:35.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.309+0000 7ff7f7fff640 1 --2- 172.21.15.88:0/3241210593 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff7dc06b210 0x7ff7dc06d6d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff7f815a310 tx=0x7ff7e4007990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:35.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.542+0000 7ff7f57fa640 1 -- 172.21.15.88:0/3241210593 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff7ec059180 con 0x7ff7f80c6570 2023-11-27T20:54:35.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.542+0000 7ff7f57fa640 1 -- 172.21.15.88:0/3241210593 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff7ec054dc0 con 0x7ff7f80c6570 2023-11-27T20:54:35.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.766+0000 7ff7ff21e640 1 -- 172.21.15.88:0/3241210593 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7f81ecea0 con 0x7ff7f80c6570 2023-11-27T20:54:35.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.786+0000 7ff7f57fa640 1 -- 172.21.15.88:0/3241210593 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6495 (secure 0 0 0) 0x7ff7f81ecea0 con 0x7ff7f80c6570 2023-11-27T20:54:35.788 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:54:35.788 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/298325117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":298325117},{"type":"v1","addr":"172.21.15.88:6837","nonce":298325117}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/1596074914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1596074914},{"type":"v1","addr":"172.21.15.167:6837","nonce":1596074914}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":34187,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/256796309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":256796309},{"type":"v1","addr":"172.21.15.88:6835","nonce":256796309}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34190,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1245449675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1245449675},{"type":"v1","addr":"172.21.15.167:6833","nonce":1245449675}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34199,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/327644613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":327644613},{"type":"v1","addr":"172.21.15.167:6835","nonce":327644613}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:54:26.940968+0000","modified":"2023-11-27T20:54:32.475051+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34205},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34205":{"gid":34205,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.88:6839/2120059880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":2120059880},{"type":"v1","addr":"172.21.15.88:6839","nonce":2120059880}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-27T20:54:35.788 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 7 2023-11-27T20:54:35.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.789+0000 7ff7ff21e640 1 -- 172.21.15.88:0/3241210593 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff7dc06b210 msgr2=0x7ff7dc06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:35.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.789+0000 7ff7ff21e640 1 --2- 172.21.15.88:0/3241210593 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff7dc06b210 0x7ff7dc06d6d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff7f815a310 tx=0x7ff7e4007990 comp rx=0 tx=0).stop 2023-11-27T20:54:35.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.789+0000 7ff7ff21e640 1 -- 172.21.15.88:0/3241210593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7f80c6570 msgr2=0x7ff7f8147060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:35.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.789+0000 7ff7ff21e640 1 --2- 172.21.15.88:0/3241210593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7f80c6570 0x7ff7f8147060 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec00b440 tx=0x7ff7ec00b900 comp rx=0 tx=0).stop 2023-11-27T20:54:35.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.789+0000 7ff7ff21e640 1 -- 172.21.15.88:0/3241210593 shutdown_connections 2023-11-27T20:54:35.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.789+0000 7ff7ff21e640 1 --2- 172.21.15.88:0/3241210593 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff7dc06b210 0x7ff7dc06d6d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:35.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.789+0000 7ff7ff21e640 1 --2- 172.21.15.88:0/3241210593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7f8150380 0x7ff7f8072100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:35.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.789+0000 7ff7ff21e640 1 --2- 172.21.15.88:0/3241210593 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7f814ffa0 0x7ff7f8071bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:35.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.789+0000 7ff7ff21e640 1 --2- 172.21.15.88:0/3241210593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7f80c6570 0x7ff7f8147060 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:35.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.789+0000 7ff7ff21e640 1 -- 172.21.15.88:0/3241210593 >> 172.21.15.88:0/3241210593 conn(0x7ff7f806b5c0 msgr2=0x7ff7f814a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:35.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.789+0000 7ff7ff21e640 1 -- 172.21.15.88:0/3241210593 shutdown_connections 2023-11-27T20:54:35.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.789+0000 7ff7ff21e640 1 -- 172.21.15.88:0/3241210593 wait complete. 2023-11-27T20:54:35.801 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:54:35.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.899+0000 7f5c67390640 1 Processor -- start 2023-11-27T20:54:35.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.899+0000 7f5c67390640 1 -- start start 2023-11-27T20:54:35.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.900+0000 7f5c67390640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5c60153770 0x7f5c60159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:35.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.900+0000 7f5c67390640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c60153b50 0x7f5c6015a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:35.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.900+0000 7f5c67390640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c6015d550 con 0x7f5c600cd500 2023-11-27T20:54:35.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.900+0000 7f5c67390640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c6015da80 con 0x7f5c60153770 2023-11-27T20:54:35.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.900+0000 7f5c67390640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c601596e0 con 0x7f5c60153b50 2023-11-27T20:54:35.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.901+0000 7f5c6492b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c60153b50 0x7f5c6015a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:35.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.901+0000 7f5c6492b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c60153b50 0x7f5c6015a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:58666/0 (socket says 172.21.15.88:58666) 2023-11-27T20:54:35.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.901+0000 7f5c6492b640 1 -- 172.21.15.88:0/876029590 learned_addr learned my addr 172.21.15.88:0/876029590 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:35.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.901+0000 7f5c6512c640 1 --2- 172.21.15.88:0/876029590 >> v2:172.21.15.167:3300/0 conn(0x7f5c60153770 0x7f5c60159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:35.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.901+0000 7f5c6592d640 1 --1- 172.21.15.88:0/876029590 >> v1:172.21.15.167:6789/0 conn(0x7f5c600cd500 0x7f5c6006c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:48142/0 (socket says 172.21.15.88:48142) 2023-11-27T20:54:35.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.904+0000 7f5c6492b640 1 -- 172.21.15.88:0/876029590 >> v2:172.21.15.167:3300/0 conn(0x7f5c60153770 msgr2=0x7f5c60159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:35.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.904+0000 7f5c6492b640 1 --2- 172.21.15.88:0/876029590 >> v2:172.21.15.167:3300/0 conn(0x7f5c60153770 0x7f5c60159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:35.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.904+0000 7f5c6492b640 1 -- 172.21.15.88:0/876029590 >> v1:172.21.15.167:6789/0 conn(0x7f5c600cd500 legacy=0x7f5c6006c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:35.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.904+0000 7f5c6492b640 1 -- 172.21.15.88:0/876029590 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6015d7a0 con 0x7f5c60153b50 2023-11-27T20:54:35.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.906+0000 7f5c6492b640 1 --2- 172.21.15.88:0/876029590 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c60153b50 0x7f5c6015a0d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5c50009870 tx=0x7f5c5002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e875f8cf9071650 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:35.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.910+0000 7f5c57fff640 1 -- 172.21.15.88:0/876029590 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c50031640 con 0x7f5c60153b50 2023-11-27T20:54:35.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.910+0000 7f5c57fff640 1 -- 172.21.15.88:0/876029590 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c500317a0 con 0x7f5c60153b50 2023-11-27T20:54:35.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.910+0000 7f5c57fff640 1 -- 172.21.15.88:0/876029590 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c50031b30 con 0x7f5c60153b50 2023-11-27T20:54:35.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.911+0000 7f5c67390640 1 -- 172.21.15.88:0/876029590 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c60153b50 msgr2=0x7f5c6015a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:35.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.911+0000 7f5c67390640 1 --2- 172.21.15.88:0/876029590 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c60153b50 0x7f5c6015a0d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5c50009870 tx=0x7f5c5002b8f0 comp rx=0 tx=0).stop 2023-11-27T20:54:35.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.911+0000 7f5c67390640 1 -- 172.21.15.88:0/876029590 shutdown_connections 2023-11-27T20:54:35.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.911+0000 7f5c67390640 1 --2- 172.21.15.88:0/876029590 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c60153b50 0x7f5c6015a0d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:35.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.911+0000 7f5c67390640 1 --2- 172.21.15.88:0/876029590 >> v2:172.21.15.167:3300/0 conn(0x7f5c60153770 0x7f5c60159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:35.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.911+0000 7f5c67390640 1 -- 172.21.15.88:0/876029590 >> 172.21.15.88:0/876029590 conn(0x7f5c60060f20 msgr2=0x7f5c60061330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:35.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.911+0000 7f5c67390640 1 -- 172.21.15.88:0/876029590 shutdown_connections 2023-11-27T20:54:35.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.911+0000 7f5c67390640 1 -- 172.21.15.88:0/876029590 wait complete. 2023-11-27T20:54:35.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.912+0000 7f5c67390640 1 Processor -- start 2023-11-27T20:54:35.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.912+0000 7f5c67390640 1 -- start start 2023-11-27T20:54:35.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.913+0000 7f5c67390640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c600cd500 0x7f5c601efd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:35.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.913+0000 7f5c67390640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c60153770 0x7f5c600c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:35.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.913+0000 7f5c67390640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c600c2800 0x7f5c6014ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:35.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.913+0000 7f5c67390640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c600c6e50 con 0x7f5c600cd500 2023-11-27T20:54:35.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.913+0000 7f5c67390640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c601ef360 con 0x7f5c60153770 2023-11-27T20:54:35.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.913+0000 7f5c67390640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c601f0290 con 0x7f5c600c2800 2023-11-27T20:54:35.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.913+0000 7f5c6512c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c600cd500 0x7f5c601efd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:35.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.913+0000 7f5c6592d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c600c2800 0x7f5c6014ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:35.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.914+0000 7f5c6492b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c60153770 0x7f5c600c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:35.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.914+0000 7f5c6512c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c600cd500 0x7f5c601efd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60196/0 (socket says 172.21.15.88:60196) 2023-11-27T20:54:35.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.914+0000 7f5c6512c640 1 -- 172.21.15.88:0/3921962807 learned_addr learned my addr 172.21.15.88:0/3921962807 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:35.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.917+0000 7f5c6512c640 1 -- 172.21.15.88:0/3921962807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c600c2800 msgr2=0x7f5c6014ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:35.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.917+0000 7f5c6512c640 1 --2- 172.21.15.88:0/3921962807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c600c2800 0x7f5c6014ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:35.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.917+0000 7f5c6512c640 1 -- 172.21.15.88:0/3921962807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c60153770 msgr2=0x7f5c600c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:35.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.917+0000 7f5c6512c640 1 --2- 172.21.15.88:0/3921962807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c60153770 0x7f5c600c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:35.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.917+0000 7f5c6512c640 1 -- 172.21.15.88:0/3921962807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c500094d0 con 0x7f5c600cd500 2023-11-27T20:54:35.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.917+0000 7f5c6592d640 1 --2- 172.21.15.88:0/3921962807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c600c2800 0x7f5c6014ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:54:35.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.919+0000 7f5c6512c640 1 --2- 172.21.15.88:0/3921962807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c600cd500 0x7f5c601efd50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c00efc0 tx=0x7f5c5c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:35.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.923+0000 7f5c55ffb640 1 -- 172.21.15.88:0/3921962807 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c014480 con 0x7f5c600cd500 2023-11-27T20:54:35.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.923+0000 7f5c55ffb640 1 -- 172.21.15.88:0/3921962807 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5c00f040 con 0x7f5c600cd500 2023-11-27T20:54:35.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.923+0000 7f5c67390640 1 -- 172.21.15.88:0/3921962807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c600c5040 con 0x7f5c600cd500 2023-11-27T20:54:35.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.923+0000 7f5c55ffb640 1 -- 172.21.15.88:0/3921962807 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c014800 con 0x7f5c600cd500 2023-11-27T20:54:35.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.923+0000 7f5c67390640 1 -- 172.21.15.88:0/3921962807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c600c5600 con 0x7f5c600cd500 2023-11-27T20:54:35.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.924+0000 7f5c67390640 1 -- 172.21.15.88:0/3921962807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c60067ca0 con 0x7f5c600cd500 2023-11-27T20:54:35.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.943+0000 7f5c55ffb640 1 -- 172.21.15.88:0/3921962807 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5c5c014960 con 0x7f5c600cd500 2023-11-27T20:54:35.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.943+0000 7f5c55ffb640 1 --2- 172.21.15.88:0/3921962807 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5c4406b240 0x7f5c4406d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:35.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.943+0000 7f5c6492b640 1 --2- 172.21.15.88:0/3921962807 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5c4406b240 0x7f5c4406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:35.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.944+0000 7f5c6492b640 1 --2- 172.21.15.88:0/3921962807 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5c4406b240 0x7f5c4406d700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5c50036000 tx=0x7f5c5003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:35.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:35.946+0000 7f5c55ffb640 1 -- 172.21.15.88:0/3921962807 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5c5c0596f0 con 0x7f5c600cd500 2023-11-27T20:54:36.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:36.182+0000 7f5c55ffb640 1 -- 172.21.15.88:0/3921962807 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5c5c055a30 con 0x7f5c600cd500 2023-11-27T20:54:36.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:36.348+0000 7f5c67390640 1 -- 172.21.15.88:0/3921962807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c600ca090 con 0x7f5c600cd500 2023-11-27T20:54:36.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:36.385+0000 7f5c55ffb640 1 -- 172.21.15.88:0/3921962807 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18339 (secure 0 0 0) 0x7f5c5c059050 con 0x7f5c600cd500 2023-11-27T20:54:36.387 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:54:36.387 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc","created":"2023-11-27T20:53:53.110827+0000","modified":"2023-11-27T20:54:32.470579+0000","last_up_change":"2023-11-27T20:54:08.219383+0000","last_in_change":"2023-11-27T20:53:59.022798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:54:09.277670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:54:24.503156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:54:25.744043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T20:54:29.704111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1207ca0f-bef1-44c6-b66b-58bf0e080ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6819","nonce":3952326022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6821","nonce":3952326022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6825","nonce":3952326022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6823","nonce":3952326022}]},"public_addr":"172.21.15.88:6819/3952326022","cluster_addr":"172.21.15.88:6821/3952326022","heartbeat_back_addr":"172.21.15.88:6825/3952326022","heartbeat_front_addr":"172.21.15.88:6823/3952326022","state":["exists","up"]},{"osd":1,"uuid":"8d1be479-4241-4335-9633-1394311fde76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6827","nonce":1788401966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6829","nonce":1788401966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6833","nonce":1788401966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6831","nonce":1788401966}]},"public_addr":"172.21.15.88:6827/1788401966","cluster_addr":"172.21.15.88:6829/1788401966","heartbeat_back_addr":"172.21.15.88:6833/1788401966","heartbeat_front_addr":"172.21.15.88:6831/1788401966","state":["exists","up"]},{"osd":2,"uuid":"7536b008-05dd-40eb-9d4a-bdac4b1c38c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6803","nonce":1166333913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6805","nonce":1166333913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6809","nonce":1166333913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6807","nonce":1166333913}]},"public_addr":"172.21.15.88:6803/1166333913","cluster_addr":"172.21.15.88:6805/1166333913","heartbeat_back_addr":"172.21.15.88:6809/1166333913","heartbeat_front_addr":"172.21.15.88:6807/1166333913","state":["exists","up"]},{"osd":3,"uuid":"47edd4d7-e99c-4ce3-851b-cc9c8e2d4480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6811","nonce":406887502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6813","nonce":406887502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6817","nonce":406887502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6815","nonce":406887502}]},"public_addr":"172.21.15.88:6811/406887502","cluster_addr":"172.21.15.88:6813/406887502","heartbeat_back_addr":"172.21.15.88:6817/406887502","heartbeat_front_addr":"172.21.15.88:6815/406887502","state":["exists","up"]},{"osd":4,"uuid":"0a81dd31-1a8b-41af-b933-d74aae63f3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6801","nonce":2551293703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6803","nonce":2551293703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6807","nonce":2551293703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6805","nonce":2551293703}]},"public_addr":"172.21.15.167:6801/2551293703","cluster_addr":"172.21.15.167:6803/2551293703","heartbeat_back_addr":"172.21.15.167:6807/2551293703","heartbeat_front_addr":"172.21.15.167:6805/2551293703","state":["exists","up"]},{"osd":5,"uuid":"1c462d0d-3361-48b3-a82a-86a920539e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6825","nonce":866085094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6827","nonce":866085094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6831","nonce":866085094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6829","nonce":866085094}]},"public_addr":"172.21.15.167:6825/866085094","cluster_addr":"172.21.15.167:6827/866085094","heartbeat_back_addr":"172.21.15.167:6831/866085094","heartbeat_front_addr":"172.21.15.167:6829/866085094","state":["exists","up"]},{"osd":6,"uuid":"d687c5ad-6c88-4a15-8120-0cdbc5610535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6809","nonce":2766725538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6811","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6813","nonce":2766725538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6819","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6821","nonce":2766725538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6815","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6817","nonce":2766725538}]},"public_addr":"172.21.15.167:6809/2766725538","cluster_addr":"172.21.15.167:6813/2766725538","heartbeat_back_addr":"172.21.15.167:6821/2766725538","heartbeat_front_addr":"172.21.15.167:6817/2766725538","state":["exists","up"]},{"osd":7,"uuid":"c9a50596-4981-4bd8-a8ef-d7679f8d9559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6812","nonce":2695037266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6816","nonce":2695037266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6823","nonce":2695037266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6820","nonce":2695037266}]},"public_addr":"172.21.15.167:6812/2695037266","cluster_addr":"172.21.15.167:6816/2695037266","heartbeat_back_addr":"172.21.15.167:6823/2695037266","heartbeat_front_addr":"172.21.15.167:6820/2695037266","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.522590+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.483170+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.492504+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.432204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.414964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.459803+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.437250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.460394+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:54:36.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:36.387+0000 7f5c67390640 1 -- 172.21.15.88:0/3921962807 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5c4406b240 msgr2=0x7f5c4406d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:36.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:36.387+0000 7f5c67390640 1 --2- 172.21.15.88:0/3921962807 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5c4406b240 0x7f5c4406d700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5c50036000 tx=0x7f5c5003c040 comp rx=0 tx=0).stop 2023-11-27T20:54:36.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:36.387+0000 7f5c67390640 1 -- 172.21.15.88:0/3921962807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c600cd500 msgr2=0x7f5c601efd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:36.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:36.387+0000 7f5c67390640 1 --2- 172.21.15.88:0/3921962807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c600cd500 0x7f5c601efd50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c00efc0 tx=0x7f5c5c00c490 comp rx=0 tx=0).stop 2023-11-27T20:54:36.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:36.387+0000 7f5c67390640 1 -- 172.21.15.88:0/3921962807 shutdown_connections 2023-11-27T20:54:36.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:36.387+0000 7f5c67390640 1 --2- 172.21.15.88:0/3921962807 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5c4406b240 0x7f5c4406d700 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:36.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:36.387+0000 7f5c67390640 1 --2- 172.21.15.88:0/3921962807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c600c2800 0x7f5c6014ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:36.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:36.387+0000 7f5c67390640 1 --2- 172.21.15.88:0/3921962807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c60153770 0x7f5c600c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:36.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:36.387+0000 7f5c67390640 1 --2- 172.21.15.88:0/3921962807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c600cd500 0x7f5c601efd50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:36.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:36.387+0000 7f5c67390640 1 -- 172.21.15.88:0/3921962807 >> 172.21.15.88:0/3921962807 conn(0x7f5c60060f20 msgr2=0x7f5c6014e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:36.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:36.387+0000 7f5c67390640 1 -- 172.21.15.88:0/3921962807 shutdown_connections 2023-11-27T20:54:36.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:36.387+0000 7f5c67390640 1 -- 172.21.15.88:0/3921962807 wait complete. 2023-11-27T20:54:37.003 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-27T20:54:26.940968+0000', 'modified': '2023-11-27T20:54:32.475051+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 34205}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_34205': {'gid': 34205, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.88:6839/2120059880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6838', 'nonce': 2120059880}, {'type': 'v1', 'addr': '172.21.15.88:6839', 'nonce': 2120059880}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-11-27T20:54:37.003 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-27T20:54:37.003 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-27T20:54:37.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.104+0000 7f1f5f101640 1 Processor -- start 2023-11-27T20:54:37.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.104+0000 7f1f5f101640 1 -- start start 2023-11-27T20:54:37.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.105+0000 7f1f5f101640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1f58151220 0x7f1f5806ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:37.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.105+0000 7f1f5f101640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f581577f0 con 0x7f1f58157240 2023-11-27T20:54:37.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.105+0000 7f1f5f101640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f58157a90 con 0x7f1f580710c0 2023-11-27T20:54:37.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.105+0000 7f1f5f101640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f58157d30 con 0x7f1f58151220 2023-11-27T20:54:37.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.106+0000 7f1f57fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1f58157240 0x7f1f580c40d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38926/0 (socket says 172.21.15.88:38926) 2023-11-27T20:54:37.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.106+0000 7f1f57fff640 1 -- 172.21.15.88:0/2560827310 learned_addr learned my addr 172.21.15.88:0/2560827310 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:54:37.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.106+0000 7f1f5ce9d640 1 --2- 172.21.15.88:0/2560827310 >> v2:172.21.15.167:3300/0 conn(0x7f1f58151220 0x7f1f5806ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:37.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.108+0000 7f1f577fe640 1 -- 172.21.15.88:0/2560827310 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3273004205 0 0) 0x7f1f581577f0 con 0x7f1f58157240 2023-11-27T20:54:37.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.108+0000 7f1f577fe640 1 -- 172.21.15.88:0/2560827310 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f40003520 con 0x7f1f58157240 2023-11-27T20:54:37.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.111+0000 7f1f5ce9d640 1 -- 172.21.15.88:0/2560827310 >> v1:172.21.15.167:6789/0 conn(0x7f1f580710c0 legacy=0x7f1f58071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:37.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.111+0000 7f1f5ce9d640 1 -- 172.21.15.88:0/2560827310 >> v1:172.21.15.88:6789/0 conn(0x7f1f58157240 legacy=0x7f1f580c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:37.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.111+0000 7f1f5ce9d640 1 -- 172.21.15.88:0/2560827310 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f58157ff0 con 0x7f1f58151220 2023-11-27T20:54:37.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.115+0000 7f1f5ce9d640 1 --2- 172.21.15.88:0/2560827310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f58151220 0x7f1f5806ed60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1f480097a0 tx=0x7f1f4802b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a39a9488e4b37df6 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:37.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.119+0000 7f1f577fe640 1 -- 172.21.15.88:0/2560827310 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4802f810 con 0x7f1f58151220 2023-11-27T20:54:37.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.119+0000 7f1f577fe640 1 -- 172.21.15.88:0/2560827310 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4802f970 con 0x7f1f58151220 2023-11-27T20:54:37.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.119+0000 7f1f577fe640 1 -- 172.21.15.88:0/2560827310 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4802fd00 con 0x7f1f58151220 2023-11-27T20:54:37.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.119+0000 7f1f5f101640 1 -- 172.21.15.88:0/2560827310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f58151220 msgr2=0x7f1f5806ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:37.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.119+0000 7f1f5f101640 1 --2- 172.21.15.88:0/2560827310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f58151220 0x7f1f5806ed60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1f480097a0 tx=0x7f1f4802b9f0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.119+0000 7f1f5f101640 1 -- 172.21.15.88:0/2560827310 shutdown_connections 2023-11-27T20:54:37.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.119+0000 7f1f5f101640 1 --2- 172.21.15.88:0/2560827310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f58151220 0x7f1f5806ed60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.119+0000 7f1f5f101640 1 -- 172.21.15.88:0/2560827310 >> 172.21.15.88:0/2560827310 conn(0x7f1f5806c5f0 msgr2=0x7f1f5806c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:37.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.119+0000 7f1f5f101640 1 -- 172.21.15.88:0/2560827310 shutdown_connections 2023-11-27T20:54:37.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.119+0000 7f1f5f101640 1 -- 172.21.15.88:0/2560827310 wait complete. 2023-11-27T20:54:37.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.120+0000 7f1f5f101640 1 Processor -- start 2023-11-27T20:54:37.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.120+0000 7f1f5f101640 1 -- start start 2023-11-27T20:54:37.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.121+0000 7f1f5f101640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f580710c0 0x7f1f581f0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:37.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.121+0000 7f1f5f101640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f58151220 0x7f1f58159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:37.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.121+0000 7f1f5f101640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f58157240 0x7f1f5815ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:37.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.121+0000 7f1f5f101640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f58141eb0 con 0x7f1f58157240 2023-11-27T20:54:37.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.121+0000 7f1f5f101640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f58158bf0 con 0x7f1f58151220 2023-11-27T20:54:37.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.121+0000 7f1f5f101640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f58158230 con 0x7f1f580710c0 2023-11-27T20:54:37.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.122+0000 7f1f5d69e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f58157240 0x7f1f5815ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:37.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.122+0000 7f1f57fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f58151220 0x7f1f58159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:37.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.122+0000 7f1f5ce9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f580710c0 0x7f1f581f0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:37.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.122+0000 7f1f57fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f58151220 0x7f1f58159d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:52864/0 (socket says 172.21.15.88:52864) 2023-11-27T20:54:37.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.122+0000 7f1f5d69e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f58157240 0x7f1f5815ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60200/0 (socket says 172.21.15.88:60200) 2023-11-27T20:54:37.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.122+0000 7f1f57fff640 1 -- 172.21.15.88:0/696451285 learned_addr learned my addr 172.21.15.88:0/696451285 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:37.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.125+0000 7f1f5d69e640 1 -- 172.21.15.88:0/696451285 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f580710c0 msgr2=0x7f1f581f0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:37.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.125+0000 7f1f5d69e640 1 --2- 172.21.15.88:0/696451285 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f580710c0 0x7f1f581f0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.125+0000 7f1f5d69e640 1 -- 172.21.15.88:0/696451285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f58151220 msgr2=0x7f1f58159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:37.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.125+0000 7f1f5d69e640 1 --2- 172.21.15.88:0/696451285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f58151220 0x7f1f58159d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.125+0000 7f1f5d69e640 1 -- 172.21.15.88:0/696451285 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f48009400 con 0x7f1f58157240 2023-11-27T20:54:37.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.128+0000 7f1f5d69e640 1 --2- 172.21.15.88:0/696451285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f58157240 0x7f1f5815ad00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1f5000c730 tx=0x7f1f5000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:37.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.131+0000 7f1f557fa640 1 -- 172.21.15.88:0/696451285 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f50006d50 con 0x7f1f58157240 2023-11-27T20:54:37.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.131+0000 7f1f557fa640 1 -- 172.21.15.88:0/696451285 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f50003970 con 0x7f1f58157240 2023-11-27T20:54:37.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.131+0000 7f1f557fa640 1 -- 172.21.15.88:0/696451285 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f50003d60 con 0x7f1f58157240 2023-11-27T20:54:37.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.131+0000 7f1f5f101640 1 -- 172.21.15.88:0/696451285 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f5815a2b0 con 0x7f1f58157240 2023-11-27T20:54:37.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.131+0000 7f1f5f101640 1 -- 172.21.15.88:0/696451285 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f58158480 con 0x7f1f58157240 2023-11-27T20:54:37.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.134+0000 7f1f61d68740 1 Processor -- start 2023-11-27T20:54:37.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.134+0000 7f1f61d68740 1 -- start start 2023-11-27T20:54:37.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.135+0000 7f1f61d68740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c085ab3650 0x55c085ab3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:37.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.135+0000 7f1f61d68740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c085afd4d0 0x55c085ab3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:37.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.135+0000 7f1f61d68740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c085ab20b0 0x55c085af2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:37.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.135+0000 7f1f61d68740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c085a6e980 con 0x55c085ab3650 2023-11-27T20:54:37.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.135+0000 7f1f61d68740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c085a20b90 con 0x55c085afd4d0 2023-11-27T20:54:37.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.135+0000 7f1f61d68740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c085a1e280 con 0x55c085ab20b0 2023-11-27T20:54:37.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.135+0000 7f1f5ce9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c085afd4d0 0x55c085ab3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:37.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.135+0000 7f1f57fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c085ab20b0 0x55c085af2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:37.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.136+0000 7f1f5ce9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c085afd4d0 0x55c085ab3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:52872/0 (socket says 172.21.15.88:52872) 2023-11-27T20:54:37.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.136+0000 7f1f5ce9d640 1 -- 172.21.15.88:0/466160664 learned_addr learned my addr 172.21.15.88:0/466160664 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:37.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.138+0000 7f1f57fff640 1 -- 172.21.15.88:0/466160664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c085afd4d0 msgr2=0x55c085ab3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:37.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.138+0000 7f1f57fff640 1 --2- 172.21.15.88:0/466160664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c085afd4d0 0x55c085ab3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.138+0000 7f1f57fff640 1 -- 172.21.15.88:0/466160664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c085ab3650 msgr2=0x55c085ab3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:37.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.138+0000 7f1f57fff640 1 --2- 172.21.15.88:0/466160664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c085ab3650 0x55c085ab3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.138+0000 7f1f57fff640 1 -- 172.21.15.88:0/466160664 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0859df500 con 0x55c085ab20b0 2023-11-27T20:54:37.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.138+0000 7f1f5ce9d640 1 --2- 172.21.15.88:0/466160664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c085afd4d0 0x55c085ab3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:54:37.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.140+0000 7f1f57fff640 1 --2- 172.21.15.88:0/466160664 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c085ab20b0 0x55c085af2eb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0011e0 tx=0x7f1f4c001bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91e36be28bf47829 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:37.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.144+0000 7f1f3e7fc640 1 -- 172.21.15.88:0/466160664 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c011b30 con 0x55c085ab20b0 2023-11-27T20:54:37.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.144+0000 7f1f3e7fc640 1 -- 172.21.15.88:0/466160664 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c011c90 con 0x55c085ab20b0 2023-11-27T20:54:37.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.144+0000 7f1f3e7fc640 1 -- 172.21.15.88:0/466160664 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c0058b0 con 0x55c085ab20b0 2023-11-27T20:54:37.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.145+0000 7f1f61d68740 1 -- 172.21.15.88:0/466160664 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c085ab20b0 msgr2=0x55c085af2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:37.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.145+0000 7f1f61d68740 1 --2- 172.21.15.88:0/466160664 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c085ab20b0 0x55c085af2eb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0011e0 tx=0x7f1f4c001bf0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.145+0000 7f1f61d68740 1 -- 172.21.15.88:0/466160664 shutdown_connections 2023-11-27T20:54:37.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.145+0000 7f1f61d68740 1 --2- 172.21.15.88:0/466160664 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c085ab20b0 0x55c085af2eb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.145+0000 7f1f61d68740 1 --2- 172.21.15.88:0/466160664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c085afd4d0 0x55c085ab3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.145+0000 7f1f61d68740 1 --2- 172.21.15.88:0/466160664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c085ab3650 0x55c085ab3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.145+0000 7f1f61d68740 1 -- 172.21.15.88:0/466160664 >> 172.21.15.88:0/466160664 conn(0x55c085aafdc0 msgr2=0x55c085ab2700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:37.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.145+0000 7f1f61d68740 1 -- 172.21.15.88:0/466160664 shutdown_connections 2023-11-27T20:54:37.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.145+0000 7f1f61d68740 1 -- 172.21.15.88:0/466160664 wait complete. 2023-11-27T20:54:37.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.146+0000 7f1f61d68740 1 -- start start 2023-11-27T20:54:37.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.146+0000 7f1f61d68740 1 Processor -- start 2023-11-27T20:54:37.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.147+0000 7f1f61d68740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c085ab3650 0x55c085af54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:37.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.147+0000 7f1f61d68740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c085afd4d0 0x55c085ad25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:37.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.147+0000 7f1f61d68740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c085b077c0 0x55c085acee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:37.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.147+0000 7f1f61d68740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c085a19b70 con 0x55c085afd4d0 2023-11-27T20:54:37.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.147+0000 7f1f61d68740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0859d3e00 con 0x55c085b077c0 2023-11-27T20:54:37.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.147+0000 7f1f61d68740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c0859d3aa0 con 0x55c085ab3650 2023-11-27T20:54:37.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.148+0000 7f1f61d68740 10 client.0 _ll_register_callbacks cb 0x55c08572bac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T20:54:37.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.148+0000 7f1f57fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c085ab3650 0x55c085af54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:37.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.148+0000 7f1f57fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c085b077c0 0x55c085acee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:37.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.148+0000 7f1f57fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c085b077c0 0x55c085acee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:52886/0 (socket says 172.21.15.88:52886) 2023-11-27T20:54:37.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.148+0000 7f1f57fff640 1 -- 172.21.15.88:0/4162562083 learned_addr learned my addr 172.21.15.88:0/4162562083 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:37.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.152+0000 7f1f57fff640 1 -- 172.21.15.88:0/4162562083 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c085ab3650 msgr2=0x55c085af54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:37.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.152+0000 7f1f57fff640 1 --2- 172.21.15.88:0/4162562083 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c085ab3650 0x55c085af54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.152+0000 7f1f57fff640 1 -- 172.21.15.88:0/4162562083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c085afd4d0 msgr2=0x55c085ad25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:37.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.152+0000 7f1f57fff640 1 --2- 172.21.15.88:0/4162562083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c085afd4d0 0x55c085ad25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.152+0000 7f1f57fff640 1 -- 172.21.15.88:0/4162562083 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f40003520 con 0x55c085b077c0 2023-11-27T20:54:37.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.153+0000 7f1f557fa640 1 -- 172.21.15.88:0/696451285 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1f500052e0 con 0x7f1f58157240 2023-11-27T20:54:37.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.153+0000 7f1f557fa640 1 --2- 172.21.15.88:0/696451285 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1f4406b180 0x7f1f4406d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:37.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.153+0000 7f1f5ce9d640 1 --2- 172.21.15.88:0/696451285 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1f4406b180 0x7f1f4406d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:37.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.153+0000 7f1f5ce9d640 1 --2- 172.21.15.88:0/696451285 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1f4406b180 0x7f1f4406d640 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55c085afd8d0 tx=0x7f1f48030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:37.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.154+0000 7f1f57fff640 1 --2- 172.21.15.88:0/4162562083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c085b077c0 0x55c085acee70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c000f60 tx=0x7f1f4c00e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2acf70df06b96cac server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:37.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.154+0000 7f1f377fe640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-11-27T20:54:37.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.157+0000 7f1f557fa640 1 -- 172.21.15.88:0/696451285 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1f500580b0 con 0x7f1f58157240 2023-11-27T20:54:37.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.158+0000 7f1f377fe640 1 -- 172.21.15.88:0/4162562083 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c007290 con 0x55c085b077c0 2023-11-27T20:54:37.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.158+0000 7f1f377fe640 1 -- 172.21.15.88:0/4162562083 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1f4c0073f0 con 0x55c085b077c0 2023-11-27T20:54:37.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.158+0000 7f1f61d68740 1 -- 172.21.15.88:0/4162562083 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c085a12b50 con 0x55c085b077c0 2023-11-27T20:54:37.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.160+0000 7f1f377fe640 1 -- 172.21.15.88:0/4162562083 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f4c007ea0 con 0x55c085b077c0 2023-11-27T20:54:37.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.160+0000 7f1f61d68740 10 client.4363 fetch_fsmap learned FSMap version 7 2023-11-27T20:54:37.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.160+0000 7f1f61d68740 1 -- 172.21.15.88:0/4162562083 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55c085a181f0 con 0x55c085b077c0 2023-11-27T20:54:37.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.175+0000 7f1f377fe640 1 -- 172.21.15.88:0/4162562083 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c085a12b50 con 0x55c085b077c0 2023-11-27T20:54:37.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.175+0000 7f1f377fe640 1 -- 172.21.15.88:0/4162562083 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 7) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f1f4c0075b0 con 0x55c085b077c0 2023-11-27T20:54:37.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.175+0000 7f1f61d68740 10 client.4363 fetch_fsmap finished waiting for FSMap version 7 2023-11-27T20:54:37.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.175+0000 7f1f61d68740 10 client.4363 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-27T20:54:37.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.175+0000 7f1f61d68740 20 client.4363 populate_metadata read hostname 'smithi088' 2023-11-27T20:54:37.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.175+0000 7f1f61d68740 1 --2- 172.21.15.88:0/4162562083 >> [v2:172.21.15.88:6838/2120059880,v1:172.21.15.88:6839/2120059880] conn(0x55c085acfff0 0x55c085ad03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:37.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.175+0000 7f1f61d68740 4 client.4363 mds_command: new command op to 34205 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-27T20:54:37.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.175+0000 7f1f61d68740 1 -- 172.21.15.88:0/4162562083 --> [v2:172.21.15.88:6838/2120059880,v1:172.21.15.88:6839/2120059880] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c085a12870 con 0x55c085acfff0 2023-11-27T20:54:37.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.183+0000 7f1f57fff640 1 --2- 172.21.15.88:0/4162562083 >> [v2:172.21.15.88:6838/2120059880,v1:172.21.15.88:6839/2120059880] conn(0x55c085acfff0 0x55c085ad03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:37.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.267+0000 7f1f57fff640 1 --2- 172.21.15.88:0/4162562083 >> [v2:172.21.15.88:6838/2120059880,v1:172.21.15.88:6839/2120059880] conn(0x55c085acfff0 0x55c085ad03d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa2630e35a125efd server_cookie=f6fc67430dd0f1d9 in_seq=0 out_seq=0 2023-11-27T20:54:37.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.267+0000 7f1f377fe640 10 client.4363 ms_handle_connect on v2:172.21.15.88:6838/2120059880 2023-11-27T20:54:37.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.385+0000 7f1f377fe640 1 -- 172.21.15.88:0/4162562083 <== mds.0 v2:172.21.15.88:6838/2120059880 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c085a12870 con 0x55c085acfff0 2023-11-27T20:54:37.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.385+0000 7f1f377fe640 10 client.4363 handle_command_reply: tid=0 2023-11-27T20:54:37.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.385+0000 7f1f61d68740 1 client.4363 shutdown 2023-11-27T20:54:37.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.386+0000 7f1f61d68740 1 -- 172.21.15.88:0/4162562083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c085b077c0 msgr2=0x55c085acee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:37.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.386+0000 7f1f61d68740 1 --2- 172.21.15.88:0/4162562083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c085b077c0 0x55c085acee70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c000f60 tx=0x7f1f4c00e000 comp rx=0 tx=0).stop 2023-11-27T20:54:37.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.386+0000 7f1f61d68740 1 -- 172.21.15.88:0/4162562083 shutdown_connections 2023-11-27T20:54:37.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.386+0000 7f1f61d68740 1 --2- 172.21.15.88:0/4162562083 >> [v2:172.21.15.88:6838/2120059880,v1:172.21.15.88:6839/2120059880] conn(0x55c085acfff0 0x55c085ad03d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.386+0000 7f1f61d68740 1 --2- 172.21.15.88:0/4162562083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c085b077c0 0x55c085acee70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.386+0000 7f1f61d68740 1 --2- 172.21.15.88:0/4162562083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c085afd4d0 0x55c085ad25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.386+0000 7f1f377fe640 0 client.4363 ms_handle_reset on v2:172.21.15.88:6838/2120059880 2023-11-27T20:54:37.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.386+0000 7f1f61d68740 1 --2- 172.21.15.88:0/4162562083 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c085ab3650 0x55c085af54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.386+0000 7f1f61d68740 1 -- 172.21.15.88:0/4162562083 >> 172.21.15.88:0/4162562083 conn(0x55c085ab20b0 msgr2=0x55c085aacbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:37.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.386+0000 7f1f61d68740 1 -- 172.21.15.88:0/4162562083 shutdown_connections 2023-11-27T20:54:37.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.386+0000 7f1f61d68740 1 -- 172.21.15.88:0/4162562083 wait complete. 2023-11-27T20:54:37.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.386+0000 7f1f61d68740 20 client.4363 trim_cache size 0 max 16384 2023-11-27T20:54:37.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.407+0000 7f1f61d68740 1 Processor -- start 2023-11-27T20:54:37.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.407+0000 7f1f61d68740 1 -- start start 2023-11-27T20:54:37.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.408+0000 7f1f61d68740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c085ab3650 0x55c085acf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:37.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.408+0000 7f1f61d68740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c085afd4d0 0x55c085ab14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:37.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.408+0000 7f1f61d68740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c085b077c0 0x55c085ab1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:37.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.408+0000 7f1f61d68740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c085999270 con 0x55c085ab3650 2023-11-27T20:54:37.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.408+0000 7f1f61d68740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c085ab3df0 con 0x55c085b077c0 2023-11-27T20:54:37.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.408+0000 7f1f61d68740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c085afc330 con 0x55c085afd4d0 2023-11-27T20:54:37.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.408+0000 7f1f5d69e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c085b077c0 0x55c085ab1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:37.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.408+0000 7f1f57fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c085afd4d0 0x55c085ab14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:37.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.408+0000 7f1f5ce9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c085ab3650 0x55c085acf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:37.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.409+0000 7f1f5d69e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c085b077c0 0x55c085ab1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:52900/0 (socket says 172.21.15.88:52900) 2023-11-27T20:54:37.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.409+0000 7f1f5d69e640 1 -- 172.21.15.88:0/3420525680 learned_addr learned my addr 172.21.15.88:0/3420525680 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:37.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.411+0000 7f1f5d69e640 1 -- 172.21.15.88:0/3420525680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c085afd4d0 msgr2=0x55c085ab14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:37.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.411+0000 7f1f5d69e640 1 --2- 172.21.15.88:0/3420525680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c085afd4d0 0x55c085ab14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.411+0000 7f1f5d69e640 1 -- 172.21.15.88:0/3420525680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c085ab3650 msgr2=0x55c085acf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:37.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.411+0000 7f1f5d69e640 1 --2- 172.21.15.88:0/3420525680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c085ab3650 0x55c085acf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.411+0000 7f1f5d69e640 1 -- 172.21.15.88:0/3420525680 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0859b5d00 con 0x55c085b077c0 2023-11-27T20:54:37.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.413+0000 7f1f5d69e640 1 --2- 172.21.15.88:0/3420525680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c085b077c0 0x55c085ab1a20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1f50087ab0 tx=0x7f1f50001250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a81ace7e4f6ce40b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:37.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.417+0000 7f1f3effd640 1 -- 172.21.15.88:0/3420525680 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f500547c0 con 0x55c085b077c0 2023-11-27T20:54:37.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.417+0000 7f1f3effd640 1 -- 172.21.15.88:0/3420525680 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5005ce90 con 0x55c085b077c0 2023-11-27T20:54:37.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.417+0000 7f1f3effd640 1 -- 172.21.15.88:0/3420525680 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f50054920 con 0x55c085b077c0 2023-11-27T20:54:37.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.418+0000 7f1f61d68740 1 -- 172.21.15.88:0/3420525680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c085b077c0 msgr2=0x55c085ab1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:37.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.418+0000 7f1f61d68740 1 --2- 172.21.15.88:0/3420525680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c085b077c0 0x55c085ab1a20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1f50087ab0 tx=0x7f1f50001250 comp rx=0 tx=0).stop 2023-11-27T20:54:37.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.418+0000 7f1f61d68740 1 -- 172.21.15.88:0/3420525680 shutdown_connections 2023-11-27T20:54:37.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.418+0000 7f1f61d68740 1 --2- 172.21.15.88:0/3420525680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c085b077c0 0x55c085ab1a20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.418+0000 7f1f61d68740 1 --2- 172.21.15.88:0/3420525680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c085afd4d0 0x55c085ab14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.418+0000 7f1f61d68740 1 --2- 172.21.15.88:0/3420525680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c085ab3650 0x55c085acf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.418+0000 7f1f61d68740 1 -- 172.21.15.88:0/3420525680 >> 172.21.15.88:0/3420525680 conn(0x55c085ab20b0 msgr2=0x55c085ab2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:37.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.418+0000 7f1f61d68740 1 -- 172.21.15.88:0/3420525680 shutdown_connections 2023-11-27T20:54:37.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.418+0000 7f1f61d68740 1 -- 172.21.15.88:0/3420525680 wait complete. 2023-11-27T20:54:37.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.418+0000 7f1f61d68740 1 -- start start 2023-11-27T20:54:37.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.419+0000 7f1f61d68740 1 Processor -- start 2023-11-27T20:54:37.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.419+0000 7f1f61d68740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c085ab3650 0x55c085af4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:37.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.419+0000 7f1f61d68740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c085afd4d0 0x55c085b58eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:37.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.419+0000 7f1f61d68740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c085b077c0 0x55c085b593f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:37.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.419+0000 7f1f61d68740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c085b5f7a0 con 0x55c085ab3650 2023-11-27T20:54:37.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.419+0000 7f1f61d68740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c085ab1c80 con 0x55c085afd4d0 2023-11-27T20:54:37.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.419+0000 7f1f61d68740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c085ab3200 con 0x55c085b077c0 2023-11-27T20:54:37.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.419+0000 7f1f61d68740 10 client.0 _ll_register_callbacks cb 0x7f1f4c001370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T20:54:37.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.420+0000 7f1f57fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c085afd4d0 0x55c085b58eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:37.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.420+0000 7f1f5ce9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c085ab3650 0x55c085af4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:37.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.420+0000 7f1f5d69e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c085b077c0 0x55c085b593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:37.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.420+0000 7f1f57fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c085afd4d0 0x55c085b58eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:52908/0 (socket says 172.21.15.88:52908) 2023-11-27T20:54:37.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.420+0000 7f1f57fff640 1 -- 172.21.15.88:0/431916050 learned_addr learned my addr 172.21.15.88:0/431916050 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:37.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.423+0000 7f1f5ce9d640 1 -- 172.21.15.88:0/431916050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c085b077c0 msgr2=0x55c085b593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:37.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.423+0000 7f1f5ce9d640 1 --2- 172.21.15.88:0/431916050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c085b077c0 0x55c085b593f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.423+0000 7f1f5ce9d640 1 -- 172.21.15.88:0/431916050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c085afd4d0 msgr2=0x55c085b58eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:37.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.423+0000 7f1f5ce9d640 1 --2- 172.21.15.88:0/431916050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c085afd4d0 0x55c085b58eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.423+0000 7f1f5ce9d640 1 -- 172.21.15.88:0/431916050 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f58158480 con 0x55c085ab3650 2023-11-27T20:54:37.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.425+0000 7f1f5ce9d640 1 --2- 172.21.15.88:0/431916050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c085ab3650 0x55c085af4d30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1f4802ba30 tx=0x7f1f48004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd8d4b2d586de13 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:37.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.425+0000 7f1f377fe640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-11-27T20:54:37.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.429+0000 7f1f377fe640 1 -- 172.21.15.88:0/431916050 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4803b040 con 0x55c085ab3650 2023-11-27T20:54:37.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.429+0000 7f1f377fe640 1 -- 172.21.15.88:0/431916050 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1f48056db0 con 0x55c085ab3650 2023-11-27T20:54:37.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.429+0000 7f1f61d68740 1 -- 172.21.15.88:0/431916050 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1f4c011c90 con 0x55c085ab3650 2023-11-27T20:54:37.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.430+0000 7f1f377fe640 1 -- 172.21.15.88:0/431916050 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f48041e60 con 0x55c085ab3650 2023-11-27T20:54:37.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.430+0000 7f1f61d68740 10 client.4332 fetch_fsmap learned FSMap version 7 2023-11-27T20:54:37.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.430+0000 7f1f61d68740 1 -- 172.21.15.88:0/431916050 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55c0859db4f0 con 0x55c085ab3650 2023-11-27T20:54:37.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.439+0000 7f1f377fe640 1 -- 172.21.15.88:0/431916050 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c011c90 con 0x55c085ab3650 2023-11-27T20:54:37.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.439+0000 7f1f377fe640 1 -- 172.21.15.88:0/431916050 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 7) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f1f48049040 con 0x55c085ab3650 2023-11-27T20:54:37.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.439+0000 7f1f61d68740 10 client.4332 fetch_fsmap finished waiting for FSMap version 7 2023-11-27T20:54:37.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.439+0000 7f1f61d68740 10 client.4332 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-27T20:54:37.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.439+0000 7f1f61d68740 20 client.4332 populate_metadata read hostname 'smithi088' 2023-11-27T20:54:37.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.439+0000 7f1f61d68740 1 --2- 172.21.15.88:0/431916050 >> [v2:172.21.15.88:6838/2120059880,v1:172.21.15.88:6839/2120059880] conn(0x55c085af2e40 0x55c085af3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:37.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.439+0000 7f1f61d68740 4 client.4332 mds_command: new command op to 34205 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-27T20:54:37.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.439+0000 7f1f61d68740 1 -- 172.21.15.88:0/431916050 --> [v2:172.21.15.88:6838/2120059880,v1:172.21.15.88:6839/2120059880] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c08571a6c0 con 0x55c085af2e40 2023-11-27T20:54:37.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.440+0000 7f1f57fff640 1 --2- 172.21.15.88:0/431916050 >> [v2:172.21.15.88:6838/2120059880,v1:172.21.15.88:6839/2120059880] conn(0x55c085af2e40 0x55c085af3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:37.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.442+0000 7f1f57fff640 1 --2- 172.21.15.88:0/431916050 >> [v2:172.21.15.88:6838/2120059880,v1:172.21.15.88:6839/2120059880] conn(0x55c085af2e40 0x55c085af3220 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad5a5ec75aa48a1 server_cookie=f0cb7a46ba673502 in_seq=0 out_seq=0 2023-11-27T20:54:37.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.442+0000 7f1f377fe640 10 client.4332 ms_handle_connect on v2:172.21.15.88:6838/2120059880 2023-11-27T20:54:37.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.459+0000 7f1f377fe640 1 -- 172.21.15.88:0/431916050 <== mds.0 v2:172.21.15.88:6838/2120059880 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55c08571a6c0 con 0x55c085af2e40 2023-11-27T20:54:37.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.459+0000 7f1f377fe640 10 client.4332 handle_command_reply: tid=0 2023-11-27T20:54:37.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.459+0000 7f1f61d68740 1 client.4332 shutdown 2023-11-27T20:54:37.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.459+0000 7f1f61d68740 1 -- 172.21.15.88:0/431916050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c085ab3650 msgr2=0x55c085af4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:37.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.459+0000 7f1f61d68740 1 --2- 172.21.15.88:0/431916050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c085ab3650 0x55c085af4d30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1f4802ba30 tx=0x7f1f48004730 comp rx=0 tx=0).stop 2023-11-27T20:54:37.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.459+0000 7f1f61d68740 1 -- 172.21.15.88:0/431916050 shutdown_connections 2023-11-27T20:54:37.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.459+0000 7f1f61d68740 1 --2- 172.21.15.88:0/431916050 >> [v2:172.21.15.88:6838/2120059880,v1:172.21.15.88:6839/2120059880] conn(0x55c085af2e40 0x55c085af3220 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.459+0000 7f1f61d68740 1 --2- 172.21.15.88:0/431916050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c085b077c0 0x55c085b593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.459+0000 7f1f61d68740 1 --2- 172.21.15.88:0/431916050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c085afd4d0 0x55c085b58eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.459+0000 7f1f61d68740 1 --2- 172.21.15.88:0/431916050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c085ab3650 0x55c085af4d30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.459+0000 7f1f377fe640 0 client.4332 ms_handle_reset on v2:172.21.15.88:6838/2120059880 2023-11-27T20:54:37.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.459+0000 7f1f61d68740 1 -- 172.21.15.88:0/431916050 >> 172.21.15.88:0/431916050 conn(0x55c085ab20b0 msgr2=0x55c085ab2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:37.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.460+0000 7f1f61d68740 1 -- 172.21.15.88:0/431916050 shutdown_connections 2023-11-27T20:54:37.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.460+0000 7f1f61d68740 1 -- 172.21.15.88:0/431916050 wait complete. 2023-11-27T20:54:37.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.460+0000 7f1f61d68740 20 client.4332 trim_cache size 0 max 16384 2023-11-27T20:54:37.463 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-27T20:54:37.463 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_fsid": "ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc", 2023-11-27T20:54:37.463 INFO:teuthology.orchestra.run.smithi088.stdout: "whoami": 0, 2023-11-27T20:54:37.463 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 34205, 2023-11-27T20:54:37.464 INFO:teuthology.orchestra.run.smithi088.stdout: "want_state": "up:active", 2023-11-27T20:54:37.464 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "up:active", 2023-11-27T20:54:37.464 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs", 2023-11-27T20:54:37.464 INFO:teuthology.orchestra.run.smithi088.stdout: "rank_uptime": 9.7517490949999992, 2023-11-27T20:54:37.464 INFO:teuthology.orchestra.run.smithi088.stdout: "mdsmap_epoch": 7, 2023-11-27T20:54:37.464 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch": 26, 2023-11-27T20:54:37.464 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch_barrier": 26, 2023-11-27T20:54:37.464 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 22.192968180000001 2023-11-27T20:54:37.464 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-27T20:54:37.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.460+0000 7f1f5f101640 1 -- 172.21.15.88:0/696451285 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1f4406b180 msgr2=0x7f1f4406d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:37.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.460+0000 7f1f5f101640 1 --2- 172.21.15.88:0/696451285 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1f4406b180 0x7f1f4406d640 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55c085afd8d0 tx=0x7f1f48030000 comp rx=0 tx=0).stop 2023-11-27T20:54:37.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.460+0000 7f1f5f101640 1 -- 172.21.15.88:0/696451285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f58157240 msgr2=0x7f1f5815ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:37.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.460+0000 7f1f5f101640 1 --2- 172.21.15.88:0/696451285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f58157240 0x7f1f5815ad00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1f5000c730 tx=0x7f1f5000cbf0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.460+0000 7f1f5f101640 1 -- 172.21.15.88:0/696451285 shutdown_connections 2023-11-27T20:54:37.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.460+0000 7f1f5f101640 1 --2- 172.21.15.88:0/696451285 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1f4406b180 0x7f1f4406d640 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.460+0000 7f1f5f101640 1 --2- 172.21.15.88:0/696451285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f58157240 0x7f1f5815ad00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.460+0000 7f1f5f101640 1 --2- 172.21.15.88:0/696451285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f58151220 0x7f1f58159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.460+0000 7f1f5f101640 1 --2- 172.21.15.88:0/696451285 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f580710c0 0x7f1f581f0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.460+0000 7f1f5f101640 1 -- 172.21.15.88:0/696451285 >> 172.21.15.88:0/696451285 conn(0x7f1f5806c5f0 msgr2=0x7f1f5814f900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:37.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.460+0000 7f1f5f101640 1 -- 172.21.15.88:0/696451285 shutdown_connections 2023-11-27T20:54:37.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.460+0000 7f1f5f101640 1 -- 172.21.15.88:0/696451285 wait complete. 2023-11-27T20:54:37.472 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-27T20:54:37.473 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-27T20:54:37.473 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T20:54:37.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.572+0000 7f5d64687640 1 Processor -- start 2023-11-27T20:54:37.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.572+0000 7f5d64687640 1 -- start start 2023-11-27T20:54:37.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.573+0000 7f5d64687640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5d5c0c7640 0x7f5d5c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:37.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.573+0000 7f5d64687640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d5c0c2600 0x7f5d5c158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:37.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.573+0000 7f5d64687640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d5c1573c0 con 0x7f5d5c151260 2023-11-27T20:54:37.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.573+0000 7f5d64687640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d5c1571d0 con 0x7f5d5c0c7640 2023-11-27T20:54:37.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.573+0000 7f5d64687640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c1576a0 con 0x7f5d5c0c2600 2023-11-27T20:54:37.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.573+0000 7f5d62c24640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d5c0c2600 0x7f5d5c158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:37.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.574+0000 7f5d61c22640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5d5c0c7640 0x7f5d5c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:37.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.574+0000 7f5d62423640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f5d5c151260 0x7f5d5c0ccf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:48158/0 (socket says 172.21.15.88:48158) 2023-11-27T20:54:37.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.574+0000 7f5d62423640 1 -- 172.21.15.88:0/2250722193 learned_addr learned my addr 172.21.15.88:0/2250722193 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:54:37.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.576+0000 7f5d62c24640 1 -- 172.21.15.88:0/2250722193 >> v2:172.21.15.167:3300/0 conn(0x7f5d5c0c7640 msgr2=0x7f5d5c06f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:37.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.576+0000 7f5d62c24640 1 --2- 172.21.15.88:0/2250722193 >> v2:172.21.15.167:3300/0 conn(0x7f5d5c0c7640 0x7f5d5c06f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.576+0000 7f5d62c24640 1 -- 172.21.15.88:0/2250722193 >> v1:172.21.15.167:6789/0 conn(0x7f5d5c151260 legacy=0x7f5d5c0ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:37.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.576+0000 7f5d62c24640 1 -- 172.21.15.88:0/2250722193 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5c157980 con 0x7f5d5c0c2600 2023-11-27T20:54:37.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.578+0000 7f5d62c24640 1 --2- 172.21.15.88:0/2250722193 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d5c0c2600 0x7f5d5c158aa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009d90 tx=0x7f5d5402bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b5560fa574ffeaa server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:37.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.582+0000 7f5d61421640 1 -- 172.21.15.88:0/2250722193 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5402cce0 con 0x7f5d5c0c2600 2023-11-27T20:54:37.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.583+0000 7f5d61421640 1 -- 172.21.15.88:0/2250722193 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5402ce40 con 0x7f5d5c0c2600 2023-11-27T20:54:37.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.583+0000 7f5d61421640 1 -- 172.21.15.88:0/2250722193 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d54034660 con 0x7f5d5c0c2600 2023-11-27T20:54:37.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.583+0000 7f5d64687640 1 -- 172.21.15.88:0/2250722193 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d5c0c2600 msgr2=0x7f5d5c158aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:37.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.583+0000 7f5d64687640 1 --2- 172.21.15.88:0/2250722193 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d5c0c2600 0x7f5d5c158aa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009d90 tx=0x7f5d5402bf30 comp rx=0 tx=0).stop 2023-11-27T20:54:37.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.583+0000 7f5d64687640 1 -- 172.21.15.88:0/2250722193 shutdown_connections 2023-11-27T20:54:37.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.583+0000 7f5d64687640 1 --2- 172.21.15.88:0/2250722193 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d5c0c2600 0x7f5d5c158aa0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.583+0000 7f5d64687640 1 --2- 172.21.15.88:0/2250722193 >> v2:172.21.15.167:3300/0 conn(0x7f5d5c0c7640 0x7f5d5c06f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.583+0000 7f5d64687640 1 -- 172.21.15.88:0/2250722193 >> 172.21.15.88:0/2250722193 conn(0x7f5d5c070990 msgr2=0x7f5d5c070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:37.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.583+0000 7f5d64687640 1 -- 172.21.15.88:0/2250722193 shutdown_connections 2023-11-27T20:54:37.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.583+0000 7f5d64687640 1 -- 172.21.15.88:0/2250722193 wait complete. 2023-11-27T20:54:37.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.584+0000 7f5d64687640 1 Processor -- start 2023-11-27T20:54:37.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.584+0000 7f5d64687640 1 -- start start 2023-11-27T20:54:37.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.585+0000 7f5d64687640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d5c0c2600 0x7f5d5c06cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:37.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.585+0000 7f5d64687640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d5c0c7640 0x7f5d5c06b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:37.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.585+0000 7f5d64687640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d5c151260 0x7f5d5c0b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:37.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.585+0000 7f5d64687640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c14de70 con 0x7f5d5c151260 2023-11-27T20:54:37.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.585+0000 7f5d64687640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c0cc9a0 con 0x7f5d5c0c2600 2023-11-27T20:54:37.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.585+0000 7f5d64687640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c14e3f0 con 0x7f5d5c0c7640 2023-11-27T20:54:37.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.586+0000 7f5d62c24640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d5c151260 0x7f5d5c0b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:37.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.586+0000 7f5d61c22640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d5c0c7640 0x7f5d5c06b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:37.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.586+0000 7f5d62423640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d5c0c2600 0x7f5d5c06cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:37.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.586+0000 7f5d62c24640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d5c151260 0x7f5d5c0b06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60248/0 (socket says 172.21.15.88:60248) 2023-11-27T20:54:37.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.586+0000 7f5d62c24640 1 -- 172.21.15.88:0/3320999276 learned_addr learned my addr 172.21.15.88:0/3320999276 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:37.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.589+0000 7f5d62c24640 1 -- 172.21.15.88:0/3320999276 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d5c0c7640 msgr2=0x7f5d5c06b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:37.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.589+0000 7f5d62c24640 1 --2- 172.21.15.88:0/3320999276 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d5c0c7640 0x7f5d5c06b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.589+0000 7f5d62c24640 1 -- 172.21.15.88:0/3320999276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d5c0c2600 msgr2=0x7f5d5c06cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:37.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.589+0000 7f5d62c24640 1 --2- 172.21.15.88:0/3320999276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d5c0c2600 0x7f5d5c06cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:37.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.589+0000 7f5d62c24640 1 -- 172.21.15.88:0/3320999276 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d54009a70 con 0x7f5d5c151260 2023-11-27T20:54:37.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.591+0000 7f5d62c24640 1 --2- 172.21.15.88:0/3320999276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d5c151260 0x7f5d5c0b06e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009eb0 tx=0x7f5d54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:37.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.595+0000 7f5d52ffd640 1 -- 172.21.15.88:0/3320999276 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5403e610 con 0x7f5d5c151260 2023-11-27T20:54:37.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.595+0000 7f5d52ffd640 1 -- 172.21.15.88:0/3320999276 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5403e770 con 0x7f5d5c151260 2023-11-27T20:54:37.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.595+0000 7f5d52ffd640 1 -- 172.21.15.88:0/3320999276 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5403eb00 con 0x7f5d5c151260 2023-11-27T20:54:37.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.595+0000 7f5d64687640 1 -- 172.21.15.88:0/3320999276 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d5c0cc740 con 0x7f5d5c151260 2023-11-27T20:54:37.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.595+0000 7f5d64687640 1 -- 172.21.15.88:0/3320999276 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d5c14ccf0 con 0x7f5d5c151260 2023-11-27T20:54:37.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.596+0000 7f5d64687640 1 -- 172.21.15.88:0/3320999276 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d5c0c3210 con 0x7f5d5c151260 2023-11-27T20:54:37.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.614+0000 7f5d52ffd640 1 -- 172.21.15.88:0/3320999276 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5d5403b050 con 0x7f5d5c151260 2023-11-27T20:54:37.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.614+0000 7f5d52ffd640 1 --2- 172.21.15.88:0/3320999276 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5d4006b210 0x7f5d4006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:37.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.615+0000 7f5d62423640 1 --2- 172.21.15.88:0/3320999276 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5d4006b210 0x7f5d4006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:37.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.615+0000 7f5d62423640 1 --2- 172.21.15.88:0/3320999276 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5d4006b210 0x7f5d4006d6d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5d58007fd0 tx=0x7f5d58007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:37.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.849+0000 7f5d52ffd640 1 -- 172.21.15.88:0/3320999276 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5d5407acd0 con 0x7f5d5c151260 2023-11-27T20:54:37.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:37.849+0000 7f5d52ffd640 1 -- 172.21.15.88:0/3320999276 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5d54077010 con 0x7f5d5c151260 2023-11-27T20:54:38.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:38.064+0000 7f5d64687640 1 -- 172.21.15.88:0/3320999276 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5d5c067470 con 0x7f5d5c151260 2023-11-27T20:54:38.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:38.070+0000 7f5d52ffd640 1 -- 172.21.15.88:0/3320999276 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f5d5404e020 con 0x7f5d5c151260 2023-11-27T20:54:38.072 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-27T20:54:38.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:38.072+0000 7f5d64687640 1 -- 172.21.15.88:0/3320999276 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5d4006b210 msgr2=0x7f5d4006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:38.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:38.072+0000 7f5d64687640 1 --2- 172.21.15.88:0/3320999276 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5d4006b210 0x7f5d4006d6d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5d58007fd0 tx=0x7f5d58007e80 comp rx=0 tx=0).stop 2023-11-27T20:54:38.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:38.072+0000 7f5d64687640 1 -- 172.21.15.88:0/3320999276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d5c151260 msgr2=0x7f5d5c0b06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:38.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:38.072+0000 7f5d64687640 1 --2- 172.21.15.88:0/3320999276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d5c151260 0x7f5d5c0b06e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009eb0 tx=0x7f5d54004a40 comp rx=0 tx=0).stop 2023-11-27T20:54:38.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:38.072+0000 7f5d64687640 1 -- 172.21.15.88:0/3320999276 shutdown_connections 2023-11-27T20:54:38.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:38.072+0000 7f5d64687640 1 --2- 172.21.15.88:0/3320999276 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5d4006b210 0x7f5d4006d6d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:38.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:38.072+0000 7f5d64687640 1 --2- 172.21.15.88:0/3320999276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d5c151260 0x7f5d5c0b06e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:38.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:38.072+0000 7f5d64687640 1 --2- 172.21.15.88:0/3320999276 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d5c0c7640 0x7f5d5c06b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:38.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:38.072+0000 7f5d64687640 1 --2- 172.21.15.88:0/3320999276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d5c0c2600 0x7f5d5c06cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:38.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:38.072+0000 7f5d64687640 1 -- 172.21.15.88:0/3320999276 >> 172.21.15.88:0/3320999276 conn(0x7f5d5c070990 msgr2=0x7f5d5c073530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:38.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:38.072+0000 7f5d64687640 1 -- 172.21.15.88:0/3320999276 shutdown_connections 2023-11-27T20:54:38.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:38.072+0000 7f5d64687640 1 -- 172.21.15.88:0/3320999276 wait complete. 2023-11-27T20:54:38.084 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-27T20:54:38.084 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T20:54:38.084 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2023-11-27T20:54:38.084 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-11-27T20:54:38.084 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-27T20:54:38.084 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-27T20:54:38.084 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-27T20:54:38.085 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-27T20:54:38.085 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-11-27T20:54:38.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:54:38.085 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2023-11-27T20:54:38.100 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T20:54:38.100 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T20:54:38.100 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T20:54:38.100 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:54:38.101 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-11-27T20:54:38.101 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:54:38.101 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:54:38.101 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:54:38.101 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2023-11-27T20:54:38.101 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:54:38.101 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:54:38.102 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2023-11-27T20:54:38.102 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:54:38.102 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2023-11-27T20:54:38.102 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T20:54:38.102 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2023-11-27T20:54:38.102 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-27T20:54:38.102 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42281sec preferred_lft 42281sec 2023-11-27T20:54:38.102 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2023-11-27T20:54:38.102 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:54:38.103 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-27T20:54:38.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:54:38.103 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-11-27T20:54:38.103 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-11-27T20:54:38.103 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add name ceph-brx type bridge 2023-11-27T20:54:38.103 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr flush dev ceph-brx 2023-11-27T20:54:38.103 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set ceph-brx up 2023-11-27T20:54:38.104 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-27T20:54:38.104 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-11-27T20:54:38.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:54:38.263 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T20:54:38.290 INFO:teuthology.orchestra.run.smithi088.stdout:1 2023-11-27T20:54:38.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:54:38.292 DEBUG:teuthology.orchestra.run.smithi088:> route 2023-11-27T20:54:38.364 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2023-11-27T20:54:38.364 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T20:54:38.364 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T20:54:38.364 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T20:54:38.364 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T20:54:38.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:54:38.365 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-11-27T20:54:38.365 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-11-27T20:54:38.365 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T20:54:38.365 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T20:54:38.365 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T20:54:38.365 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-11-27T20:54:38.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:54:38.625 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-11-27T20:54:38.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:54:38.640 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list-id 2023-11-27T20:54:38.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:54:38.695 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-11-27T20:54:38.695 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-11-27T20:54:38.695 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-27T20:54:38.695 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-11-27T20:54:38.695 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-11-27T20:54:38.779 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-11-27T20:54:38.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:54:38.780 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-11-27T20:54:38.780 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-11-27T20:54:38.780 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-11-27T20:54:38.780 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-27T20:54:38.780 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-11-27T20:54:38.780 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-11-27T20:54:38.780 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-11-27T20:54:38.781 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-11-27T20:54:38.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:54:38.920 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-11-27T20:54:38.920 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-11-27T20:54:38.920 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2023-11-27T20:54:38.921 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set dev brx.0 master ceph-brx 2023-11-27T20:54:38.921 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-11-27T20:54:38.962 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-11-27T20:54:38.962 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:54:38.962 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-11-27T20:54:39.021 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-11-27T20:54:39.021 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:54:39.021 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-11-27T20:54:39.076 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-11-27T20:54:39.144 DEBUG:teuthology.orchestra.run.smithi088:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T20:54:39.199 INFO:teuthology.orchestra.run.smithi088.stdout:/proc 2023-11-27T20:54:39.200 INFO:teuthology.orchestra.run.smithi088.stdout:/sys 2023-11-27T20:54:39.200 INFO:teuthology.orchestra.run.smithi088.stdout:/dev 2023-11-27T20:54:39.200 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/security 2023-11-27T20:54:39.200 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/shm 2023-11-27T20:54:39.200 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/pts 2023-11-27T20:54:39.200 INFO:teuthology.orchestra.run.smithi088.stdout:/run 2023-11-27T20:54:39.200 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/cgroup 2023-11-27T20:54:39.200 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/pstore 2023-11-27T20:54:39.200 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/bpf 2023-11-27T20:54:39.200 INFO:teuthology.orchestra.run.smithi088.stdout:/ 2023-11-27T20:54:39.201 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/selinux 2023-11-27T20:54:39.201 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T20:54:39.201 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/hugepages 2023-11-27T20:54:39.201 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/mqueue 2023-11-27T20:54:39.201 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/debug 2023-11-27T20:54:39.201 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/tracing 2023-11-27T20:54:39.201 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-27T20:54:39.201 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/fuse/connections 2023-11-27T20:54:39.201 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-sysctl.service 2023-11-27T20:54:39.201 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/config 2023-11-27T20:54:39.201 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-27T20:54:39.201 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/nfs/rpc_pipefs 2023-11-27T20:54:39.202 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/1000 2023-11-27T20:54:39.202 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph 2023-11-27T20:54:39.202 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T20:54:39.202 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T20:54:39.202 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T20:54:39.202 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T20:54:39.202 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns 2023-11-27T20:54:39.202 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-27T20:54:39.202 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-27T20:54:39.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:54:39.203 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-11-27T20:54:39.255 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-27T20:54:39.255 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-11-27T20:54:39.297 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-11-27T20:54:39.324 DEBUG:teuthology.orchestra.run.smithi088:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T20:54:39.379 INFO:teuthology.orchestra.run.smithi088.stdout:/proc 2023-11-27T20:54:39.379 INFO:teuthology.orchestra.run.smithi088.stdout:/sys 2023-11-27T20:54:39.379 INFO:teuthology.orchestra.run.smithi088.stdout:/dev 2023-11-27T20:54:39.379 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/security 2023-11-27T20:54:39.379 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/shm 2023-11-27T20:54:39.379 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/pts 2023-11-27T20:54:39.380 INFO:teuthology.orchestra.run.smithi088.stdout:/run 2023-11-27T20:54:39.380 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/cgroup 2023-11-27T20:54:39.380 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/pstore 2023-11-27T20:54:39.380 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/bpf 2023-11-27T20:54:39.380 INFO:teuthology.orchestra.run.smithi088.stdout:/ 2023-11-27T20:54:39.380 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/selinux 2023-11-27T20:54:39.380 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T20:54:39.380 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/hugepages 2023-11-27T20:54:39.380 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/mqueue 2023-11-27T20:54:39.380 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/debug 2023-11-27T20:54:39.380 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/tracing 2023-11-27T20:54:39.381 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-27T20:54:39.381 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/fuse/connections 2023-11-27T20:54:39.381 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-sysctl.service 2023-11-27T20:54:39.381 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/config 2023-11-27T20:54:39.381 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-27T20:54:39.381 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/nfs/rpc_pipefs 2023-11-27T20:54:39.381 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/1000 2023-11-27T20:54:39.381 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph 2023-11-27T20:54:39.381 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T20:54:39.381 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T20:54:39.381 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T20:54:39.381 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T20:54:39.382 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns 2023-11-27T20:54:39.382 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-27T20:54:39.382 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-27T20:54:39.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:54:39.382 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-11-27T20:54:39.451 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi088.stderr:2023-11-27T20:54:39.450+0000 7fb1aba43480 -1 init, newargv = 0x5621ca7a02d0 newargc=15 2023-11-27T20:54:39.452 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi088.stderr:ceph-fuse[96057]: starting ceph client 2023-11-27T20:54:39.761 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi088.stderr:ceph-fuse[96057]: starting fuse 2023-11-27T20:54:40.770 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-11-27T20:54:40.799 DEBUG:teuthology.orchestra.run.smithi088:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T20:54:40.854 INFO:teuthology.orchestra.run.smithi088.stdout:/proc 2023-11-27T20:54:40.855 INFO:teuthology.orchestra.run.smithi088.stdout:/sys 2023-11-27T20:54:40.855 INFO:teuthology.orchestra.run.smithi088.stdout:/dev 2023-11-27T20:54:40.855 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/security 2023-11-27T20:54:40.855 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/shm 2023-11-27T20:54:40.855 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/pts 2023-11-27T20:54:40.855 INFO:teuthology.orchestra.run.smithi088.stdout:/run 2023-11-27T20:54:40.855 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/cgroup 2023-11-27T20:54:40.855 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/pstore 2023-11-27T20:54:40.855 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/bpf 2023-11-27T20:54:40.855 INFO:teuthology.orchestra.run.smithi088.stdout:/ 2023-11-27T20:54:40.856 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/selinux 2023-11-27T20:54:40.856 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T20:54:40.856 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/hugepages 2023-11-27T20:54:40.856 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/mqueue 2023-11-27T20:54:40.856 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/debug 2023-11-27T20:54:40.856 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/tracing 2023-11-27T20:54:40.856 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-27T20:54:40.856 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/fuse/connections 2023-11-27T20:54:40.856 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-sysctl.service 2023-11-27T20:54:40.856 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/config 2023-11-27T20:54:40.856 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-27T20:54:40.856 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/nfs/rpc_pipefs 2023-11-27T20:54:40.857 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/1000 2023-11-27T20:54:40.857 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph 2023-11-27T20:54:40.857 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T20:54:40.857 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T20:54:40.857 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T20:54:40.857 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T20:54:40.857 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns 2023-11-27T20:54:40.857 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-27T20:54:40.857 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-27T20:54:40.857 INFO:teuthology.orchestra.run.smithi088.stdout:/home/ubuntu/cephtest/mnt.admin 2023-11-27T20:54:40.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:54:40.858 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-11-27T20:54:40.910 INFO:teuthology.orchestra.run.smithi088.stdout:41 2023-11-27T20:54:40.911 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-27T20:54:40.911 DEBUG:teuthology.orchestra.run.smithi088:> sudo stdin-killer -- python3 -c ' 2023-11-27T20:54:40.911 DEBUG:teuthology.orchestra.run.smithi088:> import glob 2023-11-27T20:54:40.911 DEBUG:teuthology.orchestra.run.smithi088:> import re 2023-11-27T20:54:40.911 DEBUG:teuthology.orchestra.run.smithi088:> import os 2023-11-27T20:54:40.911 DEBUG:teuthology.orchestra.run.smithi088:> import subprocess 2023-11-27T20:54:40.911 DEBUG:teuthology.orchestra.run.smithi088:> 2023-11-27T20:54:40.912 DEBUG:teuthology.orchestra.run.smithi088:> def _find_admin_socket(client_name): 2023-11-27T20:54:40.912 DEBUG:teuthology.orchestra.run.smithi088:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-11-27T20:54:40.912 DEBUG:teuthology.orchestra.run.smithi088:> files = glob.glob(asok_path) 2023-11-27T20:54:40.912 DEBUG:teuthology.orchestra.run.smithi088:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-11-27T20:54:40.912 DEBUG:teuthology.orchestra.run.smithi088:> 2023-11-27T20:54:40.912 DEBUG:teuthology.orchestra.run.smithi088:> # Given a non-glob path, it better be there 2023-11-27T20:54:40.912 DEBUG:teuthology.orchestra.run.smithi088:> if "*" not in asok_path: 2023-11-27T20:54:40.912 DEBUG:teuthology.orchestra.run.smithi088:> assert(len(files) == 1) 2023-11-27T20:54:40.912 DEBUG:teuthology.orchestra.run.smithi088:> return files[0] 2023-11-27T20:54:40.912 DEBUG:teuthology.orchestra.run.smithi088:> 2023-11-27T20:54:40.912 DEBUG:teuthology.orchestra.run.smithi088:> for f in files: 2023-11-27T20:54:40.912 DEBUG:teuthology.orchestra.run.smithi088:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-27T20:54:40.913 DEBUG:teuthology.orchestra.run.smithi088:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-27T20:54:40.913 DEBUG:teuthology.orchestra.run.smithi088:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-27T20:54:40.913 DEBUG:teuthology.orchestra.run.smithi088:> contents = proc_f.read() 2023-11-27T20:54:40.913 DEBUG:teuthology.orchestra.run.smithi088:> if mountpoint in contents: 2023-11-27T20:54:40.913 DEBUG:teuthology.orchestra.run.smithi088:> return f 2023-11-27T20:54:40.913 DEBUG:teuthology.orchestra.run.smithi088:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-27T20:54:40.913 DEBUG:teuthology.orchestra.run.smithi088:> 2023-11-27T20:54:40.913 DEBUG:teuthology.orchestra.run.smithi088:> print(_find_admin_socket("client.admin")) 2023-11-27T20:54:40.913 DEBUG:teuthology.orchestra.run.smithi088:> ' 2023-11-27T20:54:41.031 INFO:teuthology.orchestra.run.smithi088.stdout:/var/run/ceph/ceph-client.admin.96057.asok 2023-11-27T20:54:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-27T20:54:41.041 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.96057.asok 2023-11-27T20:54:41.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:54:41.041 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.96057.asok status 2023-11-27T20:54:41.176 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-27T20:54:41.176 INFO:teuthology.orchestra.run.smithi088.stdout: "metadata": { 2023-11-27T20:54:41.176 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_sha1": "369173db14b6995b2bd07c60ec5f63d01cf21631", 2023-11-27T20:54:41.176 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_version": "ceph version 18.0.0-7498-g369173db (369173db14b6995b2bd07c60ec5f63d01cf21631) squid (dev)", 2023-11-27T20:54:41.176 INFO:teuthology.orchestra.run.smithi088.stdout: "entity_id": "admin", 2023-11-27T20:54:41.177 INFO:teuthology.orchestra.run.smithi088.stdout: "hostname": "smithi088", 2023-11-27T20:54:41.177 INFO:teuthology.orchestra.run.smithi088.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-11-27T20:54:41.177 INFO:teuthology.orchestra.run.smithi088.stdout: "pid": "96057", 2023-11-27T20:54:41.177 INFO:teuthology.orchestra.run.smithi088.stdout: "root": "/" 2023-11-27T20:54:41.177 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-27T20:54:41.177 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_count": 0, 2023-11-27T20:54:41.177 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_pinned_count": 0, 2023-11-27T20:54:41.178 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4341, 2023-11-27T20:54:41.178 INFO:teuthology.orchestra.run.smithi088.stdout: "inst": { 2023-11-27T20:54:41.178 INFO:teuthology.orchestra.run.smithi088.stdout: "name": { 2023-11-27T20:54:41.178 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "client", 2023-11-27T20:54:41.178 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4341 2023-11-27T20:54:41.178 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-27T20:54:41.178 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2023-11-27T20:54:41.178 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-11-27T20:54:41.179 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "192.168.0.1:0", 2023-11-27T20:54:41.179 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 2409825445 2023-11-27T20:54:41.179 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-27T20:54:41.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-27T20:54:41.179 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2023-11-27T20:54:41.179 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-11-27T20:54:41.179 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "192.168.0.1:0", 2023-11-27T20:54:41.179 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 2409825445 2023-11-27T20:54:41.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-27T20:54:41.180 INFO:teuthology.orchestra.run.smithi088.stdout: "inst_str": "client.4341 192.168.0.1:0/2409825445", 2023-11-27T20:54:41.180 INFO:teuthology.orchestra.run.smithi088.stdout: "addr_str": "192.168.0.1:0/2409825445", 2023-11-27T20:54:41.180 INFO:teuthology.orchestra.run.smithi088.stdout: "inode_count": 1, 2023-11-27T20:54:41.180 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_epoch": 7, 2023-11-27T20:54:41.180 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch": 26, 2023-11-27T20:54:41.180 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch_barrier": 0, 2023-11-27T20:54:41.180 INFO:teuthology.orchestra.run.smithi088.stdout: "blocklisted": false, 2023-11-27T20:54:41.180 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs" 2023-11-27T20:54:41.180 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-27T20:54:41.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:54:41.184 DEBUG:teuthology.orchestra.run.smithi088:> stat --file-system '--printf=%T 2023-11-27T20:54:41.185 DEBUG:teuthology.orchestra.run.smithi088:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-11-27T20:54:41.210 INFO:teuthology.orchestra.run.smithi088.stdout:fuseblk 2023-11-27T20:54:41.210 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-11-27T20:54:41.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:54:41.210 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-11-27T20:54:41.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:54:41.351 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-11-27T20:54:41.555 INFO:teuthology.orchestra.run.smithi088.stdout:# file: . 2023-11-27T20:54:41.555 INFO:teuthology.orchestra.run.smithi088.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-11-27T20:54:41.555 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:54:41.555 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:54:41.555 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:54:41.571 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:54:41.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.709+0000 7f502c5be640 1 Processor -- start 2023-11-27T20:54:41.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.709+0000 7f502c5be640 1 -- start start 2023-11-27T20:54:41.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.710+0000 7f502c5be640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5024150530 0x7f50240c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:41.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.710+0000 7f502c5be640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f50240c7180 0x7f50240c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:41.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.710+0000 7f502c5be640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f50240c4a10 0x7f50241596e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:41.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.710+0000 7f502c5be640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5024150910 con 0x7f50240c4a10 2023-11-27T20:54:41.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.710+0000 7f502c5be640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50240c1ec0 con 0x7f50240c7180 2023-11-27T20:54:41.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.710+0000 7f502c5be640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502415a4e0 con 0x7f5024150530 2023-11-27T20:54:41.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.711+0000 7f502ab5b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f50240c4a10 0x7f50241596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:41.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.711+0000 7f5029b59640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f50240c7180 0x7f50240c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:41.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.711+0000 7f502ab5b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f50240c4a10 0x7f50241596e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59850/0 (socket says 172.21.15.88:59850) 2023-11-27T20:54:41.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.711+0000 7f502ab5b640 1 -- 172.21.15.88:0/2915979263 learned_addr learned my addr 172.21.15.88:0/2915979263 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:41.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.711+0000 7f502a35a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5024150530 0x7f50240c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:41.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.713+0000 7f502ab5b640 1 -- 172.21.15.88:0/2915979263 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5024150530 msgr2=0x7f50240c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:41.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.713+0000 7f502ab5b640 1 --2- 172.21.15.88:0/2915979263 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5024150530 0x7f50240c6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:41.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.713+0000 7f502ab5b640 1 -- 172.21.15.88:0/2915979263 >> v2:172.21.15.167:3300/0 conn(0x7f50240c7180 msgr2=0x7f50240c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:41.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.713+0000 7f502ab5b640 1 --2- 172.21.15.88:0/2915979263 >> v2:172.21.15.167:3300/0 conn(0x7f50240c7180 0x7f50240c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:41.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.713+0000 7f502ab5b640 1 -- 172.21.15.88:0/2915979263 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50240c2110 con 0x7f50240c4a10 2023-11-27T20:54:41.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.715+0000 7f502ab5b640 1 --2- 172.21.15.88:0/2915979263 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50240c4a10 0x7f50241596e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f502406f7d0 tx=0x7f501c02e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=114daf37411e5ff2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:41.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.718+0000 7f5029358640 1 -- 172.21.15.88:0/2915979263 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c00b0d0 con 0x7f50240c4a10 2023-11-27T20:54:41.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.719+0000 7f5029358640 1 -- 172.21.15.88:0/2915979263 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501c00b230 con 0x7f50240c4a10 2023-11-27T20:54:41.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.719+0000 7f5029358640 1 -- 172.21.15.88:0/2915979263 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c009600 con 0x7f50240c4a10 2023-11-27T20:54:41.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.719+0000 7f502c5be640 1 -- 172.21.15.88:0/2915979263 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50240c4a10 msgr2=0x7f50241596e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:41.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.719+0000 7f502c5be640 1 --2- 172.21.15.88:0/2915979263 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50240c4a10 0x7f50241596e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f502406f7d0 tx=0x7f501c02e170 comp rx=0 tx=0).stop 2023-11-27T20:54:41.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.719+0000 7f502c5be640 1 -- 172.21.15.88:0/2915979263 shutdown_connections 2023-11-27T20:54:41.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.719+0000 7f502c5be640 1 --2- 172.21.15.88:0/2915979263 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50240c4a10 0x7f50241596e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:41.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.719+0000 7f502c5be640 1 --2- 172.21.15.88:0/2915979263 >> v2:172.21.15.167:3300/0 conn(0x7f50240c7180 0x7f50240c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:41.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.719+0000 7f502c5be640 1 --2- 172.21.15.88:0/2915979263 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5024150530 0x7f50240c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:41.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.719+0000 7f502c5be640 1 -- 172.21.15.88:0/2915979263 >> 172.21.15.88:0/2915979263 conn(0x7f502406c5f0 msgr2=0x7f502406c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:41.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.719+0000 7f502c5be640 1 -- 172.21.15.88:0/2915979263 shutdown_connections 2023-11-27T20:54:41.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.719+0000 7f502c5be640 1 -- 172.21.15.88:0/2915979263 wait complete. 2023-11-27T20:54:41.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.720+0000 7f502c5be640 1 Processor -- start 2023-11-27T20:54:41.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.721+0000 7f502c5be640 1 -- start start 2023-11-27T20:54:41.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.721+0000 7f502c5be640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f50240c4a10 0x7f50241e17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:41.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.721+0000 7f502c5be640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50240c7180 0x7f50241ee260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:41.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.721+0000 7f502c5be640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5024150530 0x7f50241ee7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:41.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.721+0000 7f502c5be640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50240c91d0 con 0x7f5024150530 2023-11-27T20:54:41.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.721+0000 7f502c5be640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50240c88c0 con 0x7f50240c7180 2023-11-27T20:54:41.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.721+0000 7f502c5be640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50240c9710 con 0x7f50240c4a10 2023-11-27T20:54:41.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.722+0000 7f502ab5b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5024150530 0x7f50241ee7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:41.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.722+0000 7f502a35a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f50240c4a10 0x7f50241e17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:41.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.722+0000 7f502ab5b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5024150530 0x7f50241ee7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59866/0 (socket says 172.21.15.88:59866) 2023-11-27T20:54:41.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.722+0000 7f502ab5b640 1 -- 172.21.15.88:0/952334659 learned_addr learned my addr 172.21.15.88:0/952334659 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:41.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.722+0000 7f5029b59640 1 --2- 172.21.15.88:0/952334659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50240c7180 0x7f50241ee260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:41.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.725+0000 7f502ab5b640 1 -- 172.21.15.88:0/952334659 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f50240c4a10 msgr2=0x7f50241e17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:41.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.725+0000 7f502ab5b640 1 --2- 172.21.15.88:0/952334659 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f50240c4a10 0x7f50241e17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:41.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.725+0000 7f502ab5b640 1 -- 172.21.15.88:0/952334659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50240c7180 msgr2=0x7f50241ee260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:41.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.725+0000 7f502ab5b640 1 --2- 172.21.15.88:0/952334659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50240c7180 0x7f50241ee260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:41.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.725+0000 7f502ab5b640 1 -- 172.21.15.88:0/952334659 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501c00bd40 con 0x7f5024150530 2023-11-27T20:54:41.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.727+0000 7f502ab5b640 1 --2- 172.21.15.88:0/952334659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5024150530 0x7f50241ee7a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f501c00d240 tx=0x7f501c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:41.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.731+0000 7f501affd640 1 -- 172.21.15.88:0/952334659 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c00b0d0 con 0x7f5024150530 2023-11-27T20:54:41.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.731+0000 7f501affd640 1 -- 172.21.15.88:0/952334659 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501c040450 con 0x7f5024150530 2023-11-27T20:54:41.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.731+0000 7f501affd640 1 -- 172.21.15.88:0/952334659 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c0407e0 con 0x7f5024150530 2023-11-27T20:54:41.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.731+0000 7f502c5be640 1 -- 172.21.15.88:0/952334659 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50240c99b0 con 0x7f5024150530 2023-11-27T20:54:41.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.731+0000 7f502c5be640 1 -- 172.21.15.88:0/952334659 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50240c8df0 con 0x7f5024150530 2023-11-27T20:54:41.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.732+0000 7f502c5be640 1 -- 172.21.15.88:0/952334659 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5024067470 con 0x7f5024150530 2023-11-27T20:54:41.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.752+0000 7f501affd640 1 -- 172.21.15.88:0/952334659 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f501c040940 con 0x7f5024150530 2023-11-27T20:54:41.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.752+0000 7f501affd640 1 --2- 172.21.15.88:0/952334659 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f500806b240 0x7f500806d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:41.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.753+0000 7f502a35a640 1 --2- 172.21.15.88:0/952334659 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f500806b240 0x7f500806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:41.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.753+0000 7f502a35a640 1 --2- 172.21.15.88:0/952334659 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f500806b240 0x7f500806d700 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5020009b40 tx=0x7f5020009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:41.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.757+0000 7f501affd640 1 -- 172.21.15.88:0/952334659 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f501c07d770 con 0x7f5024150530 2023-11-27T20:54:41.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:41.987+0000 7f501affd640 1 -- 172.21.15.88:0/952334659 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f501c079ab0 con 0x7f5024150530 2023-11-27T20:54:42.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.167+0000 7f502c5be640 1 -- 172.21.15.88:0/952334659 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50240c18d0 con 0x7f5024150530 2023-11-27T20:54:42.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.204+0000 7f501affd640 1 -- 172.21.15.88:0/952334659 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18339 (secure 0 0 0) 0x7f501c07d0d0 con 0x7f5024150530 2023-11-27T20:54:42.206 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:54:42.207 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc","created":"2023-11-27T20:53:53.110827+0000","modified":"2023-11-27T20:54:32.470579+0000","last_up_change":"2023-11-27T20:54:08.219383+0000","last_in_change":"2023-11-27T20:53:59.022798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:54:09.277670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:54:24.503156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:54:25.744043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T20:54:29.704111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1207ca0f-bef1-44c6-b66b-58bf0e080ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6819","nonce":3952326022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6821","nonce":3952326022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6825","nonce":3952326022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6823","nonce":3952326022}]},"public_addr":"172.21.15.88:6819/3952326022","cluster_addr":"172.21.15.88:6821/3952326022","heartbeat_back_addr":"172.21.15.88:6825/3952326022","heartbeat_front_addr":"172.21.15.88:6823/3952326022","state":["exists","up"]},{"osd":1,"uuid":"8d1be479-4241-4335-9633-1394311fde76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6827","nonce":1788401966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6829","nonce":1788401966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6833","nonce":1788401966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6831","nonce":1788401966}]},"public_addr":"172.21.15.88:6827/1788401966","cluster_addr":"172.21.15.88:6829/1788401966","heartbeat_back_addr":"172.21.15.88:6833/1788401966","heartbeat_front_addr":"172.21.15.88:6831/1788401966","state":["exists","up"]},{"osd":2,"uuid":"7536b008-05dd-40eb-9d4a-bdac4b1c38c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6803","nonce":1166333913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6805","nonce":1166333913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6809","nonce":1166333913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6807","nonce":1166333913}]},"public_addr":"172.21.15.88:6803/1166333913","cluster_addr":"172.21.15.88:6805/1166333913","heartbeat_back_addr":"172.21.15.88:6809/1166333913","heartbeat_front_addr":"172.21.15.88:6807/1166333913","state":["exists","up"]},{"osd":3,"uuid":"47edd4d7-e99c-4ce3-851b-cc9c8e2d4480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6811","nonce":406887502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6813","nonce":406887502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6817","nonce":406887502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6815","nonce":406887502}]},"public_addr":"172.21.15.88:6811/406887502","cluster_addr":"172.21.15.88:6813/406887502","heartbeat_back_addr":"172.21.15.88:6817/406887502","heartbeat_front_addr":"172.21.15.88:6815/406887502","state":["exists","up"]},{"osd":4,"uuid":"0a81dd31-1a8b-41af-b933-d74aae63f3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6801","nonce":2551293703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6803","nonce":2551293703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6807","nonce":2551293703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6805","nonce":2551293703}]},"public_addr":"172.21.15.167:6801/2551293703","cluster_addr":"172.21.15.167:6803/2551293703","heartbeat_back_addr":"172.21.15.167:6807/2551293703","heartbeat_front_addr":"172.21.15.167:6805/2551293703","state":["exists","up"]},{"osd":5,"uuid":"1c462d0d-3361-48b3-a82a-86a920539e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6825","nonce":866085094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6827","nonce":866085094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6831","nonce":866085094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6829","nonce":866085094}]},"public_addr":"172.21.15.167:6825/866085094","cluster_addr":"172.21.15.167:6827/866085094","heartbeat_back_addr":"172.21.15.167:6831/866085094","heartbeat_front_addr":"172.21.15.167:6829/866085094","state":["exists","up"]},{"osd":6,"uuid":"d687c5ad-6c88-4a15-8120-0cdbc5610535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6809","nonce":2766725538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6811","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6813","nonce":2766725538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6819","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6821","nonce":2766725538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6815","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6817","nonce":2766725538}]},"public_addr":"172.21.15.167:6809/2766725538","cluster_addr":"172.21.15.167:6813/2766725538","heartbeat_back_addr":"172.21.15.167:6821/2766725538","heartbeat_front_addr":"172.21.15.167:6817/2766725538","state":["exists","up"]},{"osd":7,"uuid":"c9a50596-4981-4bd8-a8ef-d7679f8d9559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6812","nonce":2695037266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6816","nonce":2695037266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6823","nonce":2695037266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6820","nonce":2695037266}]},"public_addr":"172.21.15.167:6812/2695037266","cluster_addr":"172.21.15.167:6816/2695037266","heartbeat_back_addr":"172.21.15.167:6823/2695037266","heartbeat_front_addr":"172.21.15.167:6820/2695037266","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.522590+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.483170+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.492504+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.432204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.414964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.459803+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.437250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.460394+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:54:42.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.207+0000 7f502c5be640 1 -- 172.21.15.88:0/952334659 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f500806b240 msgr2=0x7f500806d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:42.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.207+0000 7f502c5be640 1 --2- 172.21.15.88:0/952334659 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f500806b240 0x7f500806d700 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5020009b40 tx=0x7f5020009190 comp rx=0 tx=0).stop 2023-11-27T20:54:42.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.207+0000 7f502c5be640 1 -- 172.21.15.88:0/952334659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5024150530 msgr2=0x7f50241ee7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:42.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.207+0000 7f502c5be640 1 --2- 172.21.15.88:0/952334659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5024150530 0x7f50241ee7a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f501c00d240 tx=0x7f501c004a40 comp rx=0 tx=0).stop 2023-11-27T20:54:42.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.207+0000 7f502c5be640 1 -- 172.21.15.88:0/952334659 shutdown_connections 2023-11-27T20:54:42.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.207+0000 7f502c5be640 1 --2- 172.21.15.88:0/952334659 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f500806b240 0x7f500806d700 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:42.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.207+0000 7f502c5be640 1 --2- 172.21.15.88:0/952334659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5024150530 0x7f50241ee7a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:42.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.207+0000 7f502c5be640 1 --2- 172.21.15.88:0/952334659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50240c7180 0x7f50241ee260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:42.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.207+0000 7f502c5be640 1 --2- 172.21.15.88:0/952334659 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f50240c4a10 0x7f50241e17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:42.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.207+0000 7f502c5be640 1 -- 172.21.15.88:0/952334659 >> 172.21.15.88:0/952334659 conn(0x7f502406c5f0 msgr2=0x7f502414eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:42.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.207+0000 7f502c5be640 1 -- 172.21.15.88:0/952334659 shutdown_connections 2023-11-27T20:54:42.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.207+0000 7f502c5be640 1 -- 172.21.15.88:0/952334659 wait complete. 2023-11-27T20:54:42.220 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:54:09.277670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:54:24.503156+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:54:25.744043+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-27T20:54:29.704111+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-27T20:54:42.220 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:54:42.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.321+0000 7f000d72c640 1 Processor -- start 2023-11-27T20:54:42.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.321+0000 7f000d72c640 1 -- start start 2023-11-27T20:54:42.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.321+0000 7f000d72c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00080c9620 0x7f00080c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:42.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.321+0000 7f000d72c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00080cbda0 con 0x7f00080cda70 2023-11-27T20:54:42.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.321+0000 7f000d72c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00080cea60 con 0x7f00080cc420 2023-11-27T20:54:42.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.321+0000 7f000d72c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00080cc230 con 0x7f00080c9620 2023-11-27T20:54:42.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.322+0000 7f0006ffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f00080cda70 0x7f00080ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40930/0 (socket says 172.21.15.88:40930) 2023-11-27T20:54:42.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.322+0000 7f0006ffd640 1 -- 172.21.15.88:0/2767608625 learned_addr learned my addr 172.21.15.88:0/2767608625 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:54:42.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.322+0000 7f00077fe640 1 --2- 172.21.15.88:0/2767608625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00080c9620 0x7f00080c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:42.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.324+0000 7f0005ffb640 1 -- 172.21.15.88:0/2767608625 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308793558 0 0) 0x7f00080cbda0 con 0x7f00080cda70 2023-11-27T20:54:42.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.324+0000 7f0005ffb640 1 -- 172.21.15.88:0/2767608625 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efff0003520 con 0x7f00080cda70 2023-11-27T20:54:42.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.325+0000 7f0005ffb640 1 -- 172.21.15.88:0/2767608625 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560307877 0 0) 0x7f00080cea60 con 0x7f00080cc420 2023-11-27T20:54:42.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.325+0000 7f0005ffb640 1 -- 172.21.15.88:0/2767608625 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00080cbda0 con 0x7f00080cc420 2023-11-27T20:54:42.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.325+0000 7f00077fe640 1 -- 172.21.15.88:0/2767608625 >> v1:172.21.15.167:6789/0 conn(0x7f00080cc420 legacy=0x7f0008159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:42.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.325+0000 7f00077fe640 1 -- 172.21.15.88:0/2767608625 >> v1:172.21.15.88:6789/0 conn(0x7f00080cda70 legacy=0x7f00080ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:42.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.325+0000 7f00077fe640 1 -- 172.21.15.88:0/2767608625 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00080cb4e0 con 0x7f00080c9620 2023-11-27T20:54:42.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.327+0000 7f00077fe640 1 --2- 172.21.15.88:0/2767608625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00080c9620 0x7f00080c9a70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0000009dc0 tx=0x7f000002bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=892221751afee307 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:42.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.331+0000 7f0005ffb640 1 -- 172.21.15.88:0/2767608625 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000002cd50 con 0x7f00080c9620 2023-11-27T20:54:42.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.331+0000 7f0005ffb640 1 -- 172.21.15.88:0/2767608625 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0000034440 con 0x7f00080c9620 2023-11-27T20:54:42.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.331+0000 7f0005ffb640 1 -- 172.21.15.88:0/2767608625 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00000347d0 con 0x7f00080c9620 2023-11-27T20:54:42.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.331+0000 7f000d72c640 1 -- 172.21.15.88:0/2767608625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00080c9620 msgr2=0x7f00080c9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:42.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.331+0000 7f000d72c640 1 --2- 172.21.15.88:0/2767608625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00080c9620 0x7f00080c9a70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0000009dc0 tx=0x7f000002bfa0 comp rx=0 tx=0).stop 2023-11-27T20:54:42.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.332+0000 7f000d72c640 1 -- 172.21.15.88:0/2767608625 shutdown_connections 2023-11-27T20:54:42.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.332+0000 7f000d72c640 1 --2- 172.21.15.88:0/2767608625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00080c9620 0x7f00080c9a70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:42.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.332+0000 7f000d72c640 1 -- 172.21.15.88:0/2767608625 >> 172.21.15.88:0/2767608625 conn(0x7f00080b07b0 msgr2=0x7f00080b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:42.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.332+0000 7f000d72c640 1 -- 172.21.15.88:0/2767608625 shutdown_connections 2023-11-27T20:54:42.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.332+0000 7f000d72c640 1 -- 172.21.15.88:0/2767608625 wait complete. 2023-11-27T20:54:42.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.333+0000 7f000d72c640 1 Processor -- start 2023-11-27T20:54:42.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.333+0000 7f000d72c640 1 -- start start 2023-11-27T20:54:42.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.334+0000 7f000d72c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00080c9620 0x7f00080c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:42.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.334+0000 7f000d72c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00080cc420 0x7f00081ef270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:42.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.334+0000 7f000d72c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00080cda70 0x7f00081ef7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:42.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.334+0000 7f000d72c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00080c3610 con 0x7f00080cc420 2023-11-27T20:54:42.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.334+0000 7f000d72c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00080c48b0 con 0x7f00080c9620 2023-11-27T20:54:42.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.334+0000 7f000d72c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00080c2a00 con 0x7f00080cda70 2023-11-27T20:54:42.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.334+0000 7f0006ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00080c9620 0x7f00080c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:42.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.334+0000 7f00067fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00080cc420 0x7f00081ef270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:42.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.334+0000 7f0006ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00080c9620 0x7f00080c3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:58420/0 (socket says 172.21.15.88:58420) 2023-11-27T20:54:42.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.334+0000 7f0006ffd640 1 -- 172.21.15.88:0/626350647 learned_addr learned my addr 172.21.15.88:0/626350647 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:42.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.334+0000 7f00077fe640 1 --2- 172.21.15.88:0/626350647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00080cda70 0x7f00081ef7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:42.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.338+0000 7f0006ffd640 1 -- 172.21.15.88:0/626350647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00080cda70 msgr2=0x7f00081ef7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:42.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.338+0000 7f0006ffd640 1 --2- 172.21.15.88:0/626350647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00080cda70 0x7f00081ef7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:42.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.338+0000 7f0006ffd640 1 -- 172.21.15.88:0/626350647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00080cc420 msgr2=0x7f00081ef270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:42.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.338+0000 7f0006ffd640 1 --2- 172.21.15.88:0/626350647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00080cc420 0x7f00081ef270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:42.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.338+0000 7f0006ffd640 1 -- 172.21.15.88:0/626350647 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0000009a70 con 0x7f00080c9620 2023-11-27T20:54:42.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.341+0000 7f0006ffd640 1 --2- 172.21.15.88:0/626350647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00080c9620 0x7f00080c3bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efff800c3c0 tx=0x7efff800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:42.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.344+0000 7effef7fe640 1 -- 172.21.15.88:0/626350647 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff8005ce0 con 0x7f00080c9620 2023-11-27T20:54:42.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.344+0000 7effef7fe640 1 -- 172.21.15.88:0/626350647 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff8005e40 con 0x7f00080c9620 2023-11-27T20:54:42.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.344+0000 7effef7fe640 1 -- 172.21.15.88:0/626350647 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff8007310 con 0x7f00080c9620 2023-11-27T20:54:42.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.344+0000 7f000d72c640 1 -- 172.21.15.88:0/626350647 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00080c2ce0 con 0x7f00080c9620 2023-11-27T20:54:42.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.345+0000 7f000d72c640 1 -- 172.21.15.88:0/626350647 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00080c32a0 con 0x7f00080c9620 2023-11-27T20:54:42.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.345+0000 7f000d72c640 1 -- 172.21.15.88:0/626350647 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0008067470 con 0x7f00080c9620 2023-11-27T20:54:42.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.595+0000 7effef7fe640 1 -- 172.21.15.88:0/626350647 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7efff8007470 con 0x7f00080c9620 2023-11-27T20:54:42.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.596+0000 7effef7fe640 1 --2- 172.21.15.88:0/626350647 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7efff406b240 0x7efff406d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:42.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.596+0000 7f00067fc640 1 --2- 172.21.15.88:0/626350647 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7efff406b240 0x7efff406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:42.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.596+0000 7f00067fc640 1 --2- 172.21.15.88:0/626350647 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7efff406b240 0x7efff406d700 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f000806b420 tx=0x7efffc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:42.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.599+0000 7effef7fe640 1 -- 172.21.15.88:0/626350647 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efff8007720 con 0x7f00080c9620 2023-11-27T20:54:42.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.610+0000 7effef7fe640 1 -- 172.21.15.88:0/626350647 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7efff8054220 con 0x7f00080c9620 2023-11-27T20:54:42.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.787+0000 7f000d72c640 1 -- 172.21.15.88:0/626350647 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f00081eeed0 con 0x7f00080c9620 2023-11-27T20:54:42.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.793+0000 7effef7fe640 1 -- 172.21.15.88:0/626350647 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7efff8017020 con 0x7f00080c9620 2023-11-27T20:54:42.795 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-27T20:54:42.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.794+0000 7f000d72c640 1 -- 172.21.15.88:0/626350647 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7efff406b240 msgr2=0x7efff406d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:42.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.794+0000 7f000d72c640 1 --2- 172.21.15.88:0/626350647 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7efff406b240 0x7efff406d700 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f000806b420 tx=0x7efffc009040 comp rx=0 tx=0).stop 2023-11-27T20:54:42.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.794+0000 7f000d72c640 1 -- 172.21.15.88:0/626350647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00080c9620 msgr2=0x7f00080c3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:42.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.794+0000 7f000d72c640 1 --2- 172.21.15.88:0/626350647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00080c9620 0x7f00080c3bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efff800c3c0 tx=0x7efff800c880 comp rx=0 tx=0).stop 2023-11-27T20:54:42.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.794+0000 7f000d72c640 1 -- 172.21.15.88:0/626350647 shutdown_connections 2023-11-27T20:54:42.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.794+0000 7f000d72c640 1 --2- 172.21.15.88:0/626350647 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7efff406b240 0x7efff406d700 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:42.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.794+0000 7f000d72c640 1 --2- 172.21.15.88:0/626350647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00080cda70 0x7f00081ef7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:42.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.794+0000 7f000d72c640 1 --2- 172.21.15.88:0/626350647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00080cc420 0x7f00081ef270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:42.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.794+0000 7f000d72c640 1 --2- 172.21.15.88:0/626350647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00080c9620 0x7f00080c3bf0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:42.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.794+0000 7f000d72c640 1 -- 172.21.15.88:0/626350647 >> 172.21.15.88:0/626350647 conn(0x7f00080b07b0 msgr2=0x7f00080afee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:42.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.794+0000 7f000d72c640 1 -- 172.21.15.88:0/626350647 shutdown_connections 2023-11-27T20:54:42.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.794+0000 7f000d72c640 1 -- 172.21.15.88:0/626350647 wait complete. 2023-11-27T20:54:42.807 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:54:42.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.908+0000 7f3169583640 1 Processor -- start 2023-11-27T20:54:42.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.908+0000 7f3169583640 1 -- start start 2023-11-27T20:54:42.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.909+0000 7f3169583640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f31640cda70 0x7f31640ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:42.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.909+0000 7f3169583640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31640c9620 0x7f31640c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:42.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.909+0000 7f3169583640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31640cbda0 con 0x7f31640cc420 2023-11-27T20:54:42.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.909+0000 7f3169583640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31640cc230 con 0x7f31640cda70 2023-11-27T20:54:42.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.909+0000 7f3169583640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31640cb4e0 con 0x7f31640c9620 2023-11-27T20:54:42.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.910+0000 7f3162ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f31640cda70 0x7f31640ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:42.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.910+0000 7f31637fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31640c9620 0x7f31640c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:42.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.910+0000 7f3162ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f31640cda70 0x7f31640ce350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:58424/0 (socket says 172.21.15.88:58424) 2023-11-27T20:54:42.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.910+0000 7f3162ffd640 1 -- 172.21.15.88:0/3330934298 learned_addr learned my addr 172.21.15.88:0/3330934298 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:42.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.913+0000 7f3162ffd640 1 -- 172.21.15.88:0/3330934298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31640c9620 msgr2=0x7f31640c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:42.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.913+0000 7f3162ffd640 1 --2- 172.21.15.88:0/3330934298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31640c9620 0x7f31640c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:42.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.913+0000 7f3162ffd640 1 -- 172.21.15.88:0/3330934298 >> v1:172.21.15.88:6789/0 conn(0x7f31640cc420 legacy=0x7f3164159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:42.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.913+0000 7f3162ffd640 1 -- 172.21.15.88:0/3330934298 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31640cce00 con 0x7f31640cda70 2023-11-27T20:54:42.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.915+0000 7f3162ffd640 1 --2- 172.21.15.88:0/3330934298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31640cda70 0x7f31640ce350 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3154009870 tx=0x7f315402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5003715163fccebb server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:42.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.933+0000 7f31627fc640 1 -- 172.21.15.88:0/3330934298 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3154030840 con 0x7f31640cda70 2023-11-27T20:54:42.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.933+0000 7f31627fc640 1 -- 172.21.15.88:0/3330934298 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31540309a0 con 0x7f31640cda70 2023-11-27T20:54:42.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.933+0000 7f31627fc640 1 -- 172.21.15.88:0/3330934298 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3154030d30 con 0x7f31640cda70 2023-11-27T20:54:42.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.934+0000 7f3169583640 1 -- 172.21.15.88:0/3330934298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31640cda70 msgr2=0x7f31640ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:42.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.934+0000 7f3169583640 1 --2- 172.21.15.88:0/3330934298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31640cda70 0x7f31640ce350 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3154009870 tx=0x7f315402b980 comp rx=0 tx=0).stop 2023-11-27T20:54:42.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.934+0000 7f3169583640 1 -- 172.21.15.88:0/3330934298 shutdown_connections 2023-11-27T20:54:42.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.934+0000 7f3169583640 1 --2- 172.21.15.88:0/3330934298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31640c9620 0x7f31640c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:42.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.934+0000 7f3169583640 1 --2- 172.21.15.88:0/3330934298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31640cda70 0x7f31640ce350 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:42.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.934+0000 7f3169583640 1 -- 172.21.15.88:0/3330934298 >> 172.21.15.88:0/3330934298 conn(0x7f31640b07b0 msgr2=0x7f31640b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:42.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.934+0000 7f3169583640 1 -- 172.21.15.88:0/3330934298 shutdown_connections 2023-11-27T20:54:42.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.934+0000 7f3169583640 1 -- 172.21.15.88:0/3330934298 wait complete. 2023-11-27T20:54:42.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.935+0000 7f3169583640 1 Processor -- start 2023-11-27T20:54:42.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.935+0000 7f3169583640 1 -- start start 2023-11-27T20:54:42.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.936+0000 7f3169583640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31640c9620 0x7f31641f2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:42.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.936+0000 7f3169583640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31640cc420 0x7f31641ef850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:42.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.936+0000 7f3169583640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31640cda70 0x7f316414ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:42.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.936+0000 7f3169583640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3164157220 con 0x7f31640cda70 2023-11-27T20:54:42.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.936+0000 7f3169583640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31640b3fd0 con 0x7f31640cc420 2023-11-27T20:54:42.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.936+0000 7f3169583640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31641eee60 con 0x7f31640c9620 2023-11-27T20:54:42.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.936+0000 7f31637fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31640cda70 0x7f316414ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:42.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.937+0000 7f31637fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31640cda70 0x7f316414ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59898/0 (socket says 172.21.15.88:59898) 2023-11-27T20:54:42.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.937+0000 7f31637fe640 1 -- 172.21.15.88:0/2333162846 learned_addr learned my addr 172.21.15.88:0/2333162846 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:42.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.937+0000 7f3162ffd640 1 --2- 172.21.15.88:0/2333162846 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31640c9620 0x7f31641f2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:42.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.940+0000 7f31637fe640 1 -- 172.21.15.88:0/2333162846 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31640c9620 msgr2=0x7f31641f2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:42.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.940+0000 7f31637fe640 1 --2- 172.21.15.88:0/2333162846 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31640c9620 0x7f31641f2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:42.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.940+0000 7f31637fe640 1 -- 172.21.15.88:0/2333162846 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31640cc420 msgr2=0x7f31641ef850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:42.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.940+0000 7f31637fe640 1 --2- 172.21.15.88:0/2333162846 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31640cc420 0x7f31641ef850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:42.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.940+0000 7f31637fe640 1 -- 172.21.15.88:0/2333162846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31540094d0 con 0x7f31640cda70 2023-11-27T20:54:42.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.942+0000 7f31637fe640 1 --2- 172.21.15.88:0/2333162846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31640cda70 0x7f316414ff10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f315c009d20 tx=0x7f315c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:42.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.961+0000 7f315b7fe640 1 -- 172.21.15.88:0/2333162846 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c009b10 con 0x7f31640cda70 2023-11-27T20:54:42.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.961+0000 7f315b7fe640 1 -- 172.21.15.88:0/2333162846 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315c00f040 con 0x7f31640cda70 2023-11-27T20:54:42.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.961+0000 7f315b7fe640 1 -- 172.21.15.88:0/2333162846 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c0146c0 con 0x7f31640cda70 2023-11-27T20:54:42.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.961+0000 7f3169583640 1 -- 172.21.15.88:0/2333162846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31641f32f0 con 0x7f31640cda70 2023-11-27T20:54:42.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.961+0000 7f3169583640 1 -- 172.21.15.88:0/2333162846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31640c4970 con 0x7f31640cda70 2023-11-27T20:54:42.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:42.963+0000 7f3169583640 1 -- 172.21.15.88:0/2333162846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3164067470 con 0x7f31640cda70 2023-11-27T20:54:43.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.204+0000 7f315b7fe640 1 -- 172.21.15.88:0/2333162846 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f315c014820 con 0x7f31640cda70 2023-11-27T20:54:43.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.205+0000 7f315b7fe640 1 --2- 172.21.15.88:0/2333162846 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f314406b210 0x7f314406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:43.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.205+0000 7f3162ffd640 1 --2- 172.21.15.88:0/2333162846 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f314406b210 0x7f314406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:43.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.205+0000 7f3162ffd640 1 --2- 172.21.15.88:0/2333162846 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f314406b210 0x7f314406d6d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3154036000 tx=0x7f3154008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:43.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.219+0000 7f315b7fe640 1 -- 172.21.15.88:0/2333162846 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f315c059ef0 con 0x7f31640cda70 2023-11-27T20:54:43.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.220+0000 7f315b7fe640 1 -- 172.21.15.88:0/2333162846 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f315c055b30 con 0x7f31640cda70 2023-11-27T20:54:43.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.400+0000 7f3169583640 1 -- 172.21.15.88:0/2333162846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f31640b4c20 con 0x7f31640cda70 2023-11-27T20:54:43.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.422+0000 7f315b7fe640 1 -- 172.21.15.88:0/2333162846 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f315c0180a0 con 0x7f31640cda70 2023-11-27T20:54:43.424 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-27T20:54:43.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.424+0000 7f3169583640 1 -- 172.21.15.88:0/2333162846 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f314406b210 msgr2=0x7f314406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:43.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.424+0000 7f3169583640 1 --2- 172.21.15.88:0/2333162846 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f314406b210 0x7f314406d6d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3154036000 tx=0x7f3154008030 comp rx=0 tx=0).stop 2023-11-27T20:54:43.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.424+0000 7f3169583640 1 -- 172.21.15.88:0/2333162846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31640cda70 msgr2=0x7f316414ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:43.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.424+0000 7f3169583640 1 --2- 172.21.15.88:0/2333162846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31640cda70 0x7f316414ff10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f315c009d20 tx=0x7f315c00c490 comp rx=0 tx=0).stop 2023-11-27T20:54:43.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.424+0000 7f3169583640 1 -- 172.21.15.88:0/2333162846 shutdown_connections 2023-11-27T20:54:43.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.424+0000 7f3169583640 1 --2- 172.21.15.88:0/2333162846 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f314406b210 0x7f314406d6d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:43.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.424+0000 7f3169583640 1 --2- 172.21.15.88:0/2333162846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31640cda70 0x7f316414ff10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:43.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.424+0000 7f3169583640 1 --2- 172.21.15.88:0/2333162846 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31640cc420 0x7f31641ef850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:43.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.424+0000 7f3169583640 1 --2- 172.21.15.88:0/2333162846 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31640c9620 0x7f31641f2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:43.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.424+0000 7f3169583640 1 -- 172.21.15.88:0/2333162846 >> 172.21.15.88:0/2333162846 conn(0x7f31640b07b0 msgr2=0x7f316406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:43.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.424+0000 7f3169583640 1 -- 172.21.15.88:0/2333162846 shutdown_connections 2023-11-27T20:54:43.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.424+0000 7f3169583640 1 -- 172.21.15.88:0/2333162846 wait complete. 2023-11-27T20:54:43.437 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:54:43.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.538+0000 7f4da058a640 1 Processor -- start 2023-11-27T20:54:43.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.538+0000 7f4da058a640 1 -- start start 2023-11-27T20:54:43.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.539+0000 7f4da058a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d980c7650 0x7f4d9815a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:43.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.539+0000 7f4da058a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4d981560f0 0x7f4d980c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:43.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.539+0000 7f4da058a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d98159dd0 con 0x7f4d980c7a30 2023-11-27T20:54:43.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.539+0000 7f4da058a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d98156580 con 0x7f4d981560f0 2023-11-27T20:54:43.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.539+0000 7f4da058a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d980c5cc0 con 0x7f4d980c7650 2023-11-27T20:54:43.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.540+0000 7f4d9e326640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d980c7650 0x7f4d9815a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:43.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.540+0000 7f4d9eb27640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4d981560f0 0x7f4d980c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:43.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.540+0000 7f4d9db25640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f4d980c7a30 0x7f4d980c6c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:36902/0 (socket says 172.21.15.88:36902) 2023-11-27T20:54:43.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.540+0000 7f4d9db25640 1 -- 172.21.15.88:0/871822675 learned_addr learned my addr 172.21.15.88:0/871822675 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:54:43.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.543+0000 7f4d9e326640 1 -- 172.21.15.88:0/871822675 >> v2:172.21.15.167:3300/0 conn(0x7f4d981560f0 msgr2=0x7f4d980c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:43.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.543+0000 7f4d9e326640 1 --2- 172.21.15.88:0/871822675 >> v2:172.21.15.167:3300/0 conn(0x7f4d981560f0 0x7f4d980c53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:43.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.543+0000 7f4d9e326640 1 -- 172.21.15.88:0/871822675 >> v1:172.21.15.167:6789/0 conn(0x7f4d980c7a30 legacy=0x7f4d980c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:43.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.543+0000 7f4d9e326640 1 -- 172.21.15.88:0/871822675 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d980c6260 con 0x7f4d980c7650 2023-11-27T20:54:43.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.545+0000 7f4d9e326640 1 --2- 172.21.15.88:0/871822675 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d980c7650 0x7f4d9815a260 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4d880097a0 tx=0x7f4d8802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d33ec394ae3cef99 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:43.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.550+0000 7f4d9d324640 1 -- 172.21.15.88:0/871822675 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8802e070 con 0x7f4d980c7650 2023-11-27T20:54:43.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.550+0000 7f4d9d324640 1 -- 172.21.15.88:0/871822675 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d880315a0 con 0x7f4d980c7650 2023-11-27T20:54:43.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.550+0000 7f4d9d324640 1 -- 172.21.15.88:0/871822675 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d88031930 con 0x7f4d980c7650 2023-11-27T20:54:43.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.550+0000 7f4da058a640 1 -- 172.21.15.88:0/871822675 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d980c7650 msgr2=0x7f4d9815a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:43.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.550+0000 7f4da058a640 1 --2- 172.21.15.88:0/871822675 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d980c7650 0x7f4d9815a260 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4d880097a0 tx=0x7f4d8802b840 comp rx=0 tx=0).stop 2023-11-27T20:54:43.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.550+0000 7f4da058a640 1 -- 172.21.15.88:0/871822675 shutdown_connections 2023-11-27T20:54:43.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.550+0000 7f4da058a640 1 --2- 172.21.15.88:0/871822675 >> v2:172.21.15.167:3300/0 conn(0x7f4d981560f0 0x7f4d980c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:43.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.550+0000 7f4da058a640 1 --2- 172.21.15.88:0/871822675 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d980c7650 0x7f4d9815a260 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:43.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.550+0000 7f4da058a640 1 -- 172.21.15.88:0/871822675 >> 172.21.15.88:0/871822675 conn(0x7f4d9806c5f0 msgr2=0x7f4d9806c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:43.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.550+0000 7f4da058a640 1 -- 172.21.15.88:0/871822675 shutdown_connections 2023-11-27T20:54:43.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.550+0000 7f4da058a640 1 -- 172.21.15.88:0/871822675 wait complete. 2023-11-27T20:54:43.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.552+0000 7f4da058a640 1 Processor -- start 2023-11-27T20:54:43.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.552+0000 7f4da058a640 1 -- start start 2023-11-27T20:54:43.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.553+0000 7f4da058a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d980c7650 0x7f4d98071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:43.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.553+0000 7f4da058a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d980c7a30 0x7f4d981458b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:43.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.553+0000 7f4da058a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d981560f0 0x7f4d981ef090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:43.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.553+0000 7f4da058a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d980c9f40 con 0x7f4d980c7a30 2023-11-27T20:54:43.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.553+0000 7f4da058a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9814bcd0 con 0x7f4d980c7650 2023-11-27T20:54:43.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.553+0000 7f4da058a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9814bfb0 con 0x7f4d981560f0 2023-11-27T20:54:43.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.553+0000 7f4d9e326640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d980c7650 0x7f4d98071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:43.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.553+0000 7f4d9eb27640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d981560f0 0x7f4d981ef090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:43.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.553+0000 7f4d9e326640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d980c7650 0x7f4d98071380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:58448/0 (socket says 172.21.15.88:58448) 2023-11-27T20:54:43.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.553+0000 7f4d9e326640 1 -- 172.21.15.88:0/1517581196 learned_addr learned my addr 172.21.15.88:0/1517581196 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:43.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.555+0000 7f4d9db25640 1 --2- 172.21.15.88:0/1517581196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d980c7a30 0x7f4d981458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:43.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.558+0000 7f4d9e326640 1 -- 172.21.15.88:0/1517581196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d981560f0 msgr2=0x7f4d981ef090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:43.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.558+0000 7f4d9e326640 1 --2- 172.21.15.88:0/1517581196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d981560f0 0x7f4d981ef090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:43.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.558+0000 7f4d9e326640 1 -- 172.21.15.88:0/1517581196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d980c7a30 msgr2=0x7f4d981458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:43.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.558+0000 7f4d9e326640 1 --2- 172.21.15.88:0/1517581196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d980c7a30 0x7f4d981458b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:43.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.558+0000 7f4d9e326640 1 -- 172.21.15.88:0/1517581196 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d88009400 con 0x7f4d980c7650 2023-11-27T20:54:43.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.563+0000 7f4d9e326640 1 --2- 172.21.15.88:0/1517581196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d980c7650 0x7f4d98071380 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4d88034040 tx=0x7f4d880046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:43.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.573+0000 7f4d8effd640 1 -- 172.21.15.88:0/1517581196 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d88032840 con 0x7f4d980c7650 2023-11-27T20:54:43.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.573+0000 7f4d8effd640 1 -- 172.21.15.88:0/1517581196 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d880329c0 con 0x7f4d980c7650 2023-11-27T20:54:43.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.573+0000 7f4d8effd640 1 -- 172.21.15.88:0/1517581196 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d88032d70 con 0x7f4d980c7650 2023-11-27T20:54:43.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.573+0000 7f4da058a640 1 -- 172.21.15.88:0/1517581196 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d9814c290 con 0x7f4d980c7650 2023-11-27T20:54:43.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.573+0000 7f4da058a640 1 -- 172.21.15.88:0/1517581196 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d98070e60 con 0x7f4d980c7650 2023-11-27T20:54:43.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.574+0000 7f4da058a640 1 -- 172.21.15.88:0/1517581196 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d9814c4b0 con 0x7f4d980c7650 2023-11-27T20:54:43.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.817+0000 7f4d8effd640 1 -- 172.21.15.88:0/1517581196 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4d8804e430 con 0x7f4d980c7650 2023-11-27T20:54:43.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.817+0000 7f4d8effd640 1 --2- 172.21.15.88:0/1517581196 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4d7c06b210 0x7f4d7c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:43.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.817+0000 7f4d9db25640 1 --2- 172.21.15.88:0/1517581196 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4d7c06b210 0x7f4d7c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:43.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.818+0000 7f4d9db25640 1 --2- 172.21.15.88:0/1517581196 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4d7c06b210 0x7f4d7c06d6d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4d98071dc0 tx=0x7f4d94007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:43.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.822+0000 7f4d8effd640 1 -- 172.21.15.88:0/1517581196 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4d8807a6f0 con 0x7f4d980c7650 2023-11-27T20:54:43.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.832+0000 7f4d8effd640 1 -- 172.21.15.88:0/1517581196 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4d88076a30 con 0x7f4d980c7650 2023-11-27T20:54:44.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:43.999+0000 7f4da058a640 1 -- 172.21.15.88:0/1517581196 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4d98067470 con 0x7f4d980c7650 2023-11-27T20:54:44.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.004+0000 7f4d8effd640 1 -- 172.21.15.88:0/1517581196 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4d8807a050 con 0x7f4d980c7650 2023-11-27T20:54:44.007 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-11-27T20:54:44.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.006+0000 7f4da058a640 1 -- 172.21.15.88:0/1517581196 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4d7c06b210 msgr2=0x7f4d7c06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:44.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.006+0000 7f4da058a640 1 --2- 172.21.15.88:0/1517581196 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4d7c06b210 0x7f4d7c06d6d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4d98071dc0 tx=0x7f4d94007e80 comp rx=0 tx=0).stop 2023-11-27T20:54:44.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.006+0000 7f4da058a640 1 -- 172.21.15.88:0/1517581196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d980c7650 msgr2=0x7f4d98071380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:44.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.006+0000 7f4da058a640 1 --2- 172.21.15.88:0/1517581196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d980c7650 0x7f4d98071380 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4d88034040 tx=0x7f4d880046c0 comp rx=0 tx=0).stop 2023-11-27T20:54:44.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.006+0000 7f4da058a640 1 -- 172.21.15.88:0/1517581196 shutdown_connections 2023-11-27T20:54:44.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.006+0000 7f4da058a640 1 --2- 172.21.15.88:0/1517581196 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4d7c06b210 0x7f4d7c06d6d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:44.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.006+0000 7f4da058a640 1 --2- 172.21.15.88:0/1517581196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d981560f0 0x7f4d981ef090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:44.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.006+0000 7f4da058a640 1 --2- 172.21.15.88:0/1517581196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d980c7a30 0x7f4d981458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:44.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.006+0000 7f4da058a640 1 --2- 172.21.15.88:0/1517581196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d980c7650 0x7f4d98071380 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:44.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.006+0000 7f4da058a640 1 -- 172.21.15.88:0/1517581196 >> 172.21.15.88:0/1517581196 conn(0x7f4d9806c5f0 msgr2=0x7f4d980c50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:44.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.006+0000 7f4da058a640 1 -- 172.21.15.88:0/1517581196 shutdown_connections 2023-11-27T20:54:44.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.006+0000 7f4da058a640 1 -- 172.21.15.88:0/1517581196 wait complete. 2023-11-27T20:54:44.020 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-27T20:54:44.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.120+0000 7f3e694ec640 1 Processor -- start 2023-11-27T20:54:44.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.120+0000 7f3e694ec640 1 -- start start 2023-11-27T20:54:44.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.121+0000 7f3e694ec640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3e641538d0 0x7f3e6415a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:44.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.121+0000 7f3e694ec640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3e6406ba50 0x7f3e6406be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:44.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.121+0000 7f3e694ec640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e640c7640 con 0x7f3e640c8ee0 2023-11-27T20:54:44.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.121+0000 7f3e694ec640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e6406d130 con 0x7f3e641538d0 2023-11-27T20:54:44.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.121+0000 7f3e694ec640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e6406b5c0 con 0x7f3e6406ba50 2023-11-27T20:54:44.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.121+0000 7f3e62ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3e641538d0 0x7f3e6415a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:44.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.121+0000 7f3e637fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3e6406ba50 0x7f3e6406be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:44.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.122+0000 7f3e637fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3e6406ba50 0x7f3e6406be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:58452/0 (socket says 172.21.15.88:58452) 2023-11-27T20:54:44.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.122+0000 7f3e637fe640 1 -- 172.21.15.88:0/1988662827 learned_addr learned my addr 172.21.15.88:0/1988662827 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:44.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.124+0000 7f3e637fe640 1 -- 172.21.15.88:0/1988662827 >> v2:172.21.15.88:3300/0 conn(0x7f3e641538d0 msgr2=0x7f3e6415a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:44.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.124+0000 7f3e637fe640 1 --2- 172.21.15.88:0/1988662827 >> v2:172.21.15.88:3300/0 conn(0x7f3e641538d0 0x7f3e6415a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:44.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.124+0000 7f3e637fe640 1 -- 172.21.15.88:0/1988662827 >> v1:172.21.15.88:6789/0 conn(0x7f3e640c8ee0 legacy=0x7f3e6406e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:44.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.124+0000 7f3e637fe640 1 -- 172.21.15.88:0/1988662827 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6415a600 con 0x7f3e6406ba50 2023-11-27T20:54:44.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.126+0000 7f3e637fe640 1 --2- 172.21.15.88:0/1988662827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e6406ba50 0x7f3e6406be80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3e6406e350 tx=0x7f3e5c02b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23d3f4e151949416 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:44.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.129+0000 7f3e61ffb640 1 -- 172.21.15.88:0/1988662827 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c031870 con 0x7f3e6406ba50 2023-11-27T20:54:44.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.130+0000 7f3e61ffb640 1 -- 172.21.15.88:0/1988662827 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5c0319d0 con 0x7f3e6406ba50 2023-11-27T20:54:44.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.130+0000 7f3e61ffb640 1 -- 172.21.15.88:0/1988662827 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c031d60 con 0x7f3e6406ba50 2023-11-27T20:54:44.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.130+0000 7f3e694ec640 1 -- 172.21.15.88:0/1988662827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e6406ba50 msgr2=0x7f3e6406be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:44.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.130+0000 7f3e694ec640 1 --2- 172.21.15.88:0/1988662827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e6406ba50 0x7f3e6406be80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3e6406e350 tx=0x7f3e5c02b910 comp rx=0 tx=0).stop 2023-11-27T20:54:44.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.130+0000 7f3e694ec640 1 -- 172.21.15.88:0/1988662827 shutdown_connections 2023-11-27T20:54:44.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.130+0000 7f3e694ec640 1 --2- 172.21.15.88:0/1988662827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e6406ba50 0x7f3e6406be80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:44.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.130+0000 7f3e694ec640 1 --2- 172.21.15.88:0/1988662827 >> v2:172.21.15.88:3300/0 conn(0x7f3e641538d0 0x7f3e6415a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:44.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.130+0000 7f3e694ec640 1 -- 172.21.15.88:0/1988662827 >> 172.21.15.88:0/1988662827 conn(0x7f3e64060f20 msgr2=0x7f3e64061300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:44.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.130+0000 7f3e694ec640 1 -- 172.21.15.88:0/1988662827 shutdown_connections 2023-11-27T20:54:44.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.130+0000 7f3e694ec640 1 -- 172.21.15.88:0/1988662827 wait complete. 2023-11-27T20:54:44.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.131+0000 7f3e694ec640 1 Processor -- start 2023-11-27T20:54:44.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.132+0000 7f3e694ec640 1 -- start start 2023-11-27T20:54:44.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.132+0000 7f3e694ec640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e6406ba50 0x7f3e641f0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:44.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.132+0000 7f3e694ec640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e640c8ee0 0x7f3e640c6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:44.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.132+0000 7f3e694ec640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e641538d0 0x7f3e641f2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:44.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.132+0000 7f3e694ec640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e640aeb00 con 0x7f3e641538d0 2023-11-27T20:54:44.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.132+0000 7f3e694ec640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e64150b20 con 0x7f3e640c8ee0 2023-11-27T20:54:44.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.132+0000 7f3e694ec640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e640ae360 con 0x7f3e6406ba50 2023-11-27T20:54:44.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.133+0000 7f3e627fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e640c8ee0 0x7f3e640c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:44.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.133+0000 7f3e637fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e641538d0 0x7f3e641f2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:44.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.133+0000 7f3e627fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e640c8ee0 0x7f3e640c6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:58468/0 (socket says 172.21.15.88:58468) 2023-11-27T20:54:44.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.133+0000 7f3e627fc640 1 -- 172.21.15.88:0/1286318422 learned_addr learned my addr 172.21.15.88:0/1286318422 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:44.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.133+0000 7f3e62ffd640 1 --2- 172.21.15.88:0/1286318422 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e6406ba50 0x7f3e641f0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:44.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.137+0000 7f3e627fc640 1 -- 172.21.15.88:0/1286318422 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e6406ba50 msgr2=0x7f3e641f0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:44.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.137+0000 7f3e627fc640 1 --2- 172.21.15.88:0/1286318422 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e6406ba50 0x7f3e641f0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:44.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.137+0000 7f3e627fc640 1 -- 172.21.15.88:0/1286318422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e641538d0 msgr2=0x7f3e641f2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:44.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.137+0000 7f3e627fc640 1 --2- 172.21.15.88:0/1286318422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e641538d0 0x7f3e641f2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:44.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.137+0000 7f3e627fc640 1 -- 172.21.15.88:0/1286318422 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5c0094d0 con 0x7f3e640c8ee0 2023-11-27T20:54:44.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.137+0000 7f3e637fe640 1 --2- 172.21.15.88:0/1286318422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e641538d0 0x7f3e641f2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:54:44.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.139+0000 7f3e627fc640 1 --2- 172.21.15.88:0/1286318422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e640c8ee0 0x7f3e640c6690 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3e5800c3f0 tx=0x7f3e5800c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:44.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.144+0000 7f3e4b7fe640 1 -- 172.21.15.88:0/1286318422 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e580052d0 con 0x7f3e640c8ee0 2023-11-27T20:54:44.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.144+0000 7f3e4b7fe640 1 -- 172.21.15.88:0/1286318422 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e58005450 con 0x7f3e640c8ee0 2023-11-27T20:54:44.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.144+0000 7f3e4b7fe640 1 -- 172.21.15.88:0/1286318422 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e58007260 con 0x7f3e640c8ee0 2023-11-27T20:54:44.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.144+0000 7f3e694ec640 1 -- 172.21.15.88:0/1286318422 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e641f3390 con 0x7f3e640c8ee0 2023-11-27T20:54:44.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.144+0000 7f3e694ec640 1 -- 172.21.15.88:0/1286318422 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e640adb60 con 0x7f3e640c8ee0 2023-11-27T20:54:44.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.144+0000 7f3e694ec640 1 -- 172.21.15.88:0/1286318422 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e640c99f0 con 0x7f3e640c8ee0 2023-11-27T20:54:44.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.163+0000 7f3e4b7fe640 1 -- 172.21.15.88:0/1286318422 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3e580073c0 con 0x7f3e640c8ee0 2023-11-27T20:54:44.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.163+0000 7f3e4b7fe640 1 --2- 172.21.15.88:0/1286318422 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3e5006b210 0x7f3e5006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:44.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.163+0000 7f3e62ffd640 1 --2- 172.21.15.88:0/1286318422 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3e5006b210 0x7f3e5006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:44.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.164+0000 7f3e62ffd640 1 --2- 172.21.15.88:0/1286318422 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3e5006b210 0x7f3e5006d6d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3e540113e0 tx=0x7f3e5400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:44.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.167+0000 7f3e4b7fe640 1 -- 172.21.15.88:0/1286318422 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3e58057cc0 con 0x7f3e640c8ee0 2023-11-27T20:54:44.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.408+0000 7f3e4b7fe640 1 -- 172.21.15.88:0/1286318422 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3e58054000 con 0x7f3e640c8ee0 2023-11-27T20:54:44.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.577+0000 7f3e694ec640 1 -- 172.21.15.88:0/1286318422 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3e6406af40 con 0x7f3e640c8ee0 2023-11-27T20:54:44.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.583+0000 7f3e4b7fe640 1 -- 172.21.15.88:0/1286318422 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3e58020070 con 0x7f3e640c8ee0 2023-11-27T20:54:44.585 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-27T20:54:44.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.585+0000 7f3e694ec640 1 -- 172.21.15.88:0/1286318422 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3e5006b210 msgr2=0x7f3e5006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:44.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.585+0000 7f3e694ec640 1 --2- 172.21.15.88:0/1286318422 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3e5006b210 0x7f3e5006d6d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3e540113e0 tx=0x7f3e5400b040 comp rx=0 tx=0).stop 2023-11-27T20:54:44.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.585+0000 7f3e694ec640 1 -- 172.21.15.88:0/1286318422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e640c8ee0 msgr2=0x7f3e640c6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:44.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.585+0000 7f3e694ec640 1 --2- 172.21.15.88:0/1286318422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e640c8ee0 0x7f3e640c6690 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3e5800c3f0 tx=0x7f3e5800c8b0 comp rx=0 tx=0).stop 2023-11-27T20:54:44.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.585+0000 7f3e694ec640 1 -- 172.21.15.88:0/1286318422 shutdown_connections 2023-11-27T20:54:44.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.585+0000 7f3e694ec640 1 --2- 172.21.15.88:0/1286318422 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3e5006b210 0x7f3e5006d6d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:44.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.585+0000 7f3e694ec640 1 --2- 172.21.15.88:0/1286318422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e641538d0 0x7f3e641f2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:44.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.585+0000 7f3e694ec640 1 --2- 172.21.15.88:0/1286318422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e640c8ee0 0x7f3e640c6690 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:44.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.585+0000 7f3e694ec640 1 --2- 172.21.15.88:0/1286318422 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e6406ba50 0x7f3e641f0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:44.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.585+0000 7f3e694ec640 1 -- 172.21.15.88:0/1286318422 >> 172.21.15.88:0/1286318422 conn(0x7f3e64060f20 msgr2=0x7f3e640c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:44.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.585+0000 7f3e694ec640 1 -- 172.21.15.88:0/1286318422 shutdown_connections 2023-11-27T20:54:44.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.585+0000 7f3e694ec640 1 -- 172.21.15.88:0/1286318422 wait complete. 2023-11-27T20:54:44.598 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T20:54:44.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.697+0000 7ff2f39d7640 1 Processor -- start 2023-11-27T20:54:44.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.697+0000 7ff2f39d7640 1 -- start start 2023-11-27T20:54:44.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.698+0000 7ff2f39d7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2ec0c7640 0x7ff2ec06f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:44.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.698+0000 7ff2f39d7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff2ec0c2600 0x7ff2ec158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:44.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.698+0000 7ff2f39d7640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2ec1573c0 con 0x7ff2ec151260 2023-11-27T20:54:44.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.698+0000 7ff2f39d7640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2ec1571d0 con 0x7ff2ec0c2600 2023-11-27T20:54:44.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.698+0000 7ff2f39d7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec1576a0 con 0x7ff2ec0c7640 2023-11-27T20:54:44.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.698+0000 7ff2f0f72640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2ec0c7640 0x7ff2ec06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:44.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.699+0000 7ff2f1773640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7ff2ec151260 0x7ff2ec0ccf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:36918/0 (socket says 172.21.15.88:36918) 2023-11-27T20:54:44.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.699+0000 7ff2f1773640 1 -- 172.21.15.88:0/540619272 learned_addr learned my addr 172.21.15.88:0/540619272 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:54:44.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.699+0000 7ff2f1f74640 1 --2- 172.21.15.88:0/540619272 >> v2:172.21.15.167:3300/0 conn(0x7ff2ec0c2600 0x7ff2ec158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:44.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.701+0000 7ff2f0f72640 1 -- 172.21.15.88:0/540619272 >> v2:172.21.15.167:3300/0 conn(0x7ff2ec0c2600 msgr2=0x7ff2ec158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:44.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.701+0000 7ff2f0f72640 1 --2- 172.21.15.88:0/540619272 >> v2:172.21.15.167:3300/0 conn(0x7ff2ec0c2600 0x7ff2ec158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:44.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.701+0000 7ff2f0f72640 1 -- 172.21.15.88:0/540619272 >> v1:172.21.15.167:6789/0 conn(0x7ff2ec151260 legacy=0x7ff2ec0ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:44.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.701+0000 7ff2f0f72640 1 -- 172.21.15.88:0/540619272 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec157980 con 0x7ff2ec0c7640 2023-11-27T20:54:44.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.704+0000 7ff2f0f72640 1 --2- 172.21.15.88:0/540619272 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2ec0c7640 0x7ff2ec06f040 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc0097a0 tx=0x7ff2dc02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfa053798f12b315 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:44.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.708+0000 7ff2e3fff640 1 -- 172.21.15.88:0/540619272 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc031830 con 0x7ff2ec0c7640 2023-11-27T20:54:44.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.708+0000 7ff2e3fff640 1 -- 172.21.15.88:0/540619272 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc031990 con 0x7ff2ec0c7640 2023-11-27T20:54:44.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.708+0000 7ff2e3fff640 1 -- 172.21.15.88:0/540619272 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc031d20 con 0x7ff2ec0c7640 2023-11-27T20:54:44.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.708+0000 7ff2f39d7640 1 -- 172.21.15.88:0/540619272 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2ec0c7640 msgr2=0x7ff2ec06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:44.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.708+0000 7ff2f39d7640 1 --2- 172.21.15.88:0/540619272 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2ec0c7640 0x7ff2ec06f040 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc0097a0 tx=0x7ff2dc02b8d0 comp rx=0 tx=0).stop 2023-11-27T20:54:44.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.708+0000 7ff2f39d7640 1 -- 172.21.15.88:0/540619272 shutdown_connections 2023-11-27T20:54:44.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.708+0000 7ff2f39d7640 1 --2- 172.21.15.88:0/540619272 >> v2:172.21.15.167:3300/0 conn(0x7ff2ec0c2600 0x7ff2ec158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:44.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.708+0000 7ff2f39d7640 1 --2- 172.21.15.88:0/540619272 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2ec0c7640 0x7ff2ec06f040 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:44.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.708+0000 7ff2f39d7640 1 -- 172.21.15.88:0/540619272 >> 172.21.15.88:0/540619272 conn(0x7ff2ec070990 msgr2=0x7ff2ec070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:44.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.709+0000 7ff2f39d7640 1 -- 172.21.15.88:0/540619272 shutdown_connections 2023-11-27T20:54:44.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.709+0000 7ff2f39d7640 1 -- 172.21.15.88:0/540619272 wait complete. 2023-11-27T20:54:44.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.710+0000 7ff2f39d7640 1 Processor -- start 2023-11-27T20:54:44.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.710+0000 7ff2f39d7640 1 -- start start 2023-11-27T20:54:44.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.710+0000 7ff2f39d7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2ec0c2600 0x7ff2ec0c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:44.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.710+0000 7ff2f39d7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2ec0c7640 0x7ff2ec14dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:44.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.710+0000 7ff2f39d7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2ec151260 0x7ff2ec0737a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:44.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.710+0000 7ff2f39d7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec14e1c0 con 0x7ff2ec0c2600 2023-11-27T20:54:44.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.710+0000 7ff2f39d7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec14e4a0 con 0x7ff2ec151260 2023-11-27T20:54:44.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.710+0000 7ff2f39d7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec1ed560 con 0x7ff2ec0c7640 2023-11-27T20:54:44.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.711+0000 7ff2f1773640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2ec0c2600 0x7ff2ec0c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:44.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.711+0000 7ff2f1f74640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2ec151260 0x7ff2ec0737a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:44.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.711+0000 7ff2f0f72640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2ec0c7640 0x7ff2ec14dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:44.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.711+0000 7ff2f1f74640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2ec151260 0x7ff2ec0737a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:58490/0 (socket says 172.21.15.88:58490) 2023-11-27T20:54:44.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.711+0000 7ff2f1f74640 1 -- 172.21.15.88:0/1344174011 learned_addr learned my addr 172.21.15.88:0/1344174011 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:44.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.715+0000 7ff2f1773640 1 -- 172.21.15.88:0/1344174011 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2ec0c7640 msgr2=0x7ff2ec14dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:44.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.715+0000 7ff2f1773640 1 --2- 172.21.15.88:0/1344174011 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2ec0c7640 0x7ff2ec14dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:44.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.715+0000 7ff2f1773640 1 -- 172.21.15.88:0/1344174011 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2ec151260 msgr2=0x7ff2ec0737a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:44.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.715+0000 7ff2f1773640 1 --2- 172.21.15.88:0/1344174011 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2ec151260 0x7ff2ec0737a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:44.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.715+0000 7ff2f1773640 1 -- 172.21.15.88:0/1344174011 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc009400 con 0x7ff2ec0c2600 2023-11-27T20:54:44.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.717+0000 7ff2f1773640 1 --2- 172.21.15.88:0/1344174011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2ec0c2600 0x7ff2ec0c52f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800c440 tx=0x7ff2e8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:44.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.721+0000 7ff2e1ffb640 1 -- 172.21.15.88:0/1344174011 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8005ce0 con 0x7ff2ec0c2600 2023-11-27T20:54:44.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.721+0000 7ff2e1ffb640 1 -- 172.21.15.88:0/1344174011 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e8005e40 con 0x7ff2ec0c2600 2023-11-27T20:54:44.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.721+0000 7ff2f39d7640 1 -- 172.21.15.88:0/1344174011 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2ec1ed840 con 0x7ff2ec0c2600 2023-11-27T20:54:44.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.721+0000 7ff2e1ffb640 1 -- 172.21.15.88:0/1344174011 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e80072d0 con 0x7ff2ec0c2600 2023-11-27T20:54:44.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.721+0000 7ff2f39d7640 1 -- 172.21.15.88:0/1344174011 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2ec1ede00 con 0x7ff2ec0c2600 2023-11-27T20:54:44.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.722+0000 7ff2f39d7640 1 -- 172.21.15.88:0/1344174011 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2ec0c3210 con 0x7ff2ec0c2600 2023-11-27T20:54:44.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.739+0000 7ff2e1ffb640 1 -- 172.21.15.88:0/1344174011 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff2e8007430 con 0x7ff2ec0c2600 2023-11-27T20:54:44.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.739+0000 7ff2e1ffb640 1 --2- 172.21.15.88:0/1344174011 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff2d006b240 0x7ff2d006d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:44.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.740+0000 7ff2f0f72640 1 --2- 172.21.15.88:0/1344174011 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff2d006b240 0x7ff2d006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:44.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.740+0000 7ff2f0f72640 1 --2- 172.21.15.88:0/1344174011 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff2d006b240 0x7ff2d006d700 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc036000 tx=0x7ff2dc03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:44.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.975+0000 7ff2e1ffb640 1 -- 172.21.15.88:0/1344174011 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff2e8057eb0 con 0x7ff2ec0c2600 2023-11-27T20:54:44.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:44.975+0000 7ff2e1ffb640 1 -- 172.21.15.88:0/1344174011 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff2e80541f0 con 0x7ff2ec0c2600 2023-11-27T20:54:45.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.160+0000 7ff2f39d7640 1 -- 172.21.15.88:0/1344174011 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff2ec067470 con 0x7ff2ec0c2600 2023-11-27T20:54:45.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.164+0000 7ff2e1ffb640 1 -- 172.21.15.88:0/1344174011 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff2e8057810 con 0x7ff2ec0c2600 2023-11-27T20:54:45.167 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-11-27T20:54:45.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.166+0000 7ff2f39d7640 1 -- 172.21.15.88:0/1344174011 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff2d006b240 msgr2=0x7ff2d006d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:45.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.166+0000 7ff2f39d7640 1 --2- 172.21.15.88:0/1344174011 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff2d006b240 0x7ff2d006d700 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc036000 tx=0x7ff2dc03c040 comp rx=0 tx=0).stop 2023-11-27T20:54:45.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.166+0000 7ff2f39d7640 1 -- 172.21.15.88:0/1344174011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2ec0c2600 msgr2=0x7ff2ec0c52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:45.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.166+0000 7ff2f39d7640 1 --2- 172.21.15.88:0/1344174011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2ec0c2600 0x7ff2ec0c52f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800c440 tx=0x7ff2e8001e70 comp rx=0 tx=0).stop 2023-11-27T20:54:45.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.166+0000 7ff2f39d7640 1 -- 172.21.15.88:0/1344174011 shutdown_connections 2023-11-27T20:54:45.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.166+0000 7ff2f39d7640 1 --2- 172.21.15.88:0/1344174011 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff2d006b240 0x7ff2d006d700 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:45.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.166+0000 7ff2f39d7640 1 --2- 172.21.15.88:0/1344174011 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2ec151260 0x7ff2ec0737a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:45.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.166+0000 7ff2f39d7640 1 --2- 172.21.15.88:0/1344174011 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2ec0c7640 0x7ff2ec14dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:45.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.166+0000 7ff2f39d7640 1 --2- 172.21.15.88:0/1344174011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2ec0c2600 0x7ff2ec0c52f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:45.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.166+0000 7ff2f39d7640 1 -- 172.21.15.88:0/1344174011 >> 172.21.15.88:0/1344174011 conn(0x7ff2ec070990 msgr2=0x7ff2ec0affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:45.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.166+0000 7ff2f39d7640 1 -- 172.21.15.88:0/1344174011 shutdown_connections 2023-11-27T20:54:45.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.166+0000 7ff2f39d7640 1 -- 172.21.15.88:0/1344174011 wait complete. 2023-11-27T20:54:45.179 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:54:45.179 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:54:45.198 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:54:45.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.341+0000 7fa73c5b0640 1 Processor -- start 2023-11-27T20:54:45.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.341+0000 7fa73c5b0640 1 -- start start 2023-11-27T20:54:45.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.342+0000 7fa73c5b0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7340c9c70 0x7fa7341594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:45.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.342+0000 7fa73c5b0640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa7340cbf00 0x7fa7340ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:45.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.342+0000 7fa73c5b0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7340cba70 con 0x7fa7340cd000 2023-11-27T20:54:45.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.342+0000 7fa73c5b0640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa734153c60 con 0x7fa7340cbf00 2023-11-27T20:54:45.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.342+0000 7fa73c5b0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7340cb490 con 0x7fa7340c9c70 2023-11-27T20:54:45.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.343+0000 7fa739b4b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa7340cbf00 0x7fa7340ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:45.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.343+0000 7fa73a34c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7340c9c70 0x7fa7341594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:45.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.343+0000 7fa73ab4d640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fa7340cd000 0x7fa7340cd430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:36930/0 (socket says 172.21.15.88:36930) 2023-11-27T20:54:45.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.343+0000 7fa73ab4d640 1 -- 172.21.15.88:0/3869274584 learned_addr learned my addr 172.21.15.88:0/3869274584 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:54:45.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.345+0000 7fa739b4b640 1 -- 172.21.15.88:0/3869274584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7340c9c70 msgr2=0x7fa7341594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:45.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.345+0000 7fa739b4b640 1 --2- 172.21.15.88:0/3869274584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7340c9c70 0x7fa7341594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:45.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.345+0000 7fa739b4b640 1 -- 172.21.15.88:0/3869274584 >> v1:172.21.15.167:6789/0 conn(0x7fa7340cd000 legacy=0x7fa7340cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:45.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.345+0000 7fa739b4b640 1 -- 172.21.15.88:0/3869274584 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7340ce2f0 con 0x7fa7340cbf00 2023-11-27T20:54:45.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.345+0000 7fa73934a640 1 -- 172.21.15.88:0/3869274584 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915962416 0 0) 0x7fa7340cba70 con 0x7fa7340cd000 2023-11-27T20:54:45.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.347+0000 7fa739b4b640 1 --2- 172.21.15.88:0/3869274584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7340cbf00 0x7fa7340ccac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa7240097a0 tx=0x7fa72402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b134d5ff44765d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:45.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.351+0000 7fa73934a640 1 -- 172.21.15.88:0/3869274584 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa724031830 con 0x7fa7340cbf00 2023-11-27T20:54:45.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.351+0000 7fa73934a640 1 -- 172.21.15.88:0/3869274584 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa724031990 con 0x7fa7340cbf00 2023-11-27T20:54:45.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.351+0000 7fa73934a640 1 -- 172.21.15.88:0/3869274584 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa724031d20 con 0x7fa7340cbf00 2023-11-27T20:54:45.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.351+0000 7fa73c5b0640 1 -- 172.21.15.88:0/3869274584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7340cbf00 msgr2=0x7fa7340ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:45.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.351+0000 7fa73c5b0640 1 --2- 172.21.15.88:0/3869274584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7340cbf00 0x7fa7340ccac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa7240097a0 tx=0x7fa72402b8d0 comp rx=0 tx=0).stop 2023-11-27T20:54:45.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.351+0000 7fa73c5b0640 1 -- 172.21.15.88:0/3869274584 shutdown_connections 2023-11-27T20:54:45.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.351+0000 7fa73c5b0640 1 --2- 172.21.15.88:0/3869274584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7340cbf00 0x7fa7340ccac0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:45.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.351+0000 7fa73c5b0640 1 --2- 172.21.15.88:0/3869274584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7340c9c70 0x7fa7341594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:45.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.351+0000 7fa73c5b0640 1 -- 172.21.15.88:0/3869274584 >> 172.21.15.88:0/3869274584 conn(0x7fa7340b07d0 msgr2=0x7fa7340b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:45.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.351+0000 7fa73c5b0640 1 -- 172.21.15.88:0/3869274584 shutdown_connections 2023-11-27T20:54:45.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.351+0000 7fa73c5b0640 1 -- 172.21.15.88:0/3869274584 wait complete. 2023-11-27T20:54:45.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.353+0000 7fa73c5b0640 1 Processor -- start 2023-11-27T20:54:45.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.353+0000 7fa73c5b0640 1 -- start start 2023-11-27T20:54:45.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.353+0000 7fa73c5b0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7340c9c70 0x7fa73415b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:45.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.353+0000 7fa73c5b0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7340cbf00 0x7fa7341f2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:45.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.353+0000 7fa73c5b0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7340cd000 0x7fa73415a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:45.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.353+0000 7fa73c5b0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7341f27b0 con 0x7fa7340c9c70 2023-11-27T20:54:45.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.353+0000 7fa73c5b0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73415d810 con 0x7fa7340cbf00 2023-11-27T20:54:45.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.353+0000 7fa73c5b0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7341588a0 con 0x7fa7340cd000 2023-11-27T20:54:45.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.354+0000 7fa73a34c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7340c9c70 0x7fa73415b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:45.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.354+0000 7fa739b4b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7340cbf00 0x7fa7341f2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:45.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.354+0000 7fa73ab4d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7340cd000 0x7fa73415a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:45.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.354+0000 7fa739b4b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7340cbf00 0x7fa7341f2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:58496/0 (socket says 172.21.15.88:58496) 2023-11-27T20:54:45.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.354+0000 7fa739b4b640 1 -- 172.21.15.88:0/2562296986 learned_addr learned my addr 172.21.15.88:0/2562296986 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:45.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.358+0000 7fa73a34c640 1 -- 172.21.15.88:0/2562296986 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7340cd000 msgr2=0x7fa73415a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:45.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.358+0000 7fa73a34c640 1 --2- 172.21.15.88:0/2562296986 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7340cd000 0x7fa73415a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:45.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.358+0000 7fa73a34c640 1 -- 172.21.15.88:0/2562296986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7340cbf00 msgr2=0x7fa7341f2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:45.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.358+0000 7fa73a34c640 1 --2- 172.21.15.88:0/2562296986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7340cbf00 0x7fa7341f2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:45.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.358+0000 7fa73a34c640 1 -- 172.21.15.88:0/2562296986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa724009400 con 0x7fa7340c9c70 2023-11-27T20:54:45.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.360+0000 7fa73a34c640 1 --2- 172.21.15.88:0/2562296986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7340c9c70 0x7fa73415b160 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00efc0 tx=0x7fa72c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:45.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.363+0000 7fa72affd640 1 -- 172.21.15.88:0/2562296986 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c014480 con 0x7fa7340c9c70 2023-11-27T20:54:45.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.363+0000 7fa72affd640 1 -- 172.21.15.88:0/2562296986 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c00f040 con 0x7fa7340c9c70 2023-11-27T20:54:45.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.363+0000 7fa72affd640 1 -- 172.21.15.88:0/2562296986 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c014800 con 0x7fa7340c9c70 2023-11-27T20:54:45.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.363+0000 7fa73c5b0640 1 -- 172.21.15.88:0/2562296986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa734159310 con 0x7fa7340c9c70 2023-11-27T20:54:45.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.363+0000 7fa73c5b0640 1 -- 172.21.15.88:0/2562296986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa734159030 con 0x7fa7340c9c70 2023-11-27T20:54:45.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.364+0000 7fa73c5b0640 1 -- 172.21.15.88:0/2562296986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa734067d60 con 0x7fa7340c9c70 2023-11-27T20:54:45.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.382+0000 7fa72affd640 1 -- 172.21.15.88:0/2562296986 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa72c014960 con 0x7fa7340c9c70 2023-11-27T20:54:45.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.383+0000 7fa72affd640 1 --2- 172.21.15.88:0/2562296986 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa71806b210 0x7fa71806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:45.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.383+0000 7fa739b4b640 1 --2- 172.21.15.88:0/2562296986 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa71806b210 0x7fa71806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:45.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.383+0000 7fa739b4b640 1 --2- 172.21.15.88:0/2562296986 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa71806b210 0x7fa71806d6d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa7341eca60 tx=0x7fa72403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:45.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.385+0000 7fa72affd640 1 -- 172.21.15.88:0/2562296986 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa72c059920 con 0x7fa7340c9c70 2023-11-27T20:54:45.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.623+0000 7fa72affd640 1 -- 172.21.15.88:0/2562296986 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa72c055c60 con 0x7fa7340c9c70 2023-11-27T20:54:45.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.808+0000 7fa73c5b0640 1 -- 172.21.15.88:0/2562296986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa73406d150 con 0x7fa7340c9c70 2023-11-27T20:54:45.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.882+0000 7fa72affd640 1 -- 172.21.15.88:0/2562296986 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18339 (secure 0 0 0) 0x7fa72c059280 con 0x7fa7340c9c70 2023-11-27T20:54:45.884 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:54:45.885 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc","created":"2023-11-27T20:53:53.110827+0000","modified":"2023-11-27T20:54:32.470579+0000","last_up_change":"2023-11-27T20:54:08.219383+0000","last_in_change":"2023-11-27T20:53:59.022798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:54:09.277670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:54:24.503156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:54:25.744043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T20:54:29.704111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1207ca0f-bef1-44c6-b66b-58bf0e080ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6819","nonce":3952326022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6821","nonce":3952326022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6825","nonce":3952326022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6823","nonce":3952326022}]},"public_addr":"172.21.15.88:6819/3952326022","cluster_addr":"172.21.15.88:6821/3952326022","heartbeat_back_addr":"172.21.15.88:6825/3952326022","heartbeat_front_addr":"172.21.15.88:6823/3952326022","state":["exists","up"]},{"osd":1,"uuid":"8d1be479-4241-4335-9633-1394311fde76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6827","nonce":1788401966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6829","nonce":1788401966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6833","nonce":1788401966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6831","nonce":1788401966}]},"public_addr":"172.21.15.88:6827/1788401966","cluster_addr":"172.21.15.88:6829/1788401966","heartbeat_back_addr":"172.21.15.88:6833/1788401966","heartbeat_front_addr":"172.21.15.88:6831/1788401966","state":["exists","up"]},{"osd":2,"uuid":"7536b008-05dd-40eb-9d4a-bdac4b1c38c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6803","nonce":1166333913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6805","nonce":1166333913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6809","nonce":1166333913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6807","nonce":1166333913}]},"public_addr":"172.21.15.88:6803/1166333913","cluster_addr":"172.21.15.88:6805/1166333913","heartbeat_back_addr":"172.21.15.88:6809/1166333913","heartbeat_front_addr":"172.21.15.88:6807/1166333913","state":["exists","up"]},{"osd":3,"uuid":"47edd4d7-e99c-4ce3-851b-cc9c8e2d4480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6811","nonce":406887502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6813","nonce":406887502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6817","nonce":406887502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6815","nonce":406887502}]},"public_addr":"172.21.15.88:6811/406887502","cluster_addr":"172.21.15.88:6813/406887502","heartbeat_back_addr":"172.21.15.88:6817/406887502","heartbeat_front_addr":"172.21.15.88:6815/406887502","state":["exists","up"]},{"osd":4,"uuid":"0a81dd31-1a8b-41af-b933-d74aae63f3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6801","nonce":2551293703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6803","nonce":2551293703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6807","nonce":2551293703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6805","nonce":2551293703}]},"public_addr":"172.21.15.167:6801/2551293703","cluster_addr":"172.21.15.167:6803/2551293703","heartbeat_back_addr":"172.21.15.167:6807/2551293703","heartbeat_front_addr":"172.21.15.167:6805/2551293703","state":["exists","up"]},{"osd":5,"uuid":"1c462d0d-3361-48b3-a82a-86a920539e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6825","nonce":866085094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6827","nonce":866085094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6831","nonce":866085094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6829","nonce":866085094}]},"public_addr":"172.21.15.167:6825/866085094","cluster_addr":"172.21.15.167:6827/866085094","heartbeat_back_addr":"172.21.15.167:6831/866085094","heartbeat_front_addr":"172.21.15.167:6829/866085094","state":["exists","up"]},{"osd":6,"uuid":"d687c5ad-6c88-4a15-8120-0cdbc5610535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6809","nonce":2766725538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6811","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6813","nonce":2766725538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6819","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6821","nonce":2766725538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6815","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6817","nonce":2766725538}]},"public_addr":"172.21.15.167:6809/2766725538","cluster_addr":"172.21.15.167:6813/2766725538","heartbeat_back_addr":"172.21.15.167:6821/2766725538","heartbeat_front_addr":"172.21.15.167:6817/2766725538","state":["exists","up"]},{"osd":7,"uuid":"c9a50596-4981-4bd8-a8ef-d7679f8d9559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6812","nonce":2695037266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6816","nonce":2695037266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6823","nonce":2695037266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6820","nonce":2695037266}]},"public_addr":"172.21.15.167:6812/2695037266","cluster_addr":"172.21.15.167:6816/2695037266","heartbeat_back_addr":"172.21.15.167:6823/2695037266","heartbeat_front_addr":"172.21.15.167:6820/2695037266","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.522590+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.483170+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.492504+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.432204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.414964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.459803+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.437250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.460394+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:54:45.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.885+0000 7fa73c5b0640 1 -- 172.21.15.88:0/2562296986 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa71806b210 msgr2=0x7fa71806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:45.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.885+0000 7fa73c5b0640 1 --2- 172.21.15.88:0/2562296986 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa71806b210 0x7fa71806d6d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa7341eca60 tx=0x7fa72403c040 comp rx=0 tx=0).stop 2023-11-27T20:54:45.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.885+0000 7fa73c5b0640 1 -- 172.21.15.88:0/2562296986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7340c9c70 msgr2=0x7fa73415b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:45.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.885+0000 7fa73c5b0640 1 --2- 172.21.15.88:0/2562296986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7340c9c70 0x7fa73415b160 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00efc0 tx=0x7fa72c00c490 comp rx=0 tx=0).stop 2023-11-27T20:54:45.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.885+0000 7fa73c5b0640 1 -- 172.21.15.88:0/2562296986 shutdown_connections 2023-11-27T20:54:45.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.885+0000 7fa73c5b0640 1 --2- 172.21.15.88:0/2562296986 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa71806b210 0x7fa71806d6d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:45.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.885+0000 7fa73c5b0640 1 --2- 172.21.15.88:0/2562296986 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7340cd000 0x7fa73415a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:45.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.885+0000 7fa73c5b0640 1 --2- 172.21.15.88:0/2562296986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7340cbf00 0x7fa7341f2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:45.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.885+0000 7fa73c5b0640 1 --2- 172.21.15.88:0/2562296986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7340c9c70 0x7fa73415b160 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:45.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.885+0000 7fa73c5b0640 1 -- 172.21.15.88:0/2562296986 >> 172.21.15.88:0/2562296986 conn(0x7fa7340b07d0 msgr2=0x7fa7340c7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:45.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.885+0000 7fa73c5b0640 1 -- 172.21.15.88:0/2562296986 shutdown_connections 2023-11-27T20:54:45.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:45.885+0000 7fa73c5b0640 1 -- 172.21.15.88:0/2562296986 wait complete. 2023-11-27T20:54:45.897 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:54:09.277670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:54:24.503156+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:54:25.744043+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-27T20:54:29.704111+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-27T20:54:45.898 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:54:46.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.000+0000 7fcc30ed0640 1 Processor -- start 2023-11-27T20:54:46.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.000+0000 7fcc30ed0640 1 -- start start 2023-11-27T20:54:46.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.001+0000 7fcc30ed0640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcc2c153730 0x7fcc2c06efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:46.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.001+0000 7fcc30ed0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcc2c15d650 0x7fcc2c0cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:46.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.001+0000 7fcc30ed0640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc2c0c7b40 con 0x7fcc2c0cced0 2023-11-27T20:54:46.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.001+0000 7fcc30ed0640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc2c153b10 con 0x7fcc2c153730 2023-11-27T20:54:46.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.001+0000 7fcc30ed0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc2c159720 con 0x7fcc2c15d650 2023-11-27T20:54:46.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.001+0000 7fcc2a59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcc2c153730 0x7fcc2c06efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:46.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.001+0000 7fcc2ad9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcc2c15d650 0x7fcc2c0cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:46.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.002+0000 7fcc2ad9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcc2c15d650 0x7fcc2c0cd360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:58510/0 (socket says 172.21.15.88:58510) 2023-11-27T20:54:46.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.002+0000 7fcc2ad9d640 1 -- 172.21.15.88:0/3479832264 learned_addr learned my addr 172.21.15.88:0/3479832264 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:46.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.004+0000 7fcc2ad9d640 1 -- 172.21.15.88:0/3479832264 >> v2:172.21.15.88:3300/0 conn(0x7fcc2c153730 msgr2=0x7fcc2c06efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:46.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.004+0000 7fcc2ad9d640 1 --2- 172.21.15.88:0/3479832264 >> v2:172.21.15.88:3300/0 conn(0x7fcc2c153730 0x7fcc2c06efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:46.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.004+0000 7fcc2ad9d640 1 -- 172.21.15.88:0/3479832264 >> v1:172.21.15.88:6789/0 conn(0x7fcc2c0cced0 legacy=0x7fcc2c15cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:46.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.004+0000 7fcc2ad9d640 1 -- 172.21.15.88:0/3479832264 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2c159a00 con 0x7fcc2c15d650 2023-11-27T20:54:46.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.006+0000 7fcc2ad9d640 1 --2- 172.21.15.88:0/3479832264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc2c15d650 0x7fcc2c0cd360 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c0c1e90 tx=0x7fcc2402c010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55b69368b436b5df server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:46.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.010+0000 7fcc29d9b640 1 -- 172.21.15.88:0/3479832264 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2402cbb0 con 0x7fcc2c15d650 2023-11-27T20:54:46.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.010+0000 7fcc29d9b640 1 -- 172.21.15.88:0/3479832264 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2402cd10 con 0x7fcc2c15d650 2023-11-27T20:54:46.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.010+0000 7fcc29d9b640 1 -- 172.21.15.88:0/3479832264 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc24034610 con 0x7fcc2c15d650 2023-11-27T20:54:46.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.010+0000 7fcc30ed0640 1 -- 172.21.15.88:0/3479832264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc2c15d650 msgr2=0x7fcc2c0cd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:46.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.010+0000 7fcc30ed0640 1 --2- 172.21.15.88:0/3479832264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc2c15d650 0x7fcc2c0cd360 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c0c1e90 tx=0x7fcc2402c010 comp rx=0 tx=0).stop 2023-11-27T20:54:46.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.010+0000 7fcc30ed0640 1 -- 172.21.15.88:0/3479832264 shutdown_connections 2023-11-27T20:54:46.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.010+0000 7fcc30ed0640 1 --2- 172.21.15.88:0/3479832264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc2c15d650 0x7fcc2c0cd360 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:46.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.010+0000 7fcc30ed0640 1 --2- 172.21.15.88:0/3479832264 >> v2:172.21.15.88:3300/0 conn(0x7fcc2c153730 0x7fcc2c06efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:46.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.010+0000 7fcc30ed0640 1 -- 172.21.15.88:0/3479832264 >> 172.21.15.88:0/3479832264 conn(0x7fcc2c070990 msgr2=0x7fcc2c070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:46.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.010+0000 7fcc30ed0640 1 -- 172.21.15.88:0/3479832264 shutdown_connections 2023-11-27T20:54:46.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.011+0000 7fcc30ed0640 1 -- 172.21.15.88:0/3479832264 wait complete. 2023-11-27T20:54:46.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.012+0000 7fcc30ed0640 1 Processor -- start 2023-11-27T20:54:46.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.012+0000 7fcc30ed0640 1 -- start start 2023-11-27T20:54:46.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.013+0000 7fcc30ed0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc2c0cced0 0x7fcc2c0ad420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:46.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.013+0000 7fcc30ed0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc2c153730 0x7fcc2c1e3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:46.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.013+0000 7fcc30ed0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc2c15d650 0x7fcc2c0b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:46.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.013+0000 7fcc30ed0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c0af960 con 0x7fcc2c0cced0 2023-11-27T20:54:46.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.013+0000 7fcc30ed0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c1e4440 con 0x7fcc2c153730 2023-11-27T20:54:46.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.013+0000 7fcc30ed0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c0b1840 con 0x7fcc2c15d650 2023-11-27T20:54:46.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.013+0000 7fcc2a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc2c0cced0 0x7fcc2c0ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:46.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.013+0000 7fcc23fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc2c153730 0x7fcc2c1e3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:46.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.013+0000 7fcc2ad9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc2c15d650 0x7fcc2c0b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:46.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.013+0000 7fcc23fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc2c153730 0x7fcc2c1e3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:58512/0 (socket says 172.21.15.88:58512) 2023-11-27T20:54:46.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.013+0000 7fcc23fff640 1 -- 172.21.15.88:0/957600361 learned_addr learned my addr 172.21.15.88:0/957600361 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:46.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.017+0000 7fcc2a59c640 1 -- 172.21.15.88:0/957600361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc2c15d650 msgr2=0x7fcc2c0b1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:46.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.017+0000 7fcc2a59c640 1 --2- 172.21.15.88:0/957600361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc2c15d650 0x7fcc2c0b1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:46.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.017+0000 7fcc2a59c640 1 -- 172.21.15.88:0/957600361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc2c153730 msgr2=0x7fcc2c1e3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:46.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.017+0000 7fcc2a59c640 1 --2- 172.21.15.88:0/957600361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc2c153730 0x7fcc2c1e3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:46.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.017+0000 7fcc2a59c640 1 -- 172.21.15.88:0/957600361 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc24009b30 con 0x7fcc2c0cced0 2023-11-27T20:54:46.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.019+0000 7fcc2a59c640 1 --2- 172.21.15.88:0/957600361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc2c0cced0 0x7fcc2c0ad420 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00e850 tx=0x7fcc1c00ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:46.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.023+0000 7fcc22ffd640 1 -- 172.21.15.88:0/957600361 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c0095b0 con 0x7fcc2c0cced0 2023-11-27T20:54:46.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.023+0000 7fcc22ffd640 1 -- 172.21.15.88:0/957600361 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1c00c940 con 0x7fcc2c0cced0 2023-11-27T20:54:46.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.023+0000 7fcc30ed0640 1 -- 172.21.15.88:0/957600361 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc2c0ad160 con 0x7fcc2c0cced0 2023-11-27T20:54:46.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.023+0000 7fcc22ffd640 1 -- 172.21.15.88:0/957600361 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c00ccd0 con 0x7fcc2c0cced0 2023-11-27T20:54:46.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.023+0000 7fcc30ed0640 1 -- 172.21.15.88:0/957600361 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc2c0b02d0 con 0x7fcc2c0cced0 2023-11-27T20:54:46.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.024+0000 7fcc30ed0640 1 -- 172.21.15.88:0/957600361 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc2c067470 con 0x7fcc2c0cced0 2023-11-27T20:54:46.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.041+0000 7fcc22ffd640 1 -- 172.21.15.88:0/957600361 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fcc1c013470 con 0x7fcc2c0cced0 2023-11-27T20:54:46.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.042+0000 7fcc22ffd640 1 --2- 172.21.15.88:0/957600361 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fcc0c06b210 0x7fcc0c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:46.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.042+0000 7fcc23fff640 1 --2- 172.21.15.88:0/957600361 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fcc0c06b210 0x7fcc0c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:46.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.042+0000 7fcc23fff640 1 --2- 172.21.15.88:0/957600361 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fcc0c06b210 0x7fcc0c06d6d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c156ff0 tx=0x7fcc14009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:46.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.044+0000 7fcc22ffd640 1 -- 172.21.15.88:0/957600361 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcc1c00ce30 con 0x7fcc2c0cced0 2023-11-27T20:54:46.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.274+0000 7fcc22ffd640 1 -- 172.21.15.88:0/957600361 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fcc1c054f80 con 0x7fcc2c0cced0 2023-11-27T20:54:46.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.441+0000 7fcc30ed0640 1 -- 172.21.15.88:0/957600361 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcc2c0ad160 con 0x7fcc2c0cced0 2023-11-27T20:54:46.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.447+0000 7fcc22ffd640 1 -- 172.21.15.88:0/957600361 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcc2c0ad160 con 0x7fcc2c0cced0 2023-11-27T20:54:46.449 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-27T20:54:46.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.449+0000 7fcc30ed0640 1 -- 172.21.15.88:0/957600361 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fcc0c06b210 msgr2=0x7fcc0c06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:46.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.449+0000 7fcc30ed0640 1 --2- 172.21.15.88:0/957600361 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fcc0c06b210 0x7fcc0c06d6d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c156ff0 tx=0x7fcc14009040 comp rx=0 tx=0).stop 2023-11-27T20:54:46.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.449+0000 7fcc30ed0640 1 -- 172.21.15.88:0/957600361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc2c0cced0 msgr2=0x7fcc2c0ad420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:46.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.449+0000 7fcc30ed0640 1 --2- 172.21.15.88:0/957600361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc2c0cced0 0x7fcc2c0ad420 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00e850 tx=0x7fcc1c00ed10 comp rx=0 tx=0).stop 2023-11-27T20:54:46.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.449+0000 7fcc30ed0640 1 -- 172.21.15.88:0/957600361 shutdown_connections 2023-11-27T20:54:46.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.449+0000 7fcc30ed0640 1 --2- 172.21.15.88:0/957600361 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fcc0c06b210 0x7fcc0c06d6d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:46.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.449+0000 7fcc30ed0640 1 --2- 172.21.15.88:0/957600361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc2c15d650 0x7fcc2c0b1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:46.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.449+0000 7fcc30ed0640 1 --2- 172.21.15.88:0/957600361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc2c153730 0x7fcc2c1e3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:46.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.449+0000 7fcc30ed0640 1 --2- 172.21.15.88:0/957600361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc2c0cced0 0x7fcc2c0ad420 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:46.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.450+0000 7fcc30ed0640 1 -- 172.21.15.88:0/957600361 >> 172.21.15.88:0/957600361 conn(0x7fcc2c070990 msgr2=0x7fcc2c1572a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:46.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.450+0000 7fcc30ed0640 1 -- 172.21.15.88:0/957600361 shutdown_connections 2023-11-27T20:54:46.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.450+0000 7fcc30ed0640 1 -- 172.21.15.88:0/957600361 wait complete. 2023-11-27T20:54:46.462 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:54:46.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.562+0000 7fa2ddf68640 1 Processor -- start 2023-11-27T20:54:46.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.562+0000 7fa2ddf68640 1 -- start start 2023-11-27T20:54:46.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.563+0000 7fa2ddf68640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2d8151520 0x7fa2d80c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:46.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.563+0000 7fa2ddf68640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa2d815a8e0 0x7fa2d815ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:46.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.563+0000 7fa2ddf68640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d80713b0 con 0x7fa2d8151900 2023-11-27T20:54:46.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.563+0000 7fa2ddf68640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d806dbc0 con 0x7fa2d815a8e0 2023-11-27T20:54:46.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.563+0000 7fa2ddf68640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d8071f50 con 0x7fa2d8151520 2023-11-27T20:54:46.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.563+0000 7fa2d7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa2d815a8e0 0x7fa2d815ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:46.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.563+0000 7fa2d77fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2d8151520 0x7fa2d80c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:46.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.564+0000 7fa2d77fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2d8151520 0x7fa2d80c5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:50190/0 (socket says 172.21.15.88:50190) 2023-11-27T20:54:46.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.564+0000 7fa2d77fe640 1 -- 172.21.15.88:0/2318878464 learned_addr learned my addr 172.21.15.88:0/2318878464 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:46.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.564+0000 7fa2d7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa2d815a8e0 0x7fa2d815ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59992/0 (socket says 172.21.15.88:59992) 2023-11-27T20:54:46.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.566+0000 7fa2d77fe640 1 -- 172.21.15.88:0/2318878464 >> v2:172.21.15.88:3300/0 conn(0x7fa2d815a8e0 msgr2=0x7fa2d815ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:46.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.566+0000 7fa2d77fe640 1 --2- 172.21.15.88:0/2318878464 >> v2:172.21.15.88:3300/0 conn(0x7fa2d815a8e0 0x7fa2d815ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:46.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.566+0000 7fa2d77fe640 1 -- 172.21.15.88:0/2318878464 >> v1:172.21.15.88:6789/0 conn(0x7fa2d8151900 legacy=0x7fa2d8071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:46.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.566+0000 7fa2d77fe640 1 -- 172.21.15.88:0/2318878464 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d80c8840 con 0x7fa2d8151520 2023-11-27T20:54:46.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.568+0000 7fa2d77fe640 1 --2- 172.21.15.88:0/2318878464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2d8151520 0x7fa2d80c5cb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8009870 tx=0x7fa2c802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4a254b4e84833dc server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:46.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.572+0000 7fa2d67fc640 1 -- 172.21.15.88:0/2318878464 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8030840 con 0x7fa2d8151520 2023-11-27T20:54:46.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.572+0000 7fa2d67fc640 1 -- 172.21.15.88:0/2318878464 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c80309a0 con 0x7fa2d8151520 2023-11-27T20:54:46.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.572+0000 7fa2d67fc640 1 -- 172.21.15.88:0/2318878464 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8030d30 con 0x7fa2d8151520 2023-11-27T20:54:46.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.573+0000 7fa2ddf68640 1 -- 172.21.15.88:0/2318878464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2d8151520 msgr2=0x7fa2d80c5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:46.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.573+0000 7fa2ddf68640 1 --2- 172.21.15.88:0/2318878464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2d8151520 0x7fa2d80c5cb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8009870 tx=0x7fa2c802b980 comp rx=0 tx=0).stop 2023-11-27T20:54:46.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.573+0000 7fa2ddf68640 1 -- 172.21.15.88:0/2318878464 shutdown_connections 2023-11-27T20:54:46.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.573+0000 7fa2ddf68640 1 --2- 172.21.15.88:0/2318878464 >> v2:172.21.15.88:3300/0 conn(0x7fa2d815a8e0 0x7fa2d815ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:46.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.573+0000 7fa2ddf68640 1 --2- 172.21.15.88:0/2318878464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2d8151520 0x7fa2d80c5cb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:46.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.573+0000 7fa2ddf68640 1 -- 172.21.15.88:0/2318878464 >> 172.21.15.88:0/2318878464 conn(0x7fa2d80c79a0 msgr2=0x7fa2d80c7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:46.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.573+0000 7fa2ddf68640 1 -- 172.21.15.88:0/2318878464 shutdown_connections 2023-11-27T20:54:46.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.573+0000 7fa2ddf68640 1 -- 172.21.15.88:0/2318878464 wait complete. 2023-11-27T20:54:46.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.574+0000 7fa2ddf68640 1 Processor -- start 2023-11-27T20:54:46.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.574+0000 7fa2ddf68640 1 -- start start 2023-11-27T20:54:46.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.575+0000 7fa2ddf68640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2d8151520 0x7fa2d80ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:46.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.575+0000 7fa2ddf68640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2d8151900 0x7fa2d80c0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:46.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.575+0000 7fa2ddf68640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2d815a8e0 0x7fa2d8150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:46.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.575+0000 7fa2ddf68640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d80c8f90 con 0x7fa2d815a8e0 2023-11-27T20:54:46.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.575+0000 7fa2ddf68640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d80ca850 con 0x7fa2d8151520 2023-11-27T20:54:46.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.575+0000 7fa2ddf68640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d81dfc60 con 0x7fa2d8151900 2023-11-27T20:54:46.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.575+0000 7fa2d7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2d815a8e0 0x7fa2d8150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:46.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.576+0000 7fa2d77fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2d8151520 0x7fa2d80ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:46.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.576+0000 7fa2d6ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2d8151900 0x7fa2d80c0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:46.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.576+0000 7fa2d7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2d815a8e0 0x7fa2d8150810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59996/0 (socket says 172.21.15.88:59996) 2023-11-27T20:54:46.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.576+0000 7fa2d7fff640 1 -- 172.21.15.88:0/3457846428 learned_addr learned my addr 172.21.15.88:0/3457846428 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:46.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.576+0000 7fa2d77fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2d8151520 0x7fa2d80ca310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:58516/0 (socket says 172.21.15.88:58516) 2023-11-27T20:54:46.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.579+0000 7fa2d7fff640 1 -- 172.21.15.88:0/3457846428 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2d8151900 msgr2=0x7fa2d80c0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:46.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.579+0000 7fa2d7fff640 1 --2- 172.21.15.88:0/3457846428 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2d8151900 0x7fa2d80c0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:46.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.579+0000 7fa2d7fff640 1 -- 172.21.15.88:0/3457846428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2d8151520 msgr2=0x7fa2d80ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:46.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.579+0000 7fa2d7fff640 1 --2- 172.21.15.88:0/3457846428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2d8151520 0x7fa2d80ca310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:46.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.579+0000 7fa2d7fff640 1 -- 172.21.15.88:0/3457846428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c80094d0 con 0x7fa2d815a8e0 2023-11-27T20:54:46.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.581+0000 7fa2d7fff640 1 --2- 172.21.15.88:0/3457846428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2d815a8e0 0x7fa2d8150810 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0009dd0 tx=0x7fa2d000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:46.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.585+0000 7fa2bffff640 1 -- 172.21.15.88:0/3457846428 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0014480 con 0x7fa2d815a8e0 2023-11-27T20:54:46.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.585+0000 7fa2bffff640 1 -- 172.21.15.88:0/3457846428 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d000f040 con 0x7fa2d815a8e0 2023-11-27T20:54:46.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.585+0000 7fa2ddf68640 1 -- 172.21.15.88:0/3457846428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d80c9e80 con 0x7fa2d815a8e0 2023-11-27T20:54:46.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.585+0000 7fa2bffff640 1 -- 172.21.15.88:0/3457846428 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0014840 con 0x7fa2d815a8e0 2023-11-27T20:54:46.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.585+0000 7fa2ddf68640 1 -- 172.21.15.88:0/3457846428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d81e0170 con 0x7fa2d815a8e0 2023-11-27T20:54:46.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.586+0000 7fa2ddf68640 1 -- 172.21.15.88:0/3457846428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d80ca010 con 0x7fa2d815a8e0 2023-11-27T20:54:46.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.605+0000 7fa2bffff640 1 -- 172.21.15.88:0/3457846428 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa2d00149a0 con 0x7fa2d815a8e0 2023-11-27T20:54:46.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.606+0000 7fa2bffff640 1 --2- 172.21.15.88:0/3457846428 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa2c406b240 0x7fa2c406d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:46.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.606+0000 7fa2d77fe640 1 --2- 172.21.15.88:0/3457846428 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa2c406b240 0x7fa2c406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:46.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.606+0000 7fa2d77fe640 1 --2- 172.21.15.88:0/3457846428 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa2c406b240 0x7fa2c406d700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8036000 tx=0x7fa2c8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:46.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.609+0000 7fa2bffff640 1 -- 172.21.15.88:0/3457846428 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa2d0059a90 con 0x7fa2d815a8e0 2023-11-27T20:54:46.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:46.839+0000 7fa2bffff640 1 -- 172.21.15.88:0/3457846428 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa2d0055dd0 con 0x7fa2d815a8e0 2023-11-27T20:54:47.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.028+0000 7fa2ddf68640 1 -- 172.21.15.88:0/3457846428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa2d8067470 con 0x7fa2d815a8e0 2023-11-27T20:54:47.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.033+0000 7fa2bffff640 1 -- 172.21.15.88:0/3457846428 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa2d0018020 con 0x7fa2d815a8e0 2023-11-27T20:54:47.034 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-27T20:54:47.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.035+0000 7fa2ddf68640 1 -- 172.21.15.88:0/3457846428 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa2c406b240 msgr2=0x7fa2c406d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:47.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.035+0000 7fa2ddf68640 1 --2- 172.21.15.88:0/3457846428 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa2c406b240 0x7fa2c406d700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8036000 tx=0x7fa2c8008030 comp rx=0 tx=0).stop 2023-11-27T20:54:47.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.035+0000 7fa2ddf68640 1 -- 172.21.15.88:0/3457846428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2d815a8e0 msgr2=0x7fa2d8150810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:47.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.035+0000 7fa2ddf68640 1 --2- 172.21.15.88:0/3457846428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2d815a8e0 0x7fa2d8150810 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0009dd0 tx=0x7fa2d000c490 comp rx=0 tx=0).stop 2023-11-27T20:54:47.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.035+0000 7fa2ddf68640 1 -- 172.21.15.88:0/3457846428 shutdown_connections 2023-11-27T20:54:47.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.035+0000 7fa2ddf68640 1 --2- 172.21.15.88:0/3457846428 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa2c406b240 0x7fa2c406d700 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:47.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.035+0000 7fa2ddf68640 1 --2- 172.21.15.88:0/3457846428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2d815a8e0 0x7fa2d8150810 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:47.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.035+0000 7fa2ddf68640 1 --2- 172.21.15.88:0/3457846428 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2d8151900 0x7fa2d80c0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:47.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.035+0000 7fa2ddf68640 1 --2- 172.21.15.88:0/3457846428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2d8151520 0x7fa2d80ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:47.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.035+0000 7fa2ddf68640 1 -- 172.21.15.88:0/3457846428 >> 172.21.15.88:0/3457846428 conn(0x7fa2d80c79a0 msgr2=0x7fa2d80c3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:47.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.036+0000 7fa2ddf68640 1 -- 172.21.15.88:0/3457846428 shutdown_connections 2023-11-27T20:54:47.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.036+0000 7fa2ddf68640 1 -- 172.21.15.88:0/3457846428 wait complete. 2023-11-27T20:54:47.048 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:54:47.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.149+0000 7f5faba2b640 1 Processor -- start 2023-11-27T20:54:47.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.150+0000 7f5faba2b640 1 -- start start 2023-11-27T20:54:47.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.150+0000 7f5faba2b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5fa40c91d0 0x7f5fa406eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:47.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.150+0000 7f5faba2b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5fa415a0c0 0x7f5fa40ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:47.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.150+0000 7f5faba2b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fa406f090 con 0x7f5fa4153730 2023-11-27T20:54:47.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.150+0000 7f5faba2b640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa40c38f0 con 0x7f5fa415a0c0 2023-11-27T20:54:47.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.150+0000 7f5faba2b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa41593d0 con 0x7f5fa40c91d0 2023-11-27T20:54:47.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.151+0000 7f5fa9fc8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5fa415a0c0 0x7f5fa40ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:47.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.151+0000 7f5fa8fc6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5fa40c91d0 0x7f5fa406eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:47.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.151+0000 7f5fa97c7640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5fa4153730 0x7f5fa40c2b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40960/0 (socket says 172.21.15.88:40960) 2023-11-27T20:54:47.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.151+0000 7f5fa97c7640 1 -- 172.21.15.88:0/3845092227 learned_addr learned my addr 172.21.15.88:0/3845092227 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:54:47.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.154+0000 7f5fa8fc6640 1 -- 172.21.15.88:0/3845092227 >> v2:172.21.15.88:3300/0 conn(0x7f5fa415a0c0 msgr2=0x7f5fa40ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:47.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.154+0000 7f5fa8fc6640 1 --2- 172.21.15.88:0/3845092227 >> v2:172.21.15.88:3300/0 conn(0x7f5fa415a0c0 0x7f5fa40ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:47.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.154+0000 7f5fa8fc6640 1 -- 172.21.15.88:0/3845092227 >> v1:172.21.15.88:6789/0 conn(0x7f5fa4153730 legacy=0x7f5fa40c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:47.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.154+0000 7f5fa8fc6640 1 -- 172.21.15.88:0/3845092227 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa4153b10 con 0x7f5fa40c91d0 2023-11-27T20:54:47.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.156+0000 7f5fa8fc6640 1 --2- 172.21.15.88:0/3845092227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5fa40c91d0 0x7f5fa406eb50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5f940097a0 tx=0x7f5f9402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3722be01b746ae6f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:47.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.159+0000 7f5f9bfff640 1 -- 172.21.15.88:0/3845092227 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f94030610 con 0x7f5fa40c91d0 2023-11-27T20:54:47.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.159+0000 7f5f9bfff640 1 -- 172.21.15.88:0/3845092227 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f94030770 con 0x7f5fa40c91d0 2023-11-27T20:54:47.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.159+0000 7f5f9bfff640 1 -- 172.21.15.88:0/3845092227 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f94030b00 con 0x7f5fa40c91d0 2023-11-27T20:54:47.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.160+0000 7f5faba2b640 1 -- 172.21.15.88:0/3845092227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5fa40c91d0 msgr2=0x7f5fa406eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:47.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.160+0000 7f5faba2b640 1 --2- 172.21.15.88:0/3845092227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5fa40c91d0 0x7f5fa406eb50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5f940097a0 tx=0x7f5f9402b960 comp rx=0 tx=0).stop 2023-11-27T20:54:47.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.160+0000 7f5faba2b640 1 -- 172.21.15.88:0/3845092227 shutdown_connections 2023-11-27T20:54:47.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.160+0000 7f5faba2b640 1 --2- 172.21.15.88:0/3845092227 >> v2:172.21.15.88:3300/0 conn(0x7f5fa415a0c0 0x7f5fa40ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:47.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.160+0000 7f5faba2b640 1 --2- 172.21.15.88:0/3845092227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5fa40c91d0 0x7f5fa406eb50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:47.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.160+0000 7f5faba2b640 1 -- 172.21.15.88:0/3845092227 >> 172.21.15.88:0/3845092227 conn(0x7f5fa40707f0 msgr2=0x7f5fa4070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:47.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.160+0000 7f5faba2b640 1 -- 172.21.15.88:0/3845092227 shutdown_connections 2023-11-27T20:54:47.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.160+0000 7f5faba2b640 1 -- 172.21.15.88:0/3845092227 wait complete. 2023-11-27T20:54:47.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.161+0000 7f5faba2b640 1 Processor -- start 2023-11-27T20:54:47.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.161+0000 7f5faba2b640 1 -- start start 2023-11-27T20:54:47.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.162+0000 7f5faba2b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fa40c91d0 0x7f5fa4157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:47.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.162+0000 7f5faba2b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5fa4153730 0x7f5fa414e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:47.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.162+0000 7f5faba2b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fa415a0c0 0x7f5fa41eec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:47.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.162+0000 7f5faba2b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa4149ff0 con 0x7f5fa415a0c0 2023-11-27T20:54:47.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.162+0000 7f5faba2b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa414a410 con 0x7f5fa40c91d0 2023-11-27T20:54:47.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.162+0000 7f5faba2b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa4148f50 con 0x7f5fa4153730 2023-11-27T20:54:47.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.162+0000 7f5fa9fc8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fa415a0c0 0x7f5fa41eec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:47.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.163+0000 7f5fa8fc6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5fa4153730 0x7f5fa414e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:47.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.163+0000 7f5fa9fc8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fa415a0c0 0x7f5fa41eec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60016/0 (socket says 172.21.15.88:60016) 2023-11-27T20:54:47.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.163+0000 7f5fa9fc8640 1 -- 172.21.15.88:0/2162752830 learned_addr learned my addr 172.21.15.88:0/2162752830 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:47.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.163+0000 7f5fa97c7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fa40c91d0 0x7f5fa4157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:47.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.166+0000 7f5fa9fc8640 1 -- 172.21.15.88:0/2162752830 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5fa4153730 msgr2=0x7f5fa414e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:47.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.166+0000 7f5fa9fc8640 1 --2- 172.21.15.88:0/2162752830 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5fa4153730 0x7f5fa414e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:47.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.166+0000 7f5fa9fc8640 1 -- 172.21.15.88:0/2162752830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fa40c91d0 msgr2=0x7f5fa4157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:47.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.166+0000 7f5fa9fc8640 1 --2- 172.21.15.88:0/2162752830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fa40c91d0 0x7f5fa4157660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:47.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.166+0000 7f5fa9fc8640 1 -- 172.21.15.88:0/2162752830 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f94009400 con 0x7f5fa415a0c0 2023-11-27T20:54:47.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.168+0000 7f5fa9fc8640 1 --2- 172.21.15.88:0/2162752830 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fa415a0c0 0x7f5fa41eec40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c00e7f0 tx=0x7f5f9c00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:47.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.171+0000 7f5f99ffb640 1 -- 172.21.15.88:0/2162752830 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c009510 con 0x7f5fa415a0c0 2023-11-27T20:54:47.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.171+0000 7f5f99ffb640 1 -- 172.21.15.88:0/2162752830 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9c00ee40 con 0x7f5fa415a0c0 2023-11-27T20:54:47.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.171+0000 7f5f99ffb640 1 -- 172.21.15.88:0/2162752830 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c00cb80 con 0x7f5fa415a0c0 2023-11-27T20:54:47.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.171+0000 7f5faba2b640 1 -- 172.21.15.88:0/2162752830 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa41491a0 con 0x7f5fa415a0c0 2023-11-27T20:54:47.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.172+0000 7f5faba2b640 1 -- 172.21.15.88:0/2162752830 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa4149c10 con 0x7f5fa415a0c0 2023-11-27T20:54:47.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.172+0000 7f5faba2b640 1 -- 172.21.15.88:0/2162752830 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa414a130 con 0x7f5fa415a0c0 2023-11-27T20:54:47.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.190+0000 7f5f99ffb640 1 -- 172.21.15.88:0/2162752830 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5f9c00cce0 con 0x7f5fa415a0c0 2023-11-27T20:54:47.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.190+0000 7f5f99ffb640 1 --2- 172.21.15.88:0/2162752830 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5f8806b240 0x7f5f8806d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:47.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.190+0000 7f5fa97c7640 1 --2- 172.21.15.88:0/2162752830 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5f8806b240 0x7f5f8806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:47.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.191+0000 7f5fa97c7640 1 --2- 172.21.15.88:0/2162752830 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5f8806b240 0x7f5f8806d700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5fa00012e0 tx=0x7f5fa0001a30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:47.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.193+0000 7f5f99ffb640 1 -- 172.21.15.88:0/2162752830 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5f9c058aa0 con 0x7f5fa415a0c0 2023-11-27T20:54:47.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.427+0000 7f5f99ffb640 1 -- 172.21.15.88:0/2162752830 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5f9c054de0 con 0x7f5fa415a0c0 2023-11-27T20:54:47.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.600+0000 7f5faba2b640 1 -- 172.21.15.88:0/2162752830 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5fa414a130 con 0x7f5fa415a0c0 2023-11-27T20:54:47.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.606+0000 7f5f99ffb640 1 -- 172.21.15.88:0/2162752830 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5fa414a130 con 0x7f5fa415a0c0 2023-11-27T20:54:47.607 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-11-27T20:54:47.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.608+0000 7f5faba2b640 1 -- 172.21.15.88:0/2162752830 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5f8806b240 msgr2=0x7f5f8806d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:47.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.608+0000 7f5faba2b640 1 --2- 172.21.15.88:0/2162752830 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5f8806b240 0x7f5f8806d700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5fa00012e0 tx=0x7f5fa0001a30 comp rx=0 tx=0).stop 2023-11-27T20:54:47.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.608+0000 7f5faba2b640 1 -- 172.21.15.88:0/2162752830 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fa415a0c0 msgr2=0x7f5fa41eec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:47.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.608+0000 7f5faba2b640 1 --2- 172.21.15.88:0/2162752830 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fa415a0c0 0x7f5fa41eec40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c00e7f0 tx=0x7f5f9c00ebf0 comp rx=0 tx=0).stop 2023-11-27T20:54:47.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.608+0000 7f5faba2b640 1 -- 172.21.15.88:0/2162752830 shutdown_connections 2023-11-27T20:54:47.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.608+0000 7f5faba2b640 1 --2- 172.21.15.88:0/2162752830 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5f8806b240 0x7f5f8806d700 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:47.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.608+0000 7f5faba2b640 1 --2- 172.21.15.88:0/2162752830 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fa415a0c0 0x7f5fa41eec40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:47.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.608+0000 7f5faba2b640 1 --2- 172.21.15.88:0/2162752830 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5fa4153730 0x7f5fa414e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:47.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.608+0000 7f5faba2b640 1 --2- 172.21.15.88:0/2162752830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fa40c91d0 0x7f5fa4157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:47.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.608+0000 7f5faba2b640 1 -- 172.21.15.88:0/2162752830 >> 172.21.15.88:0/2162752830 conn(0x7f5fa40707f0 msgr2=0x7f5fa406cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:47.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.608+0000 7f5faba2b640 1 -- 172.21.15.88:0/2162752830 shutdown_connections 2023-11-27T20:54:47.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.608+0000 7f5faba2b640 1 -- 172.21.15.88:0/2162752830 wait complete. 2023-11-27T20:54:47.620 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-27T20:54:47.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.720+0000 7f2dbca75640 1 Processor -- start 2023-11-27T20:54:47.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.720+0000 7f2dbca75640 1 -- start start 2023-11-27T20:54:47.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.721+0000 7f2dbca75640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2db80710c0 0x7f2db8071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:47.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.721+0000 7f2dbca75640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db81577f0 con 0x7f2db8151220 2023-11-27T20:54:47.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.721+0000 7f2dbca75640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db8157a90 con 0x7f2db8157240 2023-11-27T20:54:47.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.721+0000 7f2dbca75640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db806f470 con 0x7f2db80710c0 2023-11-27T20:54:47.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.722+0000 7f2db659c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2db8151220 0x7f2db806ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40966/0 (socket says 172.21.15.88:40966) 2023-11-27T20:54:47.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.722+0000 7f2db659c640 1 -- 172.21.15.88:0/3607712526 learned_addr learned my addr 172.21.15.88:0/3607712526 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:54:47.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.722+0000 7f2db6d9d640 1 --2- 172.21.15.88:0/3607712526 >> v2:172.21.15.167:3300/0 conn(0x7f2db80710c0 0x7f2db8071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:47.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.724+0000 7f2db559a640 1 -- 172.21.15.88:0/3607712526 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484929199 0 0) 0x7f2db81577f0 con 0x7f2db8151220 2023-11-27T20:54:47.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.724+0000 7f2db559a640 1 -- 172.21.15.88:0/3607712526 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2da0003520 con 0x7f2db8151220 2023-11-27T20:54:47.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.726+0000 7f2db6d9d640 1 -- 172.21.15.88:0/3607712526 >> v1:172.21.15.167:6789/0 conn(0x7f2db8157240 legacy=0x7f2db80c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:47.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.726+0000 7f2db6d9d640 1 -- 172.21.15.88:0/3607712526 >> v1:172.21.15.88:6789/0 conn(0x7f2db8151220 legacy=0x7f2db806ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:47.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.726+0000 7f2db6d9d640 1 -- 172.21.15.88:0/3607712526 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db8157d30 con 0x7f2db80710c0 2023-11-27T20:54:47.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.730+0000 7f2db6d9d640 1 --2- 172.21.15.88:0/3607712526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2db80710c0 0x7f2db8071530 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2db806f5b0 tx=0x7f2db002b9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f8ce561981c8ae1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:47.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.735+0000 7f2db559a640 1 -- 172.21.15.88:0/3607712526 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db0030890 con 0x7f2db80710c0 2023-11-27T20:54:47.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.735+0000 7f2db559a640 1 -- 172.21.15.88:0/3607712526 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db00309f0 con 0x7f2db80710c0 2023-11-27T20:54:47.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.735+0000 7f2db559a640 1 -- 172.21.15.88:0/3607712526 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db0030d80 con 0x7f2db80710c0 2023-11-27T20:54:47.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.736+0000 7f2dbca75640 1 -- 172.21.15.88:0/3607712526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2db80710c0 msgr2=0x7f2db8071530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:47.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.736+0000 7f2dbca75640 1 --2- 172.21.15.88:0/3607712526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2db80710c0 0x7f2db8071530 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2db806f5b0 tx=0x7f2db002b9d0 comp rx=0 tx=0).stop 2023-11-27T20:54:47.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.736+0000 7f2dbca75640 1 -- 172.21.15.88:0/3607712526 shutdown_connections 2023-11-27T20:54:47.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.736+0000 7f2dbca75640 1 --2- 172.21.15.88:0/3607712526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2db80710c0 0x7f2db8071530 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:47.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.736+0000 7f2dbca75640 1 -- 172.21.15.88:0/3607712526 >> 172.21.15.88:0/3607712526 conn(0x7f2db806c5f0 msgr2=0x7f2db806c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:47.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.736+0000 7f2dbca75640 1 -- 172.21.15.88:0/3607712526 shutdown_connections 2023-11-27T20:54:47.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.736+0000 7f2dbca75640 1 -- 172.21.15.88:0/3607712526 wait complete. 2023-11-27T20:54:47.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.737+0000 7f2dbca75640 1 Processor -- start 2023-11-27T20:54:47.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.737+0000 7f2dbca75640 1 -- start start 2023-11-27T20:54:47.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.738+0000 7f2dbca75640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2db80710c0 0x7f2db80c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:47.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.738+0000 7f2dbca75640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2db8151220 0x7f2db81ed960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:47.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.738+0000 7f2dbca75640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2db8157240 0x7f2db80cac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:47.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.738+0000 7f2dbca75640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db80ca340 con 0x7f2db8157240 2023-11-27T20:54:47.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.738+0000 7f2dbca75640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db81e1010 con 0x7f2db80710c0 2023-11-27T20:54:47.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.738+0000 7f2dbca75640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db81ed4d0 con 0x7f2db8151220 2023-11-27T20:54:47.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.738+0000 7f2db6d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2db8157240 0x7f2db80cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:47.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.738+0000 7f2db659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2db80710c0 0x7f2db80c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:47.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.739+0000 7f2db5d9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2db8151220 0x7f2db81ed960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:47.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.739+0000 7f2db6d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2db8157240 0x7f2db80cac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60028/0 (socket says 172.21.15.88:60028) 2023-11-27T20:54:47.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.739+0000 7f2db6d9d640 1 -- 172.21.15.88:0/1230220159 learned_addr learned my addr 172.21.15.88:0/1230220159 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:47.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.742+0000 7f2db6d9d640 1 -- 172.21.15.88:0/1230220159 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2db8151220 msgr2=0x7f2db81ed960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:47.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.742+0000 7f2db6d9d640 1 --2- 172.21.15.88:0/1230220159 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2db8151220 0x7f2db81ed960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:47.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.742+0000 7f2db6d9d640 1 -- 172.21.15.88:0/1230220159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2db80710c0 msgr2=0x7f2db80c6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:47.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.742+0000 7f2db6d9d640 1 --2- 172.21.15.88:0/1230220159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2db80710c0 0x7f2db80c6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:47.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.742+0000 7f2db6d9d640 1 -- 172.21.15.88:0/1230220159 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db0009400 con 0x7f2db8157240 2023-11-27T20:54:47.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.744+0000 7f2db6d9d640 1 --2- 172.21.15.88:0/1230220159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2db8157240 0x7f2db80cac20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2db002bfe0 tx=0x7f2db0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:47.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.746+0000 7f2da6ffd640 1 -- 172.21.15.88:0/1230220159 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db003e040 con 0x7f2db8157240 2023-11-27T20:54:47.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.746+0000 7f2dbca75640 1 -- 172.21.15.88:0/1230220159 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db81e3560 con 0x7f2db8157240 2023-11-27T20:54:47.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.746+0000 7f2dbca75640 1 -- 172.21.15.88:0/1230220159 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db81e0a50 con 0x7f2db8157240 2023-11-27T20:54:47.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.747+0000 7f2dbca75640 1 -- 172.21.15.88:0/1230220159 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db8072020 con 0x7f2db8157240 2023-11-27T20:54:47.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.747+0000 7f2da6ffd640 1 -- 172.21.15.88:0/1230220159 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db004d440 con 0x7f2db8157240 2023-11-27T20:54:47.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.747+0000 7f2da6ffd640 1 -- 172.21.15.88:0/1230220159 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db004d7b0 con 0x7f2db8157240 2023-11-27T20:54:47.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.990+0000 7f2da6ffd640 1 -- 172.21.15.88:0/1230220159 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2db004d910 con 0x7f2db8157240 2023-11-27T20:54:47.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.991+0000 7f2da6ffd640 1 --2- 172.21.15.88:0/1230220159 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f2d9806b1c0 0x7f2d9806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:47.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.991+0000 7f2db659c640 1 --2- 172.21.15.88:0/1230220159 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f2d9806b1c0 0x7f2d9806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:47.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:47.991+0000 7f2db659c640 1 --2- 172.21.15.88:0/1230220159 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f2d9806b1c0 0x7f2d9806d680 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2da8001560 tx=0x7f2da8001a90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:48.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.003+0000 7f2da6ffd640 1 -- 172.21.15.88:0/1230220159 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2db007b190 con 0x7f2db8157240 2023-11-27T20:54:48.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.003+0000 7f2da6ffd640 1 -- 172.21.15.88:0/1230220159 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2db00774d0 con 0x7f2db8157240 2023-11-27T20:54:48.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.183+0000 7f2dbca75640 1 -- 172.21.15.88:0/1230220159 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2db81e0e50 con 0x7f2db8157240 2023-11-27T20:54:48.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.188+0000 7f2da6ffd640 1 -- 172.21.15.88:0/1230220159 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2db00480a0 con 0x7f2db8157240 2023-11-27T20:54:48.190 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-27T20:54:48.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.190+0000 7f2dbca75640 1 -- 172.21.15.88:0/1230220159 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f2d9806b1c0 msgr2=0x7f2d9806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:48.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.190+0000 7f2dbca75640 1 --2- 172.21.15.88:0/1230220159 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f2d9806b1c0 0x7f2d9806d680 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2da8001560 tx=0x7f2da8001a90 comp rx=0 tx=0).stop 2023-11-27T20:54:48.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.190+0000 7f2dbca75640 1 -- 172.21.15.88:0/1230220159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2db8157240 msgr2=0x7f2db80cac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:48.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.190+0000 7f2dbca75640 1 --2- 172.21.15.88:0/1230220159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2db8157240 0x7f2db80cac20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2db002bfe0 tx=0x7f2db0004730 comp rx=0 tx=0).stop 2023-11-27T20:54:48.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.190+0000 7f2dbca75640 1 -- 172.21.15.88:0/1230220159 shutdown_connections 2023-11-27T20:54:48.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.190+0000 7f2dbca75640 1 --2- 172.21.15.88:0/1230220159 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f2d9806b1c0 0x7f2d9806d680 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:48.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.190+0000 7f2dbca75640 1 --2- 172.21.15.88:0/1230220159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2db8157240 0x7f2db80cac20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:48.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.190+0000 7f2dbca75640 1 --2- 172.21.15.88:0/1230220159 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2db8151220 0x7f2db81ed960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:48.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.190+0000 7f2dbca75640 1 --2- 172.21.15.88:0/1230220159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2db80710c0 0x7f2db80c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:48.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.190+0000 7f2dbca75640 1 -- 172.21.15.88:0/1230220159 >> 172.21.15.88:0/1230220159 conn(0x7f2db806c5f0 msgr2=0x7f2db814f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:48.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.190+0000 7f2dbca75640 1 -- 172.21.15.88:0/1230220159 shutdown_connections 2023-11-27T20:54:48.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.190+0000 7f2dbca75640 1 -- 172.21.15.88:0/1230220159 wait complete. 2023-11-27T20:54:48.202 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T20:54:48.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.302+0000 7f39f1197640 1 Processor -- start 2023-11-27T20:54:48.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.302+0000 7f39f1197640 1 -- start start 2023-11-27T20:54:48.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.303+0000 7f39f1197640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f39ec151260 0x7f39ec06f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:48.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.303+0000 7f39f1197640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f39ec0c2600 0x7f39ec158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:48.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.303+0000 7f39f1197640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39ec1573c0 con 0x7f39ec0c7640 2023-11-27T20:54:48.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.303+0000 7f39f1197640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39ec1571d0 con 0x7f39ec0c2600 2023-11-27T20:54:48.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.303+0000 7f39f1197640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39ec1576a0 con 0x7f39ec151260 2023-11-27T20:54:48.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.303+0000 7f39eb59e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f39ec0c2600 0x7f39ec158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:48.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.304+0000 7f39ead9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f39ec151260 0x7f39ec06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:48.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.304+0000 7f39eb59e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f39ec0c2600 0x7f39ec158aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60040/0 (socket says 172.21.15.88:60040) 2023-11-27T20:54:48.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.304+0000 7f39eb59e640 1 -- 172.21.15.88:0/486308692 learned_addr learned my addr 172.21.15.88:0/486308692 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:48.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.307+0000 7f39ead9d640 1 -- 172.21.15.88:0/486308692 >> v2:172.21.15.88:3300/0 conn(0x7f39ec0c2600 msgr2=0x7f39ec158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:48.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.307+0000 7f39ead9d640 1 --2- 172.21.15.88:0/486308692 >> v2:172.21.15.88:3300/0 conn(0x7f39ec0c2600 0x7f39ec158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:48.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.307+0000 7f39ead9d640 1 -- 172.21.15.88:0/486308692 >> v1:172.21.15.167:6789/0 conn(0x7f39ec0c7640 legacy=0x7f39ec0ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:48.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.307+0000 7f39ead9d640 1 -- 172.21.15.88:0/486308692 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ec157980 con 0x7f39ec151260 2023-11-27T20:54:48.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.312+0000 7f39ead9d640 1 --2- 172.21.15.88:0/486308692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39ec151260 0x7f39ec06f040 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f39ec072270 tx=0x7f39dc02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c35068f69b10b38 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:48.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.316+0000 7f39e9d9b640 1 -- 172.21.15.88:0/486308692 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc031830 con 0x7f39ec151260 2023-11-27T20:54:48.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.316+0000 7f39e9d9b640 1 -- 172.21.15.88:0/486308692 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39dc031990 con 0x7f39ec151260 2023-11-27T20:54:48.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.316+0000 7f39e9d9b640 1 -- 172.21.15.88:0/486308692 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc031d20 con 0x7f39ec151260 2023-11-27T20:54:48.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.316+0000 7f39f1197640 1 -- 172.21.15.88:0/486308692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39ec151260 msgr2=0x7f39ec06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:48.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.316+0000 7f39f1197640 1 --2- 172.21.15.88:0/486308692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39ec151260 0x7f39ec06f040 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f39ec072270 tx=0x7f39dc02b8d0 comp rx=0 tx=0).stop 2023-11-27T20:54:48.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.316+0000 7f39f1197640 1 -- 172.21.15.88:0/486308692 shutdown_connections 2023-11-27T20:54:48.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.316+0000 7f39f1197640 1 --2- 172.21.15.88:0/486308692 >> v2:172.21.15.88:3300/0 conn(0x7f39ec0c2600 0x7f39ec158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:48.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.316+0000 7f39f1197640 1 --2- 172.21.15.88:0/486308692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39ec151260 0x7f39ec06f040 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:48.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.316+0000 7f39f1197640 1 -- 172.21.15.88:0/486308692 >> 172.21.15.88:0/486308692 conn(0x7f39ec070990 msgr2=0x7f39ec070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:48.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.316+0000 7f39f1197640 1 -- 172.21.15.88:0/486308692 shutdown_connections 2023-11-27T20:54:48.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.316+0000 7f39f1197640 1 -- 172.21.15.88:0/486308692 wait complete. 2023-11-27T20:54:48.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.318+0000 7f39f1197640 1 Processor -- start 2023-11-27T20:54:48.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.318+0000 7f39f1197640 1 -- start start 2023-11-27T20:54:48.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.319+0000 7f39f1197640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39ec0c2600 0x7f39ec0b0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:48.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.319+0000 7f39f1197640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39ec0c7640 0x7f39ec0b1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:48.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.319+0000 7f39f1197640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39ec151260 0x7f39ec0c9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:48.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.319+0000 7f39f1197640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ec1f0120 con 0x7f39ec151260 2023-11-27T20:54:48.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.319+0000 7f39f1197640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ec0c8f00 con 0x7f39ec0c2600 2023-11-27T20:54:48.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.319+0000 7f39f1197640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39ec0b0540 con 0x7f39ec0c7640 2023-11-27T20:54:48.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.319+0000 7f39ead9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39ec0c2600 0x7f39ec0b0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:48.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.319+0000 7f39eb59e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39ec151260 0x7f39ec0c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:48.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.319+0000 7f39ea59c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39ec0c7640 0x7f39ec0b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:48.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.320+0000 7f39ead9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39ec0c2600 0x7f39ec0b0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:58570/0 (socket says 172.21.15.88:58570) 2023-11-27T20:54:48.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.320+0000 7f39ead9d640 1 -- 172.21.15.88:0/2323654599 learned_addr learned my addr 172.21.15.88:0/2323654599 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:48.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.323+0000 7f39ead9d640 1 -- 172.21.15.88:0/2323654599 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39ec0c7640 msgr2=0x7f39ec0b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:48.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.323+0000 7f39ead9d640 1 --2- 172.21.15.88:0/2323654599 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39ec0c7640 0x7f39ec0b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:48.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.323+0000 7f39ead9d640 1 -- 172.21.15.88:0/2323654599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39ec151260 msgr2=0x7f39ec0c9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:48.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.323+0000 7f39ead9d640 1 --2- 172.21.15.88:0/2323654599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39ec151260 0x7f39ec0c9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:48.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.323+0000 7f39ead9d640 1 -- 172.21.15.88:0/2323654599 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39dc009400 con 0x7f39ec0c2600 2023-11-27T20:54:48.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.325+0000 7f39ead9d640 1 --2- 172.21.15.88:0/2323654599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39ec0c2600 0x7f39ec0b0de0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f39dc000c00 tx=0x7f39dc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:48.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.329+0000 7f39d37fe640 1 -- 172.21.15.88:0/2323654599 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc03a960 con 0x7f39ec0c2600 2023-11-27T20:54:48.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.329+0000 7f39d37fe640 1 -- 172.21.15.88:0/2323654599 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39dc03aac0 con 0x7f39ec0c2600 2023-11-27T20:54:48.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.329+0000 7f39d37fe640 1 -- 172.21.15.88:0/2323654599 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc03ae30 con 0x7f39ec0c2600 2023-11-27T20:54:48.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.329+0000 7f39f1197640 1 -- 172.21.15.88:0/2323654599 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39ec0b07e0 con 0x7f39ec0c2600 2023-11-27T20:54:48.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.329+0000 7f39f1197640 1 -- 172.21.15.88:0/2323654599 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39ec0c9450 con 0x7f39ec0c2600 2023-11-27T20:54:48.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.330+0000 7f39f1197640 1 -- 172.21.15.88:0/2323654599 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39ec0c3210 con 0x7f39ec0c2600 2023-11-27T20:54:48.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.350+0000 7f39d37fe640 1 -- 172.21.15.88:0/2323654599 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f39dc0443f0 con 0x7f39ec0c2600 2023-11-27T20:54:48.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.350+0000 7f39d37fe640 1 --2- 172.21.15.88:0/2323654599 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f39d806b210 0x7f39d806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:48.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.350+0000 7f39ea59c640 1 --2- 172.21.15.88:0/2323654599 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f39d806b210 0x7f39d806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:48.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.351+0000 7f39ea59c640 1 --2- 172.21.15.88:0/2323654599 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f39d806b210 0x7f39d806d6d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f39ec155d20 tx=0x7f39e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:48.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.353+0000 7f39d37fe640 1 -- 172.21.15.88:0/2323654599 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f39dc07b1a0 con 0x7f39ec0c2600 2023-11-27T20:54:48.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.593+0000 7f39d37fe640 1 -- 172.21.15.88:0/2323654599 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f39dc0774e0 con 0x7f39ec0c2600 2023-11-27T20:54:48.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.773+0000 7f39f1197640 1 -- 172.21.15.88:0/2323654599 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f39ec0b09a0 con 0x7f39ec0c2600 2023-11-27T20:54:48.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.778+0000 7f39d37fe640 1 -- 172.21.15.88:0/2323654599 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f39dc035080 con 0x7f39ec0c2600 2023-11-27T20:54:48.779 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-11-27T20:54:48.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.780+0000 7f39f1197640 1 -- 172.21.15.88:0/2323654599 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f39d806b210 msgr2=0x7f39d806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:48.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.780+0000 7f39f1197640 1 --2- 172.21.15.88:0/2323654599 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f39d806b210 0x7f39d806d6d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f39ec155d20 tx=0x7f39e0009040 comp rx=0 tx=0).stop 2023-11-27T20:54:48.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.780+0000 7f39f1197640 1 -- 172.21.15.88:0/2323654599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39ec0c2600 msgr2=0x7f39ec0b0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:48.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.780+0000 7f39f1197640 1 --2- 172.21.15.88:0/2323654599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39ec0c2600 0x7f39ec0b0de0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f39dc000c00 tx=0x7f39dc0046c0 comp rx=0 tx=0).stop 2023-11-27T20:54:48.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.780+0000 7f39f1197640 1 -- 172.21.15.88:0/2323654599 shutdown_connections 2023-11-27T20:54:48.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.780+0000 7f39f1197640 1 --2- 172.21.15.88:0/2323654599 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f39d806b210 0x7f39d806d6d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:48.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.780+0000 7f39f1197640 1 --2- 172.21.15.88:0/2323654599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39ec151260 0x7f39ec0c9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:48.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.780+0000 7f39f1197640 1 --2- 172.21.15.88:0/2323654599 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39ec0c7640 0x7f39ec0b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:48.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.780+0000 7f39f1197640 1 --2- 172.21.15.88:0/2323654599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39ec0c2600 0x7f39ec0b0de0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:48.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.780+0000 7f39f1197640 1 -- 172.21.15.88:0/2323654599 >> 172.21.15.88:0/2323654599 conn(0x7f39ec070990 msgr2=0x7f39ec155d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:48.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.780+0000 7f39f1197640 1 -- 172.21.15.88:0/2323654599 shutdown_connections 2023-11-27T20:54:48.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:48.780+0000 7f39f1197640 1 -- 172.21.15.88:0/2323654599 wait complete. 2023-11-27T20:54:48.792 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi088.front.sepia.ceph.com... 2023-11-27T20:54:48.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:54:48.793 DEBUG:teuthology.orchestra.run.smithi088:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-11-27T20:54:48.819 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi088.stderr:ceph-fuse[96057]: fuse finished with error 0 and tester_r 0 2023-11-27T20:54:48.821 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:54:54.923 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2023-11-27T20:54:54.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:54:54.923 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-11-27T20:54:54.954 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:54:55.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.106+0000 7f90f8664640 1 Processor -- start 2023-11-27T20:54:55.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.106+0000 7f90f8664640 1 -- start start 2023-11-27T20:54:55.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.107+0000 7f90f8664640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90f0157a40 0x7f90f00ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:55.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.107+0000 7f90f8664640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f0158340 con 0x7f90f00ccb60 2023-11-27T20:54:55.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.107+0000 7f90f8664640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f0157e50 con 0x7f90f01514a0 2023-11-27T20:54:55.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.107+0000 7f90f8664640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f01580a0 con 0x7f90f0157a40 2023-11-27T20:54:55.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.108+0000 7f90f5bff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f90f00ccb60 0x7f90f0157330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48626/0 (socket says 172.21.15.88:48626) 2023-11-27T20:54:55.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.108+0000 7f90f5bff640 1 -- 172.21.15.88:0/690081483 learned_addr learned my addr 172.21.15.88:0/690081483 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:54:55.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.110+0000 7f90f53fe640 1 -- 172.21.15.88:0/690081483 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2379735641 0 0) 0x7f90f0158340 con 0x7f90f00ccb60 2023-11-27T20:54:55.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.110+0000 7f90f53fe640 1 -- 172.21.15.88:0/690081483 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90dc003520 con 0x7f90f00ccb60 2023-11-27T20:54:55.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.114+0000 7f90f53fe640 1 -- 172.21.15.88:0/690081483 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1638148015 0 0) 0x7f90dc003520 con 0x7f90f00ccb60 2023-11-27T20:54:55.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.114+0000 7f90f53fe640 1 -- 172.21.15.88:0/690081483 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90f0157a40 msgr2=0x7f90f00ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:55.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.114+0000 7f90f53fe640 1 --2- 172.21.15.88:0/690081483 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90f0157a40 0x7f90f00ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:55.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.114+0000 7f90f53fe640 1 -- 172.21.15.88:0/690081483 >> v1:172.21.15.167:6789/0 conn(0x7f90f01514a0 legacy=0x7f90f00c3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:55.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.114+0000 7f90f53fe640 1 -- 172.21.15.88:0/690081483 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f00c2370 con 0x7f90f00ccb60 2023-11-27T20:54:55.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.114+0000 7f90f53fe640 1 -- 172.21.15.88:0/690081483 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1067350109 0 0) 0x7f90e4001670 con 0x7f90f00ccb60 2023-11-27T20:54:55.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.114+0000 7f90f53fe640 1 -- 172.21.15.88:0/690081483 >> v1:172.21.15.88:6789/0 conn(0x7f90f00ccb60 legacy=0x7f90f0157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:55.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.114+0000 7f90f53fe640 1 --2- 172.21.15.88:0/690081483 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90f0157a40 0x7f90dc003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:55.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.114+0000 7f90f53fe640 1 --2- 172.21.15.88:0/690081483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90dc004150 0x7f90dc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:55.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.114+0000 7f90f53fe640 1 --2- 172.21.15.88:0/690081483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90dc004e20 0x7f90dc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:55.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.114+0000 7f90f53fe640 1 -- 172.21.15.88:0/690081483 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f01580a0 con 0x7f90dc004150 2023-11-27T20:54:55.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.114+0000 7f90f53fe640 1 -- 172.21.15.88:0/690081483 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90dc0055a0 con 0x7f90dc004e20 2023-11-27T20:54:55.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.114+0000 7f90f53fe640 1 -- 172.21.15.88:0/690081483 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90dc00bec0 con 0x7f90f0157a40 2023-11-27T20:54:55.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.116+0000 7f90f5bff640 1 --2- 172.21.15.88:0/690081483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90dc004150 0x7f90dc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:55.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.119+0000 7f90f5bff640 1 -- 172.21.15.88:0/690081483 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90f0157a40 msgr2=0x7f90dc003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:55.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.119+0000 7f90f5bff640 1 --2- 172.21.15.88:0/690081483 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90f0157a40 0x7f90dc003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:55.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.119+0000 7f90f5bff640 1 -- 172.21.15.88:0/690081483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90dc004e20 msgr2=0x7f90dc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:55.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.119+0000 7f90f5bff640 1 --2- 172.21.15.88:0/690081483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90dc004e20 0x7f90dc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:55.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.119+0000 7f90f5bff640 1 -- 172.21.15.88:0/690081483 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90dc003520 con 0x7f90dc004150 2023-11-27T20:54:55.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.122+0000 7f90f5bff640 1 --2- 172.21.15.88:0/690081483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90dc004150 0x7f90dc0047c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f90e400c0e0 tx=0x7f90dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da77534b362126e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:55.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.125+0000 7f90f53fe640 1 -- 172.21.15.88:0/690081483 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4005ad0 con 0x7f90dc004150 2023-11-27T20:54:55.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.125+0000 7f90f53fe640 1 -- 172.21.15.88:0/690081483 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e4005c30 con 0x7f90dc004150 2023-11-27T20:54:55.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.125+0000 7f90f53fe640 1 -- 172.21.15.88:0/690081483 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e402ca10 con 0x7f90dc004150 2023-11-27T20:54:55.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.126+0000 7f90f8664640 1 -- 172.21.15.88:0/690081483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90dc004150 msgr2=0x7f90dc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:55.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.126+0000 7f90f8664640 1 --2- 172.21.15.88:0/690081483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90dc004150 0x7f90dc0047c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f90e400c0e0 tx=0x7f90dc0057f0 comp rx=0 tx=0).stop 2023-11-27T20:54:55.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.126+0000 7f90f6c01640 1 -- 172.21.15.88:0/690081483 reap_dead start 2023-11-27T20:54:55.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.126+0000 7f90f8664640 1 -- 172.21.15.88:0/690081483 shutdown_connections 2023-11-27T20:54:55.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.126+0000 7f90f8664640 1 -- 172.21.15.88:0/690081483 >> 172.21.15.88:0/690081483 conn(0x7f90f0070790 msgr2=0x7f90f0070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:55.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.126+0000 7f90f8664640 1 -- 172.21.15.88:0/690081483 shutdown_connections 2023-11-27T20:54:55.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.126+0000 7f90f8664640 1 -- 172.21.15.88:0/690081483 wait complete. 2023-11-27T20:54:55.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.127+0000 7f90f8664640 1 Processor -- start 2023-11-27T20:54:55.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.127+0000 7f90f8664640 1 -- start start 2023-11-27T20:54:55.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.128+0000 7f90f8664640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90dc004150 0x7f90f00c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:55.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.128+0000 7f90f8664640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90f00c6ce0 0x7f90f00737a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:55.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.128+0000 7f90f8664640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90f01eed90 0x7f90f01ef210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:55.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.128+0000 7f90f8664640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f01ee900 con 0x7f90f00c6ce0 2023-11-27T20:54:55.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.128+0000 7f90f8664640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f01ef750 con 0x7f90dc004150 2023-11-27T20:54:55.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.128+0000 7f90f8664640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f00c53d0 con 0x7f90f01eed90 2023-11-27T20:54:55.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.129+0000 7f90f5bff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90f00c6ce0 0x7f90f00737a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:55.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.129+0000 7f90f5bff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90f00c6ce0 0x7f90f00737a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49374/0 (socket says 172.21.15.88:49374) 2023-11-27T20:54:55.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.129+0000 7f90f5bff640 1 -- 172.21.15.88:0/1779107522 learned_addr learned my addr 172.21.15.88:0/1779107522 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:55.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.132+0000 7f90f5bff640 1 -- 172.21.15.88:0/1779107522 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90f01eed90 msgr2=0x7f90f01ef210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:55.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.132+0000 7f90f5bff640 1 --2- 172.21.15.88:0/1779107522 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90f01eed90 0x7f90f01ef210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:55.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.132+0000 7f90f5bff640 1 -- 172.21.15.88:0/1779107522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90dc004150 msgr2=0x7f90f00c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:55.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.132+0000 7f90f5bff640 1 --2- 172.21.15.88:0/1779107522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90dc004150 0x7f90f00c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:55.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.132+0000 7f90f5bff640 1 -- 172.21.15.88:0/1779107522 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f00c5670 con 0x7f90f00c6ce0 2023-11-27T20:54:55.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.135+0000 7f90f5bff640 1 --2- 172.21.15.88:0/1779107522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90f00c6ce0 0x7f90f00737a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f90e400c0e0 tx=0x7f90f00b0ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:55.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.139+0000 7f90e2ffd640 1 -- 172.21.15.88:0/1779107522 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e402caa0 con 0x7f90f00c6ce0 2023-11-27T20:54:55.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.139+0000 7f90e2ffd640 1 -- 172.21.15.88:0/1779107522 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e402cc00 con 0x7f90f00c6ce0 2023-11-27T20:54:55.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.139+0000 7f90f8664640 1 -- 172.21.15.88:0/1779107522 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f01edcf0 con 0x7f90f00c6ce0 2023-11-27T20:54:55.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.139+0000 7f90e2ffd640 1 -- 172.21.15.88:0/1779107522 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4007070 con 0x7f90f00c6ce0 2023-11-27T20:54:55.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.139+0000 7f90f8664640 1 -- 172.21.15.88:0/1779107522 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f01ee2b0 con 0x7f90f00c6ce0 2023-11-27T20:54:55.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.140+0000 7f90f8664640 1 -- 172.21.15.88:0/1779107522 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f0067470 con 0x7f90f00c6ce0 2023-11-27T20:54:55.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.158+0000 7f90e2ffd640 1 -- 172.21.15.88:0/1779107522 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f90e4032070 con 0x7f90f00c6ce0 2023-11-27T20:54:55.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.158+0000 7f90e2ffd640 1 --2- 172.21.15.88:0/1779107522 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f90d406b1f0 0x7f90d406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:55.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.158+0000 7f90f6400640 1 --2- 172.21.15.88:0/1779107522 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f90d406b1f0 0x7f90d406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:55.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.159+0000 7f90f6400640 1 --2- 172.21.15.88:0/1779107522 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f90d406b1f0 0x7f90d406d6b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f90ec001550 tx=0x7f90ec007990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:55.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.390+0000 7f90e2ffd640 1 -- 172.21.15.88:0/1779107522 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f90e407a880 con 0x7f90f00c6ce0 2023-11-27T20:54:55.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.390+0000 7f90e2ffd640 1 -- 172.21.15.88:0/1779107522 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f90e40a9e60 con 0x7f90f00c6ce0 2023-11-27T20:54:55.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.559+0000 7f90f8664640 1 -- 172.21.15.88:0/1779107522 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90f0067470 con 0x7f90f00c6ce0 2023-11-27T20:54:55.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.601+0000 7f90e2ffd640 1 -- 172.21.15.88:0/1779107522 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18339 (secure 0 0 0) 0x7f90e404f030 con 0x7f90f00c6ce0 2023-11-27T20:54:55.605 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:54:55.606 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc","created":"2023-11-27T20:53:53.110827+0000","modified":"2023-11-27T20:54:32.470579+0000","last_up_change":"2023-11-27T20:54:08.219383+0000","last_in_change":"2023-11-27T20:53:59.022798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:54:09.277670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:54:24.503156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:54:25.744043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T20:54:29.704111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1207ca0f-bef1-44c6-b66b-58bf0e080ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6819","nonce":3952326022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6821","nonce":3952326022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6825","nonce":3952326022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6823","nonce":3952326022}]},"public_addr":"172.21.15.88:6819/3952326022","cluster_addr":"172.21.15.88:6821/3952326022","heartbeat_back_addr":"172.21.15.88:6825/3952326022","heartbeat_front_addr":"172.21.15.88:6823/3952326022","state":["exists","up"]},{"osd":1,"uuid":"8d1be479-4241-4335-9633-1394311fde76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6827","nonce":1788401966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6829","nonce":1788401966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6833","nonce":1788401966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6831","nonce":1788401966}]},"public_addr":"172.21.15.88:6827/1788401966","cluster_addr":"172.21.15.88:6829/1788401966","heartbeat_back_addr":"172.21.15.88:6833/1788401966","heartbeat_front_addr":"172.21.15.88:6831/1788401966","state":["exists","up"]},{"osd":2,"uuid":"7536b008-05dd-40eb-9d4a-bdac4b1c38c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6803","nonce":1166333913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6805","nonce":1166333913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6809","nonce":1166333913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6807","nonce":1166333913}]},"public_addr":"172.21.15.88:6803/1166333913","cluster_addr":"172.21.15.88:6805/1166333913","heartbeat_back_addr":"172.21.15.88:6809/1166333913","heartbeat_front_addr":"172.21.15.88:6807/1166333913","state":["exists","up"]},{"osd":3,"uuid":"47edd4d7-e99c-4ce3-851b-cc9c8e2d4480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6811","nonce":406887502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6813","nonce":406887502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6817","nonce":406887502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6815","nonce":406887502}]},"public_addr":"172.21.15.88:6811/406887502","cluster_addr":"172.21.15.88:6813/406887502","heartbeat_back_addr":"172.21.15.88:6817/406887502","heartbeat_front_addr":"172.21.15.88:6815/406887502","state":["exists","up"]},{"osd":4,"uuid":"0a81dd31-1a8b-41af-b933-d74aae63f3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6801","nonce":2551293703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6803","nonce":2551293703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6807","nonce":2551293703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6805","nonce":2551293703}]},"public_addr":"172.21.15.167:6801/2551293703","cluster_addr":"172.21.15.167:6803/2551293703","heartbeat_back_addr":"172.21.15.167:6807/2551293703","heartbeat_front_addr":"172.21.15.167:6805/2551293703","state":["exists","up"]},{"osd":5,"uuid":"1c462d0d-3361-48b3-a82a-86a920539e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6825","nonce":866085094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6827","nonce":866085094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6831","nonce":866085094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6829","nonce":866085094}]},"public_addr":"172.21.15.167:6825/866085094","cluster_addr":"172.21.15.167:6827/866085094","heartbeat_back_addr":"172.21.15.167:6831/866085094","heartbeat_front_addr":"172.21.15.167:6829/866085094","state":["exists","up"]},{"osd":6,"uuid":"d687c5ad-6c88-4a15-8120-0cdbc5610535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6809","nonce":2766725538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6811","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6813","nonce":2766725538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6819","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6821","nonce":2766725538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6815","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6817","nonce":2766725538}]},"public_addr":"172.21.15.167:6809/2766725538","cluster_addr":"172.21.15.167:6813/2766725538","heartbeat_back_addr":"172.21.15.167:6821/2766725538","heartbeat_front_addr":"172.21.15.167:6817/2766725538","state":["exists","up"]},{"osd":7,"uuid":"c9a50596-4981-4bd8-a8ef-d7679f8d9559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6812","nonce":2695037266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6816","nonce":2695037266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6823","nonce":2695037266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6820","nonce":2695037266}]},"public_addr":"172.21.15.167:6812/2695037266","cluster_addr":"172.21.15.167:6816/2695037266","heartbeat_back_addr":"172.21.15.167:6823/2695037266","heartbeat_front_addr":"172.21.15.167:6820/2695037266","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.522590+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.483170+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.492504+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.432204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.414964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.459803+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.437250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.460394+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:54:55.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.603+0000 7f90f8664640 1 -- 172.21.15.88:0/1779107522 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f90d406b1f0 msgr2=0x7f90d406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:55.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.603+0000 7f90f8664640 1 --2- 172.21.15.88:0/1779107522 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f90d406b1f0 0x7f90d406d6b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f90ec001550 tx=0x7f90ec007990 comp rx=0 tx=0).stop 2023-11-27T20:54:55.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.603+0000 7f90f8664640 1 -- 172.21.15.88:0/1779107522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90f00c6ce0 msgr2=0x7f90f00737a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:55.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.603+0000 7f90f8664640 1 --2- 172.21.15.88:0/1779107522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90f00c6ce0 0x7f90f00737a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f90e400c0e0 tx=0x7f90f00b0ae0 comp rx=0 tx=0).stop 2023-11-27T20:54:55.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.603+0000 7f90f8664640 1 -- 172.21.15.88:0/1779107522 shutdown_connections 2023-11-27T20:54:55.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.603+0000 7f90f8664640 1 --2- 172.21.15.88:0/1779107522 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f90d406b1f0 0x7f90d406d6b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:55.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.603+0000 7f90f8664640 1 --2- 172.21.15.88:0/1779107522 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90f01eed90 0x7f90f01ef210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:55.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.603+0000 7f90f8664640 1 --2- 172.21.15.88:0/1779107522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90f00c6ce0 0x7f90f00737a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:55.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.603+0000 7f90f8664640 1 --2- 172.21.15.88:0/1779107522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90dc004150 0x7f90f00c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:55.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.603+0000 7f90f8664640 1 -- 172.21.15.88:0/1779107522 >> 172.21.15.88:0/1779107522 conn(0x7f90f0070790 msgr2=0x7f90f00cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:55.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.603+0000 7f90f8664640 1 -- 172.21.15.88:0/1779107522 shutdown_connections 2023-11-27T20:54:55.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.603+0000 7f90f8664640 1 -- 172.21.15.88:0/1779107522 wait complete. 2023-11-27T20:54:55.615 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:54:55.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.712+0000 7f6aa2f6e640 1 Processor -- start 2023-11-27T20:54:55.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.712+0000 7f6aa2f6e640 1 -- start start 2023-11-27T20:54:55.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.713+0000 7f6aa2f6e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a9c0c52e0 0x7f6a9c0c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:55.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.713+0000 7f6aa2f6e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6a9c0c56c0 0x7f6a9c0c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:55.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.713+0000 7f6aa2f6e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9c15a7a0 con 0x7f6a9c15ac30 2023-11-27T20:54:55.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.713+0000 7f6aa2f6e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9c0c7250 con 0x7f6a9c0c56c0 2023-11-27T20:54:55.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.713+0000 7f6aa2f6e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c1574c0 con 0x7f6a9c0c52e0 2023-11-27T20:54:55.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.714+0000 7f6a9bfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6a9c0c56c0 0x7f6a9c0c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:55.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.714+0000 7f6aa0d0a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a9c0c52e0 0x7f6a9c0c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:55.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.714+0000 7f6a9bfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6a9c0c56c0 0x7f6a9c0c8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49384/0 (socket says 172.21.15.88:49384) 2023-11-27T20:54:55.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.714+0000 7f6a9bfff640 1 -- 172.21.15.88:0/3208438529 learned_addr learned my addr 172.21.15.88:0/3208438529 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:55.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.717+0000 7f6a9bfff640 1 -- 172.21.15.88:0/3208438529 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a9c0c52e0 msgr2=0x7f6a9c0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:55.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.717+0000 7f6a9bfff640 1 --2- 172.21.15.88:0/3208438529 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a9c0c52e0 0x7f6a9c0c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:55.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.717+0000 7f6a9bfff640 1 -- 172.21.15.88:0/3208438529 >> v1:172.21.15.88:6789/0 conn(0x7f6a9c15ac30 legacy=0x7f6a9c15b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:55.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.717+0000 7f6a9bfff640 1 -- 172.21.15.88:0/3208438529 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c157760 con 0x7f6a9c0c56c0 2023-11-27T20:54:55.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.717+0000 7f6aa0d0a640 1 --2- 172.21.15.88:0/3208438529 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a9c0c52e0 0x7f6a9c0c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:54:55.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.720+0000 7f6a9bfff640 1 --2- 172.21.15.88:0/3208438529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a9c0c56c0 0x7f6a9c0c8d70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6a90009870 tx=0x7f6a9002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7237cb679172f7b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:55.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.724+0000 7f6a9b7fe640 1 -- 172.21.15.88:0/3208438529 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9002f840 con 0x7f6a9c0c56c0 2023-11-27T20:54:55.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.724+0000 7f6a9b7fe640 1 -- 172.21.15.88:0/3208438529 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9002f9a0 con 0x7f6a9c0c56c0 2023-11-27T20:54:55.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.725+0000 7f6a9b7fe640 1 -- 172.21.15.88:0/3208438529 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9002fd30 con 0x7f6a9c0c56c0 2023-11-27T20:54:55.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.725+0000 7f6aa2f6e640 1 -- 172.21.15.88:0/3208438529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a9c0c56c0 msgr2=0x7f6a9c0c8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:55.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.725+0000 7f6aa2f6e640 1 --2- 172.21.15.88:0/3208438529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a9c0c56c0 0x7f6a9c0c8d70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6a90009870 tx=0x7f6a9002ba20 comp rx=0 tx=0).stop 2023-11-27T20:54:55.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.725+0000 7f6aa2f6e640 1 -- 172.21.15.88:0/3208438529 shutdown_connections 2023-11-27T20:54:55.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.725+0000 7f6aa2f6e640 1 --2- 172.21.15.88:0/3208438529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a9c0c56c0 0x7f6a9c0c8d70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:55.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.725+0000 7f6aa2f6e640 1 --2- 172.21.15.88:0/3208438529 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a9c0c52e0 0x7f6a9c0c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:55.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.725+0000 7f6aa2f6e640 1 -- 172.21.15.88:0/3208438529 >> 172.21.15.88:0/3208438529 conn(0x7f6a9c06f6d0 msgr2=0x7f6a9c06fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:55.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.725+0000 7f6aa2f6e640 1 -- 172.21.15.88:0/3208438529 shutdown_connections 2023-11-27T20:54:55.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.725+0000 7f6aa2f6e640 1 -- 172.21.15.88:0/3208438529 wait complete. 2023-11-27T20:54:55.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.726+0000 7f6aa2f6e640 1 Processor -- start 2023-11-27T20:54:55.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.726+0000 7f6aa2f6e640 1 -- start start 2023-11-27T20:54:55.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.727+0000 7f6aa2f6e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a9c0c52e0 0x7f6a9c14ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:55.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.727+0000 7f6aa2f6e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a9c0c56c0 0x7f6a9c1e2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:55.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.727+0000 7f6aa2f6e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a9c15ac30 0x7f6a9c072280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:55.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.727+0000 7f6aa2f6e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c1e2ce0 con 0x7f6a9c0c52e0 2023-11-27T20:54:55.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.727+0000 7f6aa2f6e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c1edcc0 con 0x7f6a9c15ac30 2023-11-27T20:54:55.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.727+0000 7f6aa2f6e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c1ed0b0 con 0x7f6a9c0c56c0 2023-11-27T20:54:55.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.728+0000 7f6aa0d0a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a9c0c52e0 0x7f6a9c14ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:55.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.728+0000 7f6aa150b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a9c15ac30 0x7f6a9c072280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:55.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.728+0000 7f6aa0d0a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a9c0c52e0 0x7f6a9c14ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49390/0 (socket says 172.21.15.88:49390) 2023-11-27T20:54:55.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.728+0000 7f6aa0d0a640 1 -- 172.21.15.88:0/4159230907 learned_addr learned my addr 172.21.15.88:0/4159230907 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:55.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.728+0000 7f6a9bfff640 1 --2- 172.21.15.88:0/4159230907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a9c0c56c0 0x7f6a9c1e2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:55.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.731+0000 7f6aa0d0a640 1 -- 172.21.15.88:0/4159230907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a9c0c56c0 msgr2=0x7f6a9c1e2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:55.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.732+0000 7f6aa0d0a640 1 --2- 172.21.15.88:0/4159230907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a9c0c56c0 0x7f6a9c1e2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:55.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.732+0000 7f6aa0d0a640 1 -- 172.21.15.88:0/4159230907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a9c15ac30 msgr2=0x7f6a9c072280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:55.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.732+0000 7f6aa0d0a640 1 --2- 172.21.15.88:0/4159230907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a9c15ac30 0x7f6a9c072280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:55.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.732+0000 7f6aa0d0a640 1 -- 172.21.15.88:0/4159230907 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c009400 con 0x7f6a9c0c52e0 2023-11-27T20:54:55.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.741+0000 7f6aa0d0a640 1 --2- 172.21.15.88:0/4159230907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a9c0c52e0 0x7f6a9c14ebb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00ec10 tx=0x7f6a8c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:55.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.751+0000 7f6a997fa640 1 -- 172.21.15.88:0/4159230907 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c009760 con 0x7f6a9c0c52e0 2023-11-27T20:54:55.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.751+0000 7f6a997fa640 1 -- 172.21.15.88:0/4159230907 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8c00cc30 con 0x7f6a9c0c52e0 2023-11-27T20:54:55.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.751+0000 7f6a997fa640 1 -- 172.21.15.88:0/4159230907 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c013470 con 0x7f6a9c0c52e0 2023-11-27T20:54:55.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.751+0000 7f6aa2f6e640 1 -- 172.21.15.88:0/4159230907 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a900094d0 con 0x7f6a9c0c52e0 2023-11-27T20:54:55.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.751+0000 7f6aa2f6e640 1 -- 172.21.15.88:0/4159230907 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9c1ed670 con 0x7f6a9c0c52e0 2023-11-27T20:54:55.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:55.752+0000 7f6aa2f6e640 1 -- 172.21.15.88:0/4159230907 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a9c067470 con 0x7f6a9c0c52e0 2023-11-27T20:54:56.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.051+0000 7f6a997fa640 1 -- 172.21.15.88:0/4159230907 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6a8c0135d0 con 0x7f6a9c0c52e0 2023-11-27T20:54:56.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.051+0000 7f6a997fa640 1 --2- 172.21.15.88:0/4159230907 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f6a8806b240 0x7f6a8806d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:56.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.051+0000 7f6a9bfff640 1 --2- 172.21.15.88:0/4159230907 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f6a8806b240 0x7f6a8806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:56.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.052+0000 7f6a9bfff640 1 --2- 172.21.15.88:0/4159230907 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f6a8806b240 0x7f6a8806d700 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6a90036000 tx=0x7f6a90008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:56.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.065+0000 7f6a997fa640 1 -- 172.21.15.88:0/4159230907 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6a8c058ef0 con 0x7f6a9c0c52e0 2023-11-27T20:54:56.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.065+0000 7f6a997fa640 1 -- 172.21.15.88:0/4159230907 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f6a8c055230 con 0x7f6a9c0c52e0 2023-11-27T20:54:56.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.238+0000 7f6aa2f6e640 1 -- 172.21.15.88:0/4159230907 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a9c156e10 con 0x7f6a9c0c52e0 2023-11-27T20:54:56.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.275+0000 7f6a997fa640 1 -- 172.21.15.88:0/4159230907 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18339 (secure 0 0 0) 0x7f6a8c017090 con 0x7f6a9c0c52e0 2023-11-27T20:54:56.277 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:54:56.277 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc","created":"2023-11-27T20:53:53.110827+0000","modified":"2023-11-27T20:54:32.470579+0000","last_up_change":"2023-11-27T20:54:08.219383+0000","last_in_change":"2023-11-27T20:53:59.022798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:54:09.277670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:54:24.503156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:54:25.744043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T20:54:29.704111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1207ca0f-bef1-44c6-b66b-58bf0e080ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6819","nonce":3952326022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6821","nonce":3952326022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6825","nonce":3952326022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6823","nonce":3952326022}]},"public_addr":"172.21.15.88:6819/3952326022","cluster_addr":"172.21.15.88:6821/3952326022","heartbeat_back_addr":"172.21.15.88:6825/3952326022","heartbeat_front_addr":"172.21.15.88:6823/3952326022","state":["exists","up"]},{"osd":1,"uuid":"8d1be479-4241-4335-9633-1394311fde76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6827","nonce":1788401966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6829","nonce":1788401966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6833","nonce":1788401966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6831","nonce":1788401966}]},"public_addr":"172.21.15.88:6827/1788401966","cluster_addr":"172.21.15.88:6829/1788401966","heartbeat_back_addr":"172.21.15.88:6833/1788401966","heartbeat_front_addr":"172.21.15.88:6831/1788401966","state":["exists","up"]},{"osd":2,"uuid":"7536b008-05dd-40eb-9d4a-bdac4b1c38c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6803","nonce":1166333913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6805","nonce":1166333913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6809","nonce":1166333913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6807","nonce":1166333913}]},"public_addr":"172.21.15.88:6803/1166333913","cluster_addr":"172.21.15.88:6805/1166333913","heartbeat_back_addr":"172.21.15.88:6809/1166333913","heartbeat_front_addr":"172.21.15.88:6807/1166333913","state":["exists","up"]},{"osd":3,"uuid":"47edd4d7-e99c-4ce3-851b-cc9c8e2d4480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6811","nonce":406887502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6813","nonce":406887502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6817","nonce":406887502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6815","nonce":406887502}]},"public_addr":"172.21.15.88:6811/406887502","cluster_addr":"172.21.15.88:6813/406887502","heartbeat_back_addr":"172.21.15.88:6817/406887502","heartbeat_front_addr":"172.21.15.88:6815/406887502","state":["exists","up"]},{"osd":4,"uuid":"0a81dd31-1a8b-41af-b933-d74aae63f3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6801","nonce":2551293703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6803","nonce":2551293703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6807","nonce":2551293703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6805","nonce":2551293703}]},"public_addr":"172.21.15.167:6801/2551293703","cluster_addr":"172.21.15.167:6803/2551293703","heartbeat_back_addr":"172.21.15.167:6807/2551293703","heartbeat_front_addr":"172.21.15.167:6805/2551293703","state":["exists","up"]},{"osd":5,"uuid":"1c462d0d-3361-48b3-a82a-86a920539e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6825","nonce":866085094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6827","nonce":866085094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6831","nonce":866085094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6829","nonce":866085094}]},"public_addr":"172.21.15.167:6825/866085094","cluster_addr":"172.21.15.167:6827/866085094","heartbeat_back_addr":"172.21.15.167:6831/866085094","heartbeat_front_addr":"172.21.15.167:6829/866085094","state":["exists","up"]},{"osd":6,"uuid":"d687c5ad-6c88-4a15-8120-0cdbc5610535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6809","nonce":2766725538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6811","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6813","nonce":2766725538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6819","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6821","nonce":2766725538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6815","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6817","nonce":2766725538}]},"public_addr":"172.21.15.167:6809/2766725538","cluster_addr":"172.21.15.167:6813/2766725538","heartbeat_back_addr":"172.21.15.167:6821/2766725538","heartbeat_front_addr":"172.21.15.167:6817/2766725538","state":["exists","up"]},{"osd":7,"uuid":"c9a50596-4981-4bd8-a8ef-d7679f8d9559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6812","nonce":2695037266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6816","nonce":2695037266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6823","nonce":2695037266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6820","nonce":2695037266}]},"public_addr":"172.21.15.167:6812/2695037266","cluster_addr":"172.21.15.167:6816/2695037266","heartbeat_back_addr":"172.21.15.167:6823/2695037266","heartbeat_front_addr":"172.21.15.167:6820/2695037266","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.522590+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.483170+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.492504+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.432204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.414964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.459803+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.437250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.460394+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:54:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.277+0000 7f6aa2f6e640 1 -- 172.21.15.88:0/4159230907 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f6a8806b240 msgr2=0x7f6a8806d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.277+0000 7f6aa2f6e640 1 --2- 172.21.15.88:0/4159230907 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f6a8806b240 0x7f6a8806d700 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6a90036000 tx=0x7f6a90008030 comp rx=0 tx=0).stop 2023-11-27T20:54:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.277+0000 7f6aa2f6e640 1 -- 172.21.15.88:0/4159230907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a9c0c52e0 msgr2=0x7f6a9c14ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.277+0000 7f6aa2f6e640 1 --2- 172.21.15.88:0/4159230907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a9c0c52e0 0x7f6a9c14ebb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00ec10 tx=0x7f6a8c00c520 comp rx=0 tx=0).stop 2023-11-27T20:54:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.277+0000 7f6aa2f6e640 1 -- 172.21.15.88:0/4159230907 shutdown_connections 2023-11-27T20:54:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.277+0000 7f6aa2f6e640 1 --2- 172.21.15.88:0/4159230907 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f6a8806b240 0x7f6a8806d700 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.277+0000 7f6aa2f6e640 1 --2- 172.21.15.88:0/4159230907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a9c15ac30 0x7f6a9c072280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.277+0000 7f6aa2f6e640 1 --2- 172.21.15.88:0/4159230907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a9c0c56c0 0x7f6a9c1e2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.277+0000 7f6aa2f6e640 1 --2- 172.21.15.88:0/4159230907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a9c0c52e0 0x7f6a9c14ebb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.277+0000 7f6aa2f6e640 1 -- 172.21.15.88:0/4159230907 >> 172.21.15.88:0/4159230907 conn(0x7f6a9c06f6d0 msgr2=0x7f6a9c150a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.277+0000 7f6aa2f6e640 1 -- 172.21.15.88:0/4159230907 shutdown_connections 2023-11-27T20:54:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.277+0000 7f6aa2f6e640 1 -- 172.21.15.88:0/4159230907 wait complete. 2023-11-27T20:54:56.290 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-27T20:54:56.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.391+0000 7f5011d39640 1 Processor -- start 2023-11-27T20:54:56.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.392+0000 7f5011d39640 1 -- start start 2023-11-27T20:54:56.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.392+0000 7f5011d39640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f500c0cda70 0x7f500c0ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:56.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.392+0000 7f5011d39640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f500c0cbda0 con 0x7f500c0cc420 2023-11-27T20:54:56.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.392+0000 7f5011d39640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f500c0cb4e0 con 0x7f500c0c9620 2023-11-27T20:54:56.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.392+0000 7f5011d39640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500c0cc230 con 0x7f500c0cda70 2023-11-27T20:54:56.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.393+0000 7f500affd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f500c0cc420 0x7f500c159610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48654/0 (socket says 172.21.15.88:48654) 2023-11-27T20:54:56.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.393+0000 7f500affd640 1 -- 172.21.15.88:0/846123276 learned_addr learned my addr 172.21.15.88:0/846123276 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:54:56.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.393+0000 7f500b7fe640 1 --2- 172.21.15.88:0/846123276 >> v2:172.21.15.167:3300/0 conn(0x7f500c0cda70 0x7f500c0ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:56.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.395+0000 7f500a7fc640 1 -- 172.21.15.88:0/846123276 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2565485739 0 0) 0x7f500c0cbda0 con 0x7f500c0cc420 2023-11-27T20:54:56.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.395+0000 7f500a7fc640 1 -- 172.21.15.88:0/846123276 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ff8003520 con 0x7f500c0cc420 2023-11-27T20:54:56.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.398+0000 7f500b7fe640 1 -- 172.21.15.88:0/846123276 >> v1:172.21.15.167:6789/0 conn(0x7f500c0c9620 legacy=0x7f500c163eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:56.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.398+0000 7f500b7fe640 1 -- 172.21.15.88:0/846123276 >> v1:172.21.15.88:6789/0 conn(0x7f500c0cc420 legacy=0x7f500c159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:56.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.398+0000 7f500b7fe640 1 -- 172.21.15.88:0/846123276 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500c0cce00 con 0x7f500c0cda70 2023-11-27T20:54:56.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.401+0000 7f500b7fe640 1 --2- 172.21.15.88:0/846123276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f500c0cda70 0x7f500c0ce350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc009d90 tx=0x7f4ffc02bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dfde24a7631e63a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:56.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.406+0000 7f500a7fc640 1 -- 172.21.15.88:0/846123276 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc02cd80 con 0x7f500c0cda70 2023-11-27T20:54:56.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.406+0000 7f500a7fc640 1 -- 172.21.15.88:0/846123276 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ffc034440 con 0x7f500c0cda70 2023-11-27T20:54:56.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.406+0000 7f500a7fc640 1 -- 172.21.15.88:0/846123276 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc0347d0 con 0x7f500c0cda70 2023-11-27T20:54:56.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.406+0000 7f5011d39640 1 -- 172.21.15.88:0/846123276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f500c0cda70 msgr2=0x7f500c0ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:56.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.406+0000 7f5011d39640 1 --2- 172.21.15.88:0/846123276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f500c0cda70 0x7f500c0ce350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc009d90 tx=0x7f4ffc02bfd0 comp rx=0 tx=0).stop 2023-11-27T20:54:56.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.406+0000 7f5011d39640 1 -- 172.21.15.88:0/846123276 shutdown_connections 2023-11-27T20:54:56.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.406+0000 7f5011d39640 1 --2- 172.21.15.88:0/846123276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f500c0cda70 0x7f500c0ce350 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:56.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.406+0000 7f5011d39640 1 -- 172.21.15.88:0/846123276 >> 172.21.15.88:0/846123276 conn(0x7f500c0b07b0 msgr2=0x7f500c0b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:56.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.407+0000 7f5011d39640 1 -- 172.21.15.88:0/846123276 shutdown_connections 2023-11-27T20:54:56.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.407+0000 7f5011d39640 1 -- 172.21.15.88:0/846123276 wait complete. 2023-11-27T20:54:56.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.408+0000 7f5011d39640 1 Processor -- start 2023-11-27T20:54:56.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.408+0000 7f5011d39640 1 -- start start 2023-11-27T20:54:56.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.408+0000 7f5011d39640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f500c0c9620 0x7f500c150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:56.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.408+0000 7f5011d39640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f500c0cc420 0x7f500c150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:56.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.408+0000 7f5011d39640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f500c0cda70 0x7f500c0c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:56.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.409+0000 7f5011d39640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c0c38d0 con 0x7f500c0cc420 2023-11-27T20:54:56.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.409+0000 7f5011d39640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c0c53e0 con 0x7f500c0cda70 2023-11-27T20:54:56.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.409+0000 7f5011d39640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500c0c29e0 con 0x7f500c0c9620 2023-11-27T20:54:56.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.409+0000 7f500affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f500c0cc420 0x7f500c150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:56.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.409+0000 7f500bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f500c0cda70 0x7f500c0c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:56.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.409+0000 7f500affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f500c0cc420 0x7f500c150e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49398/0 (socket says 172.21.15.88:49398) 2023-11-27T20:54:56.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.409+0000 7f500affd640 1 -- 172.21.15.88:0/2147961495 learned_addr learned my addr 172.21.15.88:0/2147961495 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:56.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.409+0000 7f500b7fe640 1 --2- 172.21.15.88:0/2147961495 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f500c0c9620 0x7f500c150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:56.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.413+0000 7f500affd640 1 -- 172.21.15.88:0/2147961495 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f500c0c9620 msgr2=0x7f500c150480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:56.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.413+0000 7f500affd640 1 --2- 172.21.15.88:0/2147961495 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f500c0c9620 0x7f500c150480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:56.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.413+0000 7f500affd640 1 -- 172.21.15.88:0/2147961495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f500c0cda70 msgr2=0x7f500c0c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:56.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.413+0000 7f500affd640 1 --2- 172.21.15.88:0/2147961495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f500c0cda70 0x7f500c0c3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:56.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.413+0000 7f500affd640 1 -- 172.21.15.88:0/2147961495 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc009a70 con 0x7f500c0cc420 2023-11-27T20:54:56.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.415+0000 7f500affd640 1 --2- 172.21.15.88:0/2147961495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f500c0cc420 0x7f500c150e30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4ff400c4d0 tx=0x7f4ff400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:56.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.418+0000 7f5003fff640 1 -- 172.21.15.88:0/2147961495 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4005ce0 con 0x7f500c0cc420 2023-11-27T20:54:56.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.419+0000 7f5003fff640 1 -- 172.21.15.88:0/2147961495 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff4005e40 con 0x7f500c0cc420 2023-11-27T20:54:56.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.419+0000 7f5003fff640 1 -- 172.21.15.88:0/2147961495 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4007270 con 0x7f500c0cc420 2023-11-27T20:54:56.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.419+0000 7f5011d39640 1 -- 172.21.15.88:0/2147961495 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500c0c2cc0 con 0x7f500c0cc420 2023-11-27T20:54:56.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.419+0000 7f5011d39640 1 -- 172.21.15.88:0/2147961495 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500c0c3280 con 0x7f500c0cc420 2023-11-27T20:54:56.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.419+0000 7f5011d39640 1 -- 172.21.15.88:0/2147961495 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500c0c64e0 con 0x7f500c0cc420 2023-11-27T20:54:56.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.660+0000 7f5003fff640 1 -- 172.21.15.88:0/2147961495 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4ff40073d0 con 0x7f500c0cc420 2023-11-27T20:54:56.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.661+0000 7f5003fff640 1 --2- 172.21.15.88:0/2147961495 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4fec06b240 0x7f4fec06d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:56.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.661+0000 7f500b7fe640 1 --2- 172.21.15.88:0/2147961495 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4fec06b240 0x7f4fec06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:56.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.661+0000 7f500b7fe640 1 --2- 172.21.15.88:0/2147961495 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4fec06b240 0x7f4fec06d700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc036000 tx=0x7f4ffc030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:56.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.673+0000 7f5003fff640 1 -- 172.21.15.88:0/2147961495 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4ff40581b0 con 0x7f500c0cc420 2023-11-27T20:54:56.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.673+0000 7f5003fff640 1 -- 172.21.15.88:0/2147961495 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4ff40544f0 con 0x7f500c0cc420 2023-11-27T20:54:56.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:56.876+0000 7f5011d39640 1 -- 172.21.15.88:0/2147961495 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f500c067470 con 0x7f500c0cc420 2023-11-27T20:54:57.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.228+0000 7f5003fff640 1 -- 172.21.15.88:0/2147961495 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4ff4057b10 con 0x7f500c0cc420 2023-11-27T20:54:57.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.230+0000 7f5011d39640 1 -- 172.21.15.88:0/2147961495 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4fec06b240 msgr2=0x7f4fec06d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:57.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.230+0000 7f5011d39640 1 --2- 172.21.15.88:0/2147961495 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4fec06b240 0x7f4fec06d700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc036000 tx=0x7f4ffc030000 comp rx=0 tx=0).stop 2023-11-27T20:54:57.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.230+0000 7f5011d39640 1 -- 172.21.15.88:0/2147961495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f500c0cc420 msgr2=0x7f500c150e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:57.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.230+0000 7f5011d39640 1 --2- 172.21.15.88:0/2147961495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f500c0cc420 0x7f500c150e30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4ff400c4d0 tx=0x7f4ff400c990 comp rx=0 tx=0).stop 2023-11-27T20:54:57.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.230+0000 7f5011d39640 1 -- 172.21.15.88:0/2147961495 shutdown_connections 2023-11-27T20:54:57.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.230+0000 7f5011d39640 1 --2- 172.21.15.88:0/2147961495 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4fec06b240 0x7f4fec06d700 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:57.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.230+0000 7f5011d39640 1 --2- 172.21.15.88:0/2147961495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f500c0cda70 0x7f500c0c3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:57.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.230+0000 7f5011d39640 1 --2- 172.21.15.88:0/2147961495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f500c0cc420 0x7f500c150e30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:57.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.230+0000 7f5011d39640 1 --2- 172.21.15.88:0/2147961495 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f500c0c9620 0x7f500c150480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:57.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.230+0000 7f5011d39640 1 -- 172.21.15.88:0/2147961495 >> 172.21.15.88:0/2147961495 conn(0x7f500c0b07b0 msgr2=0x7f500c0ae720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:57.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.231+0000 7f5011d39640 1 -- 172.21.15.88:0/2147961495 shutdown_connections 2023-11-27T20:54:57.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.231+0000 7f5011d39640 1 -- 172.21.15.88:0/2147961495 wait complete. 2023-11-27T20:54:57.243 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300} 2023-11-27T20:54:57.243 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2023-11-27T20:54:57.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.347+0000 7f1a96105640 1 Processor -- start 2023-11-27T20:54:57.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.347+0000 7f1a96105640 1 -- start start 2023-11-27T20:54:57.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.348+0000 7f1a96105640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1a9015ab30 0x7f1a900c2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:57.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.348+0000 7f1a96105640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1a9015af10 0x7f1a9015b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:57.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.348+0000 7f1a96105640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a90070310 con 0x7f1a900c8550 2023-11-27T20:54:57.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.348+0000 7f1a96105640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a9006f290 con 0x7f1a9015ab30 2023-11-27T20:54:57.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.348+0000 7f1a96105640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a9006f4d0 con 0x7f1a9015af10 2023-11-27T20:54:57.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.349+0000 7f1a8f7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1a9015ab30 0x7f1a900c2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:57.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.349+0000 7f1a8ffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1a9015af10 0x7f1a9015b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:57.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.349+0000 7f1a8effd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1a900c8550 0x7f1a900c76e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48660/0 (socket says 172.21.15.88:48660) 2023-11-27T20:54:57.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.349+0000 7f1a8effd640 1 -- 172.21.15.88:0/3707924944 learned_addr learned my addr 172.21.15.88:0/3707924944 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:54:57.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.351+0000 7f1a8ffff640 1 -- 172.21.15.88:0/3707924944 >> v2:172.21.15.88:3300/0 conn(0x7f1a9015ab30 msgr2=0x7f1a900c2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:57.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.351+0000 7f1a8ffff640 1 --2- 172.21.15.88:0/3707924944 >> v2:172.21.15.88:3300/0 conn(0x7f1a9015ab30 0x7f1a900c2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:57.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.351+0000 7f1a8ffff640 1 -- 172.21.15.88:0/3707924944 >> v1:172.21.15.88:6789/0 conn(0x7f1a900c8550 legacy=0x7f1a900c76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:57.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.351+0000 7f1a8ffff640 1 -- 172.21.15.88:0/3707924944 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a900c1da0 con 0x7f1a9015af10 2023-11-27T20:54:57.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.354+0000 7f1a8ffff640 1 --2- 172.21.15.88:0/3707924944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a9015af10 0x7f1a9015b380 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1a9006e3e0 tx=0x7f1a8802bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d782922a1c93d69 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:57.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.360+0000 7f1a8e7fc640 1 -- 172.21.15.88:0/3707924944 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8802cd00 con 0x7f1a9015af10 2023-11-27T20:54:57.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.360+0000 7f1a8e7fc640 1 -- 172.21.15.88:0/3707924944 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8802ce60 con 0x7f1a9015af10 2023-11-27T20:54:57.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.360+0000 7f1a8e7fc640 1 -- 172.21.15.88:0/3707924944 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a88034660 con 0x7f1a9015af10 2023-11-27T20:54:57.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.361+0000 7f1a96105640 1 -- 172.21.15.88:0/3707924944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a9015af10 msgr2=0x7f1a9015b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:57.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.361+0000 7f1a96105640 1 --2- 172.21.15.88:0/3707924944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a9015af10 0x7f1a9015b380 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1a9006e3e0 tx=0x7f1a8802bf50 comp rx=0 tx=0).stop 2023-11-27T20:54:57.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.361+0000 7f1a96105640 1 -- 172.21.15.88:0/3707924944 shutdown_connections 2023-11-27T20:54:57.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.361+0000 7f1a96105640 1 --2- 172.21.15.88:0/3707924944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a9015af10 0x7f1a9015b380 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:57.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.361+0000 7f1a96105640 1 --2- 172.21.15.88:0/3707924944 >> v2:172.21.15.88:3300/0 conn(0x7f1a9015ab30 0x7f1a900c2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:57.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.361+0000 7f1a96105640 1 -- 172.21.15.88:0/3707924944 >> 172.21.15.88:0/3707924944 conn(0x7f1a90070850 msgr2=0x7f1a90070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:57.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.361+0000 7f1a96105640 1 -- 172.21.15.88:0/3707924944 shutdown_connections 2023-11-27T20:54:57.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.361+0000 7f1a96105640 1 -- 172.21.15.88:0/3707924944 wait complete. 2023-11-27T20:54:57.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.362+0000 7f1a96105640 1 Processor -- start 2023-11-27T20:54:57.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.363+0000 7f1a96105640 1 -- start start 2023-11-27T20:54:57.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.363+0000 7f1a96105640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a900c8550 0x7f1a900c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:57.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.363+0000 7f1a96105640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a9015ab30 0x7f1a901f23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:57.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.363+0000 7f1a96105640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a9015af10 0x7f1a900cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:57.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.363+0000 7f1a96105640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a900c5700 con 0x7f1a9015ab30 2023-11-27T20:54:57.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.363+0000 7f1a96105640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a900caae0 con 0x7f1a9015af10 2023-11-27T20:54:57.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.363+0000 7f1a96105640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a901f1f40 con 0x7f1a900c8550 2023-11-27T20:54:57.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.364+0000 7f1a8effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a9015ab30 0x7f1a901f23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:57.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.364+0000 7f1a8ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a9015af10 0x7f1a900cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:57.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.364+0000 7f1a8f7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a900c8550 0x7f1a900c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:57.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.364+0000 7f1a8ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a9015af10 0x7f1a900cb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:39578/0 (socket says 172.21.15.88:39578) 2023-11-27T20:54:57.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.364+0000 7f1a8ffff640 1 -- 172.21.15.88:0/4198424392 learned_addr learned my addr 172.21.15.88:0/4198424392 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:57.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.367+0000 7f1a8effd640 1 -- 172.21.15.88:0/4198424392 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a900c8550 msgr2=0x7f1a900c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:57.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.367+0000 7f1a8effd640 1 --2- 172.21.15.88:0/4198424392 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a900c8550 0x7f1a900c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:57.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.367+0000 7f1a8effd640 1 -- 172.21.15.88:0/4198424392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a9015af10 msgr2=0x7f1a900cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:57.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.367+0000 7f1a8effd640 1 --2- 172.21.15.88:0/4198424392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a9015af10 0x7f1a900cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:57.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.367+0000 7f1a8effd640 1 -- 172.21.15.88:0/4198424392 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a88009a70 con 0x7f1a9015ab30 2023-11-27T20:54:57.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.370+0000 7f1a8effd640 1 --2- 172.21.15.88:0/4198424392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a9015ab30 0x7f1a901f23d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1a80000f60 tx=0x7f1a8000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:57.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.373+0000 7f1a77fff640 1 -- 172.21.15.88:0/4198424392 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a80005ce0 con 0x7f1a9015ab30 2023-11-27T20:54:57.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.373+0000 7f1a77fff640 1 -- 172.21.15.88:0/4198424392 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a80005e40 con 0x7f1a9015ab30 2023-11-27T20:54:57.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.373+0000 7f1a77fff640 1 -- 172.21.15.88:0/4198424392 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a80007310 con 0x7f1a9015ab30 2023-11-27T20:54:57.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.373+0000 7f1a96105640 1 -- 172.21.15.88:0/4198424392 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a900c51b0 con 0x7f1a9015ab30 2023-11-27T20:54:57.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.373+0000 7f1a96105640 1 -- 172.21.15.88:0/4198424392 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a900c5420 con 0x7f1a9015ab30 2023-11-27T20:54:57.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.374+0000 7f1a96105640 1 -- 172.21.15.88:0/4198424392 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a901f1d10 con 0x7f1a9015ab30 2023-11-27T20:54:57.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.615+0000 7f1a77fff640 1 -- 172.21.15.88:0/4198424392 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1a80007470 con 0x7f1a9015ab30 2023-11-27T20:54:57.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.615+0000 7f1a77fff640 1 --2- 172.21.15.88:0/4198424392 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1a7c06b210 0x7f1a7c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:57.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.615+0000 7f1a8f7fe640 1 --2- 172.21.15.88:0/4198424392 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1a7c06b210 0x7f1a7c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:57.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.616+0000 7f1a8f7fe640 1 --2- 172.21.15.88:0/4198424392 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1a7c06b210 0x7f1a7c06d6d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1a84009b40 tx=0x7f1a84009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:57.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.628+0000 7f1a77fff640 1 -- 172.21.15.88:0/4198424392 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1a80001000 con 0x7f1a9015ab30 2023-11-27T20:54:57.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.628+0000 7f1a77fff640 1 -- 172.21.15.88:0/4198424392 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f1a80054070 con 0x7f1a9015ab30 2023-11-27T20:54:57.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:57.827+0000 7f1a96105640 1 -- 172.21.15.88:0/4198424392 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f1a900c8120 con 0x7f1a9015ab30 2023-11-27T20:54:58.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.318+0000 7f1a77fff640 1 -- 172.21.15.88:0/4198424392 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v9) v1 ==== 105+0+0 (secure 0 0 0) 0x7f1a80017070 con 0x7f1a9015ab30 2023-11-27T20:54:58.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.320+0000 7f1a96105640 1 -- 172.21.15.88:0/4198424392 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1a7c06b210 msgr2=0x7f1a7c06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:58.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.320+0000 7f1a96105640 1 --2- 172.21.15.88:0/4198424392 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1a7c06b210 0x7f1a7c06d6d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1a84009b40 tx=0x7f1a84009190 comp rx=0 tx=0).stop 2023-11-27T20:54:58.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.320+0000 7f1a96105640 1 -- 172.21.15.88:0/4198424392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a9015ab30 msgr2=0x7f1a901f23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:58.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.320+0000 7f1a96105640 1 --2- 172.21.15.88:0/4198424392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a9015ab30 0x7f1a901f23d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1a80000f60 tx=0x7f1a8000c760 comp rx=0 tx=0).stop 2023-11-27T20:54:58.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.320+0000 7f1a96105640 1 -- 172.21.15.88:0/4198424392 shutdown_connections 2023-11-27T20:54:58.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.320+0000 7f1a96105640 1 --2- 172.21.15.88:0/4198424392 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1a7c06b210 0x7f1a7c06d6d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:58.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.320+0000 7f1a96105640 1 --2- 172.21.15.88:0/4198424392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a9015af10 0x7f1a900cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:58.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.320+0000 7f1a96105640 1 --2- 172.21.15.88:0/4198424392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a9015ab30 0x7f1a901f23d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:58.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.320+0000 7f1a96105640 1 --2- 172.21.15.88:0/4198424392 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a900c8550 0x7f1a900c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:58.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.320+0000 7f1a96105640 1 -- 172.21.15.88:0/4198424392 >> 172.21.15.88:0/4198424392 conn(0x7f1a90070850 msgr2=0x7f1a900c9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:58.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.320+0000 7f1a96105640 1 -- 172.21.15.88:0/4198424392 shutdown_connections 2023-11-27T20:54:58.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.320+0000 7f1a96105640 1 -- 172.21.15.88:0/4198424392 wait complete. 2023-11-27T20:54:58.333 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-27T20:54:58.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.438+0000 7f821f243640 1 Processor -- start 2023-11-27T20:54:58.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.438+0000 7f821f243640 1 -- start start 2023-11-27T20:54:58.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.439+0000 7f821f243640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f821815ab30 0x7f82180c2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:58.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.439+0000 7f821f243640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f82180c8550 0x7f82180c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:58.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.439+0000 7f821f243640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8218070310 con 0x7f821815af10 2023-11-27T20:54:58.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.439+0000 7f821f243640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821806f290 con 0x7f821815ab30 2023-11-27T20:54:58.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.439+0000 7f821f243640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82180c7c20 con 0x7f82180c8550 2023-11-27T20:54:58.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.472+0000 7f821cfdf640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f821815ab30 0x7f82180c2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:58.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.474+0000 7f8217fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f82180c8550 0x7f82180c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:58.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.474+0000 7f821d7e0640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f821815af10 0x7f82181511b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:59526/0 (socket says 172.21.15.88:59526) 2023-11-27T20:54:58.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.474+0000 7f821d7e0640 1 -- 172.21.15.88:0/1862290043 learned_addr learned my addr 172.21.15.88:0/1862290043 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:54:58.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.478+0000 7f821cfdf640 1 -- 172.21.15.88:0/1862290043 >> v2:172.21.15.167:3300/0 conn(0x7f82180c8550 msgr2=0x7f82180c76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:58.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.478+0000 7f821cfdf640 1 --2- 172.21.15.88:0/1862290043 >> v2:172.21.15.167:3300/0 conn(0x7f82180c8550 0x7f82180c76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:58.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.478+0000 7f821cfdf640 1 -- 172.21.15.88:0/1862290043 >> v1:172.21.15.167:6789/0 conn(0x7f821815af10 legacy=0x7f82181511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:58.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.478+0000 7f821cfdf640 1 -- 172.21.15.88:0/1862290043 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821806f4d0 con 0x7f821815ab30 2023-11-27T20:54:58.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.478+0000 7f8217fff640 1 --2- 172.21.15.88:0/1862290043 >> v2:172.21.15.167:3300/0 conn(0x7f82180c8550 0x7f82180c76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:54:58.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.480+0000 7f821cfdf640 1 --2- 172.21.15.88:0/1862290043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f821815ab30 0x7f82180c2b60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f82180ca3d0 tx=0x7f820c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d241a7f6dff15a8f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:58.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.483+0000 7f82177fe640 1 -- 172.21.15.88:0/1862290043 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c030610 con 0x7f821815ab30 2023-11-27T20:54:58.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.484+0000 7f82177fe640 1 -- 172.21.15.88:0/1862290043 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c030770 con 0x7f821815ab30 2023-11-27T20:54:58.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.484+0000 7f82177fe640 1 -- 172.21.15.88:0/1862290043 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c030b00 con 0x7f821815ab30 2023-11-27T20:54:58.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.484+0000 7f821f243640 1 -- 172.21.15.88:0/1862290043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f821815ab30 msgr2=0x7f82180c2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:58.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.484+0000 7f821f243640 1 --2- 172.21.15.88:0/1862290043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f821815ab30 0x7f82180c2b60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f82180ca3d0 tx=0x7f820c02b960 comp rx=0 tx=0).stop 2023-11-27T20:54:58.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.484+0000 7f821f243640 1 -- 172.21.15.88:0/1862290043 shutdown_connections 2023-11-27T20:54:58.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.484+0000 7f821f243640 1 --2- 172.21.15.88:0/1862290043 >> v2:172.21.15.167:3300/0 conn(0x7f82180c8550 0x7f82180c76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:58.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.484+0000 7f821f243640 1 --2- 172.21.15.88:0/1862290043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f821815ab30 0x7f82180c2b60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:58.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.484+0000 7f821f243640 1 -- 172.21.15.88:0/1862290043 >> 172.21.15.88:0/1862290043 conn(0x7f8218070850 msgr2=0x7f8218070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:58.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.484+0000 7f821f243640 1 -- 172.21.15.88:0/1862290043 shutdown_connections 2023-11-27T20:54:58.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.484+0000 7f821f243640 1 -- 172.21.15.88:0/1862290043 wait complete. 2023-11-27T20:54:58.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.486+0000 7f821f243640 1 Processor -- start 2023-11-27T20:54:58.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.486+0000 7f821f243640 1 -- start start 2023-11-27T20:54:58.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.486+0000 7f821f243640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82180c8550 0x7f82180c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:58.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.486+0000 7f821f243640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f821815ab30 0x7f821814a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:58.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.486+0000 7f821f243640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f821815af10 0x7f821814abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:58.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.487+0000 7f821f243640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82180c51b0 con 0x7f821815ab30 2023-11-27T20:54:58.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.487+0000 7f821f243640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82180c5490 con 0x7f82180c8550 2023-11-27T20:54:58.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.487+0000 7f821f243640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82180c5770 con 0x7f821815af10 2023-11-27T20:54:58.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.487+0000 7f8217fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f821815ab30 0x7f821814a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:58.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.487+0000 7f821cfdf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82180c8550 0x7f82180c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:58.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.487+0000 7f821cfdf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82180c8550 0x7f82180c6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:39604/0 (socket says 172.21.15.88:39604) 2023-11-27T20:54:58.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.487+0000 7f821cfdf640 1 -- 172.21.15.88:0/3114724540 learned_addr learned my addr 172.21.15.88:0/3114724540 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:58.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.491+0000 7f821cfdf640 1 -- 172.21.15.88:0/3114724540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f821815af10 msgr2=0x7f821814abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:58.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.491+0000 7f821cfdf640 1 --2- 172.21.15.88:0/3114724540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f821815af10 0x7f821814abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:58.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.491+0000 7f821cfdf640 1 -- 172.21.15.88:0/3114724540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f821815ab30 msgr2=0x7f821814a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:58.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.491+0000 7f821cfdf640 1 --2- 172.21.15.88:0/3114724540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f821815ab30 0x7f821814a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:58.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.491+0000 7f821cfdf640 1 -- 172.21.15.88:0/3114724540 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8204009400 con 0x7f82180c8550 2023-11-27T20:54:58.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.491+0000 7f8217fff640 1 --2- 172.21.15.88:0/3114724540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f821815ab30 0x7f821814a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:54:58.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.493+0000 7f821cfdf640 1 --2- 172.21.15.88:0/3114724540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82180c8550 0x7f82180c6250 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f820c009890 tx=0x7f820c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:58.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.497+0000 7f82157fa640 1 -- 172.21.15.88:0/3114724540 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c03e040 con 0x7f82180c8550 2023-11-27T20:54:58.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.497+0000 7f82157fa640 1 -- 172.21.15.88:0/3114724540 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c039b90 con 0x7f82180c8550 2023-11-27T20:54:58.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.497+0000 7f82157fa640 1 -- 172.21.15.88:0/3114724540 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c0443f0 con 0x7f82180c8550 2023-11-27T20:54:58.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.497+0000 7f821f243640 1 -- 172.21.15.88:0/3114724540 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f820c009400 con 0x7f82180c8550 2023-11-27T20:54:58.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.497+0000 7f821f243640 1 -- 172.21.15.88:0/3114724540 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82180c5d30 con 0x7f82180c8550 2023-11-27T20:54:58.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.498+0000 7f821f243640 1 -- 172.21.15.88:0/3114724540 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82180c5f50 con 0x7f82180c8550 2023-11-27T20:54:58.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.752+0000 7f82157fa640 1 -- 172.21.15.88:0/3114724540 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f820c04d3b0 con 0x7f82180c8550 2023-11-27T20:54:58.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.753+0000 7f82157fa640 1 --2- 172.21.15.88:0/3114724540 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f81fc06b210 0x7f81fc06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:58.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.753+0000 7f8217fff640 1 --2- 172.21.15.88:0/3114724540 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f81fc06b210 0x7f81fc06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:58.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.753+0000 7f8217fff640 1 --2- 172.21.15.88:0/3114724540 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f81fc06b210 0x7f81fc06d6d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f82180af720 tx=0x7f8204009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:58.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.757+0000 7f82157fa640 1 -- 172.21.15.88:0/3114724540 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f820c07ab30 con 0x7f82180c8550 2023-11-27T20:54:58.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.768+0000 7f82157fa640 1 -- 172.21.15.88:0/3114724540 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f820c076e70 con 0x7f82180c8550 2023-11-27T20:54:58.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:58.971+0000 7f821f243640 1 -- 172.21.15.88:0/3114724540 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f82180c55d0 con 0x7f82180c8550 2023-11-27T20:54:59.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.674+0000 7f82157fa640 1 -- 172.21.15.88:0/3114724540 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7f82180c55d0 con 0x7f82180c8550 2023-11-27T20:54:59.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.676+0000 7f821f243640 1 -- 172.21.15.88:0/3114724540 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f81fc06b210 msgr2=0x7f81fc06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:59.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.676+0000 7f821f243640 1 --2- 172.21.15.88:0/3114724540 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f81fc06b210 0x7f81fc06d6d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f82180af720 tx=0x7f8204009190 comp rx=0 tx=0).stop 2023-11-27T20:54:59.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.676+0000 7f821f243640 1 -- 172.21.15.88:0/3114724540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82180c8550 msgr2=0x7f82180c6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:59.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.676+0000 7f821f243640 1 --2- 172.21.15.88:0/3114724540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82180c8550 0x7f82180c6250 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f820c009890 tx=0x7f820c004730 comp rx=0 tx=0).stop 2023-11-27T20:54:59.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.676+0000 7f821f243640 1 -- 172.21.15.88:0/3114724540 shutdown_connections 2023-11-27T20:54:59.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.676+0000 7f821f243640 1 --2- 172.21.15.88:0/3114724540 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f81fc06b210 0x7f81fc06d6d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:59.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.676+0000 7f821f243640 1 --2- 172.21.15.88:0/3114724540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f821815af10 0x7f821814abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:59.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.676+0000 7f821f243640 1 --2- 172.21.15.88:0/3114724540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f821815ab30 0x7f821814a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:59.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.676+0000 7f821f243640 1 --2- 172.21.15.88:0/3114724540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82180c8550 0x7f82180c6250 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:59.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.677+0000 7f821f243640 1 -- 172.21.15.88:0/3114724540 >> 172.21.15.88:0/3114724540 conn(0x7f8218070850 msgr2=0x7f82180c9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:59.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.677+0000 7f821f243640 1 -- 172.21.15.88:0/3114724540 shutdown_connections 2023-11-27T20:54:59.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.677+0000 7f821f243640 1 -- 172.21.15.88:0/3114724540 wait complete. 2023-11-27T20:54:59.690 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-11-27T20:54:59.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.792+0000 7fd293741640 1 Processor -- start 2023-11-27T20:54:59.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.792+0000 7fd293741640 1 -- start start 2023-11-27T20:54:59.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.793+0000 7fd293741640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd28c1538f0 0x7fd28c06f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:59.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.793+0000 7fd293741640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd28c0cceb0 0x7fd28c0cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:59.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.793+0000 7fd293741640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd28c0c7b50 con 0x7fd28c15cf40 2023-11-27T20:54:59.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.793+0000 7fd293741640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd28c159720 con 0x7fd28c0cceb0 2023-11-27T20:54:59.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.793+0000 7fd293741640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c159a00 con 0x7fd28c1538f0 2023-11-27T20:54:59.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.793+0000 7fd290cdc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd28c0cceb0 0x7fd28c0cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:59.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.794+0000 7fd2914dd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd28c1538f0 0x7fd28c06f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:59.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.794+0000 7fd2914dd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd28c1538f0 0x7fd28c06f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:56288/0 (socket says 172.21.15.88:56288) 2023-11-27T20:54:59.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.794+0000 7fd2914dd640 1 -- 172.21.15.88:0/2216558821 learned_addr learned my addr 172.21.15.88:0/2216558821 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:59.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.796+0000 7fd2914dd640 1 -- 172.21.15.88:0/2216558821 >> v2:172.21.15.88:3300/0 conn(0x7fd28c0cceb0 msgr2=0x7fd28c0cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:54:59.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.796+0000 7fd2914dd640 1 --2- 172.21.15.88:0/2216558821 >> v2:172.21.15.88:3300/0 conn(0x7fd28c0cceb0 0x7fd28c0cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:59.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.796+0000 7fd2914dd640 1 -- 172.21.15.88:0/2216558821 >> v1:172.21.15.88:6789/0 conn(0x7fd28c15cf40 legacy=0x7fd28c15d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:59.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.796+0000 7fd2914dd640 1 -- 172.21.15.88:0/2216558821 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28c159ce0 con 0x7fd28c1538f0 2023-11-27T20:54:59.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.798+0000 7fd2914dd640 1 --2- 172.21.15.88:0/2216558821 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd28c1538f0 0x7fd28c06f000 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd288009870 tx=0x7fd28802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c041350cf10210ce server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:59.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.802+0000 7fd283fff640 1 -- 172.21.15.88:0/2216558821 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd288030840 con 0x7fd28c1538f0 2023-11-27T20:54:59.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.802+0000 7fd283fff640 1 -- 172.21.15.88:0/2216558821 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2880309a0 con 0x7fd28c1538f0 2023-11-27T20:54:59.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.802+0000 7fd283fff640 1 -- 172.21.15.88:0/2216558821 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd288030d30 con 0x7fd28c1538f0 2023-11-27T20:54:59.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.802+0000 7fd293741640 1 -- 172.21.15.88:0/2216558821 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd28c1538f0 msgr2=0x7fd28c06f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:59.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.802+0000 7fd293741640 1 --2- 172.21.15.88:0/2216558821 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd28c1538f0 0x7fd28c06f000 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd288009870 tx=0x7fd28802b980 comp rx=0 tx=0).stop 2023-11-27T20:54:59.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.802+0000 7fd293741640 1 -- 172.21.15.88:0/2216558821 shutdown_connections 2023-11-27T20:54:59.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.802+0000 7fd293741640 1 --2- 172.21.15.88:0/2216558821 >> v2:172.21.15.88:3300/0 conn(0x7fd28c0cceb0 0x7fd28c0cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:59.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.802+0000 7fd293741640 1 --2- 172.21.15.88:0/2216558821 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd28c1538f0 0x7fd28c06f000 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:59.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.802+0000 7fd293741640 1 -- 172.21.15.88:0/2216558821 >> 172.21.15.88:0/2216558821 conn(0x7fd28c070990 msgr2=0x7fd28c070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:54:59.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.802+0000 7fd293741640 1 -- 172.21.15.88:0/2216558821 shutdown_connections 2023-11-27T20:54:59.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.803+0000 7fd293741640 1 -- 172.21.15.88:0/2216558821 wait complete. 2023-11-27T20:54:59.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.804+0000 7fd293741640 1 Processor -- start 2023-11-27T20:54:59.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.804+0000 7fd293741640 1 -- start start 2023-11-27T20:54:59.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.804+0000 7fd293741640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd28c0cceb0 0x7fd28c147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:59.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.804+0000 7fd293741640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd28c1538f0 0x7fd28c1478b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:59.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.804+0000 7fd293741640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd28c15cf40 0x7fd28c0b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:59.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.804+0000 7fd293741640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c0b02e0 con 0x7fd28c0cceb0 2023-11-27T20:54:59.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.804+0000 7fd293741640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c06bc40 con 0x7fd28c1538f0 2023-11-27T20:54:59.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.804+0000 7fd293741640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c0cb9d0 con 0x7fd28c15cf40 2023-11-27T20:54:59.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.805+0000 7fd291cde640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd28c15cf40 0x7fd28c0b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:59.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.805+0000 7fd2914dd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd28c0cceb0 0x7fd28c147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:59.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.805+0000 7fd290cdc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd28c1538f0 0x7fd28c1478b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:59.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.805+0000 7fd291cde640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd28c15cf40 0x7fd28c0b0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:56290/0 (socket says 172.21.15.88:56290) 2023-11-27T20:54:59.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.805+0000 7fd291cde640 1 -- 172.21.15.88:0/1753872936 learned_addr learned my addr 172.21.15.88:0/1753872936 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:54:59.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.808+0000 7fd2914dd640 1 -- 172.21.15.88:0/1753872936 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd28c15cf40 msgr2=0x7fd28c0b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:59.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.808+0000 7fd2914dd640 1 --2- 172.21.15.88:0/1753872936 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd28c15cf40 0x7fd28c0b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:59.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.808+0000 7fd2914dd640 1 -- 172.21.15.88:0/1753872936 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd28c1538f0 msgr2=0x7fd28c1478b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:54:59.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.808+0000 7fd2914dd640 1 --2- 172.21.15.88:0/1753872936 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd28c1538f0 0x7fd28c1478b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:54:59.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.808+0000 7fd2914dd640 1 -- 172.21.15.88:0/1753872936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2880094d0 con 0x7fd28c0cceb0 2023-11-27T20:54:59.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.811+0000 7fd2914dd640 1 --2- 172.21.15.88:0/1753872936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd28c0cceb0 0x7fd28c147370 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd288033000 tx=0x7fd288004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:59.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.814+0000 7fd281ffb640 1 -- 172.21.15.88:0/1753872936 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd288039a10 con 0x7fd28c0cceb0 2023-11-27T20:54:59.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.814+0000 7fd281ffb640 1 -- 172.21.15.88:0/1753872936 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd288039b70 con 0x7fd28c0cceb0 2023-11-27T20:54:59.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.814+0000 7fd281ffb640 1 -- 172.21.15.88:0/1753872936 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd288043410 con 0x7fd28c0cceb0 2023-11-27T20:54:59.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.814+0000 7fd293741640 1 -- 172.21.15.88:0/1753872936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd28c0cc1e0 con 0x7fd28c0cceb0 2023-11-27T20:54:59.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.815+0000 7fd293741640 1 -- 172.21.15.88:0/1753872936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28c146ee0 con 0x7fd28c0cceb0 2023-11-27T20:54:59.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.815+0000 7fd293741640 1 -- 172.21.15.88:0/1753872936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd28c06f610 con 0x7fd28c0cceb0 2023-11-27T20:54:59.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.834+0000 7fd281ffb640 1 -- 172.21.15.88:0/1753872936 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd28802f390 con 0x7fd28c0cceb0 2023-11-27T20:54:59.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.834+0000 7fd281ffb640 1 --2- 172.21.15.88:0/1753872936 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd27006b1c0 0x7fd27006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:54:59.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.834+0000 7fd290cdc640 1 --2- 172.21.15.88:0/1753872936 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd27006b1c0 0x7fd27006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:54:59.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.835+0000 7fd290cdc640 1 --2- 172.21.15.88:0/1753872936 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd27006b1c0 0x7fd27006d680 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd28c1482d0 tx=0x7fd27c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:54:59.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:54:59.837+0000 7fd281ffb640 1 -- 172.21.15.88:0/1753872936 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd28807a940 con 0x7fd28c0cceb0 2023-11-27T20:55:00.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.071+0000 7fd281ffb640 1 -- 172.21.15.88:0/1753872936 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd288076c80 con 0x7fd28c0cceb0 2023-11-27T20:55:00.184 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:55:00.186 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:55:00.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.279+0000 7fd293741640 1 -- 172.21.15.88:0/1753872936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fd28c0cbf00 con 0x7fd28c0cceb0 2023-11-27T20:55:00.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.669+0000 7fd281ffb640 1 -- 172.21.15.88:0/1753872936 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v12) v1 ==== 115+0+0 (secure 0 0 0) 0x7fd288048070 con 0x7fd28c0cceb0 2023-11-27T20:55:00.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.671+0000 7fd293741640 1 -- 172.21.15.88:0/1753872936 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd27006b1c0 msgr2=0x7fd27006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:00.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.671+0000 7fd293741640 1 --2- 172.21.15.88:0/1753872936 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd27006b1c0 0x7fd27006d680 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd28c1482d0 tx=0x7fd27c009190 comp rx=0 tx=0).stop 2023-11-27T20:55:00.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.671+0000 7fd293741640 1 -- 172.21.15.88:0/1753872936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd28c0cceb0 msgr2=0x7fd28c147370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:00.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.671+0000 7fd293741640 1 --2- 172.21.15.88:0/1753872936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd28c0cceb0 0x7fd28c147370 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd288033000 tx=0x7fd288004730 comp rx=0 tx=0).stop 2023-11-27T20:55:00.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.671+0000 7fd293741640 1 -- 172.21.15.88:0/1753872936 shutdown_connections 2023-11-27T20:55:00.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.671+0000 7fd293741640 1 --2- 172.21.15.88:0/1753872936 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd27006b1c0 0x7fd27006d680 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:00.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.671+0000 7fd293741640 1 --2- 172.21.15.88:0/1753872936 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd28c15cf40 0x7fd28c0b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:00.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.671+0000 7fd293741640 1 --2- 172.21.15.88:0/1753872936 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd28c1538f0 0x7fd28c1478b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:00.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.671+0000 7fd293741640 1 --2- 172.21.15.88:0/1753872936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd28c0cceb0 0x7fd28c147370 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:00.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.671+0000 7fd293741640 1 -- 172.21.15.88:0/1753872936 >> 172.21.15.88:0/1753872936 conn(0x7fd28c070990 msgr2=0x7fd28c0c86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:00.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.671+0000 7fd293741640 1 -- 172.21.15.88:0/1753872936 shutdown_connections 2023-11-27T20:55:00.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.671+0000 7fd293741640 1 -- 172.21.15.88:0/1753872936 wait complete. 2023-11-27T20:55:00.686 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-27T20:55:00.687 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:55:00.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.829+0000 7f1d20ec2640 1 Processor -- start 2023-11-27T20:55:00.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.829+0000 7f1d20ec2640 1 -- start start 2023-11-27T20:55:00.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.830+0000 7f1d20ec2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d1c0c52e0 0x7f1d1c0c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:00.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.830+0000 7f1d20ec2640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1d1c15ac30 0x7f1d1c15b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:00.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.830+0000 7f1d20ec2640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d1c15a7a0 con 0x7f1d1c0c56c0 2023-11-27T20:55:00.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.830+0000 7f1d20ec2640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d1c0c7250 con 0x7f1d1c15ac30 2023-11-27T20:55:00.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.830+0000 7f1d20ec2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c15b600 con 0x7f1d1c0c52e0 2023-11-27T20:55:00.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.830+0000 7f1d1ad9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1d1c15ac30 0x7f1d1c15b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:00.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.831+0000 7f1d1ad9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1d1c15ac30 0x7f1d1c15b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50390/0 (socket says 172.21.15.88:50390) 2023-11-27T20:55:00.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.831+0000 7f1d1ad9d640 1 -- 172.21.15.88:0/2851583265 learned_addr learned my addr 172.21.15.88:0/2851583265 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:00.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.833+0000 7f1d1ad9d640 1 -- 172.21.15.88:0/2851583265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d1c0c52e0 msgr2=0x7f1d1c0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:00.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.833+0000 7f1d1ad9d640 1 --2- 172.21.15.88:0/2851583265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d1c0c52e0 0x7f1d1c0c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:00.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.833+0000 7f1d1ad9d640 1 -- 172.21.15.88:0/2851583265 >> v1:172.21.15.167:6789/0 conn(0x7f1d1c0c56c0 legacy=0x7f1d1c0c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:00.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.833+0000 7f1d1ad9d640 1 -- 172.21.15.88:0/2851583265 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c1574c0 con 0x7f1d1c15ac30 2023-11-27T20:55:00.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.835+0000 7f1d1ad9d640 1 --2- 172.21.15.88:0/2851583265 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d1c15ac30 0x7f1d1c15b0c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009e50 tx=0x7f1d1402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ebb3bb711af3f41 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:00.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.838+0000 7f1d1959a640 1 -- 172.21.15.88:0/2851583265 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1402ca70 con 0x7f1d1c15ac30 2023-11-27T20:55:00.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.838+0000 7f1d1959a640 1 -- 172.21.15.88:0/2851583265 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1402cbd0 con 0x7f1d1c15ac30 2023-11-27T20:55:00.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.838+0000 7f1d1959a640 1 -- 172.21.15.88:0/2851583265 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d140343f0 con 0x7f1d1c15ac30 2023-11-27T20:55:00.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.839+0000 7f1d20ec2640 1 -- 172.21.15.88:0/2851583265 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d1c15ac30 msgr2=0x7f1d1c15b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:00.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.839+0000 7f1d20ec2640 1 --2- 172.21.15.88:0/2851583265 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d1c15ac30 0x7f1d1c15b0c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009e50 tx=0x7f1d1402bed0 comp rx=0 tx=0).stop 2023-11-27T20:55:00.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.839+0000 7f1d20ec2640 1 -- 172.21.15.88:0/2851583265 shutdown_connections 2023-11-27T20:55:00.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.839+0000 7f1d20ec2640 1 --2- 172.21.15.88:0/2851583265 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d1c15ac30 0x7f1d1c15b0c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:00.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.839+0000 7f1d20ec2640 1 --2- 172.21.15.88:0/2851583265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d1c0c52e0 0x7f1d1c0c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:00.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.839+0000 7f1d20ec2640 1 -- 172.21.15.88:0/2851583265 >> 172.21.15.88:0/2851583265 conn(0x7f1d1c06f6d0 msgr2=0x7f1d1c06fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:00.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.839+0000 7f1d20ec2640 1 -- 172.21.15.88:0/2851583265 shutdown_connections 2023-11-27T20:55:00.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.839+0000 7f1d20ec2640 1 -- 172.21.15.88:0/2851583265 wait complete. 2023-11-27T20:55:00.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.840+0000 7f1d20ec2640 1 Processor -- start 2023-11-27T20:55:00.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.840+0000 7f1d20ec2640 1 -- start start 2023-11-27T20:55:00.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.841+0000 7f1d20ec2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d1c0c52e0 0x7f1d1c152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:00.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.841+0000 7f1d20ec2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d1c0c56c0 0x7f1d1c14c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:00.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.841+0000 7f1d20ec2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d1c15ac30 0x7f1d1c14cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:00.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.841+0000 7f1d20ec2640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c14db00 con 0x7f1d1c0c56c0 2023-11-27T20:55:00.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.841+0000 7f1d20ec2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c153950 con 0x7f1d1c0c52e0 2023-11-27T20:55:00.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.841+0000 7f1d20ec2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c1545b0 con 0x7f1d1c15ac30 2023-11-27T20:55:00.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.842+0000 7f1d19d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d1c0c56c0 0x7f1d1c14c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:00.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.842+0000 7f1d19d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d1c0c56c0 0x7f1d1c14c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50398/0 (socket says 172.21.15.88:50398) 2023-11-27T20:55:00.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.842+0000 7f1d19d9b640 1 -- 172.21.15.88:0/3112721400 learned_addr learned my addr 172.21.15.88:0/3112721400 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:00.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.845+0000 7f1d19d9b640 1 -- 172.21.15.88:0/3112721400 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d1c15ac30 msgr2=0x7f1d1c14cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:00.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.845+0000 7f1d19d9b640 1 --2- 172.21.15.88:0/3112721400 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d1c15ac30 0x7f1d1c14cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:00.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.845+0000 7f1d19d9b640 1 -- 172.21.15.88:0/3112721400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d1c0c52e0 msgr2=0x7f1d1c152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:00.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.845+0000 7f1d19d9b640 1 --2- 172.21.15.88:0/3112721400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d1c0c52e0 0x7f1d1c152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:00.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.845+0000 7f1d19d9b640 1 -- 172.21.15.88:0/3112721400 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d14009b30 con 0x7f1d1c0c56c0 2023-11-27T20:55:00.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.848+0000 7f1d19d9b640 1 --2- 172.21.15.88:0/3112721400 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d1c0c56c0 0x7f1d1c14c9d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c00b3e0 tx=0x7f1d0c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:00.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.851+0000 7f1d0affd640 1 -- 172.21.15.88:0/3112721400 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c011830 con 0x7f1d1c0c56c0 2023-11-27T20:55:00.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.851+0000 7f1d0affd640 1 -- 172.21.15.88:0/3112721400 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0c0119b0 con 0x7f1d1c0c56c0 2023-11-27T20:55:00.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.851+0000 7f1d20ec2640 1 -- 172.21.15.88:0/3112721400 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d1c154210 con 0x7f1d1c0c56c0 2023-11-27T20:55:00.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.851+0000 7f1d0affd640 1 -- 172.21.15.88:0/3112721400 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c011d60 con 0x7f1d1c0c56c0 2023-11-27T20:55:00.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.851+0000 7f1d20ec2640 1 -- 172.21.15.88:0/3112721400 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d1c154da0 con 0x7f1d1c0c56c0 2023-11-27T20:55:00.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.852+0000 7f1d20ec2640 1 -- 172.21.15.88:0/3112721400 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d1c0c27a0 con 0x7f1d1c0c56c0 2023-11-27T20:55:00.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.870+0000 7f1d0affd640 1 -- 172.21.15.88:0/3112721400 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1d0c023430 con 0x7f1d1c0c56c0 2023-11-27T20:55:00.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.870+0000 7f1d0affd640 1 --2- 172.21.15.88:0/3112721400 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1cfc06b210 0x7f1cfc06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:00.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.871+0000 7f1d1a59c640 1 --2- 172.21.15.88:0/3112721400 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1cfc06b210 0x7f1cfc06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:00.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.871+0000 7f1d1a59c640 1 --2- 172.21.15.88:0/3112721400 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1cfc06b210 0x7f1cfc06d6d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1d10009670 tx=0x7f1d10006bf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:00.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:00.874+0000 7f1d0affd640 1 -- 172.21.15.88:0/3112721400 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1d0c058d40 con 0x7f1d1c0c56c0 2023-11-27T20:55:01.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.103+0000 7f1d0affd640 1 -- 172.21.15.88:0/3112721400 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f1d0c054980 con 0x7f1d1c0c56c0 2023-11-27T20:55:01.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.309+0000 7f1d20ec2640 1 -- 172.21.15.88:0/3112721400 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d1c067470 con 0x7f1d1c0c56c0 2023-11-27T20:55:01.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.322+0000 7f1d0affd640 1 -- 172.21.15.88:0/3112721400 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+6517 (secure 0 0 0) 0x7f1d0c015020 con 0x7f1d1c0c56c0 2023-11-27T20:55:01.327 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:55:01.327 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/298325117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":298325117},{"type":"v1","addr":"172.21.15.88:6837","nonce":298325117}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/1596074914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1596074914},{"type":"v1","addr":"172.21.15.167:6837","nonce":1596074914}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":34187,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/256796309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":256796309},{"type":"v1","addr":"172.21.15.88:6835","nonce":256796309}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34190,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/1245449675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1245449675},{"type":"v1","addr":"172.21.15.167:6833","nonce":1245449675}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:54:26.940968+0000","modified":"2023-11-27T20:55:00.285394+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1],"up":{"mds_0":34205,"mds_1":34199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34199":{"gid":34199,"name":"b","rank":1,"incarnation":10,"state":"up:creating","state_seq":1,"addr":"172.21.15.167:6835/327644613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":327644613},{"type":"v1","addr":"172.21.15.167:6835","nonce":327644613}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34205":{"gid":34205,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.88:6839/2120059880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":2120059880},{"type":"v1","addr":"172.21.15.88:6839","nonce":2120059880}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T20:55:01.328 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 12 2023-11-27T20:55:01.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.324+0000 7f1d20ec2640 1 -- 172.21.15.88:0/3112721400 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1cfc06b210 msgr2=0x7f1cfc06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:01.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.324+0000 7f1d20ec2640 1 --2- 172.21.15.88:0/3112721400 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1cfc06b210 0x7f1cfc06d6d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1d10009670 tx=0x7f1d10006bf0 comp rx=0 tx=0).stop 2023-11-27T20:55:01.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.324+0000 7f1d20ec2640 1 -- 172.21.15.88:0/3112721400 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d1c0c56c0 msgr2=0x7f1d1c14c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:01.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.324+0000 7f1d20ec2640 1 --2- 172.21.15.88:0/3112721400 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d1c0c56c0 0x7f1d1c14c9d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c00b3e0 tx=0x7f1d0c00b8a0 comp rx=0 tx=0).stop 2023-11-27T20:55:01.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.324+0000 7f1d20ec2640 1 -- 172.21.15.88:0/3112721400 shutdown_connections 2023-11-27T20:55:01.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.324+0000 7f1d20ec2640 1 --2- 172.21.15.88:0/3112721400 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1cfc06b210 0x7f1cfc06d6d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:01.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.324+0000 7f1d20ec2640 1 --2- 172.21.15.88:0/3112721400 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d1c15ac30 0x7f1d1c14cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:01.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.324+0000 7f1d20ec2640 1 --2- 172.21.15.88:0/3112721400 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d1c0c56c0 0x7f1d1c14c9d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:01.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.324+0000 7f1d20ec2640 1 --2- 172.21.15.88:0/3112721400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d1c0c52e0 0x7f1d1c152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:01.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.324+0000 7f1d20ec2640 1 -- 172.21.15.88:0/3112721400 >> 172.21.15.88:0/3112721400 conn(0x7f1d1c06f6d0 msgr2=0x7f1d1c14fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:01.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.324+0000 7f1d20ec2640 1 -- 172.21.15.88:0/3112721400 shutdown_connections 2023-11-27T20:55:01.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.324+0000 7f1d20ec2640 1 -- 172.21.15.88:0/3112721400 wait complete. 2023-11-27T20:55:01.336 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:55:01.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.435+0000 7fef17043640 1 Processor -- start 2023-11-27T20:55:01.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.435+0000 7fef17043640 1 -- start start 2023-11-27T20:55:01.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.435+0000 7fef17043640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fef100c46c0 0x7fef100c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:01.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.435+0000 7fef17043640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fef100c4aa0 0x7fef1014fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:01.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.435+0000 7fef17043640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef10150290 0x7fef100c1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:01.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.435+0000 7fef17043640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef100c76f0 con 0x7fef100c4aa0 2023-11-27T20:55:01.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.436+0000 7fef17043640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef100c2bc0 con 0x7fef100c46c0 2023-11-27T20:55:01.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.436+0000 7fef17043640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef100c6dc0 con 0x7fef10150290 2023-11-27T20:55:01.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.436+0000 7fef14ddf640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fef100c46c0 0x7fef100c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:01.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.436+0000 7fef0ffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fef100c4aa0 0x7fef1014fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:01.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.436+0000 7fef155e0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef10150290 0x7fef100c1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:01.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.436+0000 7fef14ddf640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fef100c46c0 0x7fef100c53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:41110/0 (socket says 172.21.15.88:41110) 2023-11-27T20:55:01.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.436+0000 7fef14ddf640 1 -- 172.21.15.88:0/857500151 learned_addr learned my addr 172.21.15.88:0/857500151 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:01.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.439+0000 7fef14ddf640 1 -- 172.21.15.88:0/857500151 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef10150290 msgr2=0x7fef100c1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:01.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.439+0000 7fef14ddf640 1 --2- 172.21.15.88:0/857500151 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef10150290 0x7fef100c1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:01.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.439+0000 7fef14ddf640 1 -- 172.21.15.88:0/857500151 >> v2:172.21.15.88:3300/0 conn(0x7fef100c4aa0 msgr2=0x7fef1014fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:01.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.439+0000 7fef14ddf640 1 --2- 172.21.15.88:0/857500151 >> v2:172.21.15.88:3300/0 conn(0x7fef100c4aa0 0x7fef1014fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:01.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.439+0000 7fef14ddf640 1 -- 172.21.15.88:0/857500151 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef100c70a0 con 0x7fef100c46c0 2023-11-27T20:55:01.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.441+0000 7fef14ddf640 1 --2- 172.21.15.88:0/857500151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef100c46c0 0x7fef100c53c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fef100c5080 tx=0x7fef0802bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9ab226efe1a30d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:01.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.444+0000 7fef0f7fe640 1 -- 172.21.15.88:0/857500151 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0802ca70 con 0x7fef100c46c0 2023-11-27T20:55:01.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.444+0000 7fef0f7fe640 1 -- 172.21.15.88:0/857500151 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0802cbd0 con 0x7fef100c46c0 2023-11-27T20:55:01.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.444+0000 7fef0f7fe640 1 -- 172.21.15.88:0/857500151 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef080343f0 con 0x7fef100c46c0 2023-11-27T20:55:01.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.445+0000 7fef17043640 1 -- 172.21.15.88:0/857500151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef100c46c0 msgr2=0x7fef100c53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:01.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.445+0000 7fef17043640 1 --2- 172.21.15.88:0/857500151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef100c46c0 0x7fef100c53c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fef100c5080 tx=0x7fef0802bed0 comp rx=0 tx=0).stop 2023-11-27T20:55:01.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.445+0000 7fef17043640 1 -- 172.21.15.88:0/857500151 shutdown_connections 2023-11-27T20:55:01.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.445+0000 7fef17043640 1 --2- 172.21.15.88:0/857500151 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef10150290 0x7fef100c1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:01.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.445+0000 7fef17043640 1 --2- 172.21.15.88:0/857500151 >> v2:172.21.15.88:3300/0 conn(0x7fef100c4aa0 0x7fef1014fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:01.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.445+0000 7fef17043640 1 --2- 172.21.15.88:0/857500151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef100c46c0 0x7fef100c53c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:01.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.445+0000 7fef17043640 1 -- 172.21.15.88:0/857500151 >> 172.21.15.88:0/857500151 conn(0x7fef1006c5f0 msgr2=0x7fef1006c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:01.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.445+0000 7fef17043640 1 -- 172.21.15.88:0/857500151 shutdown_connections 2023-11-27T20:55:01.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.445+0000 7fef17043640 1 -- 172.21.15.88:0/857500151 wait complete. 2023-11-27T20:55:01.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.446+0000 7fef17043640 1 Processor -- start 2023-11-27T20:55:01.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.446+0000 7fef17043640 1 -- start start 2023-11-27T20:55:01.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.447+0000 7fef17043640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef100c46c0 0x7fef101411b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:01.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.447+0000 7fef17043640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef100c4aa0 0x7fef100c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:01.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.447+0000 7fef17043640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef10150290 0x7fef100c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:01.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.447+0000 7fef17043640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef100ca030 con 0x7fef100c46c0 2023-11-27T20:55:01.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.447+0000 7fef17043640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1015a570 con 0x7fef100c4aa0 2023-11-27T20:55:01.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.447+0000 7fef17043640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef1014c2d0 con 0x7fef10150290 2023-11-27T20:55:01.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.448+0000 7fef14ddf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef100c46c0 0x7fef101411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:01.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.448+0000 7fef0ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef100c4aa0 0x7fef100c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:01.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.448+0000 7fef155e0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef10150290 0x7fef100c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:01.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.448+0000 7fef0ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef100c4aa0 0x7fef100c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:41116/0 (socket says 172.21.15.88:41116) 2023-11-27T20:55:01.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.448+0000 7fef0ffff640 1 -- 172.21.15.88:0/2888392804 learned_addr learned my addr 172.21.15.88:0/2888392804 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:01.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.451+0000 7fef14ddf640 1 -- 172.21.15.88:0/2888392804 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef10150290 msgr2=0x7fef100c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:01.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.451+0000 7fef14ddf640 1 --2- 172.21.15.88:0/2888392804 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef10150290 0x7fef100c9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:01.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.451+0000 7fef14ddf640 1 -- 172.21.15.88:0/2888392804 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef100c4aa0 msgr2=0x7fef100c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:01.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.451+0000 7fef14ddf640 1 --2- 172.21.15.88:0/2888392804 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef100c4aa0 0x7fef100c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:01.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.451+0000 7fef14ddf640 1 -- 172.21.15.88:0/2888392804 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef08009b30 con 0x7fef100c46c0 2023-11-27T20:55:01.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.454+0000 7fef14ddf640 1 --2- 172.21.15.88:0/2888392804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef100c46c0 0x7fef101411b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fef100c2d00 tx=0x7fef08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:01.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.457+0000 7fef0d7fa640 1 -- 172.21.15.88:0/2888392804 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0803e450 con 0x7fef100c46c0 2023-11-27T20:55:01.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.457+0000 7fef0d7fa640 1 -- 172.21.15.88:0/2888392804 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0803e5b0 con 0x7fef100c46c0 2023-11-27T20:55:01.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.457+0000 7fef0d7fa640 1 -- 172.21.15.88:0/2888392804 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0803e760 con 0x7fef100c46c0 2023-11-27T20:55:01.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.457+0000 7fef17043640 1 -- 172.21.15.88:0/2888392804 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef100cb2d0 con 0x7fef100c46c0 2023-11-27T20:55:01.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.457+0000 7fef17043640 1 -- 172.21.15.88:0/2888392804 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef100c8f70 con 0x7fef100c46c0 2023-11-27T20:55:01.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.458+0000 7fef17043640 1 -- 172.21.15.88:0/2888392804 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef10067470 con 0x7fef100c46c0 2023-11-27T20:55:01.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.700+0000 7fef0d7fa640 1 -- 172.21.15.88:0/2888392804 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fef0803e8c0 con 0x7fef100c46c0 2023-11-27T20:55:01.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.701+0000 7fef0d7fa640 1 --2- 172.21.15.88:0/2888392804 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7feef006b210 0x7feef006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:01.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.701+0000 7fef0ffff640 1 --2- 172.21.15.88:0/2888392804 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7feef006b210 0x7feef006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:01.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.701+0000 7fef0ffff640 1 --2- 172.21.15.88:0/2888392804 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7feef006b210 0x7feef006d6d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fef100cb9f0 tx=0x7feef8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:01.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.715+0000 7fef0d7fa640 1 -- 172.21.15.88:0/2888392804 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fef0807b2e0 con 0x7fef100c46c0 2023-11-27T20:55:01.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.716+0000 7fef0d7fa640 1 -- 172.21.15.88:0/2888392804 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fef08077620 con 0x7fef100c46c0 2023-11-27T20:55:01.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.898+0000 7fef17043640 1 -- 172.21.15.88:0/2888392804 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef100cb2d0 con 0x7fef100c46c0 2023-11-27T20:55:01.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.940+0000 7fef0d7fa640 1 -- 172.21.15.88:0/2888392804 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18666 (secure 0 0 0) 0x7fef100cb2d0 con 0x7fef100c46c0 2023-11-27T20:55:01.942 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:55:01.942 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":28,"fsid":"ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc","created":"2023-11-27T20:53:53.110827+0000","modified":"2023-11-27T20:55:00.550945+0000","last_up_change":"2023-11-27T20:54:08.219383+0000","last_in_change":"2023-11-27T20:53:59.022798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:54:09.277670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:54:24.503156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:54:25.744043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T20:54:29.704111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1207ca0f-bef1-44c6-b66b-58bf0e080ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6819","nonce":3952326022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6821","nonce":3952326022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6825","nonce":3952326022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6823","nonce":3952326022}]},"public_addr":"172.21.15.88:6819/3952326022","cluster_addr":"172.21.15.88:6821/3952326022","heartbeat_back_addr":"172.21.15.88:6825/3952326022","heartbeat_front_addr":"172.21.15.88:6823/3952326022","state":["exists","up"]},{"osd":1,"uuid":"8d1be479-4241-4335-9633-1394311fde76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6827","nonce":1788401966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6829","nonce":1788401966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6833","nonce":1788401966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6831","nonce":1788401966}]},"public_addr":"172.21.15.88:6827/1788401966","cluster_addr":"172.21.15.88:6829/1788401966","heartbeat_back_addr":"172.21.15.88:6833/1788401966","heartbeat_front_addr":"172.21.15.88:6831/1788401966","state":["exists","up"]},{"osd":2,"uuid":"7536b008-05dd-40eb-9d4a-bdac4b1c38c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6803","nonce":1166333913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6805","nonce":1166333913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6809","nonce":1166333913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6807","nonce":1166333913}]},"public_addr":"172.21.15.88:6803/1166333913","cluster_addr":"172.21.15.88:6805/1166333913","heartbeat_back_addr":"172.21.15.88:6809/1166333913","heartbeat_front_addr":"172.21.15.88:6807/1166333913","state":["exists","up"]},{"osd":3,"uuid":"47edd4d7-e99c-4ce3-851b-cc9c8e2d4480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6811","nonce":406887502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6813","nonce":406887502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6817","nonce":406887502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6815","nonce":406887502}]},"public_addr":"172.21.15.88:6811/406887502","cluster_addr":"172.21.15.88:6813/406887502","heartbeat_back_addr":"172.21.15.88:6817/406887502","heartbeat_front_addr":"172.21.15.88:6815/406887502","state":["exists","up"]},{"osd":4,"uuid":"0a81dd31-1a8b-41af-b933-d74aae63f3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6801","nonce":2551293703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6803","nonce":2551293703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6807","nonce":2551293703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6805","nonce":2551293703}]},"public_addr":"172.21.15.167:6801/2551293703","cluster_addr":"172.21.15.167:6803/2551293703","heartbeat_back_addr":"172.21.15.167:6807/2551293703","heartbeat_front_addr":"172.21.15.167:6805/2551293703","state":["exists","up"]},{"osd":5,"uuid":"1c462d0d-3361-48b3-a82a-86a920539e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6825","nonce":866085094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6827","nonce":866085094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6831","nonce":866085094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6829","nonce":866085094}]},"public_addr":"172.21.15.167:6825/866085094","cluster_addr":"172.21.15.167:6827/866085094","heartbeat_back_addr":"172.21.15.167:6831/866085094","heartbeat_front_addr":"172.21.15.167:6829/866085094","state":["exists","up"]},{"osd":6,"uuid":"d687c5ad-6c88-4a15-8120-0cdbc5610535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6809","nonce":2766725538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6811","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6813","nonce":2766725538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6819","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6821","nonce":2766725538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6815","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6817","nonce":2766725538}]},"public_addr":"172.21.15.167:6809/2766725538","cluster_addr":"172.21.15.167:6813/2766725538","heartbeat_back_addr":"172.21.15.167:6821/2766725538","heartbeat_front_addr":"172.21.15.167:6817/2766725538","state":["exists","up"]},{"osd":7,"uuid":"c9a50596-4981-4bd8-a8ef-d7679f8d9559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6812","nonce":2695037266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6816","nonce":2695037266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6823","nonce":2695037266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6820","nonce":2695037266}]},"public_addr":"172.21.15.167:6812/2695037266","cluster_addr":"172.21.15.167:6816/2695037266","heartbeat_back_addr":"172.21.15.167:6823/2695037266","heartbeat_front_addr":"172.21.15.167:6820/2695037266","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.522590+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.483170+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.492504+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.432204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.414964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.459803+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.437250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.460394+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.1d","mappings":[{"from":0,"to":1}]},{"pgid":"3.35","mappings":[{"from":0,"to":7}]},{"pgid":"4.4","mappings":[{"from":6,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":4}]},{"pgid":"4.e","mappings":[{"from":3,"to":5}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:55:01.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.943+0000 7fef17043640 1 -- 172.21.15.88:0/2888392804 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7feef006b210 msgr2=0x7feef006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:01.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.943+0000 7fef17043640 1 --2- 172.21.15.88:0/2888392804 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7feef006b210 0x7feef006d6d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fef100cb9f0 tx=0x7feef8009190 comp rx=0 tx=0).stop 2023-11-27T20:55:01.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.943+0000 7fef17043640 1 -- 172.21.15.88:0/2888392804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef100c46c0 msgr2=0x7fef101411b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:01.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.943+0000 7fef17043640 1 --2- 172.21.15.88:0/2888392804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef100c46c0 0x7fef101411b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fef100c2d00 tx=0x7fef08004a40 comp rx=0 tx=0).stop 2023-11-27T20:55:01.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.943+0000 7fef17043640 1 -- 172.21.15.88:0/2888392804 shutdown_connections 2023-11-27T20:55:01.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.943+0000 7fef17043640 1 --2- 172.21.15.88:0/2888392804 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7feef006b210 0x7feef006d6d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:01.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.943+0000 7fef17043640 1 --2- 172.21.15.88:0/2888392804 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef10150290 0x7fef100c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:01.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.943+0000 7fef17043640 1 --2- 172.21.15.88:0/2888392804 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef100c4aa0 0x7fef100c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:01.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.943+0000 7fef17043640 1 --2- 172.21.15.88:0/2888392804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef100c46c0 0x7fef101411b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:01.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.943+0000 7fef17043640 1 -- 172.21.15.88:0/2888392804 >> 172.21.15.88:0/2888392804 conn(0x7fef1006c5f0 msgr2=0x7fef1006e270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:01.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.943+0000 7fef17043640 1 -- 172.21.15.88:0/2888392804 shutdown_connections 2023-11-27T20:55:01.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:01.943+0000 7fef17043640 1 -- 172.21.15.88:0/2888392804 wait complete. 2023-11-27T20:55:01.956 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-27T20:55:01.956 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:55:02.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.057+0000 7fd1861ce640 1 Processor -- start 2023-11-27T20:55:02.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.057+0000 7fd1861ce640 1 -- start start 2023-11-27T20:55:02.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.057+0000 7fd1861ce640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd1800cda70 0x7fd1800ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:02.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.057+0000 7fd1861ce640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1800c9620 0x7fd1800c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:02.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.057+0000 7fd1861ce640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1800cbda0 con 0x7fd1800cc420 2023-11-27T20:55:02.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.057+0000 7fd1861ce640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1800cc230 con 0x7fd1800cda70 2023-11-27T20:55:02.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.057+0000 7fd1861ce640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1800cb4e0 con 0x7fd1800c9620 2023-11-27T20:55:02.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.058+0000 7fd17ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1800c9620 0x7fd1800c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:02.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.059+0000 7fd17f7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd1800cda70 0x7fd1800ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:02.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.059+0000 7fd17effd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fd1800cc420 0x7fd180159610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:59012/0 (socket says 172.21.15.88:59012) 2023-11-27T20:55:02.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.059+0000 7fd17effd640 1 -- 172.21.15.88:0/212264646 learned_addr learned my addr 172.21.15.88:0/212264646 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:55:02.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.061+0000 7fd17ffff640 1 -- 172.21.15.88:0/212264646 >> v2:172.21.15.167:3300/0 conn(0x7fd1800cda70 msgr2=0x7fd1800ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:02.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.061+0000 7fd17ffff640 1 --2- 172.21.15.88:0/212264646 >> v2:172.21.15.167:3300/0 conn(0x7fd1800cda70 0x7fd1800ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:02.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.061+0000 7fd17ffff640 1 -- 172.21.15.88:0/212264646 >> v1:172.21.15.167:6789/0 conn(0x7fd1800cc420 legacy=0x7fd180159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:02.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.061+0000 7fd17ffff640 1 -- 172.21.15.88:0/212264646 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1800cce00 con 0x7fd1800c9620 2023-11-27T20:55:02.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.063+0000 7fd17ffff640 1 --2- 172.21.15.88:0/212264646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1800c9620 0x7fd1800c9a70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd178009d90 tx=0x7fd17802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa128d58a7b5ac5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:02.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.067+0000 7fd17e7fc640 1 -- 172.21.15.88:0/212264646 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17802cc50 con 0x7fd1800c9620 2023-11-27T20:55:02.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.067+0000 7fd17e7fc640 1 -- 172.21.15.88:0/212264646 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17802cdb0 con 0x7fd1800c9620 2023-11-27T20:55:02.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.067+0000 7fd17e7fc640 1 -- 172.21.15.88:0/212264646 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd178034660 con 0x7fd1800c9620 2023-11-27T20:55:02.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.067+0000 7fd1861ce640 1 -- 172.21.15.88:0/212264646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1800c9620 msgr2=0x7fd1800c9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:02.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.067+0000 7fd1861ce640 1 --2- 172.21.15.88:0/212264646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1800c9620 0x7fd1800c9a70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd178009d90 tx=0x7fd17802bea0 comp rx=0 tx=0).stop 2023-11-27T20:55:02.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.068+0000 7fd1861ce640 1 -- 172.21.15.88:0/212264646 shutdown_connections 2023-11-27T20:55:02.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.068+0000 7fd1861ce640 1 --2- 172.21.15.88:0/212264646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1800c9620 0x7fd1800c9a70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:02.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.068+0000 7fd1861ce640 1 --2- 172.21.15.88:0/212264646 >> v2:172.21.15.167:3300/0 conn(0x7fd1800cda70 0x7fd1800ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:02.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.068+0000 7fd1861ce640 1 -- 172.21.15.88:0/212264646 >> 172.21.15.88:0/212264646 conn(0x7fd1800b07b0 msgr2=0x7fd1800b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:02.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.068+0000 7fd1861ce640 1 -- 172.21.15.88:0/212264646 shutdown_connections 2023-11-27T20:55:02.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.068+0000 7fd1861ce640 1 -- 172.21.15.88:0/212264646 wait complete. 2023-11-27T20:55:02.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.069+0000 7fd1861ce640 1 Processor -- start 2023-11-27T20:55:02.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.069+0000 7fd1861ce640 1 -- start start 2023-11-27T20:55:02.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.069+0000 7fd1861ce640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1800c9620 0x7fd180153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:02.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.069+0000 7fd1861ce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1800cc420 0x7fd1801efd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:02.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.069+0000 7fd1861ce640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1800cda70 0x7fd180156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:02.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.069+0000 7fd1861ce640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd180155290 con 0x7fd1800cda70 2023-11-27T20:55:02.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.069+0000 7fd1861ce640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1801f0260 con 0x7fd1800cc420 2023-11-27T20:55:02.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.069+0000 7fd1861ce640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd180150d60 con 0x7fd1800c9620 2023-11-27T20:55:02.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.070+0000 7fd17effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1800cc420 0x7fd1801efd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:02.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.070+0000 7fd17f7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1800c9620 0x7fd180153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:02.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.070+0000 7fd17ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1800cda70 0x7fd180156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:02.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.070+0000 7fd17effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1800cc420 0x7fd1801efd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:41130/0 (socket says 172.21.15.88:41130) 2023-11-27T20:55:02.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.070+0000 7fd17effd640 1 -- 172.21.15.88:0/3549726399 learned_addr learned my addr 172.21.15.88:0/3549726399 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:02.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.074+0000 7fd17effd640 1 -- 172.21.15.88:0/3549726399 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1800c9620 msgr2=0x7fd180153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:02.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.074+0000 7fd17effd640 1 --2- 172.21.15.88:0/3549726399 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1800c9620 0x7fd180153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:02.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.074+0000 7fd17effd640 1 -- 172.21.15.88:0/3549726399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1800cda70 msgr2=0x7fd180156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:02.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.074+0000 7fd17effd640 1 --2- 172.21.15.88:0/3549726399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1800cda70 0x7fd180156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:02.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.074+0000 7fd17effd640 1 -- 172.21.15.88:0/3549726399 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd178009a70 con 0x7fd1800cc420 2023-11-27T20:55:02.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.076+0000 7fd17effd640 1 --2- 172.21.15.88:0/3549726399 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1800cc420 0x7fd1801efd20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd17400c430 tx=0x7fd17400c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:02.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.078+0000 7fd167fff640 1 -- 172.21.15.88:0/3549726399 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd174005ce0 con 0x7fd1800cc420 2023-11-27T20:55:02.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.078+0000 7fd1861ce640 1 -- 172.21.15.88:0/3549726399 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd180154b80 con 0x7fd1800cc420 2023-11-27T20:55:02.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.078+0000 7fd1861ce640 1 -- 172.21.15.88:0/3549726399 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1801548a0 con 0x7fd1800cc420 2023-11-27T20:55:02.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.079+0000 7fd1861ce640 1 -- 172.21.15.88:0/3549726399 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd180150bc0 con 0x7fd1800cc420 2023-11-27T20:55:02.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.079+0000 7fd167fff640 1 -- 172.21.15.88:0/3549726399 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd174005e40 con 0x7fd1800cc420 2023-11-27T20:55:02.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.079+0000 7fd167fff640 1 -- 172.21.15.88:0/3549726399 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd174004b40 con 0x7fd1800cc420 2023-11-27T20:55:02.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.325+0000 7fd167fff640 1 -- 172.21.15.88:0/3549726399 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd1740072d0 con 0x7fd1800cc420 2023-11-27T20:55:02.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.325+0000 7fd167fff640 1 --2- 172.21.15.88:0/3549726399 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd16c06b1c0 0x7fd16c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:02.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.325+0000 7fd17f7fe640 1 --2- 172.21.15.88:0/3549726399 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd16c06b1c0 0x7fd16c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:02.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.326+0000 7fd17f7fe640 1 --2- 172.21.15.88:0/3549726399 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd16c06b1c0 0x7fd16c06d680 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd170009aa0 tx=0x7fd170009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:02.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.328+0000 7fd167fff640 1 -- 172.21.15.88:0/3549726399 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd1740581a0 con 0x7fd1800cc420 2023-11-27T20:55:02.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.338+0000 7fd167fff640 1 -- 172.21.15.88:0/3549726399 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd1740544e0 con 0x7fd1800cc420 2023-11-27T20:55:02.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.502+0000 7fd1861ce640 1 -- 172.21.15.88:0/3549726399 --> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd1800cba30 con 0x7fd16c06b1c0 2023-11-27T20:55:02.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.511+0000 7fd167fff640 1 -- 172.21.15.88:0/3549726399 <== mgr.4105 v2:172.21.15.88:6800/352455703 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345272 (secure 0 0 0) 0x7fd170011a00 con 0x7fd16c06b1c0 2023-11-27T20:55:02.516 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:55:02.518 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-11-27T20:55:02.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.514+0000 7fd1861ce640 1 -- 172.21.15.88:0/3549726399 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd16c06b1c0 msgr2=0x7fd16c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:02.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.514+0000 7fd1861ce640 1 --2- 172.21.15.88:0/3549726399 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd16c06b1c0 0x7fd16c06d680 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd170009aa0 tx=0x7fd170009190 comp rx=0 tx=0).stop 2023-11-27T20:55:02.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.514+0000 7fd1861ce640 1 -- 172.21.15.88:0/3549726399 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1800cc420 msgr2=0x7fd1801efd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:02.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.514+0000 7fd1861ce640 1 --2- 172.21.15.88:0/3549726399 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1800cc420 0x7fd1801efd20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd17400c430 tx=0x7fd17400c8f0 comp rx=0 tx=0).stop 2023-11-27T20:55:02.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.514+0000 7fd1861ce640 1 -- 172.21.15.88:0/3549726399 shutdown_connections 2023-11-27T20:55:02.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.514+0000 7fd1861ce640 1 --2- 172.21.15.88:0/3549726399 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd16c06b1c0 0x7fd16c06d680 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:02.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.514+0000 7fd1861ce640 1 --2- 172.21.15.88:0/3549726399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1800cda70 0x7fd180156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:02.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.514+0000 7fd1861ce640 1 --2- 172.21.15.88:0/3549726399 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1800cc420 0x7fd1801efd20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:02.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.514+0000 7fd1861ce640 1 --2- 172.21.15.88:0/3549726399 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1800c9620 0x7fd180153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:02.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.514+0000 7fd1861ce640 1 -- 172.21.15.88:0/3549726399 >> 172.21.15.88:0/3549726399 conn(0x7fd1800b07b0 msgr2=0x7fd1800c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:02.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.515+0000 7fd1861ce640 1 -- 172.21.15.88:0/3549726399 shutdown_connections 2023-11-27T20:55:02.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.515+0000 7fd1861ce640 1 -- 172.21.15.88:0/3549726399 wait complete. 2023-11-27T20:55:02.527 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2023-11-27T20:55:00.906596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219516,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755204,"statfs":{"total":773094113280,"available":772869328896,"internally_reserved":0,"allocated":3416064,"data_stored":2038576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002130"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.777494+0000","last_change":"2023-11-27T20:54:26.222003+0000","last_active":"2023-11-27T20:54:31.777494+0000","last_peered":"2023-11-27T20:54:31.777494+0000","last_clean":"2023-11-27T20:54:31.777494+0000","last_became_active":"2023-11-27T20:54:26.221715+0000","last_became_peered":"2023-11-27T20:54:26.221715+0000","last_unstale":"2023-11-27T20:54:31.777494+0000","last_undegraded":"2023-11-27T20:54:31.777494+0000","last_fullsized":"2023-11-27T20:54:31.777494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:36:45.301515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.823427+0000","last_change":"2023-11-27T20:54:27.508401+0000","last_active":"2023-11-27T20:54:31.823427+0000","last_peered":"2023-11-27T20:54:31.823427+0000","last_clean":"2023-11-27T20:54:31.823427+0000","last_became_active":"2023-11-27T20:54:27.508003+0000","last_became_peered":"2023-11-27T20:54:27.508003+0000","last_unstale":"2023-11-27T20:54:31.823427+0000","last_undegraded":"2023-11-27T20:54:31.823427+0000","last_fullsized":"2023-11-27T20:54:31.823427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:11:42.954310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:33.073691+0000","last_change":"2023-11-27T20:54:31.837226+0000","last_active":"2023-11-27T20:54:33.073691+0000","last_peered":"2023-11-27T20:54:33.073691+0000","last_clean":"2023-11-27T20:54:33.073691+0000","last_became_active":"2023-11-27T20:54:31.836803+0000","last_became_peered":"2023-11-27T20:54:31.836803+0000","last_unstale":"2023-11-27T20:54:33.073691+0000","last_undegraded":"2023-11-27T20:54:33.073691+0000","last_fullsized":"2023-11-27T20:54:33.073691+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:06.363326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.823506+0000","last_change":"2023-11-27T20:54:26.227906+0000","last_active":"2023-11-27T20:54:31.823506+0000","last_peered":"2023-11-27T20:54:31.823506+0000","last_clean":"2023-11-27T20:54:31.823506+0000","last_became_active":"2023-11-27T20:54:26.227620+0000","last_became_peered":"2023-11-27T20:54:26.227620+0000","last_unstale":"2023-11-27T20:54:31.823506+0000","last_undegraded":"2023-11-27T20:54:31.823506+0000","last_fullsized":"2023-11-27T20:54:31.823506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:35.560769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822441+0000","last_change":"2023-11-27T20:54:27.507740+0000","last_active":"2023-11-27T20:54:31.822441+0000","last_peered":"2023-11-27T20:54:31.822441+0000","last_clean":"2023-11-27T20:54:31.822441+0000","last_became_active":"2023-11-27T20:54:27.507460+0000","last_became_peered":"2023-11-27T20:54:27.507460+0000","last_unstale":"2023-11-27T20:54:31.822441+0000","last_undegraded":"2023-11-27T20:54:31.822441+0000","last_fullsized":"2023-11-27T20:54:31.822441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:24:30.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.989350+0000","last_change":"2023-11-27T20:54:31.831638+0000","last_active":"2023-11-27T20:54:32.989350+0000","last_peered":"2023-11-27T20:54:32.989350+0000","last_clean":"2023-11-27T20:54:32.989350+0000","last_became_active":"2023-11-27T20:54:31.830724+0000","last_became_peered":"2023-11-27T20:54:31.830724+0000","last_unstale":"2023-11-27T20:54:32.989350+0000","last_undegraded":"2023-11-27T20:54:32.989350+0000","last_fullsized":"2023-11-27T20:54:32.989350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:54.926925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.810114+0000","last_change":"2023-11-27T20:54:26.226645+0000","last_active":"2023-11-27T20:54:31.810114+0000","last_peered":"2023-11-27T20:54:31.810114+0000","last_clean":"2023-11-27T20:54:31.810114+0000","last_became_active":"2023-11-27T20:54:26.226407+0000","last_became_peered":"2023-11-27T20:54:26.226407+0000","last_unstale":"2023-11-27T20:54:31.810114+0000","last_undegraded":"2023-11-27T20:54:31.810114+0000","last_fullsized":"2023-11-27T20:54:31.810114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:32:19.691350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.808046+0000","last_change":"2023-11-27T20:54:27.512803+0000","last_active":"2023-11-27T20:54:31.808046+0000","last_peered":"2023-11-27T20:54:31.808046+0000","last_clean":"2023-11-27T20:54:31.808046+0000","last_became_active":"2023-11-27T20:54:27.512548+0000","last_became_peered":"2023-11-27T20:54:27.512548+0000","last_unstale":"2023-11-27T20:54:31.808046+0000","last_undegraded":"2023-11-27T20:54:31.808046+0000","last_fullsized":"2023-11-27T20:54:31.808046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:36.652979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.989718+0000","last_change":"2023-11-27T20:54:31.828391+0000","last_active":"2023-11-27T20:54:32.989718+0000","last_peered":"2023-11-27T20:54:32.989718+0000","last_clean":"2023-11-27T20:54:32.989718+0000","last_became_active":"2023-11-27T20:54:31.828045+0000","last_became_peered":"2023-11-27T20:54:31.828045+0000","last_unstale":"2023-11-27T20:54:32.989718+0000","last_undegraded":"2023-11-27T20:54:32.989718+0000","last_fullsized":"2023-11-27T20:54:32.989718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:58.308604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.812920+0000","last_change":"2023-11-27T20:54:26.226762+0000","last_active":"2023-11-27T20:54:31.812920+0000","last_peered":"2023-11-27T20:54:31.812920+0000","last_clean":"2023-11-27T20:54:31.812920+0000","last_became_active":"2023-11-27T20:54:26.226522+0000","last_became_peered":"2023-11-27T20:54:26.226522+0000","last_unstale":"2023-11-27T20:54:31.812920+0000","last_undegraded":"2023-11-27T20:54:31.812920+0000","last_fullsized":"2023-11-27T20:54:31.812920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:31.269905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.816619+0000","last_change":"2023-11-27T20:54:27.516477+0000","last_active":"2023-11-27T20:54:31.816619+0000","last_peered":"2023-11-27T20:54:31.816619+0000","last_clean":"2023-11-27T20:54:31.816619+0000","last_became_active":"2023-11-27T20:54:27.516246+0000","last_became_peered":"2023-11-27T20:54:27.516246+0000","last_unstale":"2023-11-27T20:54:31.816619+0000","last_undegraded":"2023-11-27T20:54:31.816619+0000","last_fullsized":"2023-11-27T20:54:31.816619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:19.426600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.989408+0000","last_change":"2023-11-27T20:54:31.828759+0000","last_active":"2023-11-27T20:54:32.989408+0000","last_peered":"2023-11-27T20:54:32.989408+0000","last_clean":"2023-11-27T20:54:32.989408+0000","last_became_active":"2023-11-27T20:54:31.828371+0000","last_became_peered":"2023-11-27T20:54:31.828371+0000","last_unstale":"2023-11-27T20:54:32.989408+0000","last_undegraded":"2023-11-27T20:54:32.989408+0000","last_fullsized":"2023-11-27T20:54:32.989408+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:40.986177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.816060+0000","last_change":"2023-11-27T20:54:27.498572+0000","last_active":"2023-11-27T20:54:31.816060+0000","last_peered":"2023-11-27T20:54:31.816060+0000","last_clean":"2023-11-27T20:54:31.816060+0000","last_became_active":"2023-11-27T20:54:27.498279+0000","last_became_peered":"2023-11-27T20:54:27.498279+0000","last_unstale":"2023-11-27T20:54:31.816060+0000","last_undegraded":"2023-11-27T20:54:31.816060+0000","last_fullsized":"2023-11-27T20:54:31.816060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:23:57.929109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.815422+0000","last_change":"2023-11-27T20:54:26.227734+0000","last_active":"2023-11-27T20:54:31.815422+0000","last_peered":"2023-11-27T20:54:31.815422+0000","last_clean":"2023-11-27T20:54:31.815422+0000","last_became_active":"2023-11-27T20:54:26.227503+0000","last_became_peered":"2023-11-27T20:54:26.227503+0000","last_unstale":"2023-11-27T20:54:31.815422+0000","last_undegraded":"2023-11-27T20:54:31.815422+0000","last_fullsized":"2023-11-27T20:54:31.815422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:08.206775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:33.075676+0000","last_change":"2023-11-27T20:54:31.827976+0000","last_active":"2023-11-27T20:54:33.075676+0000","last_peered":"2023-11-27T20:54:33.075676+0000","last_clean":"2023-11-27T20:54:33.075676+0000","last_became_active":"2023-11-27T20:54:31.827631+0000","last_became_peered":"2023-11-27T20:54:31.827631+0000","last_unstale":"2023-11-27T20:54:33.075676+0000","last_undegraded":"2023-11-27T20:54:33.075676+0000","last_fullsized":"2023-11-27T20:54:33.075676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:58:58.404897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822583+0000","last_change":"2023-11-27T20:54:27.510917+0000","last_active":"2023-11-27T20:54:31.822583+0000","last_peered":"2023-11-27T20:54:31.822583+0000","last_clean":"2023-11-27T20:54:31.822583+0000","last_became_active":"2023-11-27T20:54:27.510668+0000","last_became_peered":"2023-11-27T20:54:27.510668+0000","last_unstale":"2023-11-27T20:54:31.822583+0000","last_undegraded":"2023-11-27T20:54:31.822583+0000","last_fullsized":"2023-11-27T20:54:31.822583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:27:15.390631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.740121+0000","last_change":"2023-11-27T20:54:26.231461+0000","last_active":"2023-11-27T20:54:31.740121+0000","last_peered":"2023-11-27T20:54:31.740121+0000","last_clean":"2023-11-27T20:54:31.740121+0000","last_became_active":"2023-11-27T20:54:26.231081+0000","last_became_peered":"2023-11-27T20:54:26.231081+0000","last_unstale":"2023-11-27T20:54:31.740121+0000","last_undegraded":"2023-11-27T20:54:31.740121+0000","last_fullsized":"2023-11-27T20:54:31.740121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:35.560769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:33.075195+0000","last_change":"2023-11-27T20:54:31.817058+0000","last_active":"2023-11-27T20:54:33.075195+0000","last_peered":"2023-11-27T20:54:33.075195+0000","last_clean":"2023-11-27T20:54:33.075195+0000","last_became_active":"2023-11-27T20:54:31.816700+0000","last_became_peered":"2023-11-27T20:54:31.816700+0000","last_unstale":"2023-11-27T20:54:33.075195+0000","last_undegraded":"2023-11-27T20:54:33.075195+0000","last_fullsized":"2023-11-27T20:54:33.075195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:02.384459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.777016+0000","last_change":"2023-11-27T20:54:27.510195+0000","last_active":"2023-11-27T20:54:31.777016+0000","last_peered":"2023-11-27T20:54:31.777016+0000","last_clean":"2023-11-27T20:54:31.777016+0000","last_became_active":"2023-11-27T20:54:27.509961+0000","last_became_peered":"2023-11-27T20:54:27.509961+0000","last_unstale":"2023-11-27T20:54:31.777016+0000","last_undegraded":"2023-11-27T20:54:31.777016+0000","last_fullsized":"2023-11-27T20:54:31.777016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:15:47.196613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.777633+0000","last_change":"2023-11-27T20:54:26.223978+0000","last_active":"2023-11-27T20:54:31.777633+0000","last_peered":"2023-11-27T20:54:31.777633+0000","last_clean":"2023-11-27T20:54:31.777633+0000","last_became_active":"2023-11-27T20:54:26.223717+0000","last_became_peered":"2023-11-27T20:54:26.223717+0000","last_unstale":"2023-11-27T20:54:31.777633+0000","last_undegraded":"2023-11-27T20:54:31.777633+0000","last_fullsized":"2023-11-27T20:54:31.777633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:19:35.269523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:33.074072+0000","last_change":"2023-11-27T20:54:31.836718+0000","last_active":"2023-11-27T20:54:33.074072+0000","last_peered":"2023-11-27T20:54:33.074072+0000","last_clean":"2023-11-27T20:54:33.074072+0000","last_became_active":"2023-11-27T20:54:31.836346+0000","last_became_peered":"2023-11-27T20:54:31.836346+0000","last_unstale":"2023-11-27T20:54:33.074072+0000","last_undegraded":"2023-11-27T20:54:33.074072+0000","last_fullsized":"2023-11-27T20:54:33.074072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:29:03.931226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.815286+0000","last_change":"2023-11-27T20:54:27.493578+0000","last_active":"2023-11-27T20:54:31.815286+0000","last_peered":"2023-11-27T20:54:31.815286+0000","last_clean":"2023-11-27T20:54:31.815286+0000","last_became_active":"2023-11-27T20:54:27.493327+0000","last_became_peered":"2023-11-27T20:54:27.493327+0000","last_unstale":"2023-11-27T20:54:31.815286+0000","last_undegraded":"2023-11-27T20:54:31.815286+0000","last_fullsized":"2023-11-27T20:54:31.815286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:48:56.464995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.809870+0000","last_change":"2023-11-27T20:54:26.227383+0000","last_active":"2023-11-27T20:54:31.809870+0000","last_peered":"2023-11-27T20:54:31.809870+0000","last_clean":"2023-11-27T20:54:31.809870+0000","last_became_active":"2023-11-27T20:54:26.227120+0000","last_became_peered":"2023-11-27T20:54:26.227120+0000","last_unstale":"2023-11-27T20:54:31.809870+0000","last_undegraded":"2023-11-27T20:54:31.809870+0000","last_fullsized":"2023-11-27T20:54:31.809870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:20.644474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.989678+0000","last_change":"2023-11-27T20:54:31.830134+0000","last_active":"2023-11-27T20:54:32.989678+0000","last_peered":"2023-11-27T20:54:32.989678+0000","last_clean":"2023-11-27T20:54:32.989678+0000","last_became_active":"2023-11-27T20:54:31.829800+0000","last_became_peered":"2023-11-27T20:54:31.829800+0000","last_unstale":"2023-11-27T20:54:32.989678+0000","last_undegraded":"2023-11-27T20:54:32.989678+0000","last_fullsized":"2023-11-27T20:54:32.989678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:24:35.498899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.777855+0000","last_change":"2023-11-27T20:54:27.510815+0000","last_active":"2023-11-27T20:54:31.777855+0000","last_peered":"2023-11-27T20:54:31.777855+0000","last_clean":"2023-11-27T20:54:31.777855+0000","last_became_active":"2023-11-27T20:54:27.510573+0000","last_became_peered":"2023-11-27T20:54:27.510573+0000","last_unstale":"2023-11-27T20:54:31.777855+0000","last_undegraded":"2023-11-27T20:54:31.777855+0000","last_fullsized":"2023-11-27T20:54:31.777855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:44:21.573980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.816455+0000","last_change":"2023-11-27T20:54:26.224703+0000","last_active":"2023-11-27T20:54:31.816455+0000","last_peered":"2023-11-27T20:54:31.816455+0000","last_clean":"2023-11-27T20:54:31.816455+0000","last_became_active":"2023-11-27T20:54:26.224412+0000","last_became_peered":"2023-11-27T20:54:26.224412+0000","last_unstale":"2023-11-27T20:54:31.816455+0000","last_undegraded":"2023-11-27T20:54:31.816455+0000","last_fullsized":"2023-11-27T20:54:31.816455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:02.889092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.989328+0000","last_change":"2023-11-27T20:54:31.819739+0000","last_active":"2023-11-27T20:54:32.989328+0000","last_peered":"2023-11-27T20:54:32.989328+0000","last_clean":"2023-11-27T20:54:32.989328+0000","last_became_active":"2023-11-27T20:54:31.819371+0000","last_became_peered":"2023-11-27T20:54:31.819371+0000","last_unstale":"2023-11-27T20:54:32.989328+0000","last_undegraded":"2023-11-27T20:54:32.989328+0000","last_fullsized":"2023-11-27T20:54:32.989328+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:35.147110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.777412+0000","last_change":"2023-11-27T20:54:27.500858+0000","last_active":"2023-11-27T20:54:31.777412+0000","last_peered":"2023-11-27T20:54:31.777412+0000","last_clean":"2023-11-27T20:54:31.777412+0000","last_became_active":"2023-11-27T20:54:27.500455+0000","last_became_peered":"2023-11-27T20:54:27.500455+0000","last_unstale":"2023-11-27T20:54:31.777412+0000","last_undegraded":"2023-11-27T20:54:31.777412+0000","last_fullsized":"2023-11-27T20:54:31.777412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:12:05.775037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.778046+0000","last_change":"2023-11-27T20:54:26.223401+0000","last_active":"2023-11-27T20:54:31.778046+0000","last_peered":"2023-11-27T20:54:31.778046+0000","last_clean":"2023-11-27T20:54:31.778046+0000","last_became_active":"2023-11-27T20:54:26.222981+0000","last_became_peered":"2023-11-27T20:54:26.222981+0000","last_unstale":"2023-11-27T20:54:31.778046+0000","last_undegraded":"2023-11-27T20:54:31.778046+0000","last_fullsized":"2023-11-27T20:54:31.778046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:43:11.830626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.849636+0000","last_change":"2023-11-27T20:54:31.814118+0000","last_active":"2023-11-27T20:54:32.849636+0000","last_peered":"2023-11-27T20:54:32.849636+0000","last_clean":"2023-11-27T20:54:32.849636+0000","last_became_active":"2023-11-27T20:54:31.813765+0000","last_became_peered":"2023-11-27T20:54:31.813765+0000","last_unstale":"2023-11-27T20:54:32.849636+0000","last_undegraded":"2023-11-27T20:54:32.849636+0000","last_fullsized":"2023-11-27T20:54:32.849636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:28:56.396805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.741029+0000","last_change":"2023-11-27T20:54:27.506449+0000","last_active":"2023-11-27T20:54:31.741029+0000","last_peered":"2023-11-27T20:54:31.741029+0000","last_clean":"2023-11-27T20:54:31.741029+0000","last_became_active":"2023-11-27T20:54:27.506210+0000","last_became_peered":"2023-11-27T20:54:27.506210+0000","last_unstale":"2023-11-27T20:54:31.741029+0000","last_undegraded":"2023-11-27T20:54:31.741029+0000","last_fullsized":"2023-11-27T20:54:31.741029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:32:20.783560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.816840+0000","last_change":"2023-11-27T20:54:26.220043+0000","last_active":"2023-11-27T20:54:31.816840+0000","last_peered":"2023-11-27T20:54:31.816840+0000","last_clean":"2023-11-27T20:54:31.816840+0000","last_became_active":"2023-11-27T20:54:26.219775+0000","last_became_peered":"2023-11-27T20:54:26.219775+0000","last_unstale":"2023-11-27T20:54:31.816840+0000","last_undegraded":"2023-11-27T20:54:31.816840+0000","last_fullsized":"2023-11-27T20:54:31.816840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:33.812297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.875660+0000","last_change":"2023-11-27T20:54:31.825960+0000","last_active":"2023-11-27T20:54:32.875660+0000","last_peered":"2023-11-27T20:54:32.875660+0000","last_clean":"2023-11-27T20:54:32.875660+0000","last_became_active":"2023-11-27T20:54:31.825591+0000","last_became_peered":"2023-11-27T20:54:31.825591+0000","last_unstale":"2023-11-27T20:54:32.875660+0000","last_undegraded":"2023-11-27T20:54:32.875660+0000","last_fullsized":"2023-11-27T20:54:32.875660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:24:35.498899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.737747+0000","last_change":"2023-11-27T20:54:27.500927+0000","last_active":"2023-11-27T20:54:31.737747+0000","last_peered":"2023-11-27T20:54:31.737747+0000","last_clean":"2023-11-27T20:54:31.737747+0000","last_became_active":"2023-11-27T20:54:27.500677+0000","last_became_peered":"2023-11-27T20:54:27.500677+0000","last_unstale":"2023-11-27T20:54:31.737747+0000","last_undegraded":"2023-11-27T20:54:31.737747+0000","last_fullsized":"2023-11-27T20:54:31.737747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:56.708375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822187+0000","last_change":"2023-11-27T20:54:26.227877+0000","last_active":"2023-11-27T20:54:31.822187+0000","last_peered":"2023-11-27T20:54:31.822187+0000","last_clean":"2023-11-27T20:54:31.822187+0000","last_became_active":"2023-11-27T20:54:26.227605+0000","last_became_peered":"2023-11-27T20:54:26.227605+0000","last_unstale":"2023-11-27T20:54:31.822187+0000","last_undegraded":"2023-11-27T20:54:31.822187+0000","last_fullsized":"2023-11-27T20:54:31.822187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:40.031252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.875257+0000","last_change":"2023-11-27T20:54:31.826732+0000","last_active":"2023-11-27T20:54:32.875257+0000","last_peered":"2023-11-27T20:54:32.875257+0000","last_clean":"2023-11-27T20:54:32.875257+0000","last_became_active":"2023-11-27T20:54:31.826406+0000","last_became_peered":"2023-11-27T20:54:31.826406+0000","last_unstale":"2023-11-27T20:54:32.875257+0000","last_undegraded":"2023-11-27T20:54:32.875257+0000","last_fullsized":"2023-11-27T20:54:32.875257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:54.926925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.811397+0000","last_change":"2023-11-27T20:54:27.517007+0000","last_active":"2023-11-27T20:54:31.811397+0000","last_peered":"2023-11-27T20:54:31.811397+0000","last_clean":"2023-11-27T20:54:31.811397+0000","last_became_active":"2023-11-27T20:54:27.516686+0000","last_became_peered":"2023-11-27T20:54:27.516686+0000","last_unstale":"2023-11-27T20:54:31.811397+0000","last_undegraded":"2023-11-27T20:54:31.811397+0000","last_fullsized":"2023-11-27T20:54:31.811397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:50.369518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.816350+0000","last_change":"2023-11-27T20:54:26.230192+0000","last_active":"2023-11-27T20:54:31.816350+0000","last_peered":"2023-11-27T20:54:31.816350+0000","last_clean":"2023-11-27T20:54:31.816350+0000","last_became_active":"2023-11-27T20:54:26.229985+0000","last_became_peered":"2023-11-27T20:54:26.229985+0000","last_unstale":"2023-11-27T20:54:31.816350+0000","last_undegraded":"2023-11-27T20:54:31.816350+0000","last_fullsized":"2023-11-27T20:54:31.816350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:58:59.280763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.875538+0000","last_change":"2023-11-27T20:54:31.830421+0000","last_active":"2023-11-27T20:54:32.875538+0000","last_peered":"2023-11-27T20:54:32.875538+0000","last_clean":"2023-11-27T20:54:32.875538+0000","last_became_active":"2023-11-27T20:54:31.830059+0000","last_became_peered":"2023-11-27T20:54:31.830059+0000","last_unstale":"2023-11-27T20:54:32.875538+0000","last_undegraded":"2023-11-27T20:54:32.875538+0000","last_fullsized":"2023-11-27T20:54:32.875538+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:11:47.511718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822538+0000","last_change":"2023-11-27T20:54:27.513378+0000","last_active":"2023-11-27T20:54:31.822538+0000","last_peered":"2023-11-27T20:54:31.822538+0000","last_clean":"2023-11-27T20:54:31.822538+0000","last_became_active":"2023-11-27T20:54:27.512093+0000","last_became_peered":"2023-11-27T20:54:27.512093+0000","last_unstale":"2023-11-27T20:54:31.822538+0000","last_undegraded":"2023-11-27T20:54:31.822538+0000","last_fullsized":"2023-11-27T20:54:31.822538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:24:36.921232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.823979+0000","last_change":"2023-11-27T20:54:26.230913+0000","last_active":"2023-11-27T20:54:31.823979+0000","last_peered":"2023-11-27T20:54:31.823979+0000","last_clean":"2023-11-27T20:54:31.823979+0000","last_became_active":"2023-11-27T20:54:26.230548+0000","last_became_peered":"2023-11-27T20:54:26.230548+0000","last_unstale":"2023-11-27T20:54:31.823979+0000","last_undegraded":"2023-11-27T20:54:31.823979+0000","last_fullsized":"2023-11-27T20:54:31.823979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:42:11.153092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.875589+0000","last_change":"2023-11-27T20:54:31.826708+0000","last_active":"2023-11-27T20:54:32.875589+0000","last_peered":"2023-11-27T20:54:32.875589+0000","last_clean":"2023-11-27T20:54:32.875589+0000","last_became_active":"2023-11-27T20:54:31.826367+0000","last_became_peered":"2023-11-27T20:54:31.826367+0000","last_unstale":"2023-11-27T20:54:32.875589+0000","last_undegraded":"2023-11-27T20:54:32.875589+0000","last_fullsized":"2023-11-27T20:54:32.875589+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:56:07.208945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.740164+0000","last_change":"2023-11-27T20:54:27.503689+0000","last_active":"2023-11-27T20:54:31.740164+0000","last_peered":"2023-11-27T20:54:31.740164+0000","last_clean":"2023-11-27T20:54:31.740164+0000","last_became_active":"2023-11-27T20:54:27.502941+0000","last_became_peered":"2023-11-27T20:54:27.502941+0000","last_unstale":"2023-11-27T20:54:31.740164+0000","last_undegraded":"2023-11-27T20:54:31.740164+0000","last_fullsized":"2023-11-27T20:54:31.740164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:59:41.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.815383+0000","last_change":"2023-11-27T20:54:26.214419+0000","last_active":"2023-11-27T20:54:31.815383+0000","last_peered":"2023-11-27T20:54:31.815383+0000","last_clean":"2023-11-27T20:54:31.815383+0000","last_became_active":"2023-11-27T20:54:26.214166+0000","last_became_peered":"2023-11-27T20:54:26.214166+0000","last_unstale":"2023-11-27T20:54:31.815383+0000","last_undegraded":"2023-11-27T20:54:31.815383+0000","last_fullsized":"2023-11-27T20:54:31.815383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:44:20.481769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.856943+0000","last_change":"2023-11-27T20:54:31.832551+0000","last_active":"2023-11-27T20:54:32.856943+0000","last_peered":"2023-11-27T20:54:32.856943+0000","last_clean":"2023-11-27T20:54:32.856943+0000","last_became_active":"2023-11-27T20:54:31.832196+0000","last_became_peered":"2023-11-27T20:54:31.832196+0000","last_unstale":"2023-11-27T20:54:32.856943+0000","last_undegraded":"2023-11-27T20:54:32.856943+0000","last_fullsized":"2023-11-27T20:54:32.856943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:26:46.712422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.777729+0000","last_change":"2023-11-27T20:54:27.433404+0000","last_active":"2023-11-27T20:54:31.777729+0000","last_peered":"2023-11-27T20:54:31.777729+0000","last_clean":"2023-11-27T20:54:31.777729+0000","last_became_active":"2023-11-27T20:54:27.433161+0000","last_became_peered":"2023-11-27T20:54:27.433161+0000","last_unstale":"2023-11-27T20:54:31.777729+0000","last_undegraded":"2023-11-27T20:54:31.777729+0000","last_fullsized":"2023-11-27T20:54:31.777729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:09.298985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.815493+0000","last_change":"2023-11-27T20:54:26.227451+0000","last_active":"2023-11-27T20:54:31.815493+0000","last_peered":"2023-11-27T20:54:31.815493+0000","last_clean":"2023-11-27T20:54:31.815493+0000","last_became_active":"2023-11-27T20:54:26.227133+0000","last_became_peered":"2023-11-27T20:54:26.227133+0000","last_unstale":"2023-11-27T20:54:31.815493+0000","last_undegraded":"2023-11-27T20:54:31.815493+0000","last_fullsized":"2023-11-27T20:54:31.815493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:58.281608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.808182+0000","last_change":"2023-11-27T20:54:11.452973+0000","last_active":"2023-11-27T20:54:31.808182+0000","last_peered":"2023-11-27T20:54:31.808182+0000","last_clean":"2023-11-27T20:54:31.808182+0000","last_became_active":"2023-11-27T20:54:11.452181+0000","last_became_peered":"2023-11-27T20:54:11.452181+0000","last_unstale":"2023-11-27T20:54:31.808182+0000","last_undegraded":"2023-11-27T20:54:31.808182+0000","last_fullsized":"2023-11-27T20:54:31.808182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:09.564478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:09.564478+0000","last_clean_scrub_stamp":"2023-11-27T20:54:09.564478+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:07.792065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:33.075943+0000","last_change":"2023-11-27T20:54:31.818408+0000","last_active":"2023-11-27T20:54:33.075943+0000","last_peered":"2023-11-27T20:54:33.075943+0000","last_clean":"2023-11-27T20:54:33.075943+0000","last_became_active":"2023-11-27T20:54:31.818048+0000","last_became_peered":"2023-11-27T20:54:31.818048+0000","last_unstale":"2023-11-27T20:54:33.075943+0000","last_undegraded":"2023-11-27T20:54:33.075943+0000","last_fullsized":"2023-11-27T20:54:33.075943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:48:53.892148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.816687+0000","last_change":"2023-11-27T20:54:27.493626+0000","last_active":"2023-11-27T20:54:31.816687+0000","last_peered":"2023-11-27T20:54:31.816687+0000","last_clean":"2023-11-27T20:54:31.816687+0000","last_became_active":"2023-11-27T20:54:27.493256+0000","last_became_peered":"2023-11-27T20:54:27.493256+0000","last_unstale":"2023-11-27T20:54:31.816687+0000","last_undegraded":"2023-11-27T20:54:31.816687+0000","last_fullsized":"2023-11-27T20:54:31.816687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:40:57.665118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.741104+0000","last_change":"2023-11-27T20:54:26.230079+0000","last_active":"2023-11-27T20:54:31.741104+0000","last_peered":"2023-11-27T20:54:31.741104+0000","last_clean":"2023-11-27T20:54:31.741104+0000","last_became_active":"2023-11-27T20:54:26.229796+0000","last_became_peered":"2023-11-27T20:54:26.229796+0000","last_unstale":"2023-11-27T20:54:31.741104+0000","last_undegraded":"2023-11-27T20:54:31.741104+0000","last_fullsized":"2023-11-27T20:54:31.741104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:55.616164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.989591+0000","last_change":"2023-11-27T20:54:31.825472+0000","last_active":"2023-11-27T20:54:32.989591+0000","last_peered":"2023-11-27T20:54:32.989591+0000","last_clean":"2023-11-27T20:54:32.989591+0000","last_became_active":"2023-11-27T20:54:31.825080+0000","last_became_peered":"2023-11-27T20:54:31.825080+0000","last_unstale":"2023-11-27T20:54:32.989591+0000","last_undegraded":"2023-11-27T20:54:32.989591+0000","last_fullsized":"2023-11-27T20:54:32.989591+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:56:07.208945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.812692+0000","last_change":"2023-11-27T20:54:27.512434+0000","last_active":"2023-11-27T20:54:31.812692+0000","last_peered":"2023-11-27T20:54:31.812692+0000","last_clean":"2023-11-27T20:54:31.812692+0000","last_became_active":"2023-11-27T20:54:27.512164+0000","last_became_peered":"2023-11-27T20:54:27.512164+0000","last_unstale":"2023-11-27T20:54:31.812692+0000","last_undegraded":"2023-11-27T20:54:31.812692+0000","last_fullsized":"2023-11-27T20:54:31.812692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:56:02.651538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822994+0000","last_change":"2023-11-27T20:54:26.226148+0000","last_active":"2023-11-27T20:54:31.822994+0000","last_peered":"2023-11-27T20:54:31.822994+0000","last_clean":"2023-11-27T20:54:31.822994+0000","last_became_active":"2023-11-27T20:54:26.225886+0000","last_became_peered":"2023-11-27T20:54:26.225886+0000","last_unstale":"2023-11-27T20:54:31.822994+0000","last_undegraded":"2023-11-27T20:54:31.822994+0000","last_fullsized":"2023-11-27T20:54:31.822994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:32:19.691350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.856567+0000","last_change":"2023-11-27T20:54:31.828729+0000","last_active":"2023-11-27T20:54:32.856567+0000","last_peered":"2023-11-27T20:54:32.856567+0000","last_clean":"2023-11-27T20:54:32.856567+0000","last_became_active":"2023-11-27T20:54:31.828368+0000","last_became_peered":"2023-11-27T20:54:31.828368+0000","last_unstale":"2023-11-27T20:54:32.856567+0000","last_undegraded":"2023-11-27T20:54:32.856567+0000","last_fullsized":"2023-11-27T20:54:32.856567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:02.384459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.812360+0000","last_change":"2023-11-27T20:54:27.515800+0000","last_active":"2023-11-27T20:54:31.812360+0000","last_peered":"2023-11-27T20:54:31.812360+0000","last_clean":"2023-11-27T20:54:31.812360+0000","last_became_active":"2023-11-27T20:54:27.515416+0000","last_became_peered":"2023-11-27T20:54:27.515416+0000","last_unstale":"2023-11-27T20:54:31.812360+0000","last_undegraded":"2023-11-27T20:54:31.812360+0000","last_fullsized":"2023-11-27T20:54:31.812360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:03:00.166936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.777955+0000","last_change":"2023-11-27T20:54:26.224880+0000","last_active":"2023-11-27T20:54:31.777955+0000","last_peered":"2023-11-27T20:54:31.777955+0000","last_clean":"2023-11-27T20:54:31.777955+0000","last_became_active":"2023-11-27T20:54:26.224604+0000","last_became_peered":"2023-11-27T20:54:26.224604+0000","last_unstale":"2023-11-27T20:54:31.777955+0000","last_undegraded":"2023-11-27T20:54:31.777955+0000","last_fullsized":"2023-11-27T20:54:31.777955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:15:45.927622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:33.074737+0000","last_change":"2023-11-27T20:54:31.819648+0000","last_active":"2023-11-27T20:54:33.074737+0000","last_peered":"2023-11-27T20:54:33.074737+0000","last_clean":"2023-11-27T20:54:33.074737+0000","last_became_active":"2023-11-27T20:54:31.819294+0000","last_became_peered":"2023-11-27T20:54:31.819294+0000","last_unstale":"2023-11-27T20:54:33.074737+0000","last_undegraded":"2023-11-27T20:54:33.074737+0000","last_fullsized":"2023-11-27T20:54:33.074737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:15.043559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.738358+0000","last_change":"2023-11-27T20:54:27.512925+0000","last_active":"2023-11-27T20:54:31.738358+0000","last_peered":"2023-11-27T20:54:31.738358+0000","last_clean":"2023-11-27T20:54:31.738358+0000","last_became_active":"2023-11-27T20:54:27.512663+0000","last_became_peered":"2023-11-27T20:54:27.512663+0000","last_unstale":"2023-11-27T20:54:31.738358+0000","last_undegraded":"2023-11-27T20:54:31.738358+0000","last_fullsized":"2023-11-27T20:54:31.738358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:41.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.812441+0000","last_change":"2023-11-27T20:54:26.225344+0000","last_active":"2023-11-27T20:54:31.812441+0000","last_peered":"2023-11-27T20:54:31.812441+0000","last_clean":"2023-11-27T20:54:31.812441+0000","last_became_active":"2023-11-27T20:54:26.225056+0000","last_became_peered":"2023-11-27T20:54:26.225056+0000","last_unstale":"2023-11-27T20:54:31.812441+0000","last_undegraded":"2023-11-27T20:54:31.812441+0000","last_fullsized":"2023-11-27T20:54:31.812441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:39.965666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:33.073909+0000","last_change":"2023-11-27T20:54:31.827590+0000","last_active":"2023-11-27T20:54:33.073909+0000","last_peered":"2023-11-27T20:54:33.073909+0000","last_clean":"2023-11-27T20:54:33.073909+0000","last_became_active":"2023-11-27T20:54:31.827175+0000","last_became_peered":"2023-11-27T20:54:31.827175+0000","last_unstale":"2023-11-27T20:54:33.073909+0000","last_undegraded":"2023-11-27T20:54:33.073909+0000","last_fullsized":"2023-11-27T20:54:33.073909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:07:26.372924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.815206+0000","last_change":"2023-11-27T20:54:27.498488+0000","last_active":"2023-11-27T20:54:31.815206+0000","last_peered":"2023-11-27T20:54:31.815206+0000","last_clean":"2023-11-27T20:54:31.815206+0000","last_became_active":"2023-11-27T20:54:27.498225+0000","last_became_peered":"2023-11-27T20:54:27.498225+0000","last_unstale":"2023-11-27T20:54:31.815206+0000","last_undegraded":"2023-11-27T20:54:31.815206+0000","last_fullsized":"2023-11-27T20:54:31.815206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:20:24.928142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.777107+0000","last_change":"2023-11-27T20:54:26.225580+0000","last_active":"2023-11-27T20:54:31.777107+0000","last_peered":"2023-11-27T20:54:31.777107+0000","last_clean":"2023-11-27T20:54:31.777107+0000","last_became_active":"2023-11-27T20:54:26.225333+0000","last_became_peered":"2023-11-27T20:54:26.225333+0000","last_unstale":"2023-11-27T20:54:31.777107+0000","last_undegraded":"2023-11-27T20:54:31.777107+0000","last_fullsized":"2023-11-27T20:54:31.777107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:46:01.797509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.857069+0000","last_change":"2023-11-27T20:54:31.836029+0000","last_active":"2023-11-27T20:54:32.857069+0000","last_peered":"2023-11-27T20:54:32.857069+0000","last_clean":"2023-11-27T20:54:32.857069+0000","last_became_active":"2023-11-27T20:54:31.835629+0000","last_became_peered":"2023-11-27T20:54:31.835629+0000","last_unstale":"2023-11-27T20:54:32.857069+0000","last_undegraded":"2023-11-27T20:54:32.857069+0000","last_fullsized":"2023-11-27T20:54:32.857069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:06.015093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.808051+0000","last_change":"2023-11-27T20:54:27.511034+0000","last_active":"2023-11-27T20:54:31.808051+0000","last_peered":"2023-11-27T20:54:31.808051+0000","last_clean":"2023-11-27T20:54:31.808051+0000","last_became_active":"2023-11-27T20:54:27.510775+0000","last_became_peered":"2023-11-27T20:54:27.510775+0000","last_unstale":"2023-11-27T20:54:31.808051+0000","last_undegraded":"2023-11-27T20:54:31.808051+0000","last_fullsized":"2023-11-27T20:54:31.808051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:56.708375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.810385+0000","last_change":"2023-11-27T20:54:26.227007+0000","last_active":"2023-11-27T20:54:31.810385+0000","last_peered":"2023-11-27T20:54:31.810385+0000","last_clean":"2023-11-27T20:54:31.810385+0000","last_became_active":"2023-11-27T20:54:26.226745+0000","last_became_peered":"2023-11-27T20:54:26.226745+0000","last_unstale":"2023-11-27T20:54:31.810385+0000","last_undegraded":"2023-11-27T20:54:31.810385+0000","last_fullsized":"2023-11-27T20:54:31.810385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:41:46.312385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.857112+0000","last_change":"2023-11-27T20:54:31.831969+0000","last_active":"2023-11-27T20:54:32.857112+0000","last_peered":"2023-11-27T20:54:32.857112+0000","last_clean":"2023-11-27T20:54:32.857112+0000","last_became_active":"2023-11-27T20:54:31.831620+0000","last_became_peered":"2023-11-27T20:54:31.831620+0000","last_unstale":"2023-11-27T20:54:32.857112+0000","last_undegraded":"2023-11-27T20:54:32.857112+0000","last_fullsized":"2023-11-27T20:54:32.857112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:57:38.465675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.815341+0000","last_change":"2023-11-27T20:54:27.515785+0000","last_active":"2023-11-27T20:54:31.815341+0000","last_peered":"2023-11-27T20:54:31.815341+0000","last_clean":"2023-11-27T20:54:31.815341+0000","last_became_active":"2023-11-27T20:54:27.515524+0000","last_became_peered":"2023-11-27T20:54:27.515524+0000","last_unstale":"2023-11-27T20:54:31.815341+0000","last_undegraded":"2023-11-27T20:54:31.815341+0000","last_fullsized":"2023-11-27T20:54:31.815341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:40:33.267986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.816279+0000","last_change":"2023-11-27T20:54:26.225975+0000","last_active":"2023-11-27T20:54:31.816279+0000","last_peered":"2023-11-27T20:54:31.816279+0000","last_clean":"2023-11-27T20:54:31.816279+0000","last_became_active":"2023-11-27T20:54:26.225691+0000","last_became_peered":"2023-11-27T20:54:26.225691+0000","last_unstale":"2023-11-27T20:54:31.816279+0000","last_undegraded":"2023-11-27T20:54:31.816279+0000","last_fullsized":"2023-11-27T20:54:31.816279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:25.427192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.875411+0000","last_change":"2023-11-27T20:54:31.827058+0000","last_active":"2023-11-27T20:54:32.875411+0000","last_peered":"2023-11-27T20:54:32.875411+0000","last_clean":"2023-11-27T20:54:32.875411+0000","last_became_active":"2023-11-27T20:54:31.826669+0000","last_became_peered":"2023-11-27T20:54:31.826669+0000","last_unstale":"2023-11-27T20:54:32.875411+0000","last_undegraded":"2023-11-27T20:54:32.875411+0000","last_fullsized":"2023-11-27T20:54:32.875411+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:40.986177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.739987+0000","last_change":"2023-11-27T20:54:27.503066+0000","last_active":"2023-11-27T20:54:31.739987+0000","last_peered":"2023-11-27T20:54:31.739987+0000","last_clean":"2023-11-27T20:54:31.739987+0000","last_became_active":"2023-11-27T20:54:27.502677+0000","last_became_peered":"2023-11-27T20:54:27.502677+0000","last_unstale":"2023-11-27T20:54:31.739987+0000","last_undegraded":"2023-11-27T20:54:31.739987+0000","last_fullsized":"2023-11-27T20:54:31.739987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:41.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822673+0000","last_change":"2023-11-27T20:54:26.228175+0000","last_active":"2023-11-27T20:54:31.822673+0000","last_peered":"2023-11-27T20:54:31.822673+0000","last_clean":"2023-11-27T20:54:31.822673+0000","last_became_active":"2023-11-27T20:54:26.227911+0000","last_became_peered":"2023-11-27T20:54:26.227911+0000","last_unstale":"2023-11-27T20:54:31.822673+0000","last_undegraded":"2023-11-27T20:54:31.822673+0000","last_fullsized":"2023-11-27T20:54:31.822673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:57.995466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:33.075799+0000","last_change":"2023-11-27T20:54:31.828136+0000","last_active":"2023-11-27T20:54:33.075799+0000","last_peered":"2023-11-27T20:54:33.075799+0000","last_clean":"2023-11-27T20:54:33.075799+0000","last_became_active":"2023-11-27T20:54:31.827785+0000","last_became_peered":"2023-11-27T20:54:31.827785+0000","last_unstale":"2023-11-27T20:54:33.075799+0000","last_undegraded":"2023-11-27T20:54:33.075799+0000","last_fullsized":"2023-11-27T20:54:33.075799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:28:18.206490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.809969+0000","last_change":"2023-11-27T20:54:27.514185+0000","last_active":"2023-11-27T20:54:31.809969+0000","last_peered":"2023-11-27T20:54:31.809969+0000","last_clean":"2023-11-27T20:54:31.809969+0000","last_became_active":"2023-11-27T20:54:27.513655+0000","last_became_peered":"2023-11-27T20:54:27.513655+0000","last_unstale":"2023-11-27T20:54:31.809969+0000","last_undegraded":"2023-11-27T20:54:31.809969+0000","last_fullsized":"2023-11-27T20:54:31.809969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:52.629755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:48.829257+0000","last_change":"2023-11-27T20:54:26.230827+0000","last_active":"2023-11-27T20:54:48.829257+0000","last_peered":"2023-11-27T20:54:48.829257+0000","last_clean":"2023-11-27T20:54:48.829257+0000","last_became_active":"2023-11-27T20:54:26.230570+0000","last_became_peered":"2023-11-27T20:54:26.230570+0000","last_unstale":"2023-11-27T20:54:48.829257+0000","last_undegraded":"2023-11-27T20:54:48.829257+0000","last_fullsized":"2023-11-27T20:54:48.829257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:42:04.480038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.849793+0000","last_change":"2023-11-27T20:54:31.828482+0000","last_active":"2023-11-27T20:54:32.849793+0000","last_peered":"2023-11-27T20:54:32.849793+0000","last_clean":"2023-11-27T20:54:32.849793+0000","last_became_active":"2023-11-27T20:54:31.827872+0000","last_became_peered":"2023-11-27T20:54:31.827872+0000","last_unstale":"2023-11-27T20:54:32.849793+0000","last_undegraded":"2023-11-27T20:54:32.849793+0000","last_fullsized":"2023-11-27T20:54:32.849793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:32:35.015914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.815371+0000","last_change":"2023-11-27T20:54:27.493526+0000","last_active":"2023-11-27T20:54:31.815371+0000","last_peered":"2023-11-27T20:54:31.815371+0000","last_clean":"2023-11-27T20:54:31.815371+0000","last_became_active":"2023-11-27T20:54:27.493257+0000","last_became_peered":"2023-11-27T20:54:27.493257+0000","last_unstale":"2023-11-27T20:54:31.815371+0000","last_undegraded":"2023-11-27T20:54:31.815371+0000","last_fullsized":"2023-11-27T20:54:31.815371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:04.222900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.823571+0000","last_change":"2023-11-27T20:54:26.231237+0000","last_active":"2023-11-27T20:54:31.823571+0000","last_peered":"2023-11-27T20:54:31.823571+0000","last_clean":"2023-11-27T20:54:31.823571+0000","last_became_active":"2023-11-27T20:54:26.230963+0000","last_became_peered":"2023-11-27T20:54:26.230963+0000","last_unstale":"2023-11-27T20:54:31.823571+0000","last_undegraded":"2023-11-27T20:54:31.823571+0000","last_fullsized":"2023-11-27T20:54:31.823571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:11:24.730507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.989454+0000","last_change":"2023-11-27T20:54:31.825391+0000","last_active":"2023-11-27T20:54:32.989454+0000","last_peered":"2023-11-27T20:54:32.989454+0000","last_clean":"2023-11-27T20:54:32.989454+0000","last_became_active":"2023-11-27T20:54:31.825038+0000","last_became_peered":"2023-11-27T20:54:31.825038+0000","last_unstale":"2023-11-27T20:54:32.989454+0000","last_undegraded":"2023-11-27T20:54:32.989454+0000","last_fullsized":"2023-11-27T20:54:32.989454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:11:47.511718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822521+0000","last_change":"2023-11-27T20:54:27.508226+0000","last_active":"2023-11-27T20:54:31.822521+0000","last_peered":"2023-11-27T20:54:31.822521+0000","last_clean":"2023-11-27T20:54:31.822521+0000","last_became_active":"2023-11-27T20:54:27.507805+0000","last_became_peered":"2023-11-27T20:54:27.507805+0000","last_unstale":"2023-11-27T20:54:31.822521+0000","last_undegraded":"2023-11-27T20:54:31.822521+0000","last_fullsized":"2023-11-27T20:54:31.822521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:43:42.137077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.810714+0000","last_change":"2023-11-27T20:54:26.226915+0000","last_active":"2023-11-27T20:54:31.810714+0000","last_peered":"2023-11-27T20:54:31.810714+0000","last_clean":"2023-11-27T20:54:31.810714+0000","last_became_active":"2023-11-27T20:54:26.226679+0000","last_became_peered":"2023-11-27T20:54:26.226679+0000","last_unstale":"2023-11-27T20:54:31.810714+0000","last_undegraded":"2023-11-27T20:54:31.810714+0000","last_fullsized":"2023-11-27T20:54:31.810714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:05:08.792958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:33.073649+0000","last_change":"2023-11-27T20:54:31.834934+0000","last_active":"2023-11-27T20:54:33.073649+0000","last_peered":"2023-11-27T20:54:33.073649+0000","last_clean":"2023-11-27T20:54:33.073649+0000","last_became_active":"2023-11-27T20:54:31.834569+0000","last_became_peered":"2023-11-27T20:54:31.834569+0000","last_unstale":"2023-11-27T20:54:33.073649+0000","last_undegraded":"2023-11-27T20:54:33.073649+0000","last_fullsized":"2023-11-27T20:54:33.073649+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:15:51.754021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.738211+0000","last_change":"2023-11-27T20:54:27.498841+0000","last_active":"2023-11-27T20:54:31.738211+0000","last_peered":"2023-11-27T20:54:31.738211+0000","last_clean":"2023-11-27T20:54:31.738211+0000","last_became_active":"2023-11-27T20:54:27.498535+0000","last_became_peered":"2023-11-27T20:54:27.498535+0000","last_unstale":"2023-11-27T20:54:31.738211+0000","last_undegraded":"2023-11-27T20:54:31.738211+0000","last_fullsized":"2023-11-27T20:54:31.738211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:21.736684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.808463+0000","last_change":"2023-11-27T20:54:26.228140+0000","last_active":"2023-11-27T20:54:31.808463+0000","last_peered":"2023-11-27T20:54:31.808463+0000","last_clean":"2023-11-27T20:54:31.808463+0000","last_became_active":"2023-11-27T20:54:26.227878+0000","last_became_peered":"2023-11-27T20:54:26.227878+0000","last_unstale":"2023-11-27T20:54:31.808463+0000","last_undegraded":"2023-11-27T20:54:31.808463+0000","last_fullsized":"2023-11-27T20:54:31.808463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:21:36.965668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.850058+0000","last_change":"2023-11-27T20:54:31.825264+0000","last_active":"2023-11-27T20:54:32.850058+0000","last_peered":"2023-11-27T20:54:32.850058+0000","last_clean":"2023-11-27T20:54:32.850058+0000","last_became_active":"2023-11-27T20:54:31.824914+0000","last_became_peered":"2023-11-27T20:54:31.824914+0000","last_unstale":"2023-11-27T20:54:32.850058+0000","last_undegraded":"2023-11-27T20:54:32.850058+0000","last_fullsized":"2023-11-27T20:54:32.850058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:49:01.022403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.850088+0000","last_change":"2023-11-27T20:54:31.828359+0000","last_active":"2023-11-27T20:54:32.850088+0000","last_peered":"2023-11-27T20:54:32.850088+0000","last_clean":"2023-11-27T20:54:32.850088+0000","last_became_active":"2023-11-27T20:54:31.827971+0000","last_became_peered":"2023-11-27T20:54:31.827971+0000","last_unstale":"2023-11-27T20:54:32.850088+0000","last_undegraded":"2023-11-27T20:54:32.850088+0000","last_fullsized":"2023-11-27T20:54:32.850088+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:02.858386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.777537+0000","last_change":"2023-11-27T20:54:27.434914+0000","last_active":"2023-11-27T20:54:31.777537+0000","last_peered":"2023-11-27T20:54:31.777537+0000","last_clean":"2023-11-27T20:54:31.777537+0000","last_became_active":"2023-11-27T20:54:27.434635+0000","last_became_peered":"2023-11-27T20:54:27.434635+0000","last_unstale":"2023-11-27T20:54:31.777537+0000","last_undegraded":"2023-11-27T20:54:31.777537+0000","last_fullsized":"2023-11-27T20:54:31.777537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:59.373818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.815303+0000","last_change":"2023-11-27T20:54:26.224770+0000","last_active":"2023-11-27T20:54:31.815303+0000","last_peered":"2023-11-27T20:54:31.815303+0000","last_clean":"2023-11-27T20:54:31.815303+0000","last_became_active":"2023-11-27T20:54:26.224502+0000","last_became_peered":"2023-11-27T20:54:26.224502+0000","last_unstale":"2023-11-27T20:54:31.815303+0000","last_undegraded":"2023-11-27T20:54:31.815303+0000","last_fullsized":"2023-11-27T20:54:31.815303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:51:28.157451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:33.075772+0000","last_change":"2023-11-27T20:54:31.827147+0000","last_active":"2023-11-27T20:54:33.075772+0000","last_peered":"2023-11-27T20:54:33.075772+0000","last_clean":"2023-11-27T20:54:33.075772+0000","last_became_active":"2023-11-27T20:54:31.826790+0000","last_became_peered":"2023-11-27T20:54:31.826790+0000","last_unstale":"2023-11-27T20:54:33.075772+0000","last_undegraded":"2023-11-27T20:54:33.075772+0000","last_fullsized":"2023-11-27T20:54:33.075772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:11:33.954256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822763+0000","last_change":"2023-11-27T20:54:27.507947+0000","last_active":"2023-11-27T20:54:31.822763+0000","last_peered":"2023-11-27T20:54:31.822763+0000","last_clean":"2023-11-27T20:54:31.822763+0000","last_became_active":"2023-11-27T20:54:27.507698+0000","last_became_peered":"2023-11-27T20:54:27.507698+0000","last_unstale":"2023-11-27T20:54:31.822763+0000","last_undegraded":"2023-11-27T20:54:31.822763+0000","last_fullsized":"2023-11-27T20:54:31.822763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:50.369518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.739942+0000","last_change":"2023-11-27T20:54:26.230417+0000","last_active":"2023-11-27T20:54:31.739942+0000","last_peered":"2023-11-27T20:54:31.739942+0000","last_clean":"2023-11-27T20:54:31.739942+0000","last_became_active":"2023-11-27T20:54:26.229725+0000","last_became_peered":"2023-11-27T20:54:26.229725+0000","last_unstale":"2023-11-27T20:54:31.739942+0000","last_undegraded":"2023-11-27T20:54:31.739942+0000","last_fullsized":"2023-11-27T20:54:31.739942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:01.075715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.816108+0000","last_change":"2023-11-27T20:54:26.221975+0000","last_active":"2023-11-27T20:54:31.816108+0000","last_peered":"2023-11-27T20:54:31.816108+0000","last_clean":"2023-11-27T20:54:31.816108+0000","last_became_active":"2023-11-27T20:54:26.221715+0000","last_became_peered":"2023-11-27T20:54:26.221715+0000","last_unstale":"2023-11-27T20:54:31.816108+0000","last_undegraded":"2023-11-27T20:54:31.816108+0000","last_fullsized":"2023-11-27T20:54:31.816108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:15.156440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.777218+0000","last_change":"2023-11-27T20:54:27.517213+0000","last_active":"2023-11-27T20:54:31.777218+0000","last_peered":"2023-11-27T20:54:31.777218+0000","last_clean":"2023-11-27T20:54:31.777218+0000","last_became_active":"2023-11-27T20:54:27.516887+0000","last_became_peered":"2023-11-27T20:54:27.516887+0000","last_unstale":"2023-11-27T20:54:31.777218+0000","last_undegraded":"2023-11-27T20:54:31.777218+0000","last_fullsized":"2023-11-27T20:54:31.777218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:51:29.249661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.849891+0000","last_change":"2023-11-27T20:54:31.827740+0000","last_active":"2023-11-27T20:54:32.849891+0000","last_peered":"2023-11-27T20:54:32.849891+0000","last_clean":"2023-11-27T20:54:32.849891+0000","last_became_active":"2023-11-27T20:54:31.827395+0000","last_became_peered":"2023-11-27T20:54:31.827395+0000","last_unstale":"2023-11-27T20:54:32.849891+0000","last_undegraded":"2023-11-27T20:54:32.849891+0000","last_fullsized":"2023-11-27T20:54:32.849891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:20:29.485550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822694+0000","last_change":"2023-11-27T20:54:26.227971+0000","last_active":"2023-11-27T20:54:31.822694+0000","last_peered":"2023-11-27T20:54:31.822694+0000","last_clean":"2023-11-27T20:54:31.822694+0000","last_became_active":"2023-11-27T20:54:26.227713+0000","last_became_peered":"2023-11-27T20:54:26.227713+0000","last_unstale":"2023-11-27T20:54:31.822694+0000","last_undegraded":"2023-11-27T20:54:31.822694+0000","last_fullsized":"2023-11-27T20:54:31.822694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:39.965666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.807894+0000","last_change":"2023-11-27T20:54:27.506394+0000","last_active":"2023-11-27T20:54:31.807894+0000","last_peered":"2023-11-27T20:54:31.807894+0000","last_clean":"2023-11-27T20:54:31.807894+0000","last_became_active":"2023-11-27T20:54:27.506119+0000","last_became_peered":"2023-11-27T20:54:27.506119+0000","last_unstale":"2023-11-27T20:54:31.807894+0000","last_undegraded":"2023-11-27T20:54:31.807894+0000","last_fullsized":"2023-11-27T20:54:31.807894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:21.736684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:33.073853+0000","last_change":"2023-11-27T20:54:31.833185+0000","last_active":"2023-11-27T20:54:33.073853+0000","last_peered":"2023-11-27T20:54:33.073853+0000","last_clean":"2023-11-27T20:54:33.073853+0000","last_became_active":"2023-11-27T20:54:31.832813+0000","last_became_peered":"2023-11-27T20:54:31.832813+0000","last_unstale":"2023-11-27T20:54:33.073853+0000","last_undegraded":"2023-11-27T20:54:33.073853+0000","last_fullsized":"2023-11-27T20:54:33.073853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:13.856393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.737168+0000","last_change":"2023-11-27T20:54:27.500687+0000","last_active":"2023-11-27T20:54:31.737168+0000","last_peered":"2023-11-27T20:54:31.737168+0000","last_clean":"2023-11-27T20:54:31.737168+0000","last_became_active":"2023-11-27T20:54:27.500394+0000","last_became_peered":"2023-11-27T20:54:27.500394+0000","last_unstale":"2023-11-27T20:54:31.737168+0000","last_undegraded":"2023-11-27T20:54:31.737168+0000","last_fullsized":"2023-11-27T20:54:31.737168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:15:32.173306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.823856+0000","last_change":"2023-11-27T20:54:27.515441+0000","last_active":"2023-11-27T20:54:31.823856+0000","last_peered":"2023-11-27T20:54:31.823856+0000","last_clean":"2023-11-27T20:54:31.823856+0000","last_became_active":"2023-11-27T20:54:27.515173+0000","last_became_peered":"2023-11-27T20:54:27.515173+0000","last_unstale":"2023-11-27T20:54:31.823856+0000","last_undegraded":"2023-11-27T20:54:31.823856+0000","last_fullsized":"2023-11-27T20:54:31.823856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:19:36.361734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.815902+0000","last_change":"2023-11-27T20:54:27.506358+0000","last_active":"2023-11-27T20:54:31.815902+0000","last_peered":"2023-11-27T20:54:31.815902+0000","last_clean":"2023-11-27T20:54:31.815902+0000","last_became_active":"2023-11-27T20:54:27.506112+0000","last_became_peered":"2023-11-27T20:54:27.506112+0000","last_unstale":"2023-11-27T20:54:31.815902+0000","last_undegraded":"2023-11-27T20:54:31.815902+0000","last_fullsized":"2023-11-27T20:54:31.815902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:58.300979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822599+0000","last_change":"2023-11-27T20:54:27.510776+0000","last_active":"2023-11-27T20:54:31.822599+0000","last_peered":"2023-11-27T20:54:31.822599+0000","last_clean":"2023-11-27T20:54:31.822599+0000","last_became_active":"2023-11-27T20:54:27.510532+0000","last_became_peered":"2023-11-27T20:54:27.510532+0000","last_unstale":"2023-11-27T20:54:31.822599+0000","last_undegraded":"2023-11-27T20:54:31.822599+0000","last_fullsized":"2023-11-27T20:54:31.822599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:36.428770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.740954+0000","last_change":"2023-11-27T20:54:27.513775+0000","last_active":"2023-11-27T20:54:31.740954+0000","last_peered":"2023-11-27T20:54:31.740954+0000","last_clean":"2023-11-27T20:54:31.740954+0000","last_became_active":"2023-11-27T20:54:27.513517+0000","last_became_peered":"2023-11-27T20:54:27.513517+0000","last_unstale":"2023-11-27T20:54:31.740954+0000","last_undegraded":"2023-11-27T20:54:31.740954+0000","last_fullsized":"2023-11-27T20:54:31.740954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:07:21.815516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.740763+0000","last_change":"2023-11-27T20:54:27.511798+0000","last_active":"2023-11-27T20:54:31.740763+0000","last_peered":"2023-11-27T20:54:31.740763+0000","last_clean":"2023-11-27T20:54:31.740763+0000","last_became_active":"2023-11-27T20:54:27.511559+0000","last_became_peered":"2023-11-27T20:54:27.511559+0000","last_unstale":"2023-11-27T20:54:31.740763+0000","last_undegraded":"2023-11-27T20:54:31.740763+0000","last_fullsized":"2023-11-27T20:54:31.740763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:41.057877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.738121+0000","last_change":"2023-11-27T20:54:27.499585+0000","last_active":"2023-11-27T20:54:31.738121+0000","last_peered":"2023-11-27T20:54:31.738121+0000","last_clean":"2023-11-27T20:54:31.738121+0000","last_became_active":"2023-11-27T20:54:27.499323+0000","last_became_peered":"2023-11-27T20:54:27.499323+0000","last_unstale":"2023-11-27T20:54:31.738121+0000","last_undegraded":"2023-11-27T20:54:31.738121+0000","last_fullsized":"2023-11-27T20:54:31.738121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:59:41.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822345+0000","last_change":"2023-11-27T20:54:27.508846+0000","last_active":"2023-11-27T20:54:31.822345+0000","last_peered":"2023-11-27T20:54:31.822345+0000","last_clean":"2023-11-27T20:54:31.822345+0000","last_became_active":"2023-11-27T20:54:27.508615+0000","last_became_peered":"2023-11-27T20:54:27.508615+0000","last_unstale":"2023-11-27T20:54:31.822345+0000","last_undegraded":"2023-11-27T20:54:31.822345+0000","last_fullsized":"2023-11-27T20:54:31.822345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:53.751196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.815301+0000","last_change":"2023-11-27T20:54:27.510920+0000","last_active":"2023-11-27T20:54:31.815301+0000","last_peered":"2023-11-27T20:54:31.815301+0000","last_clean":"2023-11-27T20:54:31.815301+0000","last_became_active":"2023-11-27T20:54:27.510647+0000","last_became_peered":"2023-11-27T20:54:27.510647+0000","last_unstale":"2023-11-27T20:54:31.815301+0000","last_undegraded":"2023-11-27T20:54:31.815301+0000","last_fullsized":"2023-11-27T20:54:31.815301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:32:30.458506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822367+0000","last_change":"2023-11-27T20:54:27.508596+0000","last_active":"2023-11-27T20:54:31.822367+0000","last_peered":"2023-11-27T20:54:31.822367+0000","last_clean":"2023-11-27T20:54:31.822367+0000","last_became_active":"2023-11-27T20:54:27.508360+0000","last_became_peered":"2023-11-27T20:54:27.508360+0000","last_unstale":"2023-11-27T20:54:31.822367+0000","last_undegraded":"2023-11-27T20:54:31.822367+0000","last_fullsized":"2023-11-27T20:54:31.822367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:58.794639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.807821+0000","last_change":"2023-11-27T20:54:27.513374+0000","last_active":"2023-11-27T20:54:31.807821+0000","last_peered":"2023-11-27T20:54:31.807821+0000","last_clean":"2023-11-27T20:54:31.807821+0000","last_became_active":"2023-11-27T20:54:27.513105+0000","last_became_peered":"2023-11-27T20:54:27.513105+0000","last_unstale":"2023-11-27T20:54:31.807821+0000","last_undegraded":"2023-11-27T20:54:31.807821+0000","last_fullsized":"2023-11-27T20:54:31.807821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:59:41.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.777135+0000","last_change":"2023-11-27T20:54:27.433370+0000","last_active":"2023-11-27T20:54:31.777135+0000","last_peered":"2023-11-27T20:54:31.777135+0000","last_clean":"2023-11-27T20:54:31.777135+0000","last_became_active":"2023-11-27T20:54:27.433179+0000","last_became_peered":"2023-11-27T20:54:27.433179+0000","last_unstale":"2023-11-27T20:54:31.777135+0000","last_undegraded":"2023-11-27T20:54:31.777135+0000","last_fullsized":"2023-11-27T20:54:31.777135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:01.805918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.812620+0000","last_change":"2023-11-27T20:54:27.515324+0000","last_active":"2023-11-27T20:54:31.812620+0000","last_peered":"2023-11-27T20:54:31.812620+0000","last_clean":"2023-11-27T20:54:31.812620+0000","last_became_active":"2023-11-27T20:54:27.515068+0000","last_became_peered":"2023-11-27T20:54:27.515068+0000","last_unstale":"2023-11-27T20:54:31.812620+0000","last_undegraded":"2023-11-27T20:54:31.812620+0000","last_fullsized":"2023-11-27T20:54:31.812620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:11:42.954310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.816771+0000","last_change":"2023-11-27T20:54:27.498621+0000","last_active":"2023-11-27T20:54:31.816771+0000","last_peered":"2023-11-27T20:54:31.816771+0000","last_clean":"2023-11-27T20:54:31.816771+0000","last_became_active":"2023-11-27T20:54:27.498306+0000","last_became_peered":"2023-11-27T20:54:27.498306+0000","last_unstale":"2023-11-27T20:54:31.816771+0000","last_undegraded":"2023-11-27T20:54:31.816771+0000","last_fullsized":"2023-11-27T20:54:31.816771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:20:24.529896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.823688+0000","last_change":"2023-11-27T20:54:27.513134+0000","last_active":"2023-11-27T20:54:31.823688+0000","last_peered":"2023-11-27T20:54:31.823688+0000","last_clean":"2023-11-27T20:54:31.823688+0000","last_became_active":"2023-11-27T20:54:27.512897+0000","last_became_peered":"2023-11-27T20:54:27.512897+0000","last_unstale":"2023-11-27T20:54:31.823688+0000","last_undegraded":"2023-11-27T20:54:31.823688+0000","last_fullsized":"2023-11-27T20:54:31.823688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:13:40.877792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.816378+0000","last_change":"2023-11-27T20:54:27.515196+0000","last_active":"2023-11-27T20:54:31.816378+0000","last_peered":"2023-11-27T20:54:31.816378+0000","last_clean":"2023-11-27T20:54:31.816378+0000","last_became_active":"2023-11-27T20:54:27.514946+0000","last_became_peered":"2023-11-27T20:54:27.514946+0000","last_unstale":"2023-11-27T20:54:31.816378+0000","last_undegraded":"2023-11-27T20:54:31.816378+0000","last_fullsized":"2023-11-27T20:54:31.816378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:06:07.940123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.815176+0000","last_change":"2023-11-27T20:54:27.493565+0000","last_active":"2023-11-27T20:54:31.815176+0000","last_peered":"2023-11-27T20:54:31.815176+0000","last_clean":"2023-11-27T20:54:31.815176+0000","last_became_active":"2023-11-27T20:54:27.493297+0000","last_became_peered":"2023-11-27T20:54:27.493297+0000","last_unstale":"2023-11-27T20:54:31.815176+0000","last_undegraded":"2023-11-27T20:54:31.815176+0000","last_fullsized":"2023-11-27T20:54:31.815176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:28:51.839397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822292+0000","last_change":"2023-11-27T20:54:27.512910+0000","last_active":"2023-11-27T20:54:31.822292+0000","last_peered":"2023-11-27T20:54:31.822292+0000","last_clean":"2023-11-27T20:54:31.822292+0000","last_became_active":"2023-11-27T20:54:27.512662+0000","last_became_peered":"2023-11-27T20:54:27.512662+0000","last_unstale":"2023-11-27T20:54:31.822292+0000","last_undegraded":"2023-11-27T20:54:31.822292+0000","last_fullsized":"2023-11-27T20:54:31.822292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:52.629755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.739909+0000","last_change":"2023-11-27T20:54:27.512406+0000","last_active":"2023-11-27T20:54:31.739909+0000","last_peered":"2023-11-27T20:54:31.739909+0000","last_clean":"2023-11-27T20:54:31.739909+0000","last_became_active":"2023-11-27T20:54:27.512124+0000","last_became_peered":"2023-11-27T20:54:27.512124+0000","last_unstale":"2023-11-27T20:54:31.739909+0000","last_undegraded":"2023-11-27T20:54:31.739909+0000","last_fullsized":"2023-11-27T20:54:31.739909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:21.736684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.739988+0000","last_change":"2023-11-27T20:54:27.517262+0000","last_active":"2023-11-27T20:54:31.739988+0000","last_peered":"2023-11-27T20:54:31.739988+0000","last_clean":"2023-11-27T20:54:31.739988+0000","last_became_active":"2023-11-27T20:54:27.516907+0000","last_became_peered":"2023-11-27T20:54:27.516907+0000","last_unstale":"2023-11-27T20:54:31.739988+0000","last_undegraded":"2023-11-27T20:54:31.739988+0000","last_fullsized":"2023-11-27T20:54:31.739988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:05:09.885169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.812554+0000","last_change":"2023-11-27T20:54:27.515432+0000","last_active":"2023-11-27T20:54:31.812554+0000","last_peered":"2023-11-27T20:54:31.812554+0000","last_clean":"2023-11-27T20:54:31.812554+0000","last_became_active":"2023-11-27T20:54:27.515182+0000","last_became_peered":"2023-11-27T20:54:27.515182+0000","last_unstale":"2023-11-27T20:54:31.812554+0000","last_undegraded":"2023-11-27T20:54:31.812554+0000","last_fullsized":"2023-11-27T20:54:31.812554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:36.428770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.809880+0000","last_change":"2023-11-27T20:54:27.516164+0000","last_active":"2023-11-27T20:54:31.809880+0000","last_peered":"2023-11-27T20:54:31.809880+0000","last_clean":"2023-11-27T20:54:31.809880+0000","last_became_active":"2023-11-27T20:54:27.515344+0000","last_became_peered":"2023-11-27T20:54:27.515344+0000","last_unstale":"2023-11-27T20:54:31.809880+0000","last_undegraded":"2023-11-27T20:54:31.809880+0000","last_fullsized":"2023-11-27T20:54:31.809880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:58.794639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.810638+0000","last_change":"2023-11-27T20:54:27.512956+0000","last_active":"2023-11-27T20:54:31.810638+0000","last_peered":"2023-11-27T20:54:31.810638+0000","last_clean":"2023-11-27T20:54:31.810638+0000","last_became_active":"2023-11-27T20:54:27.512692+0000","last_became_peered":"2023-11-27T20:54:27.512692+0000","last_unstale":"2023-11-27T20:54:31.810638+0000","last_undegraded":"2023-11-27T20:54:31.810638+0000","last_fullsized":"2023-11-27T20:54:31.810638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:53.751196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.808424+0000","last_change":"2023-11-27T20:54:27.499043+0000","last_active":"2023-11-27T20:54:31.808424+0000","last_peered":"2023-11-27T20:54:31.808424+0000","last_clean":"2023-11-27T20:54:31.808424+0000","last_became_active":"2023-11-27T20:54:27.498790+0000","last_became_peered":"2023-11-27T20:54:27.498790+0000","last_unstale":"2023-11-27T20:54:31.808424+0000","last_undegraded":"2023-11-27T20:54:31.808424+0000","last_fullsized":"2023-11-27T20:54:31.808424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:41.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822460+0000","last_change":"2023-11-27T20:54:27.513089+0000","last_active":"2023-11-27T20:54:31.822460+0000","last_peered":"2023-11-27T20:54:31.822460+0000","last_clean":"2023-11-27T20:54:31.822460+0000","last_became_active":"2023-11-27T20:54:27.512777+0000","last_became_peered":"2023-11-27T20:54:27.512777+0000","last_unstale":"2023-11-27T20:54:31.822460+0000","last_undegraded":"2023-11-27T20:54:31.822460+0000","last_fullsized":"2023-11-27T20:54:31.822460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:32.362116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.810313+0000","last_change":"2023-11-27T20:54:27.512691+0000","last_active":"2023-11-27T20:54:31.810313+0000","last_peered":"2023-11-27T20:54:31.810313+0000","last_clean":"2023-11-27T20:54:31.810313+0000","last_became_active":"2023-11-27T20:54:27.512433+0000","last_became_peered":"2023-11-27T20:54:27.512433+0000","last_unstale":"2023-11-27T20:54:31.810313+0000","last_undegraded":"2023-11-27T20:54:31.810313+0000","last_fullsized":"2023-11-27T20:54:31.810313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:30.589702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.737862+0000","last_change":"2023-11-27T20:54:27.432322+0000","last_active":"2023-11-27T20:54:31.737862+0000","last_peered":"2023-11-27T20:54:31.737862+0000","last_clean":"2023-11-27T20:54:31.737862+0000","last_became_active":"2023-11-27T20:54:27.432152+0000","last_became_peered":"2023-11-27T20:54:27.432152+0000","last_unstale":"2023-11-27T20:54:31.737862+0000","last_undegraded":"2023-11-27T20:54:31.737862+0000","last_fullsized":"2023-11-27T20:54:31.737862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:02.167926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.811574+0000","last_change":"2023-11-27T20:54:27.516081+0000","last_active":"2023-11-27T20:54:31.811574+0000","last_peered":"2023-11-27T20:54:31.811574+0000","last_clean":"2023-11-27T20:54:31.811574+0000","last_became_active":"2023-11-27T20:54:27.515801+0000","last_became_peered":"2023-11-27T20:54:27.515801+0000","last_unstale":"2023-11-27T20:54:31.811574+0000","last_undegraded":"2023-11-27T20:54:31.811574+0000","last_fullsized":"2023-11-27T20:54:31.811574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:24:30.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.737709+0000","last_change":"2023-11-27T20:54:27.432375+0000","last_active":"2023-11-27T20:54:31.737709+0000","last_peered":"2023-11-27T20:54:31.737709+0000","last_clean":"2023-11-27T20:54:31.737709+0000","last_became_active":"2023-11-27T20:54:27.432160+0000","last_became_peered":"2023-11-27T20:54:27.432160+0000","last_unstale":"2023-11-27T20:54:31.737709+0000","last_undegraded":"2023-11-27T20:54:31.737709+0000","last_fullsized":"2023-11-27T20:54:31.737709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:36.652979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822893+0000","last_change":"2023-11-27T20:54:27.505374+0000","last_active":"2023-11-27T20:54:31.822893+0000","last_peered":"2023-11-27T20:54:31.822893+0000","last_clean":"2023-11-27T20:54:31.822893+0000","last_became_active":"2023-11-27T20:54:27.505122+0000","last_became_peered":"2023-11-27T20:54:27.505122+0000","last_unstale":"2023-11-27T20:54:31.822893+0000","last_undegraded":"2023-11-27T20:54:31.822893+0000","last_fullsized":"2023-11-27T20:54:31.822893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:30.589702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822240+0000","last_change":"2023-11-27T20:54:27.505531+0000","last_active":"2023-11-27T20:54:31.822240+0000","last_peered":"2023-11-27T20:54:31.822240+0000","last_clean":"2023-11-27T20:54:31.822240+0000","last_became_active":"2023-11-27T20:54:27.505236+0000","last_became_peered":"2023-11-27T20:54:27.505236+0000","last_unstale":"2023-11-27T20:54:31.822240+0000","last_undegraded":"2023-11-27T20:54:31.822240+0000","last_fullsized":"2023-11-27T20:54:31.822240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:56:02.651538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.812286+0000","last_change":"2023-11-27T20:54:27.515185+0000","last_active":"2023-11-27T20:54:31.812286+0000","last_peered":"2023-11-27T20:54:31.812286+0000","last_clean":"2023-11-27T20:54:31.812286+0000","last_became_active":"2023-11-27T20:54:27.514846+0000","last_became_peered":"2023-11-27T20:54:27.514846+0000","last_unstale":"2023-11-27T20:54:31.812286+0000","last_undegraded":"2023-11-27T20:54:31.812286+0000","last_fullsized":"2023-11-27T20:54:31.812286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:43:42.137077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":106070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":696530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":109912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.254}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":696508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]}]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":106194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":110584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542158,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":106652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:55:02.533 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:55:02.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.665+0000 7f8270724640 1 Processor -- start 2023-11-27T20:55:02.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.665+0000 7f8270724640 1 -- start start 2023-11-27T20:55:02.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.666+0000 7f8270724640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f82680c8ee0 0x7f826806e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:02.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.666+0000 7f8270724640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f826806ed80 0x7f826806ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:02.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.666+0000 7f8270724640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82680c7640 con 0x7f82681538d0 2023-11-27T20:55:02.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.666+0000 7f8270724640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f826806d130 con 0x7f82680c8ee0 2023-11-27T20:55:02.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.666+0000 7f8270724640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f826806b5c0 con 0x7f826806ed80 2023-11-27T20:55:02.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.667+0000 7f826e4c0640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f82681538d0 0x7f826815a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34390/0 (socket says 172.21.15.88:34390) 2023-11-27T20:55:02.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.667+0000 7f826e4c0640 1 -- 172.21.15.88:0/3173938654 learned_addr learned my addr 172.21.15.88:0/3173938654 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:55:02.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.667+0000 7f826ecc1640 1 --2- 172.21.15.88:0/3173938654 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f826806ed80 0x7f826806ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:02.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.667+0000 7f826dcbf640 1 --2- 172.21.15.88:0/3173938654 >> v2:172.21.15.167:3300/0 conn(0x7f82680c8ee0 0x7f826806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:02.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.669+0000 7f826d4be640 1 -- 172.21.15.88:0/3173938654 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1023710034 0 0) 0x7f82680c7640 con 0x7f82681538d0 2023-11-27T20:55:02.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.669+0000 7f826d4be640 1 -- 172.21.15.88:0/3173938654 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8254003520 con 0x7f82681538d0 2023-11-27T20:55:02.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.669+0000 7f826dcbf640 1 -- 172.21.15.88:0/3173938654 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f826806ed80 msgr2=0x7f826806ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:02.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.669+0000 7f826dcbf640 1 --2- 172.21.15.88:0/3173938654 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f826806ed80 0x7f826806ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:02.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.669+0000 7f826dcbf640 1 -- 172.21.15.88:0/3173938654 >> v1:172.21.15.88:6789/0 conn(0x7f82681538d0 legacy=0x7f826815a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:02.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.669+0000 7f826dcbf640 1 -- 172.21.15.88:0/3173938654 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82680cd750 con 0x7f82680c8ee0 2023-11-27T20:55:02.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.671+0000 7f826dcbf640 1 --2- 172.21.15.88:0/3173938654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82680c8ee0 0x7f826806e840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f82580097a0 tx=0x7f825802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18a1d3476de50416 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:02.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.675+0000 7f826d4be640 1 -- 172.21.15.88:0/3173938654 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825802e070 con 0x7f82680c8ee0 2023-11-27T20:55:02.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.675+0000 7f826d4be640 1 -- 172.21.15.88:0/3173938654 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82580315a0 con 0x7f82680c8ee0 2023-11-27T20:55:02.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.675+0000 7f826d4be640 1 -- 172.21.15.88:0/3173938654 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8258031930 con 0x7f82680c8ee0 2023-11-27T20:55:02.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.676+0000 7f8270724640 1 -- 172.21.15.88:0/3173938654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82680c8ee0 msgr2=0x7f826806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:02.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.676+0000 7f8270724640 1 --2- 172.21.15.88:0/3173938654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82680c8ee0 0x7f826806e840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f82580097a0 tx=0x7f825802b840 comp rx=0 tx=0).stop 2023-11-27T20:55:02.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.676+0000 7f8270724640 1 -- 172.21.15.88:0/3173938654 shutdown_connections 2023-11-27T20:55:02.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.676+0000 7f8270724640 1 --2- 172.21.15.88:0/3173938654 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f826806ed80 0x7f826806ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:02.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.676+0000 7f8270724640 1 --2- 172.21.15.88:0/3173938654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82680c8ee0 0x7f826806e840 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:02.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.676+0000 7f8270724640 1 -- 172.21.15.88:0/3173938654 >> 172.21.15.88:0/3173938654 conn(0x7f8268060f20 msgr2=0x7f8268061300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:02.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.676+0000 7f8270724640 1 -- 172.21.15.88:0/3173938654 shutdown_connections 2023-11-27T20:55:02.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.676+0000 7f8270724640 1 -- 172.21.15.88:0/3173938654 wait complete. 2023-11-27T20:55:02.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.677+0000 7f8270724640 1 Processor -- start 2023-11-27T20:55:02.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.677+0000 7f8270724640 1 -- start start 2023-11-27T20:55:02.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.678+0000 7f8270724640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f826806ed80 0x7f82680b1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:02.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.678+0000 7f8270724640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82680c8ee0 0x7f826814bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:02.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.678+0000 7f8270724640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82681538d0 0x7f8268150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:02.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.678+0000 7f8270724640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82680b1bc0 con 0x7f82680c8ee0 2023-11-27T20:55:02.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.678+0000 7f8270724640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82680b0c30 con 0x7f826806ed80 2023-11-27T20:55:02.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.678+0000 7f8270724640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82680b11f0 con 0x7f82681538d0 2023-11-27T20:55:02.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.679+0000 7f826dcbf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82680c8ee0 0x7f826814bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:02.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.679+0000 7f826e4c0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f826806ed80 0x7f82680b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:02.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.679+0000 7f826ecc1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82681538d0 0x7f8268150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:02.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.679+0000 7f826dcbf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82680c8ee0 0x7f826814bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50426/0 (socket says 172.21.15.88:50426) 2023-11-27T20:55:02.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.679+0000 7f826dcbf640 1 -- 172.21.15.88:0/511310521 learned_addr learned my addr 172.21.15.88:0/511310521 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:02.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.682+0000 7f826dcbf640 1 -- 172.21.15.88:0/511310521 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82681538d0 msgr2=0x7f8268150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:02.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.682+0000 7f826dcbf640 1 --2- 172.21.15.88:0/511310521 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82681538d0 0x7f8268150c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:02.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.682+0000 7f826dcbf640 1 -- 172.21.15.88:0/511310521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f826806ed80 msgr2=0x7f82680b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:02.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.682+0000 7f826dcbf640 1 --2- 172.21.15.88:0/511310521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f826806ed80 0x7f82680b1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:02.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.682+0000 7f826dcbf640 1 -- 172.21.15.88:0/511310521 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8258009400 con 0x7f82680c8ee0 2023-11-27T20:55:02.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.685+0000 7f826dcbf640 1 --2- 172.21.15.88:0/511310521 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82680c8ee0 0x7f826814bb10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8258034040 tx=0x7f82580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:02.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.688+0000 7f825effd640 1 -- 172.21.15.88:0/511310521 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8258032840 con 0x7f82680c8ee0 2023-11-27T20:55:02.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.688+0000 7f825effd640 1 -- 172.21.15.88:0/511310521 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82580329c0 con 0x7f82680c8ee0 2023-11-27T20:55:02.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.688+0000 7f825effd640 1 -- 172.21.15.88:0/511310521 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8258032d70 con 0x7f82680c8ee0 2023-11-27T20:55:02.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.688+0000 7f8270724640 1 -- 172.21.15.88:0/511310521 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f826814c050 con 0x7f82680c8ee0 2023-11-27T20:55:02.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.688+0000 7f8270724640 1 -- 172.21.15.88:0/511310521 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82680b2070 con 0x7f82680c8ee0 2023-11-27T20:55:02.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.689+0000 7f8270724640 1 -- 172.21.15.88:0/511310521 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82680c73d0 con 0x7f82680c8ee0 2023-11-27T20:55:02.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.708+0000 7f825effd640 1 -- 172.21.15.88:0/511310521 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f825804e430 con 0x7f82680c8ee0 2023-11-27T20:55:02.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.708+0000 7f825effd640 1 --2- 172.21.15.88:0/511310521 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f824c06b210 0x7f824c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:02.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.708+0000 7f826e4c0640 1 --2- 172.21.15.88:0/511310521 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f824c06b210 0x7f824c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:02.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.709+0000 7f826e4c0640 1 --2- 172.21.15.88:0/511310521 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f824c06b210 0x7f824c06d6d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8264005c00 tx=0x7f8264009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:02.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.941+0000 7f825effd640 1 -- 172.21.15.88:0/511310521 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f825807a5e0 con 0x7f82680c8ee0 2023-11-27T20:55:02.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:02.941+0000 7f825effd640 1 -- 172.21.15.88:0/511310521 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8258076920 con 0x7f82680c8ee0 2023-11-27T20:55:03.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.121+0000 7f8270724640 1 -- 172.21.15.88:0/511310521 --> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f82680c3dc0 con 0x7f824c06b210 2023-11-27T20:55:03.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.129+0000 7f825effd640 1 -- 172.21.15.88:0/511310521 <== mgr.4105 v2:172.21.15.88:6800/352455703 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345311 (secure 0 0 0) 0x7f82680c3dc0 con 0x7f824c06b210 2023-11-27T20:55:03.134 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:55:03.138 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-11-27T20:55:03.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.133+0000 7f8270724640 1 -- 172.21.15.88:0/511310521 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f824c06b210 msgr2=0x7f824c06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:03.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.133+0000 7f8270724640 1 --2- 172.21.15.88:0/511310521 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f824c06b210 0x7f824c06d6d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8264005c00 tx=0x7f8264009040 comp rx=0 tx=0).stop 2023-11-27T20:55:03.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.133+0000 7f8270724640 1 -- 172.21.15.88:0/511310521 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82680c8ee0 msgr2=0x7f826814bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:03.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.133+0000 7f8270724640 1 --2- 172.21.15.88:0/511310521 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82680c8ee0 0x7f826814bb10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8258034040 tx=0x7f82580046c0 comp rx=0 tx=0).stop 2023-11-27T20:55:03.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.133+0000 7f8270724640 1 -- 172.21.15.88:0/511310521 shutdown_connections 2023-11-27T20:55:03.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.133+0000 7f8270724640 1 --2- 172.21.15.88:0/511310521 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f824c06b210 0x7f824c06d6d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:03.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.133+0000 7f8270724640 1 --2- 172.21.15.88:0/511310521 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82681538d0 0x7f8268150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:03.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.133+0000 7f8270724640 1 --2- 172.21.15.88:0/511310521 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82680c8ee0 0x7f826814bb10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:03.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.133+0000 7f8270724640 1 --2- 172.21.15.88:0/511310521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f826806ed80 0x7f82680b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:03.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.133+0000 7f8270724640 1 -- 172.21.15.88:0/511310521 >> 172.21.15.88:0/511310521 conn(0x7f8268060f20 msgr2=0x7f8268073530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:03.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.133+0000 7f8270724640 1 -- 172.21.15.88:0/511310521 shutdown_connections 2023-11-27T20:55:03.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.133+0000 7f8270724640 1 -- 172.21.15.88:0/511310521 wait complete. 2023-11-27T20:55:03.145 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2023-11-27T20:55:02.906980+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595120,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":228,"num_write_kb":2443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":177,"ondisk_log_size":177,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219596,"kb_used_data":3404,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755124,"statfs":{"total":773094113280,"available":772869246976,"internally_reserved":0,"allocated":3485696,"data_stored":2067320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":112,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001919"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610254+0000","last_change":"2023-11-27T20:54:26.222003+0000","last_active":"2023-11-27T20:54:59.610254+0000","last_peered":"2023-11-27T20:54:59.610254+0000","last_clean":"2023-11-27T20:54:59.610254+0000","last_became_active":"2023-11-27T20:54:26.221715+0000","last_became_peered":"2023-11-27T20:54:26.221715+0000","last_unstale":"2023-11-27T20:54:59.610254+0000","last_undegraded":"2023-11-27T20:54:59.610254+0000","last_fullsized":"2023-11-27T20:54:59.610254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:36:45.301515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.823427+0000","last_change":"2023-11-27T20:54:27.508401+0000","last_active":"2023-11-27T20:54:31.823427+0000","last_peered":"2023-11-27T20:54:31.823427+0000","last_clean":"2023-11-27T20:54:31.823427+0000","last_became_active":"2023-11-27T20:54:27.508003+0000","last_became_peered":"2023-11-27T20:54:27.508003+0000","last_unstale":"2023-11-27T20:54:31.823427+0000","last_undegraded":"2023-11-27T20:54:31.823427+0000","last_fullsized":"2023-11-27T20:54:31.823427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:11:42.954310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:33.073691+0000","last_change":"2023-11-27T20:54:31.837226+0000","last_active":"2023-11-27T20:54:33.073691+0000","last_peered":"2023-11-27T20:54:33.073691+0000","last_clean":"2023-11-27T20:54:33.073691+0000","last_became_active":"2023-11-27T20:54:31.836803+0000","last_became_peered":"2023-11-27T20:54:31.836803+0000","last_unstale":"2023-11-27T20:54:33.073691+0000","last_undegraded":"2023-11-27T20:54:33.073691+0000","last_fullsized":"2023-11-27T20:54:33.073691+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:06.363326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.823506+0000","last_change":"2023-11-27T20:54:26.227906+0000","last_active":"2023-11-27T20:54:31.823506+0000","last_peered":"2023-11-27T20:54:31.823506+0000","last_clean":"2023-11-27T20:54:31.823506+0000","last_became_active":"2023-11-27T20:54:26.227620+0000","last_became_peered":"2023-11-27T20:54:26.227620+0000","last_unstale":"2023-11-27T20:54:31.823506+0000","last_undegraded":"2023-11-27T20:54:31.823506+0000","last_fullsized":"2023-11-27T20:54:31.823506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:35.560769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822441+0000","last_change":"2023-11-27T20:54:27.507740+0000","last_active":"2023-11-27T20:54:31.822441+0000","last_peered":"2023-11-27T20:54:31.822441+0000","last_clean":"2023-11-27T20:54:31.822441+0000","last_became_active":"2023-11-27T20:54:27.507460+0000","last_became_peered":"2023-11-27T20:54:27.507460+0000","last_unstale":"2023-11-27T20:54:31.822441+0000","last_undegraded":"2023-11-27T20:54:31.822441+0000","last_fullsized":"2023-11-27T20:54:31.822441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:24:30.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.989350+0000","last_change":"2023-11-27T20:54:31.831638+0000","last_active":"2023-11-27T20:54:32.989350+0000","last_peered":"2023-11-27T20:54:32.989350+0000","last_clean":"2023-11-27T20:54:32.989350+0000","last_became_active":"2023-11-27T20:54:31.830724+0000","last_became_peered":"2023-11-27T20:54:31.830724+0000","last_unstale":"2023-11-27T20:54:32.989350+0000","last_undegraded":"2023-11-27T20:54:32.989350+0000","last_fullsized":"2023-11-27T20:54:32.989350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:54.926925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.810114+0000","last_change":"2023-11-27T20:54:26.226645+0000","last_active":"2023-11-27T20:54:31.810114+0000","last_peered":"2023-11-27T20:54:31.810114+0000","last_clean":"2023-11-27T20:54:31.810114+0000","last_became_active":"2023-11-27T20:54:26.226407+0000","last_became_peered":"2023-11-27T20:54:26.226407+0000","last_unstale":"2023-11-27T20:54:31.810114+0000","last_undegraded":"2023-11-27T20:54:31.810114+0000","last_fullsized":"2023-11-27T20:54:31.810114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:32:19.691350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.808046+0000","last_change":"2023-11-27T20:54:27.512803+0000","last_active":"2023-11-27T20:54:31.808046+0000","last_peered":"2023-11-27T20:54:31.808046+0000","last_clean":"2023-11-27T20:54:31.808046+0000","last_became_active":"2023-11-27T20:54:27.512548+0000","last_became_peered":"2023-11-27T20:54:27.512548+0000","last_unstale":"2023-11-27T20:54:31.808046+0000","last_undegraded":"2023-11-27T20:54:31.808046+0000","last_fullsized":"2023-11-27T20:54:31.808046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:36.652979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.989718+0000","last_change":"2023-11-27T20:54:31.828391+0000","last_active":"2023-11-27T20:54:32.989718+0000","last_peered":"2023-11-27T20:54:32.989718+0000","last_clean":"2023-11-27T20:54:32.989718+0000","last_became_active":"2023-11-27T20:54:31.828045+0000","last_became_peered":"2023-11-27T20:54:31.828045+0000","last_unstale":"2023-11-27T20:54:32.989718+0000","last_undegraded":"2023-11-27T20:54:32.989718+0000","last_fullsized":"2023-11-27T20:54:32.989718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:58.308604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.812920+0000","last_change":"2023-11-27T20:54:26.226762+0000","last_active":"2023-11-27T20:54:31.812920+0000","last_peered":"2023-11-27T20:54:31.812920+0000","last_clean":"2023-11-27T20:54:31.812920+0000","last_became_active":"2023-11-27T20:54:26.226522+0000","last_became_peered":"2023-11-27T20:54:26.226522+0000","last_unstale":"2023-11-27T20:54:31.812920+0000","last_undegraded":"2023-11-27T20:54:31.812920+0000","last_fullsized":"2023-11-27T20:54:31.812920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:31.269905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:00.790042+0000","last_change":"2023-11-27T20:55:00.790042+0000","last_active":"2023-11-27T20:55:00.790042+0000","last_peered":"2023-11-27T20:55:00.790042+0000","last_clean":"2023-11-27T20:55:00.790042+0000","last_became_active":"2023-11-27T20:55:00.789772+0000","last_became_peered":"2023-11-27T20:55:00.789772+0000","last_unstale":"2023-11-27T20:55:00.790042+0000","last_undegraded":"2023-11-27T20:55:00.790042+0000","last_fullsized":"2023-11-27T20:55:00.790042+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:51:32.237462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.989408+0000","last_change":"2023-11-27T20:54:31.828759+0000","last_active":"2023-11-27T20:54:32.989408+0000","last_peered":"2023-11-27T20:54:32.989408+0000","last_clean":"2023-11-27T20:54:32.989408+0000","last_became_active":"2023-11-27T20:54:31.828371+0000","last_became_peered":"2023-11-27T20:54:31.828371+0000","last_unstale":"2023-11-27T20:54:32.989408+0000","last_undegraded":"2023-11-27T20:54:32.989408+0000","last_fullsized":"2023-11-27T20:54:32.989408+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:40.986177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609966+0000","last_change":"2023-11-27T20:54:27.498572+0000","last_active":"2023-11-27T20:54:59.609966+0000","last_peered":"2023-11-27T20:54:59.609966+0000","last_clean":"2023-11-27T20:54:59.609966+0000","last_became_active":"2023-11-27T20:54:27.498279+0000","last_became_peered":"2023-11-27T20:54:27.498279+0000","last_unstale":"2023-11-27T20:54:59.609966+0000","last_undegraded":"2023-11-27T20:54:59.609966+0000","last_fullsized":"2023-11-27T20:54:59.609966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:23:57.929109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610059+0000","last_change":"2023-11-27T20:54:26.227734+0000","last_active":"2023-11-27T20:54:59.610059+0000","last_peered":"2023-11-27T20:54:59.610059+0000","last_clean":"2023-11-27T20:54:59.610059+0000","last_became_active":"2023-11-27T20:54:26.227503+0000","last_became_peered":"2023-11-27T20:54:26.227503+0000","last_unstale":"2023-11-27T20:54:59.610059+0000","last_undegraded":"2023-11-27T20:54:59.610059+0000","last_fullsized":"2023-11-27T20:54:59.610059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:08.206775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610029+0000","last_change":"2023-11-27T20:54:31.827976+0000","last_active":"2023-11-27T20:54:59.610029+0000","last_peered":"2023-11-27T20:54:59.610029+0000","last_clean":"2023-11-27T20:54:59.610029+0000","last_became_active":"2023-11-27T20:54:31.827631+0000","last_became_peered":"2023-11-27T20:54:31.827631+0000","last_unstale":"2023-11-27T20:54:59.610029+0000","last_undegraded":"2023-11-27T20:54:59.610029+0000","last_fullsized":"2023-11-27T20:54:59.610029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:58:58.404897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822583+0000","last_change":"2023-11-27T20:54:27.510917+0000","last_active":"2023-11-27T20:54:31.822583+0000","last_peered":"2023-11-27T20:54:31.822583+0000","last_clean":"2023-11-27T20:54:31.822583+0000","last_became_active":"2023-11-27T20:54:27.510668+0000","last_became_peered":"2023-11-27T20:54:27.510668+0000","last_unstale":"2023-11-27T20:54:31.822583+0000","last_undegraded":"2023-11-27T20:54:31.822583+0000","last_fullsized":"2023-11-27T20:54:31.822583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:27:15.390631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.740121+0000","last_change":"2023-11-27T20:54:26.231461+0000","last_active":"2023-11-27T20:54:31.740121+0000","last_peered":"2023-11-27T20:54:31.740121+0000","last_clean":"2023-11-27T20:54:31.740121+0000","last_became_active":"2023-11-27T20:54:26.231081+0000","last_became_peered":"2023-11-27T20:54:26.231081+0000","last_unstale":"2023-11-27T20:54:31.740121+0000","last_undegraded":"2023-11-27T20:54:31.740121+0000","last_fullsized":"2023-11-27T20:54:31.740121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:35.560769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:33.075195+0000","last_change":"2023-11-27T20:54:31.817058+0000","last_active":"2023-11-27T20:54:33.075195+0000","last_peered":"2023-11-27T20:54:33.075195+0000","last_clean":"2023-11-27T20:54:33.075195+0000","last_became_active":"2023-11-27T20:54:31.816700+0000","last_became_peered":"2023-11-27T20:54:31.816700+0000","last_unstale":"2023-11-27T20:54:33.075195+0000","last_undegraded":"2023-11-27T20:54:33.075195+0000","last_fullsized":"2023-11-27T20:54:33.075195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:02.384459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609645+0000","last_change":"2023-11-27T20:54:27.510195+0000","last_active":"2023-11-27T20:54:59.609645+0000","last_peered":"2023-11-27T20:54:59.609645+0000","last_clean":"2023-11-27T20:54:59.609645+0000","last_became_active":"2023-11-27T20:54:27.509961+0000","last_became_peered":"2023-11-27T20:54:27.509961+0000","last_unstale":"2023-11-27T20:54:59.609645+0000","last_undegraded":"2023-11-27T20:54:59.609645+0000","last_fullsized":"2023-11-27T20:54:59.609645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:15:47.196613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610048+0000","last_change":"2023-11-27T20:54:26.223978+0000","last_active":"2023-11-27T20:54:59.610048+0000","last_peered":"2023-11-27T20:54:59.610048+0000","last_clean":"2023-11-27T20:54:59.610048+0000","last_became_active":"2023-11-27T20:54:26.223717+0000","last_became_peered":"2023-11-27T20:54:26.223717+0000","last_unstale":"2023-11-27T20:54:59.610048+0000","last_undegraded":"2023-11-27T20:54:59.610048+0000","last_fullsized":"2023-11-27T20:54:59.610048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:19:35.269523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:33.074072+0000","last_change":"2023-11-27T20:54:31.836718+0000","last_active":"2023-11-27T20:54:33.074072+0000","last_peered":"2023-11-27T20:54:33.074072+0000","last_clean":"2023-11-27T20:54:33.074072+0000","last_became_active":"2023-11-27T20:54:31.836346+0000","last_became_peered":"2023-11-27T20:54:31.836346+0000","last_unstale":"2023-11-27T20:54:33.074072+0000","last_undegraded":"2023-11-27T20:54:33.074072+0000","last_fullsized":"2023-11-27T20:54:33.074072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:29:03.931226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609830+0000","last_change":"2023-11-27T20:54:27.493578+0000","last_active":"2023-11-27T20:54:59.609830+0000","last_peered":"2023-11-27T20:54:59.609830+0000","last_clean":"2023-11-27T20:54:59.609830+0000","last_became_active":"2023-11-27T20:54:27.493327+0000","last_became_peered":"2023-11-27T20:54:27.493327+0000","last_unstale":"2023-11-27T20:54:59.609830+0000","last_undegraded":"2023-11-27T20:54:59.609830+0000","last_fullsized":"2023-11-27T20:54:59.609830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:48:56.464995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.809870+0000","last_change":"2023-11-27T20:54:26.227383+0000","last_active":"2023-11-27T20:54:31.809870+0000","last_peered":"2023-11-27T20:54:31.809870+0000","last_clean":"2023-11-27T20:54:31.809870+0000","last_became_active":"2023-11-27T20:54:26.227120+0000","last_became_peered":"2023-11-27T20:54:26.227120+0000","last_unstale":"2023-11-27T20:54:31.809870+0000","last_undegraded":"2023-11-27T20:54:31.809870+0000","last_fullsized":"2023-11-27T20:54:31.809870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:20.644474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.989678+0000","last_change":"2023-11-27T20:54:31.830134+0000","last_active":"2023-11-27T20:54:32.989678+0000","last_peered":"2023-11-27T20:54:32.989678+0000","last_clean":"2023-11-27T20:54:32.989678+0000","last_became_active":"2023-11-27T20:54:31.829800+0000","last_became_peered":"2023-11-27T20:54:31.829800+0000","last_unstale":"2023-11-27T20:54:32.989678+0000","last_undegraded":"2023-11-27T20:54:32.989678+0000","last_fullsized":"2023-11-27T20:54:32.989678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:24:35.498899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609925+0000","last_change":"2023-11-27T20:54:27.510815+0000","last_active":"2023-11-27T20:54:59.609925+0000","last_peered":"2023-11-27T20:54:59.609925+0000","last_clean":"2023-11-27T20:54:59.609925+0000","last_became_active":"2023-11-27T20:54:27.510573+0000","last_became_peered":"2023-11-27T20:54:27.510573+0000","last_unstale":"2023-11-27T20:54:59.609925+0000","last_undegraded":"2023-11-27T20:54:59.609925+0000","last_fullsized":"2023-11-27T20:54:59.609925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:44:21.573980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610389+0000","last_change":"2023-11-27T20:54:26.224703+0000","last_active":"2023-11-27T20:54:59.610389+0000","last_peered":"2023-11-27T20:54:59.610389+0000","last_clean":"2023-11-27T20:54:59.610389+0000","last_became_active":"2023-11-27T20:54:26.224412+0000","last_became_peered":"2023-11-27T20:54:26.224412+0000","last_unstale":"2023-11-27T20:54:59.610389+0000","last_undegraded":"2023-11-27T20:54:59.610389+0000","last_fullsized":"2023-11-27T20:54:59.610389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:02.889092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.989328+0000","last_change":"2023-11-27T20:54:31.819739+0000","last_active":"2023-11-27T20:54:32.989328+0000","last_peered":"2023-11-27T20:54:32.989328+0000","last_clean":"2023-11-27T20:54:32.989328+0000","last_became_active":"2023-11-27T20:54:31.819371+0000","last_became_peered":"2023-11-27T20:54:31.819371+0000","last_unstale":"2023-11-27T20:54:32.989328+0000","last_undegraded":"2023-11-27T20:54:32.989328+0000","last_fullsized":"2023-11-27T20:54:32.989328+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:35.147110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610181+0000","last_change":"2023-11-27T20:54:27.500858+0000","last_active":"2023-11-27T20:54:59.610181+0000","last_peered":"2023-11-27T20:54:59.610181+0000","last_clean":"2023-11-27T20:54:59.610181+0000","last_became_active":"2023-11-27T20:54:27.500455+0000","last_became_peered":"2023-11-27T20:54:27.500455+0000","last_unstale":"2023-11-27T20:54:59.610181+0000","last_undegraded":"2023-11-27T20:54:59.610181+0000","last_fullsized":"2023-11-27T20:54:59.610181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:12:05.775037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610082+0000","last_change":"2023-11-27T20:54:26.223401+0000","last_active":"2023-11-27T20:54:59.610082+0000","last_peered":"2023-11-27T20:54:59.610082+0000","last_clean":"2023-11-27T20:54:59.610082+0000","last_became_active":"2023-11-27T20:54:26.222981+0000","last_became_peered":"2023-11-27T20:54:26.222981+0000","last_unstale":"2023-11-27T20:54:59.610082+0000","last_undegraded":"2023-11-27T20:54:59.610082+0000","last_fullsized":"2023-11-27T20:54:59.610082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:43:11.830626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609560+0000","last_change":"2023-11-27T20:54:31.814118+0000","last_active":"2023-11-27T20:54:59.609560+0000","last_peered":"2023-11-27T20:54:59.609560+0000","last_clean":"2023-11-27T20:54:59.609560+0000","last_became_active":"2023-11-27T20:54:31.813765+0000","last_became_peered":"2023-11-27T20:54:31.813765+0000","last_unstale":"2023-11-27T20:54:59.609560+0000","last_undegraded":"2023-11-27T20:54:59.609560+0000","last_fullsized":"2023-11-27T20:54:59.609560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:28:56.396805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.741029+0000","last_change":"2023-11-27T20:54:27.506449+0000","last_active":"2023-11-27T20:54:31.741029+0000","last_peered":"2023-11-27T20:54:31.741029+0000","last_clean":"2023-11-27T20:54:31.741029+0000","last_became_active":"2023-11-27T20:54:27.506210+0000","last_became_peered":"2023-11-27T20:54:27.506210+0000","last_unstale":"2023-11-27T20:54:31.741029+0000","last_undegraded":"2023-11-27T20:54:31.741029+0000","last_fullsized":"2023-11-27T20:54:31.741029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:32:20.783560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610771+0000","last_change":"2023-11-27T20:54:26.220043+0000","last_active":"2023-11-27T20:54:59.610771+0000","last_peered":"2023-11-27T20:54:59.610771+0000","last_clean":"2023-11-27T20:54:59.610771+0000","last_became_active":"2023-11-27T20:54:26.219775+0000","last_became_peered":"2023-11-27T20:54:26.219775+0000","last_unstale":"2023-11-27T20:54:59.610771+0000","last_undegraded":"2023-11-27T20:54:59.610771+0000","last_fullsized":"2023-11-27T20:54:59.610771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:33.812297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.875660+0000","last_change":"2023-11-27T20:54:31.825960+0000","last_active":"2023-11-27T20:54:32.875660+0000","last_peered":"2023-11-27T20:54:32.875660+0000","last_clean":"2023-11-27T20:54:32.875660+0000","last_became_active":"2023-11-27T20:54:31.825591+0000","last_became_peered":"2023-11-27T20:54:31.825591+0000","last_unstale":"2023-11-27T20:54:32.875660+0000","last_undegraded":"2023-11-27T20:54:32.875660+0000","last_fullsized":"2023-11-27T20:54:32.875660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:24:35.498899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.737747+0000","last_change":"2023-11-27T20:54:27.500927+0000","last_active":"2023-11-27T20:54:31.737747+0000","last_peered":"2023-11-27T20:54:31.737747+0000","last_clean":"2023-11-27T20:54:31.737747+0000","last_became_active":"2023-11-27T20:54:27.500677+0000","last_became_peered":"2023-11-27T20:54:27.500677+0000","last_unstale":"2023-11-27T20:54:31.737747+0000","last_undegraded":"2023-11-27T20:54:31.737747+0000","last_fullsized":"2023-11-27T20:54:31.737747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:56.708375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822187+0000","last_change":"2023-11-27T20:54:26.227877+0000","last_active":"2023-11-27T20:54:31.822187+0000","last_peered":"2023-11-27T20:54:31.822187+0000","last_clean":"2023-11-27T20:54:31.822187+0000","last_became_active":"2023-11-27T20:54:26.227605+0000","last_became_peered":"2023-11-27T20:54:26.227605+0000","last_unstale":"2023-11-27T20:54:31.822187+0000","last_undegraded":"2023-11-27T20:54:31.822187+0000","last_fullsized":"2023-11-27T20:54:31.822187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:40.031252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.875257+0000","last_change":"2023-11-27T20:54:31.826732+0000","last_active":"2023-11-27T20:54:32.875257+0000","last_peered":"2023-11-27T20:54:32.875257+0000","last_clean":"2023-11-27T20:54:32.875257+0000","last_became_active":"2023-11-27T20:54:31.826406+0000","last_became_peered":"2023-11-27T20:54:31.826406+0000","last_unstale":"2023-11-27T20:54:32.875257+0000","last_undegraded":"2023-11-27T20:54:32.875257+0000","last_fullsized":"2023-11-27T20:54:32.875257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:54.926925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.811397+0000","last_change":"2023-11-27T20:54:27.517007+0000","last_active":"2023-11-27T20:54:31.811397+0000","last_peered":"2023-11-27T20:54:31.811397+0000","last_clean":"2023-11-27T20:54:31.811397+0000","last_became_active":"2023-11-27T20:54:27.516686+0000","last_became_peered":"2023-11-27T20:54:27.516686+0000","last_unstale":"2023-11-27T20:54:31.811397+0000","last_undegraded":"2023-11-27T20:54:31.811397+0000","last_fullsized":"2023-11-27T20:54:31.811397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:50.369518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610271+0000","last_change":"2023-11-27T20:54:26.230192+0000","last_active":"2023-11-27T20:54:59.610271+0000","last_peered":"2023-11-27T20:54:59.610271+0000","last_clean":"2023-11-27T20:54:59.610271+0000","last_became_active":"2023-11-27T20:54:26.229985+0000","last_became_peered":"2023-11-27T20:54:26.229985+0000","last_unstale":"2023-11-27T20:54:59.610271+0000","last_undegraded":"2023-11-27T20:54:59.610271+0000","last_fullsized":"2023-11-27T20:54:59.610271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:58:59.280763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.875538+0000","last_change":"2023-11-27T20:54:31.830421+0000","last_active":"2023-11-27T20:54:32.875538+0000","last_peered":"2023-11-27T20:54:32.875538+0000","last_clean":"2023-11-27T20:54:32.875538+0000","last_became_active":"2023-11-27T20:54:31.830059+0000","last_became_peered":"2023-11-27T20:54:31.830059+0000","last_unstale":"2023-11-27T20:54:32.875538+0000","last_undegraded":"2023-11-27T20:54:32.875538+0000","last_fullsized":"2023-11-27T20:54:32.875538+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:11:47.511718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822538+0000","last_change":"2023-11-27T20:54:27.513378+0000","last_active":"2023-11-27T20:54:31.822538+0000","last_peered":"2023-11-27T20:54:31.822538+0000","last_clean":"2023-11-27T20:54:31.822538+0000","last_became_active":"2023-11-27T20:54:27.512093+0000","last_became_peered":"2023-11-27T20:54:27.512093+0000","last_unstale":"2023-11-27T20:54:31.822538+0000","last_undegraded":"2023-11-27T20:54:31.822538+0000","last_fullsized":"2023-11-27T20:54:31.822538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:24:36.921232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.823979+0000","last_change":"2023-11-27T20:54:26.230913+0000","last_active":"2023-11-27T20:54:31.823979+0000","last_peered":"2023-11-27T20:54:31.823979+0000","last_clean":"2023-11-27T20:54:31.823979+0000","last_became_active":"2023-11-27T20:54:26.230548+0000","last_became_peered":"2023-11-27T20:54:26.230548+0000","last_unstale":"2023-11-27T20:54:31.823979+0000","last_undegraded":"2023-11-27T20:54:31.823979+0000","last_fullsized":"2023-11-27T20:54:31.823979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:42:11.153092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.875589+0000","last_change":"2023-11-27T20:54:31.826708+0000","last_active":"2023-11-27T20:54:32.875589+0000","last_peered":"2023-11-27T20:54:32.875589+0000","last_clean":"2023-11-27T20:54:32.875589+0000","last_became_active":"2023-11-27T20:54:31.826367+0000","last_became_peered":"2023-11-27T20:54:31.826367+0000","last_unstale":"2023-11-27T20:54:32.875589+0000","last_undegraded":"2023-11-27T20:54:32.875589+0000","last_fullsized":"2023-11-27T20:54:32.875589+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:56:07.208945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.740164+0000","last_change":"2023-11-27T20:54:27.503689+0000","last_active":"2023-11-27T20:54:31.740164+0000","last_peered":"2023-11-27T20:54:31.740164+0000","last_clean":"2023-11-27T20:54:31.740164+0000","last_became_active":"2023-11-27T20:54:27.502941+0000","last_became_peered":"2023-11-27T20:54:27.502941+0000","last_unstale":"2023-11-27T20:54:31.740164+0000","last_undegraded":"2023-11-27T20:54:31.740164+0000","last_fullsized":"2023-11-27T20:54:31.740164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:59:41.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"26'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609801+0000","last_change":"2023-11-27T20:54:26.214419+0000","last_active":"2023-11-27T20:54:59.609801+0000","last_peered":"2023-11-27T20:54:59.609801+0000","last_clean":"2023-11-27T20:54:59.609801+0000","last_became_active":"2023-11-27T20:54:26.214166+0000","last_became_peered":"2023-11-27T20:54:26.214166+0000","last_unstale":"2023-11-27T20:54:59.609801+0000","last_undegraded":"2023-11-27T20:54:59.609801+0000","last_fullsized":"2023-11-27T20:54:59.609801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:44:20.481769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.856943+0000","last_change":"2023-11-27T20:54:31.832551+0000","last_active":"2023-11-27T20:54:32.856943+0000","last_peered":"2023-11-27T20:54:32.856943+0000","last_clean":"2023-11-27T20:54:32.856943+0000","last_became_active":"2023-11-27T20:54:31.832196+0000","last_became_peered":"2023-11-27T20:54:31.832196+0000","last_unstale":"2023-11-27T20:54:32.856943+0000","last_undegraded":"2023-11-27T20:54:32.856943+0000","last_fullsized":"2023-11-27T20:54:32.856943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:26:46.712422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609820+0000","last_change":"2023-11-27T20:54:27.433404+0000","last_active":"2023-11-27T20:54:59.609820+0000","last_peered":"2023-11-27T20:54:59.609820+0000","last_clean":"2023-11-27T20:54:59.609820+0000","last_became_active":"2023-11-27T20:54:27.433161+0000","last_became_peered":"2023-11-27T20:54:27.433161+0000","last_unstale":"2023-11-27T20:54:59.609820+0000","last_undegraded":"2023-11-27T20:54:59.609820+0000","last_fullsized":"2023-11-27T20:54:59.609820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:09.298985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"26'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610149+0000","last_change":"2023-11-27T20:54:26.227451+0000","last_active":"2023-11-27T20:54:59.610149+0000","last_peered":"2023-11-27T20:54:59.610149+0000","last_clean":"2023-11-27T20:54:59.610149+0000","last_became_active":"2023-11-27T20:54:26.227133+0000","last_became_peered":"2023-11-27T20:54:26.227133+0000","last_unstale":"2023-11-27T20:54:59.610149+0000","last_undegraded":"2023-11-27T20:54:59.610149+0000","last_fullsized":"2023-11-27T20:54:59.610149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:58.281608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.808182+0000","last_change":"2023-11-27T20:54:11.452973+0000","last_active":"2023-11-27T20:54:31.808182+0000","last_peered":"2023-11-27T20:54:31.808182+0000","last_clean":"2023-11-27T20:54:31.808182+0000","last_became_active":"2023-11-27T20:54:11.452181+0000","last_became_peered":"2023-11-27T20:54:11.452181+0000","last_unstale":"2023-11-27T20:54:31.808182+0000","last_undegraded":"2023-11-27T20:54:31.808182+0000","last_fullsized":"2023-11-27T20:54:31.808182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:09.564478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:09.564478+0000","last_clean_scrub_stamp":"2023-11-27T20:54:09.564478+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:07.792065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610624+0000","last_change":"2023-11-27T20:54:31.818408+0000","last_active":"2023-11-27T20:54:59.610624+0000","last_peered":"2023-11-27T20:54:59.610624+0000","last_clean":"2023-11-27T20:54:59.610624+0000","last_became_active":"2023-11-27T20:54:31.818048+0000","last_became_peered":"2023-11-27T20:54:31.818048+0000","last_unstale":"2023-11-27T20:54:59.610624+0000","last_undegraded":"2023-11-27T20:54:59.610624+0000","last_fullsized":"2023-11-27T20:54:59.610624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:48:53.892148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610546+0000","last_change":"2023-11-27T20:54:27.493626+0000","last_active":"2023-11-27T20:54:59.610546+0000","last_peered":"2023-11-27T20:54:59.610546+0000","last_clean":"2023-11-27T20:54:59.610546+0000","last_became_active":"2023-11-27T20:54:27.493256+0000","last_became_peered":"2023-11-27T20:54:27.493256+0000","last_unstale":"2023-11-27T20:54:59.610546+0000","last_undegraded":"2023-11-27T20:54:59.610546+0000","last_fullsized":"2023-11-27T20:54:59.610546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:40:57.665118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.741104+0000","last_change":"2023-11-27T20:54:26.230079+0000","last_active":"2023-11-27T20:54:31.741104+0000","last_peered":"2023-11-27T20:54:31.741104+0000","last_clean":"2023-11-27T20:54:31.741104+0000","last_became_active":"2023-11-27T20:54:26.229796+0000","last_became_peered":"2023-11-27T20:54:26.229796+0000","last_unstale":"2023-11-27T20:54:31.741104+0000","last_undegraded":"2023-11-27T20:54:31.741104+0000","last_fullsized":"2023-11-27T20:54:31.741104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:55.616164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.989591+0000","last_change":"2023-11-27T20:54:31.825472+0000","last_active":"2023-11-27T20:54:32.989591+0000","last_peered":"2023-11-27T20:54:32.989591+0000","last_clean":"2023-11-27T20:54:32.989591+0000","last_became_active":"2023-11-27T20:54:31.825080+0000","last_became_peered":"2023-11-27T20:54:31.825080+0000","last_unstale":"2023-11-27T20:54:32.989591+0000","last_undegraded":"2023-11-27T20:54:32.989591+0000","last_fullsized":"2023-11-27T20:54:32.989591+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:56:07.208945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:00.595764+0000","last_change":"2023-11-27T20:55:00.593751+0000","last_active":"2023-11-27T20:55:00.595764+0000","last_peered":"2023-11-27T20:55:00.595764+0000","last_clean":"2023-11-27T20:55:00.595764+0000","last_became_active":"2023-11-27T20:55:00.593249+0000","last_became_peered":"2023-11-27T20:55:00.593249+0000","last_unstale":"2023-11-27T20:55:00.595764+0000","last_undegraded":"2023-11-27T20:55:00.595764+0000","last_fullsized":"2023-11-27T20:55:00.595764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:10.486151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822994+0000","last_change":"2023-11-27T20:54:26.226148+0000","last_active":"2023-11-27T20:54:31.822994+0000","last_peered":"2023-11-27T20:54:31.822994+0000","last_clean":"2023-11-27T20:54:31.822994+0000","last_became_active":"2023-11-27T20:54:26.225886+0000","last_became_peered":"2023-11-27T20:54:26.225886+0000","last_unstale":"2023-11-27T20:54:31.822994+0000","last_undegraded":"2023-11-27T20:54:31.822994+0000","last_fullsized":"2023-11-27T20:54:31.822994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:32:19.691350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.856567+0000","last_change":"2023-11-27T20:54:31.828729+0000","last_active":"2023-11-27T20:54:32.856567+0000","last_peered":"2023-11-27T20:54:32.856567+0000","last_clean":"2023-11-27T20:54:32.856567+0000","last_became_active":"2023-11-27T20:54:31.828368+0000","last_became_peered":"2023-11-27T20:54:31.828368+0000","last_unstale":"2023-11-27T20:54:32.856567+0000","last_undegraded":"2023-11-27T20:54:32.856567+0000","last_fullsized":"2023-11-27T20:54:32.856567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:02.384459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.812360+0000","last_change":"2023-11-27T20:54:27.515800+0000","last_active":"2023-11-27T20:54:31.812360+0000","last_peered":"2023-11-27T20:54:31.812360+0000","last_clean":"2023-11-27T20:54:31.812360+0000","last_became_active":"2023-11-27T20:54:27.515416+0000","last_became_peered":"2023-11-27T20:54:27.515416+0000","last_unstale":"2023-11-27T20:54:31.812360+0000","last_undegraded":"2023-11-27T20:54:31.812360+0000","last_fullsized":"2023-11-27T20:54:31.812360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:03:00.166936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610003+0000","last_change":"2023-11-27T20:54:26.224880+0000","last_active":"2023-11-27T20:54:59.610003+0000","last_peered":"2023-11-27T20:54:59.610003+0000","last_clean":"2023-11-27T20:54:59.610003+0000","last_became_active":"2023-11-27T20:54:26.224604+0000","last_became_peered":"2023-11-27T20:54:26.224604+0000","last_unstale":"2023-11-27T20:54:59.610003+0000","last_undegraded":"2023-11-27T20:54:59.610003+0000","last_fullsized":"2023-11-27T20:54:59.610003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:15:45.927622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609459+0000","last_change":"2023-11-27T20:54:31.819648+0000","last_active":"2023-11-27T20:54:59.609459+0000","last_peered":"2023-11-27T20:54:59.609459+0000","last_clean":"2023-11-27T20:54:59.609459+0000","last_became_active":"2023-11-27T20:54:31.819294+0000","last_became_peered":"2023-11-27T20:54:31.819294+0000","last_unstale":"2023-11-27T20:54:59.609459+0000","last_undegraded":"2023-11-27T20:54:59.609459+0000","last_fullsized":"2023-11-27T20:54:59.609459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:15.043559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.738358+0000","last_change":"2023-11-27T20:54:27.512925+0000","last_active":"2023-11-27T20:54:31.738358+0000","last_peered":"2023-11-27T20:54:31.738358+0000","last_clean":"2023-11-27T20:54:31.738358+0000","last_became_active":"2023-11-27T20:54:27.512663+0000","last_became_peered":"2023-11-27T20:54:27.512663+0000","last_unstale":"2023-11-27T20:54:31.738358+0000","last_undegraded":"2023-11-27T20:54:31.738358+0000","last_fullsized":"2023-11-27T20:54:31.738358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:41.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.812441+0000","last_change":"2023-11-27T20:54:26.225344+0000","last_active":"2023-11-27T20:54:31.812441+0000","last_peered":"2023-11-27T20:54:31.812441+0000","last_clean":"2023-11-27T20:54:31.812441+0000","last_became_active":"2023-11-27T20:54:26.225056+0000","last_became_peered":"2023-11-27T20:54:26.225056+0000","last_unstale":"2023-11-27T20:54:31.812441+0000","last_undegraded":"2023-11-27T20:54:31.812441+0000","last_fullsized":"2023-11-27T20:54:31.812441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:39.965666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:33.073909+0000","last_change":"2023-11-27T20:54:31.827590+0000","last_active":"2023-11-27T20:54:33.073909+0000","last_peered":"2023-11-27T20:54:33.073909+0000","last_clean":"2023-11-27T20:54:33.073909+0000","last_became_active":"2023-11-27T20:54:31.827175+0000","last_became_peered":"2023-11-27T20:54:31.827175+0000","last_unstale":"2023-11-27T20:54:33.073909+0000","last_undegraded":"2023-11-27T20:54:33.073909+0000","last_fullsized":"2023-11-27T20:54:33.073909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:07:26.372924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609706+0000","last_change":"2023-11-27T20:54:27.498488+0000","last_active":"2023-11-27T20:54:59.609706+0000","last_peered":"2023-11-27T20:54:59.609706+0000","last_clean":"2023-11-27T20:54:59.609706+0000","last_became_active":"2023-11-27T20:54:27.498225+0000","last_became_peered":"2023-11-27T20:54:27.498225+0000","last_unstale":"2023-11-27T20:54:59.609706+0000","last_undegraded":"2023-11-27T20:54:59.609706+0000","last_fullsized":"2023-11-27T20:54:59.609706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:20:24.928142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'10","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609734+0000","last_change":"2023-11-27T20:54:26.225580+0000","last_active":"2023-11-27T20:54:59.609734+0000","last_peered":"2023-11-27T20:54:59.609734+0000","last_clean":"2023-11-27T20:54:59.609734+0000","last_became_active":"2023-11-27T20:54:26.225333+0000","last_became_peered":"2023-11-27T20:54:26.225333+0000","last_unstale":"2023-11-27T20:54:59.609734+0000","last_undegraded":"2023-11-27T20:54:59.609734+0000","last_fullsized":"2023-11-27T20:54:59.609734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:46:01.797509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.857069+0000","last_change":"2023-11-27T20:54:31.836029+0000","last_active":"2023-11-27T20:54:32.857069+0000","last_peered":"2023-11-27T20:54:32.857069+0000","last_clean":"2023-11-27T20:54:32.857069+0000","last_became_active":"2023-11-27T20:54:31.835629+0000","last_became_peered":"2023-11-27T20:54:31.835629+0000","last_unstale":"2023-11-27T20:54:32.857069+0000","last_undegraded":"2023-11-27T20:54:32.857069+0000","last_fullsized":"2023-11-27T20:54:32.857069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:06.015093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.808051+0000","last_change":"2023-11-27T20:54:27.511034+0000","last_active":"2023-11-27T20:54:31.808051+0000","last_peered":"2023-11-27T20:54:31.808051+0000","last_clean":"2023-11-27T20:54:31.808051+0000","last_became_active":"2023-11-27T20:54:27.510775+0000","last_became_peered":"2023-11-27T20:54:27.510775+0000","last_unstale":"2023-11-27T20:54:31.808051+0000","last_undegraded":"2023-11-27T20:54:31.808051+0000","last_fullsized":"2023-11-27T20:54:31.808051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:56.708375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.810385+0000","last_change":"2023-11-27T20:54:26.227007+0000","last_active":"2023-11-27T20:54:31.810385+0000","last_peered":"2023-11-27T20:54:31.810385+0000","last_clean":"2023-11-27T20:54:31.810385+0000","last_became_active":"2023-11-27T20:54:26.226745+0000","last_became_peered":"2023-11-27T20:54:26.226745+0000","last_unstale":"2023-11-27T20:54:31.810385+0000","last_undegraded":"2023-11-27T20:54:31.810385+0000","last_fullsized":"2023-11-27T20:54:31.810385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:41:46.312385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.857112+0000","last_change":"2023-11-27T20:54:31.831969+0000","last_active":"2023-11-27T20:54:32.857112+0000","last_peered":"2023-11-27T20:54:32.857112+0000","last_clean":"2023-11-27T20:54:32.857112+0000","last_became_active":"2023-11-27T20:54:31.831620+0000","last_became_peered":"2023-11-27T20:54:31.831620+0000","last_unstale":"2023-11-27T20:54:32.857112+0000","last_undegraded":"2023-11-27T20:54:32.857112+0000","last_fullsized":"2023-11-27T20:54:32.857112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:57:38.465675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609895+0000","last_change":"2023-11-27T20:54:27.515785+0000","last_active":"2023-11-27T20:54:59.609895+0000","last_peered":"2023-11-27T20:54:59.609895+0000","last_clean":"2023-11-27T20:54:59.609895+0000","last_became_active":"2023-11-27T20:54:27.515524+0000","last_became_peered":"2023-11-27T20:54:27.515524+0000","last_unstale":"2023-11-27T20:54:59.609895+0000","last_undegraded":"2023-11-27T20:54:59.609895+0000","last_fullsized":"2023-11-27T20:54:59.609895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:40:33.267986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610197+0000","last_change":"2023-11-27T20:54:26.225975+0000","last_active":"2023-11-27T20:54:59.610197+0000","last_peered":"2023-11-27T20:54:59.610197+0000","last_clean":"2023-11-27T20:54:59.610197+0000","last_became_active":"2023-11-27T20:54:26.225691+0000","last_became_peered":"2023-11-27T20:54:26.225691+0000","last_unstale":"2023-11-27T20:54:59.610197+0000","last_undegraded":"2023-11-27T20:54:59.610197+0000","last_fullsized":"2023-11-27T20:54:59.610197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:25.427192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.875411+0000","last_change":"2023-11-27T20:54:31.827058+0000","last_active":"2023-11-27T20:54:32.875411+0000","last_peered":"2023-11-27T20:54:32.875411+0000","last_clean":"2023-11-27T20:54:32.875411+0000","last_became_active":"2023-11-27T20:54:31.826669+0000","last_became_peered":"2023-11-27T20:54:31.826669+0000","last_unstale":"2023-11-27T20:54:32.875411+0000","last_undegraded":"2023-11-27T20:54:32.875411+0000","last_fullsized":"2023-11-27T20:54:32.875411+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:40.986177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.739987+0000","last_change":"2023-11-27T20:54:27.503066+0000","last_active":"2023-11-27T20:54:31.739987+0000","last_peered":"2023-11-27T20:54:31.739987+0000","last_clean":"2023-11-27T20:54:31.739987+0000","last_became_active":"2023-11-27T20:54:27.502677+0000","last_became_peered":"2023-11-27T20:54:27.502677+0000","last_unstale":"2023-11-27T20:54:31.739987+0000","last_undegraded":"2023-11-27T20:54:31.739987+0000","last_fullsized":"2023-11-27T20:54:31.739987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:41.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822673+0000","last_change":"2023-11-27T20:54:26.228175+0000","last_active":"2023-11-27T20:54:31.822673+0000","last_peered":"2023-11-27T20:54:31.822673+0000","last_clean":"2023-11-27T20:54:31.822673+0000","last_became_active":"2023-11-27T20:54:26.227911+0000","last_became_peered":"2023-11-27T20:54:26.227911+0000","last_unstale":"2023-11-27T20:54:31.822673+0000","last_undegraded":"2023-11-27T20:54:31.822673+0000","last_fullsized":"2023-11-27T20:54:31.822673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:57.995466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610892+0000","last_change":"2023-11-27T20:54:31.828136+0000","last_active":"2023-11-27T20:54:59.610892+0000","last_peered":"2023-11-27T20:54:59.610892+0000","last_clean":"2023-11-27T20:54:59.610892+0000","last_became_active":"2023-11-27T20:54:31.827785+0000","last_became_peered":"2023-11-27T20:54:31.827785+0000","last_unstale":"2023-11-27T20:54:59.610892+0000","last_undegraded":"2023-11-27T20:54:59.610892+0000","last_fullsized":"2023-11-27T20:54:59.610892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:28:18.206490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.809969+0000","last_change":"2023-11-27T20:54:27.514185+0000","last_active":"2023-11-27T20:54:31.809969+0000","last_peered":"2023-11-27T20:54:31.809969+0000","last_clean":"2023-11-27T20:54:31.809969+0000","last_became_active":"2023-11-27T20:54:27.513655+0000","last_became_peered":"2023-11-27T20:54:27.513655+0000","last_unstale":"2023-11-27T20:54:31.809969+0000","last_undegraded":"2023-11-27T20:54:31.809969+0000","last_fullsized":"2023-11-27T20:54:31.809969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:52.629755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:48.829257+0000","last_change":"2023-11-27T20:54:26.230827+0000","last_active":"2023-11-27T20:54:48.829257+0000","last_peered":"2023-11-27T20:54:48.829257+0000","last_clean":"2023-11-27T20:54:48.829257+0000","last_became_active":"2023-11-27T20:54:26.230570+0000","last_became_peered":"2023-11-27T20:54:26.230570+0000","last_unstale":"2023-11-27T20:54:48.829257+0000","last_undegraded":"2023-11-27T20:54:48.829257+0000","last_fullsized":"2023-11-27T20:54:48.829257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:42:04.480038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609727+0000","last_change":"2023-11-27T20:54:31.828482+0000","last_active":"2023-11-27T20:54:59.609727+0000","last_peered":"2023-11-27T20:54:59.609727+0000","last_clean":"2023-11-27T20:54:59.609727+0000","last_became_active":"2023-11-27T20:54:31.827872+0000","last_became_peered":"2023-11-27T20:54:31.827872+0000","last_unstale":"2023-11-27T20:54:59.609727+0000","last_undegraded":"2023-11-27T20:54:59.609727+0000","last_fullsized":"2023-11-27T20:54:59.609727+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:32:35.015914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610523+0000","last_change":"2023-11-27T20:54:27.493526+0000","last_active":"2023-11-27T20:54:59.610523+0000","last_peered":"2023-11-27T20:54:59.610523+0000","last_clean":"2023-11-27T20:54:59.610523+0000","last_became_active":"2023-11-27T20:54:27.493257+0000","last_became_peered":"2023-11-27T20:54:27.493257+0000","last_unstale":"2023-11-27T20:54:59.610523+0000","last_undegraded":"2023-11-27T20:54:59.610523+0000","last_fullsized":"2023-11-27T20:54:59.610523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:04.222900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.823571+0000","last_change":"2023-11-27T20:54:26.231237+0000","last_active":"2023-11-27T20:54:31.823571+0000","last_peered":"2023-11-27T20:54:31.823571+0000","last_clean":"2023-11-27T20:54:31.823571+0000","last_became_active":"2023-11-27T20:54:26.230963+0000","last_became_peered":"2023-11-27T20:54:26.230963+0000","last_unstale":"2023-11-27T20:54:31.823571+0000","last_undegraded":"2023-11-27T20:54:31.823571+0000","last_fullsized":"2023-11-27T20:54:31.823571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:11:24.730507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:32.989454+0000","last_change":"2023-11-27T20:54:31.825391+0000","last_active":"2023-11-27T20:54:32.989454+0000","last_peered":"2023-11-27T20:54:32.989454+0000","last_clean":"2023-11-27T20:54:32.989454+0000","last_became_active":"2023-11-27T20:54:31.825038+0000","last_became_peered":"2023-11-27T20:54:31.825038+0000","last_unstale":"2023-11-27T20:54:32.989454+0000","last_undegraded":"2023-11-27T20:54:32.989454+0000","last_fullsized":"2023-11-27T20:54:32.989454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:11:47.511718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822521+0000","last_change":"2023-11-27T20:54:27.508226+0000","last_active":"2023-11-27T20:54:31.822521+0000","last_peered":"2023-11-27T20:54:31.822521+0000","last_clean":"2023-11-27T20:54:31.822521+0000","last_became_active":"2023-11-27T20:54:27.507805+0000","last_became_peered":"2023-11-27T20:54:27.507805+0000","last_unstale":"2023-11-27T20:54:31.822521+0000","last_undegraded":"2023-11-27T20:54:31.822521+0000","last_fullsized":"2023-11-27T20:54:31.822521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:43:42.137077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.810714+0000","last_change":"2023-11-27T20:54:26.226915+0000","last_active":"2023-11-27T20:54:31.810714+0000","last_peered":"2023-11-27T20:54:31.810714+0000","last_clean":"2023-11-27T20:54:31.810714+0000","last_became_active":"2023-11-27T20:54:26.226679+0000","last_became_peered":"2023-11-27T20:54:26.226679+0000","last_unstale":"2023-11-27T20:54:31.810714+0000","last_undegraded":"2023-11-27T20:54:31.810714+0000","last_fullsized":"2023-11-27T20:54:31.810714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:05:08.792958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:33.073649+0000","last_change":"2023-11-27T20:54:31.834934+0000","last_active":"2023-11-27T20:54:33.073649+0000","last_peered":"2023-11-27T20:54:33.073649+0000","last_clean":"2023-11-27T20:54:33.073649+0000","last_became_active":"2023-11-27T20:54:31.834569+0000","last_became_peered":"2023-11-27T20:54:31.834569+0000","last_unstale":"2023-11-27T20:54:33.073649+0000","last_undegraded":"2023-11-27T20:54:33.073649+0000","last_fullsized":"2023-11-27T20:54:33.073649+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:15:51.754021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.738211+0000","last_change":"2023-11-27T20:54:27.498841+0000","last_active":"2023-11-27T20:54:31.738211+0000","last_peered":"2023-11-27T20:54:31.738211+0000","last_clean":"2023-11-27T20:54:31.738211+0000","last_became_active":"2023-11-27T20:54:27.498535+0000","last_became_peered":"2023-11-27T20:54:27.498535+0000","last_unstale":"2023-11-27T20:54:31.738211+0000","last_undegraded":"2023-11-27T20:54:31.738211+0000","last_fullsized":"2023-11-27T20:54:31.738211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:21.736684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.808463+0000","last_change":"2023-11-27T20:54:26.228140+0000","last_active":"2023-11-27T20:54:31.808463+0000","last_peered":"2023-11-27T20:54:31.808463+0000","last_clean":"2023-11-27T20:54:31.808463+0000","last_became_active":"2023-11-27T20:54:26.227878+0000","last_became_peered":"2023-11-27T20:54:26.227878+0000","last_unstale":"2023-11-27T20:54:31.808463+0000","last_undegraded":"2023-11-27T20:54:31.808463+0000","last_fullsized":"2023-11-27T20:54:31.808463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:21:36.965668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609901+0000","last_change":"2023-11-27T20:54:31.825264+0000","last_active":"2023-11-27T20:54:59.609901+0000","last_peered":"2023-11-27T20:54:59.609901+0000","last_clean":"2023-11-27T20:54:59.609901+0000","last_became_active":"2023-11-27T20:54:31.824914+0000","last_became_peered":"2023-11-27T20:54:31.824914+0000","last_unstale":"2023-11-27T20:54:59.609901+0000","last_undegraded":"2023-11-27T20:54:59.609901+0000","last_fullsized":"2023-11-27T20:54:59.609901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:49:01.022403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609853+0000","last_change":"2023-11-27T20:54:31.828359+0000","last_active":"2023-11-27T20:54:59.609853+0000","last_peered":"2023-11-27T20:54:59.609853+0000","last_clean":"2023-11-27T20:54:59.609853+0000","last_became_active":"2023-11-27T20:54:31.827971+0000","last_became_peered":"2023-11-27T20:54:31.827971+0000","last_unstale":"2023-11-27T20:54:59.609853+0000","last_undegraded":"2023-11-27T20:54:59.609853+0000","last_fullsized":"2023-11-27T20:54:59.609853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:02.858386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609971+0000","last_change":"2023-11-27T20:54:27.434914+0000","last_active":"2023-11-27T20:54:59.609971+0000","last_peered":"2023-11-27T20:54:59.609971+0000","last_clean":"2023-11-27T20:54:59.609971+0000","last_became_active":"2023-11-27T20:54:27.434635+0000","last_became_peered":"2023-11-27T20:54:27.434635+0000","last_unstale":"2023-11-27T20:54:59.609971+0000","last_undegraded":"2023-11-27T20:54:59.609971+0000","last_fullsized":"2023-11-27T20:54:59.609971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:59.373818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609710+0000","last_change":"2023-11-27T20:54:26.224770+0000","last_active":"2023-11-27T20:54:59.609710+0000","last_peered":"2023-11-27T20:54:59.609710+0000","last_clean":"2023-11-27T20:54:59.609710+0000","last_became_active":"2023-11-27T20:54:26.224502+0000","last_became_peered":"2023-11-27T20:54:26.224502+0000","last_unstale":"2023-11-27T20:54:59.609710+0000","last_undegraded":"2023-11-27T20:54:59.609710+0000","last_fullsized":"2023-11-27T20:54:59.609710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:51:28.157451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609919+0000","last_change":"2023-11-27T20:54:31.827147+0000","last_active":"2023-11-27T20:54:59.609919+0000","last_peered":"2023-11-27T20:54:59.609919+0000","last_clean":"2023-11-27T20:54:59.609919+0000","last_became_active":"2023-11-27T20:54:31.826790+0000","last_became_peered":"2023-11-27T20:54:31.826790+0000","last_unstale":"2023-11-27T20:54:59.609919+0000","last_undegraded":"2023-11-27T20:54:59.609919+0000","last_fullsized":"2023-11-27T20:54:59.609919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:11:33.954256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822763+0000","last_change":"2023-11-27T20:54:27.507947+0000","last_active":"2023-11-27T20:54:31.822763+0000","last_peered":"2023-11-27T20:54:31.822763+0000","last_clean":"2023-11-27T20:54:31.822763+0000","last_became_active":"2023-11-27T20:54:27.507698+0000","last_became_peered":"2023-11-27T20:54:27.507698+0000","last_unstale":"2023-11-27T20:54:31.822763+0000","last_undegraded":"2023-11-27T20:54:31.822763+0000","last_fullsized":"2023-11-27T20:54:31.822763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:50.369518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.739942+0000","last_change":"2023-11-27T20:54:26.230417+0000","last_active":"2023-11-27T20:54:31.739942+0000","last_peered":"2023-11-27T20:54:31.739942+0000","last_clean":"2023-11-27T20:54:31.739942+0000","last_became_active":"2023-11-27T20:54:26.229725+0000","last_became_peered":"2023-11-27T20:54:26.229725+0000","last_unstale":"2023-11-27T20:54:31.739942+0000","last_undegraded":"2023-11-27T20:54:31.739942+0000","last_fullsized":"2023-11-27T20:54:31.739942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:01.075715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610096+0000","last_change":"2023-11-27T20:54:26.221975+0000","last_active":"2023-11-27T20:54:59.610096+0000","last_peered":"2023-11-27T20:54:59.610096+0000","last_clean":"2023-11-27T20:54:59.610096+0000","last_became_active":"2023-11-27T20:54:26.221715+0000","last_became_peered":"2023-11-27T20:54:26.221715+0000","last_unstale":"2023-11-27T20:54:59.610096+0000","last_undegraded":"2023-11-27T20:54:59.610096+0000","last_fullsized":"2023-11-27T20:54:59.610096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:15.156440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609797+0000","last_change":"2023-11-27T20:54:27.517213+0000","last_active":"2023-11-27T20:54:59.609797+0000","last_peered":"2023-11-27T20:54:59.609797+0000","last_clean":"2023-11-27T20:54:59.609797+0000","last_became_active":"2023-11-27T20:54:27.516887+0000","last_became_peered":"2023-11-27T20:54:27.516887+0000","last_unstale":"2023-11-27T20:54:59.609797+0000","last_undegraded":"2023-11-27T20:54:59.609797+0000","last_fullsized":"2023-11-27T20:54:59.609797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:51:29.249661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610033+0000","last_change":"2023-11-27T20:54:31.827740+0000","last_active":"2023-11-27T20:54:59.610033+0000","last_peered":"2023-11-27T20:54:59.610033+0000","last_clean":"2023-11-27T20:54:59.610033+0000","last_became_active":"2023-11-27T20:54:31.827395+0000","last_became_peered":"2023-11-27T20:54:31.827395+0000","last_unstale":"2023-11-27T20:54:59.610033+0000","last_undegraded":"2023-11-27T20:54:59.610033+0000","last_fullsized":"2023-11-27T20:54:59.610033+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:20:29.485550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822694+0000","last_change":"2023-11-27T20:54:26.227971+0000","last_active":"2023-11-27T20:54:31.822694+0000","last_peered":"2023-11-27T20:54:31.822694+0000","last_clean":"2023-11-27T20:54:31.822694+0000","last_became_active":"2023-11-27T20:54:26.227713+0000","last_became_peered":"2023-11-27T20:54:26.227713+0000","last_unstale":"2023-11-27T20:54:31.822694+0000","last_undegraded":"2023-11-27T20:54:31.822694+0000","last_fullsized":"2023-11-27T20:54:31.822694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:39.965666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.807894+0000","last_change":"2023-11-27T20:54:27.506394+0000","last_active":"2023-11-27T20:54:31.807894+0000","last_peered":"2023-11-27T20:54:31.807894+0000","last_clean":"2023-11-27T20:54:31.807894+0000","last_became_active":"2023-11-27T20:54:27.506119+0000","last_became_peered":"2023-11-27T20:54:27.506119+0000","last_unstale":"2023-11-27T20:54:31.807894+0000","last_undegraded":"2023-11-27T20:54:31.807894+0000","last_fullsized":"2023-11-27T20:54:31.807894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:21.736684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T20:54:33.073853+0000","last_change":"2023-11-27T20:54:31.833185+0000","last_active":"2023-11-27T20:54:33.073853+0000","last_peered":"2023-11-27T20:54:33.073853+0000","last_clean":"2023-11-27T20:54:33.073853+0000","last_became_active":"2023-11-27T20:54:31.832813+0000","last_became_peered":"2023-11-27T20:54:31.832813+0000","last_unstale":"2023-11-27T20:54:33.073853+0000","last_undegraded":"2023-11-27T20:54:33.073853+0000","last_fullsized":"2023-11-27T20:54:33.073853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:13.856393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.737168+0000","last_change":"2023-11-27T20:54:27.500687+0000","last_active":"2023-11-27T20:54:31.737168+0000","last_peered":"2023-11-27T20:54:31.737168+0000","last_clean":"2023-11-27T20:54:31.737168+0000","last_became_active":"2023-11-27T20:54:27.500394+0000","last_became_peered":"2023-11-27T20:54:27.500394+0000","last_unstale":"2023-11-27T20:54:31.737168+0000","last_undegraded":"2023-11-27T20:54:31.737168+0000","last_fullsized":"2023-11-27T20:54:31.737168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:15:32.173306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.823856+0000","last_change":"2023-11-27T20:54:27.515441+0000","last_active":"2023-11-27T20:54:31.823856+0000","last_peered":"2023-11-27T20:54:31.823856+0000","last_clean":"2023-11-27T20:54:31.823856+0000","last_became_active":"2023-11-27T20:54:27.515173+0000","last_became_peered":"2023-11-27T20:54:27.515173+0000","last_unstale":"2023-11-27T20:54:31.823856+0000","last_undegraded":"2023-11-27T20:54:31.823856+0000","last_fullsized":"2023-11-27T20:54:31.823856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:19:36.361734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609870+0000","last_change":"2023-11-27T20:54:27.506358+0000","last_active":"2023-11-27T20:54:59.609870+0000","last_peered":"2023-11-27T20:54:59.609870+0000","last_clean":"2023-11-27T20:54:59.609870+0000","last_became_active":"2023-11-27T20:54:27.506112+0000","last_became_peered":"2023-11-27T20:54:27.506112+0000","last_unstale":"2023-11-27T20:54:59.609870+0000","last_undegraded":"2023-11-27T20:54:59.609870+0000","last_fullsized":"2023-11-27T20:54:59.609870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:58.300979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822599+0000","last_change":"2023-11-27T20:54:27.510776+0000","last_active":"2023-11-27T20:54:31.822599+0000","last_peered":"2023-11-27T20:54:31.822599+0000","last_clean":"2023-11-27T20:54:31.822599+0000","last_became_active":"2023-11-27T20:54:27.510532+0000","last_became_peered":"2023-11-27T20:54:27.510532+0000","last_unstale":"2023-11-27T20:54:31.822599+0000","last_undegraded":"2023-11-27T20:54:31.822599+0000","last_fullsized":"2023-11-27T20:54:31.822599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:36.428770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.740954+0000","last_change":"2023-11-27T20:54:27.513775+0000","last_active":"2023-11-27T20:54:31.740954+0000","last_peered":"2023-11-27T20:54:31.740954+0000","last_clean":"2023-11-27T20:54:31.740954+0000","last_became_active":"2023-11-27T20:54:27.513517+0000","last_became_peered":"2023-11-27T20:54:27.513517+0000","last_unstale":"2023-11-27T20:54:31.740954+0000","last_undegraded":"2023-11-27T20:54:31.740954+0000","last_fullsized":"2023-11-27T20:54:31.740954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:07:21.815516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.740763+0000","last_change":"2023-11-27T20:54:27.511798+0000","last_active":"2023-11-27T20:54:31.740763+0000","last_peered":"2023-11-27T20:54:31.740763+0000","last_clean":"2023-11-27T20:54:31.740763+0000","last_became_active":"2023-11-27T20:54:27.511559+0000","last_became_peered":"2023-11-27T20:54:27.511559+0000","last_unstale":"2023-11-27T20:54:31.740763+0000","last_undegraded":"2023-11-27T20:54:31.740763+0000","last_fullsized":"2023-11-27T20:54:31.740763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:41.057877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.738121+0000","last_change":"2023-11-27T20:54:27.499585+0000","last_active":"2023-11-27T20:54:31.738121+0000","last_peered":"2023-11-27T20:54:31.738121+0000","last_clean":"2023-11-27T20:54:31.738121+0000","last_became_active":"2023-11-27T20:54:27.499323+0000","last_became_peered":"2023-11-27T20:54:27.499323+0000","last_unstale":"2023-11-27T20:54:31.738121+0000","last_undegraded":"2023-11-27T20:54:31.738121+0000","last_fullsized":"2023-11-27T20:54:31.738121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:59:41.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822345+0000","last_change":"2023-11-27T20:54:27.508846+0000","last_active":"2023-11-27T20:54:31.822345+0000","last_peered":"2023-11-27T20:54:31.822345+0000","last_clean":"2023-11-27T20:54:31.822345+0000","last_became_active":"2023-11-27T20:54:27.508615+0000","last_became_peered":"2023-11-27T20:54:27.508615+0000","last_unstale":"2023-11-27T20:54:31.822345+0000","last_undegraded":"2023-11-27T20:54:31.822345+0000","last_fullsized":"2023-11-27T20:54:31.822345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:53.751196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609632+0000","last_change":"2023-11-27T20:54:27.510920+0000","last_active":"2023-11-27T20:54:59.609632+0000","last_peered":"2023-11-27T20:54:59.609632+0000","last_clean":"2023-11-27T20:54:59.609632+0000","last_became_active":"2023-11-27T20:54:27.510647+0000","last_became_peered":"2023-11-27T20:54:27.510647+0000","last_unstale":"2023-11-27T20:54:59.609632+0000","last_undegraded":"2023-11-27T20:54:59.609632+0000","last_fullsized":"2023-11-27T20:54:59.609632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:32:30.458506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822367+0000","last_change":"2023-11-27T20:54:27.508596+0000","last_active":"2023-11-27T20:54:31.822367+0000","last_peered":"2023-11-27T20:54:31.822367+0000","last_clean":"2023-11-27T20:54:31.822367+0000","last_became_active":"2023-11-27T20:54:27.508360+0000","last_became_peered":"2023-11-27T20:54:27.508360+0000","last_unstale":"2023-11-27T20:54:31.822367+0000","last_undegraded":"2023-11-27T20:54:31.822367+0000","last_fullsized":"2023-11-27T20:54:31.822367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:58.794639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.807821+0000","last_change":"2023-11-27T20:54:27.513374+0000","last_active":"2023-11-27T20:54:31.807821+0000","last_peered":"2023-11-27T20:54:31.807821+0000","last_clean":"2023-11-27T20:54:31.807821+0000","last_became_active":"2023-11-27T20:54:27.513105+0000","last_became_peered":"2023-11-27T20:54:27.513105+0000","last_unstale":"2023-11-27T20:54:31.807821+0000","last_undegraded":"2023-11-27T20:54:31.807821+0000","last_fullsized":"2023-11-27T20:54:31.807821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:59:41.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609724+0000","last_change":"2023-11-27T20:54:27.433370+0000","last_active":"2023-11-27T20:54:59.609724+0000","last_peered":"2023-11-27T20:54:59.609724+0000","last_clean":"2023-11-27T20:54:59.609724+0000","last_became_active":"2023-11-27T20:54:27.433179+0000","last_became_peered":"2023-11-27T20:54:27.433179+0000","last_unstale":"2023-11-27T20:54:59.609724+0000","last_undegraded":"2023-11-27T20:54:59.609724+0000","last_fullsized":"2023-11-27T20:54:59.609724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:01.805918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.812620+0000","last_change":"2023-11-27T20:54:27.515324+0000","last_active":"2023-11-27T20:54:31.812620+0000","last_peered":"2023-11-27T20:54:31.812620+0000","last_clean":"2023-11-27T20:54:31.812620+0000","last_became_active":"2023-11-27T20:54:27.515068+0000","last_became_peered":"2023-11-27T20:54:27.515068+0000","last_unstale":"2023-11-27T20:54:31.812620+0000","last_undegraded":"2023-11-27T20:54:31.812620+0000","last_fullsized":"2023-11-27T20:54:31.812620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:11:42.954310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610694+0000","last_change":"2023-11-27T20:54:27.498621+0000","last_active":"2023-11-27T20:54:59.610694+0000","last_peered":"2023-11-27T20:54:59.610694+0000","last_clean":"2023-11-27T20:54:59.610694+0000","last_became_active":"2023-11-27T20:54:27.498306+0000","last_became_peered":"2023-11-27T20:54:27.498306+0000","last_unstale":"2023-11-27T20:54:59.610694+0000","last_undegraded":"2023-11-27T20:54:59.610694+0000","last_fullsized":"2023-11-27T20:54:59.610694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:20:24.529896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.823688+0000","last_change":"2023-11-27T20:54:27.513134+0000","last_active":"2023-11-27T20:54:31.823688+0000","last_peered":"2023-11-27T20:54:31.823688+0000","last_clean":"2023-11-27T20:54:31.823688+0000","last_became_active":"2023-11-27T20:54:27.512897+0000","last_became_peered":"2023-11-27T20:54:27.512897+0000","last_unstale":"2023-11-27T20:54:31.823688+0000","last_undegraded":"2023-11-27T20:54:31.823688+0000","last_fullsized":"2023-11-27T20:54:31.823688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:13:40.877792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610185+0000","last_change":"2023-11-27T20:54:27.515196+0000","last_active":"2023-11-27T20:54:59.610185+0000","last_peered":"2023-11-27T20:54:59.610185+0000","last_clean":"2023-11-27T20:54:59.610185+0000","last_became_active":"2023-11-27T20:54:27.514946+0000","last_became_peered":"2023-11-27T20:54:27.514946+0000","last_unstale":"2023-11-27T20:54:59.610185+0000","last_undegraded":"2023-11-27T20:54:59.610185+0000","last_fullsized":"2023-11-27T20:54:59.610185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:06:07.940123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609907+0000","last_change":"2023-11-27T20:54:27.493565+0000","last_active":"2023-11-27T20:54:59.609907+0000","last_peered":"2023-11-27T20:54:59.609907+0000","last_clean":"2023-11-27T20:54:59.609907+0000","last_became_active":"2023-11-27T20:54:27.493297+0000","last_became_peered":"2023-11-27T20:54:27.493297+0000","last_unstale":"2023-11-27T20:54:59.609907+0000","last_undegraded":"2023-11-27T20:54:59.609907+0000","last_fullsized":"2023-11-27T20:54:59.609907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:28:51.839397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822292+0000","last_change":"2023-11-27T20:54:27.512910+0000","last_active":"2023-11-27T20:54:31.822292+0000","last_peered":"2023-11-27T20:54:31.822292+0000","last_clean":"2023-11-27T20:54:31.822292+0000","last_became_active":"2023-11-27T20:54:27.512662+0000","last_became_peered":"2023-11-27T20:54:27.512662+0000","last_unstale":"2023-11-27T20:54:31.822292+0000","last_undegraded":"2023-11-27T20:54:31.822292+0000","last_fullsized":"2023-11-27T20:54:31.822292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:52.629755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.739909+0000","last_change":"2023-11-27T20:54:27.512406+0000","last_active":"2023-11-27T20:54:31.739909+0000","last_peered":"2023-11-27T20:54:31.739909+0000","last_clean":"2023-11-27T20:54:31.739909+0000","last_became_active":"2023-11-27T20:54:27.512124+0000","last_became_peered":"2023-11-27T20:54:27.512124+0000","last_unstale":"2023-11-27T20:54:31.739909+0000","last_undegraded":"2023-11-27T20:54:31.739909+0000","last_fullsized":"2023-11-27T20:54:31.739909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:21.736684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.739988+0000","last_change":"2023-11-27T20:54:27.517262+0000","last_active":"2023-11-27T20:54:31.739988+0000","last_peered":"2023-11-27T20:54:31.739988+0000","last_clean":"2023-11-27T20:54:31.739988+0000","last_became_active":"2023-11-27T20:54:27.516907+0000","last_became_peered":"2023-11-27T20:54:27.516907+0000","last_unstale":"2023-11-27T20:54:31.739988+0000","last_undegraded":"2023-11-27T20:54:31.739988+0000","last_fullsized":"2023-11-27T20:54:31.739988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:05:09.885169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.812554+0000","last_change":"2023-11-27T20:54:27.515432+0000","last_active":"2023-11-27T20:54:31.812554+0000","last_peered":"2023-11-27T20:54:31.812554+0000","last_clean":"2023-11-27T20:54:31.812554+0000","last_became_active":"2023-11-27T20:54:27.515182+0000","last_became_peered":"2023-11-27T20:54:27.515182+0000","last_unstale":"2023-11-27T20:54:31.812554+0000","last_undegraded":"2023-11-27T20:54:31.812554+0000","last_fullsized":"2023-11-27T20:54:31.812554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:36.428770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.809880+0000","last_change":"2023-11-27T20:54:27.516164+0000","last_active":"2023-11-27T20:54:31.809880+0000","last_peered":"2023-11-27T20:54:31.809880+0000","last_clean":"2023-11-27T20:54:31.809880+0000","last_became_active":"2023-11-27T20:54:27.515344+0000","last_became_peered":"2023-11-27T20:54:27.515344+0000","last_unstale":"2023-11-27T20:54:31.809880+0000","last_undegraded":"2023-11-27T20:54:31.809880+0000","last_fullsized":"2023-11-27T20:54:31.809880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:58.794639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.810638+0000","last_change":"2023-11-27T20:54:27.512956+0000","last_active":"2023-11-27T20:54:31.810638+0000","last_peered":"2023-11-27T20:54:31.810638+0000","last_clean":"2023-11-27T20:54:31.810638+0000","last_became_active":"2023-11-27T20:54:27.512692+0000","last_became_peered":"2023-11-27T20:54:27.512692+0000","last_unstale":"2023-11-27T20:54:31.810638+0000","last_undegraded":"2023-11-27T20:54:31.810638+0000","last_fullsized":"2023-11-27T20:54:31.810638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:53.751196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.808424+0000","last_change":"2023-11-27T20:54:27.499043+0000","last_active":"2023-11-27T20:54:31.808424+0000","last_peered":"2023-11-27T20:54:31.808424+0000","last_clean":"2023-11-27T20:54:31.808424+0000","last_became_active":"2023-11-27T20:54:27.498790+0000","last_became_peered":"2023-11-27T20:54:27.498790+0000","last_unstale":"2023-11-27T20:54:31.808424+0000","last_undegraded":"2023-11-27T20:54:31.808424+0000","last_fullsized":"2023-11-27T20:54:31.808424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:41.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822460+0000","last_change":"2023-11-27T20:54:27.513089+0000","last_active":"2023-11-27T20:54:31.822460+0000","last_peered":"2023-11-27T20:54:31.822460+0000","last_clean":"2023-11-27T20:54:31.822460+0000","last_became_active":"2023-11-27T20:54:27.512777+0000","last_became_peered":"2023-11-27T20:54:27.512777+0000","last_unstale":"2023-11-27T20:54:31.822460+0000","last_undegraded":"2023-11-27T20:54:31.822460+0000","last_fullsized":"2023-11-27T20:54:31.822460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:32.362116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.810313+0000","last_change":"2023-11-27T20:54:27.512691+0000","last_active":"2023-11-27T20:54:31.810313+0000","last_peered":"2023-11-27T20:54:31.810313+0000","last_clean":"2023-11-27T20:54:31.810313+0000","last_became_active":"2023-11-27T20:54:27.512433+0000","last_became_peered":"2023-11-27T20:54:27.512433+0000","last_unstale":"2023-11-27T20:54:31.810313+0000","last_undegraded":"2023-11-27T20:54:31.810313+0000","last_fullsized":"2023-11-27T20:54:31.810313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:30.589702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.737862+0000","last_change":"2023-11-27T20:54:27.432322+0000","last_active":"2023-11-27T20:54:31.737862+0000","last_peered":"2023-11-27T20:54:31.737862+0000","last_clean":"2023-11-27T20:54:31.737862+0000","last_became_active":"2023-11-27T20:54:27.432152+0000","last_became_peered":"2023-11-27T20:54:27.432152+0000","last_unstale":"2023-11-27T20:54:31.737862+0000","last_undegraded":"2023-11-27T20:54:31.737862+0000","last_fullsized":"2023-11-27T20:54:31.737862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:02.167926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.811574+0000","last_change":"2023-11-27T20:54:27.516081+0000","last_active":"2023-11-27T20:54:31.811574+0000","last_peered":"2023-11-27T20:54:31.811574+0000","last_clean":"2023-11-27T20:54:31.811574+0000","last_became_active":"2023-11-27T20:54:27.515801+0000","last_became_peered":"2023-11-27T20:54:27.515801+0000","last_unstale":"2023-11-27T20:54:31.811574+0000","last_undegraded":"2023-11-27T20:54:31.811574+0000","last_fullsized":"2023-11-27T20:54:31.811574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:24:30.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.737709+0000","last_change":"2023-11-27T20:54:27.432375+0000","last_active":"2023-11-27T20:54:31.737709+0000","last_peered":"2023-11-27T20:54:31.737709+0000","last_clean":"2023-11-27T20:54:31.737709+0000","last_became_active":"2023-11-27T20:54:27.432160+0000","last_became_peered":"2023-11-27T20:54:27.432160+0000","last_unstale":"2023-11-27T20:54:31.737709+0000","last_undegraded":"2023-11-27T20:54:31.737709+0000","last_fullsized":"2023-11-27T20:54:31.737709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:36.652979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822893+0000","last_change":"2023-11-27T20:54:27.505374+0000","last_active":"2023-11-27T20:54:31.822893+0000","last_peered":"2023-11-27T20:54:31.822893+0000","last_clean":"2023-11-27T20:54:31.822893+0000","last_became_active":"2023-11-27T20:54:27.505122+0000","last_became_peered":"2023-11-27T20:54:27.505122+0000","last_unstale":"2023-11-27T20:54:31.822893+0000","last_undegraded":"2023-11-27T20:54:31.822893+0000","last_fullsized":"2023-11-27T20:54:31.822893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:30.589702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.822240+0000","last_change":"2023-11-27T20:54:27.505531+0000","last_active":"2023-11-27T20:54:31.822240+0000","last_peered":"2023-11-27T20:54:31.822240+0000","last_clean":"2023-11-27T20:54:31.822240+0000","last_became_active":"2023-11-27T20:54:27.505236+0000","last_became_peered":"2023-11-27T20:54:27.505236+0000","last_unstale":"2023-11-27T20:54:31.822240+0000","last_undegraded":"2023-11-27T20:54:31.822240+0000","last_fullsized":"2023-11-27T20:54:31.822240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:56:02.651538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-27T20:54:31.812286+0000","last_change":"2023-11-27T20:54:27.515185+0000","last_active":"2023-11-27T20:54:31.812286+0000","last_peered":"2023-11-27T20:54:31.812286+0000","last_clean":"2023-11-27T20:54:31.812286+0000","last_became_active":"2023-11-27T20:54:27.514846+0000","last_became_peered":"2023-11-27T20:54:27.514846+0000","last_unstale":"2023-11-27T20:54:31.812286+0000","last_undegraded":"2023-11-27T20:54:31.812286+0000","last_fullsized":"2023-11-27T20:54:31.812286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:43:42.137077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4752,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":10086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60,"ondisk_log_size":60,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":106070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":696530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":109912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.254}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":696508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]}]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":106194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":125337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":120643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:55:03.150 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-27T20:55:03.151 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-27T20:55:03.151 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-27T20:55:03.151 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-27T20:55:03.151 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-27T20:55:03.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.284+0000 7f4702bb6640 1 Processor -- start 2023-11-27T20:55:03.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.284+0000 7f4702bb6640 1 -- start start 2023-11-27T20:55:03.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.285+0000 7f4702bb6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f46fc1594c0 0x7f46fc0721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:03.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.285+0000 7f4702bb6640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46fc072af0 con 0x7f46fc159fb0 2023-11-27T20:55:03.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.285+0000 7f4702bb6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46fc072720 con 0x7f46fc06cbf0 2023-11-27T20:55:03.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.285+0000 7f4702bb6640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46fc0c04e0 con 0x7f46fc1594c0 2023-11-27T20:55:03.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.286+0000 7f46f3fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f46fc06cbf0 0x7f46fc1598a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:59026/0 (socket says 172.21.15.88:59026) 2023-11-27T20:55:03.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.286+0000 7f46f3fff640 1 -- 172.21.15.88:0/3510314803 learned_addr learned my addr 172.21.15.88:0/3510314803 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:55:03.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.286+0000 7f4700952640 1 --2- 172.21.15.88:0/3510314803 >> v2:172.21.15.88:3300/0 conn(0x7f46fc1594c0 0x7f46fc0721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:03.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.288+0000 7f46f37fe640 1 -- 172.21.15.88:0/3510314803 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3734760667 0 0) 0x7f46ec001110 con 0x7f46fc06cbf0 2023-11-27T20:55:03.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.288+0000 7f46f37fe640 1 -- 172.21.15.88:0/3510314803 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46e4003520 con 0x7f46fc06cbf0 2023-11-27T20:55:03.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.291+0000 7f4700952640 1 -- 172.21.15.88:0/3510314803 >> v1:172.21.15.167:6789/0 conn(0x7f46fc06cbf0 legacy=0x7f46fc1598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:03.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.291+0000 7f4700952640 1 -- 172.21.15.88:0/3510314803 >> v1:172.21.15.88:6789/0 conn(0x7f46fc159fb0 legacy=0x7f46fc163d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:03.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.291+0000 7f4700952640 1 -- 172.21.15.88:0/3510314803 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46fc0c1c10 con 0x7f46fc1594c0 2023-11-27T20:55:03.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.294+0000 7f4700952640 1 --2- 172.21.15.88:0/3510314803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46fc1594c0 0x7f46fc0721e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f46f80097a0 tx=0x7f46f802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a012a0d8cdb3f977 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:03.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.298+0000 7f46f37fe640 1 -- 172.21.15.88:0/3510314803 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f8030610 con 0x7f46fc1594c0 2023-11-27T20:55:03.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.298+0000 7f46f37fe640 1 -- 172.21.15.88:0/3510314803 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f8030770 con 0x7f46fc1594c0 2023-11-27T20:55:03.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.298+0000 7f46f37fe640 1 -- 172.21.15.88:0/3510314803 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f8030b00 con 0x7f46fc1594c0 2023-11-27T20:55:03.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.299+0000 7f4702bb6640 1 -- 172.21.15.88:0/3510314803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46fc1594c0 msgr2=0x7f46fc0721e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:03.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.299+0000 7f4702bb6640 1 --2- 172.21.15.88:0/3510314803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46fc1594c0 0x7f46fc0721e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f46f80097a0 tx=0x7f46f802b960 comp rx=0 tx=0).stop 2023-11-27T20:55:03.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.299+0000 7f4702bb6640 1 -- 172.21.15.88:0/3510314803 shutdown_connections 2023-11-27T20:55:03.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.299+0000 7f4702bb6640 1 --2- 172.21.15.88:0/3510314803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46fc1594c0 0x7f46fc0721e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:03.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.299+0000 7f4702bb6640 1 -- 172.21.15.88:0/3510314803 >> 172.21.15.88:0/3510314803 conn(0x7f46fc0c79a0 msgr2=0x7f46fc0c7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:03.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.299+0000 7f4702bb6640 1 -- 172.21.15.88:0/3510314803 shutdown_connections 2023-11-27T20:55:03.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.299+0000 7f4702bb6640 1 -- 172.21.15.88:0/3510314803 wait complete. 2023-11-27T20:55:03.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.300+0000 7f4702bb6640 1 Processor -- start 2023-11-27T20:55:03.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.300+0000 7f4702bb6640 1 -- start start 2023-11-27T20:55:03.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.301+0000 7f4702bb6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46fc06cbf0 0x7f46fc14fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:03.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.301+0000 7f4702bb6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46fc1594c0 0x7f46fc0c3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:03.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.301+0000 7f4702bb6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46fc159fb0 0x7f46fc14eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:03.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.301+0000 7f4702bb6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc14db60 con 0x7f46fc06cbf0 2023-11-27T20:55:03.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.301+0000 7f4702bb6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc14e2f0 con 0x7f46fc159fb0 2023-11-27T20:55:03.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.301+0000 7f4702bb6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc150410 con 0x7f46fc1594c0 2023-11-27T20:55:03.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.301+0000 7f4700952640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46fc06cbf0 0x7f46fc14fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:03.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.302+0000 7f4701153640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46fc159fb0 0x7f46fc14eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:03.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.302+0000 7f4700952640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46fc06cbf0 0x7f46fc14fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50438/0 (socket says 172.21.15.88:50438) 2023-11-27T20:55:03.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.302+0000 7f4700952640 1 -- 172.21.15.88:0/1512662366 learned_addr learned my addr 172.21.15.88:0/1512662366 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:03.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.302+0000 7f46f3fff640 1 --2- 172.21.15.88:0/1512662366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46fc1594c0 0x7f46fc0c3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:03.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.305+0000 7f4700952640 1 -- 172.21.15.88:0/1512662366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46fc1594c0 msgr2=0x7f46fc0c3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:03.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.305+0000 7f4700952640 1 --2- 172.21.15.88:0/1512662366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46fc1594c0 0x7f46fc0c3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:03.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.305+0000 7f4700952640 1 -- 172.21.15.88:0/1512662366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46fc159fb0 msgr2=0x7f46fc14eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:03.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.305+0000 7f4700952640 1 --2- 172.21.15.88:0/1512662366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46fc159fb0 0x7f46fc14eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:03.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.305+0000 7f4700952640 1 -- 172.21.15.88:0/1512662366 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f8009400 con 0x7f46fc06cbf0 2023-11-27T20:55:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.307+0000 7f4700952640 1 --2- 172.21.15.88:0/1512662366 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46fc06cbf0 0x7f46fc14fed0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f46f8009890 tx=0x7f46f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:03.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.309+0000 7f46f17fa640 1 -- 172.21.15.88:0/1512662366 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f803e040 con 0x7f46fc06cbf0 2023-11-27T20:55:03.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.309+0000 7f4702bb6640 1 -- 172.21.15.88:0/1512662366 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46fc14fa40 con 0x7f46fc06cbf0 2023-11-27T20:55:03.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.309+0000 7f4702bb6640 1 -- 172.21.15.88:0/1512662366 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46fc0c28d0 con 0x7f46fc06cbf0 2023-11-27T20:55:03.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.310+0000 7f4702bb6640 1 -- 172.21.15.88:0/1512662366 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46fc067470 con 0x7f46fc06cbf0 2023-11-27T20:55:03.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.311+0000 7f46f17fa640 1 -- 172.21.15.88:0/1512662366 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f8039a20 con 0x7f46fc06cbf0 2023-11-27T20:55:03.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.311+0000 7f46f17fa640 1 -- 172.21.15.88:0/1512662366 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f8039d90 con 0x7f46fc06cbf0 2023-11-27T20:55:03.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.557+0000 7f46f17fa640 1 -- 172.21.15.88:0/1512662366 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f46f80423e0 con 0x7f46fc06cbf0 2023-11-27T20:55:03.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.557+0000 7f46f17fa640 1 --2- 172.21.15.88:0/1512662366 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f46e806b1c0 0x7f46e806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:03.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.558+0000 7f46f3fff640 1 --2- 172.21.15.88:0/1512662366 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f46e806b1c0 0x7f46e806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:03.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.558+0000 7f46f3fff640 1 --2- 172.21.15.88:0/1512662366 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f46e806b1c0 0x7f46e806d680 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f46fc1ecc30 tx=0x7f46ec007bb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:03.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.573+0000 7f46f17fa640 1 -- 172.21.15.88:0/1512662366 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f46f807ab90 con 0x7f46fc06cbf0 2023-11-27T20:55:03.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.573+0000 7f46f17fa640 1 -- 172.21.15.88:0/1512662366 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f46f8076ed0 con 0x7f46fc06cbf0 2023-11-27T20:55:03.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.786+0000 7f4702bb6640 1 -- 172.21.15.88:0/1512662366 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f46fc067db0 con 0x7f46fc06cbf0 2023-11-27T20:55:03.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.923+0000 7f46f17fa640 1 -- 172.21.15.88:0/1512662366 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171157 (secure 0 0 0) 0x7f46f807a4f0 con 0x7f46fc06cbf0 2023-11-27T20:55:03.927 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:55:03.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.925+0000 7f4702bb6640 1 -- 172.21.15.88:0/1512662366 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f46e806b1c0 msgr2=0x7f46e806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:03.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.926+0000 7f4702bb6640 1 --2- 172.21.15.88:0/1512662366 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f46e806b1c0 0x7f46e806d680 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f46fc1ecc30 tx=0x7f46ec007bb0 comp rx=0 tx=0).stop 2023-11-27T20:55:03.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.926+0000 7f4702bb6640 1 -- 172.21.15.88:0/1512662366 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46fc06cbf0 msgr2=0x7f46fc14fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:03.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.926+0000 7f4702bb6640 1 --2- 172.21.15.88:0/1512662366 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46fc06cbf0 0x7f46fc14fed0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f46f8009890 tx=0x7f46f8004730 comp rx=0 tx=0).stop 2023-11-27T20:55:03.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.926+0000 7f4702bb6640 1 -- 172.21.15.88:0/1512662366 shutdown_connections 2023-11-27T20:55:03.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.926+0000 7f4702bb6640 1 --2- 172.21.15.88:0/1512662366 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f46e806b1c0 0x7f46e806d680 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:03.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.926+0000 7f4702bb6640 1 --2- 172.21.15.88:0/1512662366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46fc159fb0 0x7f46fc14eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:03.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.926+0000 7f4702bb6640 1 --2- 172.21.15.88:0/1512662366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46fc1594c0 0x7f46fc0c3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:03.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.926+0000 7f4702bb6640 1 --2- 172.21.15.88:0/1512662366 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46fc06cbf0 0x7f46fc14fed0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:03.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.926+0000 7f4702bb6640 1 -- 172.21.15.88:0/1512662366 >> 172.21.15.88:0/1512662366 conn(0x7f46fc0c79a0 msgr2=0x7f46fc0b0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:03.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.926+0000 7f4702bb6640 1 -- 172.21.15.88:0/1512662366 shutdown_connections 2023-11-27T20:55:03.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:03.926+0000 7f4702bb6640 1 -- 172.21.15.88:0/1512662366 wait complete. 2023-11-27T20:55:03.938 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":5,"active_gid":4105,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":352455703},{"type":"v1","addr":"172.21.15.88:6801","nonce":352455703}]},"active_addr":"172.21.15.88:6801/352455703","active_change":"2023-11-27T20:53:58.593278+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":405699796}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":1120155987}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":77611309}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":1887436556}]}]} 2023-11-27T20:55:03.942 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-27T20:55:03.942 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-27T20:55:03.942 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:55:04.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.041+0000 7f0c1fa5d640 1 Processor -- start 2023-11-27T20:55:04.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.041+0000 7f0c1fa5d640 1 -- start start 2023-11-27T20:55:04.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.042+0000 7f0c1fa5d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0c180c56c0 0x7f0c180c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:04.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.042+0000 7f0c1fa5d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0c1815ac30 0x7f0c1815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:04.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.042+0000 7f0c1fa5d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1815a7a0 con 0x7f0c180c52e0 2023-11-27T20:55:04.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.042+0000 7f0c1fa5d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c180c7250 con 0x7f0c1815ac30 2023-11-27T20:55:04.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.042+0000 7f0c1fa5d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1815b5e0 con 0x7f0c180c56c0 2023-11-27T20:55:04.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.042+0000 7f0c1dffa640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0c1815ac30 0x7f0c1815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:04.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.042+0000 7f0c1cff8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0c180c56c0 0x7f0c180c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:04.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.043+0000 7f0c1cff8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0c180c56c0 0x7f0c180c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:41160/0 (socket says 172.21.15.88:41160) 2023-11-27T20:55:04.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.043+0000 7f0c1cff8640 1 -- 172.21.15.88:0/2258884992 learned_addr learned my addr 172.21.15.88:0/2258884992 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:04.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.045+0000 7f0c1cff8640 1 -- 172.21.15.88:0/2258884992 >> v2:172.21.15.88:3300/0 conn(0x7f0c1815ac30 msgr2=0x7f0c1815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:04.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.045+0000 7f0c1cff8640 1 --2- 172.21.15.88:0/2258884992 >> v2:172.21.15.88:3300/0 conn(0x7f0c1815ac30 0x7f0c1815b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:04.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.045+0000 7f0c1cff8640 1 -- 172.21.15.88:0/2258884992 >> v1:172.21.15.88:6789/0 conn(0x7f0c180c52e0 legacy=0x7f0c180c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:04.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.045+0000 7f0c1cff8640 1 -- 172.21.15.88:0/2258884992 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c181574c0 con 0x7f0c180c56c0 2023-11-27T20:55:04.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.047+0000 7f0c1cff8640 1 --2- 172.21.15.88:0/2258884992 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c180c56c0 0x7f0c180c8220 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0c180706c0 tx=0x7f0c0802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1503988d6a1ad89c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:04.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.051+0000 7f0c0ffff640 1 -- 172.21.15.88:0/2258884992 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c08030860 con 0x7f0c180c56c0 2023-11-27T20:55:04.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.051+0000 7f0c0ffff640 1 -- 172.21.15.88:0/2258884992 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c080309c0 con 0x7f0c180c56c0 2023-11-27T20:55:04.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.051+0000 7f0c0ffff640 1 -- 172.21.15.88:0/2258884992 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c08030d50 con 0x7f0c180c56c0 2023-11-27T20:55:04.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.052+0000 7f0c1fa5d640 1 -- 172.21.15.88:0/2258884992 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c180c56c0 msgr2=0x7f0c180c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:04.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.052+0000 7f0c1fa5d640 1 --2- 172.21.15.88:0/2258884992 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c180c56c0 0x7f0c180c8220 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0c180706c0 tx=0x7f0c0802b9a0 comp rx=0 tx=0).stop 2023-11-27T20:55:04.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.052+0000 7f0c1fa5d640 1 -- 172.21.15.88:0/2258884992 shutdown_connections 2023-11-27T20:55:04.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.052+0000 7f0c1fa5d640 1 --2- 172.21.15.88:0/2258884992 >> v2:172.21.15.88:3300/0 conn(0x7f0c1815ac30 0x7f0c1815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:04.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.052+0000 7f0c1fa5d640 1 --2- 172.21.15.88:0/2258884992 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c180c56c0 0x7f0c180c8220 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:04.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.052+0000 7f0c1fa5d640 1 -- 172.21.15.88:0/2258884992 >> 172.21.15.88:0/2258884992 conn(0x7f0c1806f6d0 msgr2=0x7f0c1806fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:04.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.052+0000 7f0c1fa5d640 1 -- 172.21.15.88:0/2258884992 shutdown_connections 2023-11-27T20:55:04.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.052+0000 7f0c1fa5d640 1 -- 172.21.15.88:0/2258884992 wait complete. 2023-11-27T20:55:04.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.053+0000 7f0c1fa5d640 1 Processor -- start 2023-11-27T20:55:04.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.053+0000 7f0c1fa5d640 1 -- start start 2023-11-27T20:55:04.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.054+0000 7f0c1fa5d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c180c52e0 0x7f0c180c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:04.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.054+0000 7f0c1fa5d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c180c56c0 0x7f0c180cb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:04.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.054+0000 7f0c1fa5d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c1815ac30 0x7f0c180cb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:04.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.054+0000 7f0c1fa5d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c180cadb0 con 0x7f0c180c52e0 2023-11-27T20:55:04.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.054+0000 7f0c1fa5d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c180ca4f0 con 0x7f0c180c56c0 2023-11-27T20:55:04.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.054+0000 7f0c1fa5d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c181eb370 con 0x7f0c1815ac30 2023-11-27T20:55:04.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.055+0000 7f0c1d7f9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c180c52e0 0x7f0c180c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:04.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.055+0000 7f0c1cff8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c180c56c0 0x7f0c180cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:04.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.055+0000 7f0c1dffa640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c1815ac30 0x7f0c180cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:04.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.055+0000 7f0c1d7f9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c180c52e0 0x7f0c180c4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50460/0 (socket says 172.21.15.88:50460) 2023-11-27T20:55:04.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.055+0000 7f0c1d7f9640 1 -- 172.21.15.88:0/3967702002 learned_addr learned my addr 172.21.15.88:0/3967702002 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:04.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.058+0000 7f0c1d7f9640 1 -- 172.21.15.88:0/3967702002 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c1815ac30 msgr2=0x7f0c180cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:04.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.058+0000 7f0c1d7f9640 1 --2- 172.21.15.88:0/3967702002 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c1815ac30 0x7f0c180cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:04.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.058+0000 7f0c1d7f9640 1 -- 172.21.15.88:0/3967702002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c180c56c0 msgr2=0x7f0c180cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:04.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.058+0000 7f0c1d7f9640 1 --2- 172.21.15.88:0/3967702002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c180c56c0 0x7f0c180cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:04.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.058+0000 7f0c1d7f9640 1 -- 172.21.15.88:0/3967702002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c080094d0 con 0x7f0c180c52e0 2023-11-27T20:55:04.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.061+0000 7f0c1d7f9640 1 --2- 172.21.15.88:0/3967702002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c180c52e0 0x7f0c180c4000 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0c1400c400 tx=0x7f0c1400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:04.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.066+0000 7f0c0dffb640 1 -- 172.21.15.88:0/3967702002 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c140052d0 con 0x7f0c180c52e0 2023-11-27T20:55:04.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.066+0000 7f0c0dffb640 1 -- 172.21.15.88:0/3967702002 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c14005450 con 0x7f0c180c52e0 2023-11-27T20:55:04.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.066+0000 7f0c1fa5d640 1 -- 172.21.15.88:0/3967702002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c181eb650 con 0x7f0c180c52e0 2023-11-27T20:55:04.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.066+0000 7f0c0dffb640 1 -- 172.21.15.88:0/3967702002 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c14007260 con 0x7f0c180c52e0 2023-11-27T20:55:04.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.066+0000 7f0c1fa5d640 1 -- 172.21.15.88:0/3967702002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c180caa40 con 0x7f0c180c52e0 2023-11-27T20:55:04.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.067+0000 7f0c1fa5d640 1 -- 172.21.15.88:0/3967702002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c180cabd0 con 0x7f0c180c52e0 2023-11-27T20:55:04.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.085+0000 7f0c0dffb640 1 -- 172.21.15.88:0/3967702002 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0c140073c0 con 0x7f0c180c52e0 2023-11-27T20:55:04.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.086+0000 7f0c0dffb640 1 --2- 172.21.15.88:0/3967702002 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f0bfc06b210 0x7f0bfc06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:04.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.086+0000 7f0c1cff8640 1 --2- 172.21.15.88:0/3967702002 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f0bfc06b210 0x7f0bfc06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:04.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.086+0000 7f0c1cff8640 1 --2- 172.21.15.88:0/3967702002 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f0bfc06b210 0x7f0bfc06d6d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0c08036000 tx=0x7f0c08008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:04.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.090+0000 7f0c0dffb640 1 -- 172.21.15.88:0/3967702002 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0c14007670 con 0x7f0c180c52e0 2023-11-27T20:55:04.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.326+0000 7f0c0dffb640 1 -- 172.21.15.88:0/3967702002 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0c14054400 con 0x7f0c180c52e0 2023-11-27T20:55:04.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.499+0000 7f0c1fa5d640 1 -- 172.21.15.88:0/3967702002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c18067470 con 0x7f0c180c52e0 2023-11-27T20:55:04.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.549+0000 7f0c0dffb640 1 -- 172.21.15.88:0/3967702002 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18666 (secure 0 0 0) 0x7f0c14020070 con 0x7f0c180c52e0 2023-11-27T20:55:04.551 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:55:04.551 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":28,"fsid":"ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc","created":"2023-11-27T20:53:53.110827+0000","modified":"2023-11-27T20:55:00.550945+0000","last_up_change":"2023-11-27T20:54:08.219383+0000","last_in_change":"2023-11-27T20:53:59.022798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:54:09.277670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:54:24.503156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:54:25.744043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T20:54:29.704111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1207ca0f-bef1-44c6-b66b-58bf0e080ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6819","nonce":3952326022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6821","nonce":3952326022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6825","nonce":3952326022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6823","nonce":3952326022}]},"public_addr":"172.21.15.88:6819/3952326022","cluster_addr":"172.21.15.88:6821/3952326022","heartbeat_back_addr":"172.21.15.88:6825/3952326022","heartbeat_front_addr":"172.21.15.88:6823/3952326022","state":["exists","up"]},{"osd":1,"uuid":"8d1be479-4241-4335-9633-1394311fde76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6827","nonce":1788401966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6829","nonce":1788401966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6833","nonce":1788401966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6831","nonce":1788401966}]},"public_addr":"172.21.15.88:6827/1788401966","cluster_addr":"172.21.15.88:6829/1788401966","heartbeat_back_addr":"172.21.15.88:6833/1788401966","heartbeat_front_addr":"172.21.15.88:6831/1788401966","state":["exists","up"]},{"osd":2,"uuid":"7536b008-05dd-40eb-9d4a-bdac4b1c38c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6803","nonce":1166333913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6805","nonce":1166333913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6809","nonce":1166333913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6807","nonce":1166333913}]},"public_addr":"172.21.15.88:6803/1166333913","cluster_addr":"172.21.15.88:6805/1166333913","heartbeat_back_addr":"172.21.15.88:6809/1166333913","heartbeat_front_addr":"172.21.15.88:6807/1166333913","state":["exists","up"]},{"osd":3,"uuid":"47edd4d7-e99c-4ce3-851b-cc9c8e2d4480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6811","nonce":406887502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6813","nonce":406887502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6817","nonce":406887502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6815","nonce":406887502}]},"public_addr":"172.21.15.88:6811/406887502","cluster_addr":"172.21.15.88:6813/406887502","heartbeat_back_addr":"172.21.15.88:6817/406887502","heartbeat_front_addr":"172.21.15.88:6815/406887502","state":["exists","up"]},{"osd":4,"uuid":"0a81dd31-1a8b-41af-b933-d74aae63f3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6801","nonce":2551293703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6803","nonce":2551293703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6807","nonce":2551293703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6805","nonce":2551293703}]},"public_addr":"172.21.15.167:6801/2551293703","cluster_addr":"172.21.15.167:6803/2551293703","heartbeat_back_addr":"172.21.15.167:6807/2551293703","heartbeat_front_addr":"172.21.15.167:6805/2551293703","state":["exists","up"]},{"osd":5,"uuid":"1c462d0d-3361-48b3-a82a-86a920539e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6825","nonce":866085094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6827","nonce":866085094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6831","nonce":866085094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6829","nonce":866085094}]},"public_addr":"172.21.15.167:6825/866085094","cluster_addr":"172.21.15.167:6827/866085094","heartbeat_back_addr":"172.21.15.167:6831/866085094","heartbeat_front_addr":"172.21.15.167:6829/866085094","state":["exists","up"]},{"osd":6,"uuid":"d687c5ad-6c88-4a15-8120-0cdbc5610535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6809","nonce":2766725538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6811","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6813","nonce":2766725538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6819","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6821","nonce":2766725538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6815","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6817","nonce":2766725538}]},"public_addr":"172.21.15.167:6809/2766725538","cluster_addr":"172.21.15.167:6813/2766725538","heartbeat_back_addr":"172.21.15.167:6821/2766725538","heartbeat_front_addr":"172.21.15.167:6817/2766725538","state":["exists","up"]},{"osd":7,"uuid":"c9a50596-4981-4bd8-a8ef-d7679f8d9559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6812","nonce":2695037266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6816","nonce":2695037266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6823","nonce":2695037266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6820","nonce":2695037266}]},"public_addr":"172.21.15.167:6812/2695037266","cluster_addr":"172.21.15.167:6816/2695037266","heartbeat_back_addr":"172.21.15.167:6823/2695037266","heartbeat_front_addr":"172.21.15.167:6820/2695037266","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.522590+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.483170+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.492504+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.432204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.414964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.459803+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.437250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.460394+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.1d","mappings":[{"from":0,"to":1}]},{"pgid":"3.35","mappings":[{"from":0,"to":7}]},{"pgid":"4.4","mappings":[{"from":6,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":4}]},{"pgid":"4.e","mappings":[{"from":3,"to":5}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:55:04.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.551+0000 7f0c1fa5d640 1 -- 172.21.15.88:0/3967702002 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f0bfc06b210 msgr2=0x7f0bfc06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:04.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.551+0000 7f0c1fa5d640 1 --2- 172.21.15.88:0/3967702002 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f0bfc06b210 0x7f0bfc06d6d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0c08036000 tx=0x7f0c08008030 comp rx=0 tx=0).stop 2023-11-27T20:55:04.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.551+0000 7f0c1fa5d640 1 -- 172.21.15.88:0/3967702002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c180c52e0 msgr2=0x7f0c180c4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:04.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.551+0000 7f0c1fa5d640 1 --2- 172.21.15.88:0/3967702002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c180c52e0 0x7f0c180c4000 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0c1400c400 tx=0x7f0c1400c8c0 comp rx=0 tx=0).stop 2023-11-27T20:55:04.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.551+0000 7f0c1fa5d640 1 -- 172.21.15.88:0/3967702002 shutdown_connections 2023-11-27T20:55:04.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.551+0000 7f0c1fa5d640 1 --2- 172.21.15.88:0/3967702002 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f0bfc06b210 0x7f0bfc06d6d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:04.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.552+0000 7f0c1fa5d640 1 --2- 172.21.15.88:0/3967702002 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c1815ac30 0x7f0c180cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:04.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.552+0000 7f0c1fa5d640 1 --2- 172.21.15.88:0/3967702002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c180c56c0 0x7f0c180cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:04.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.552+0000 7f0c1fa5d640 1 --2- 172.21.15.88:0/3967702002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c180c52e0 0x7f0c180c4000 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:04.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.552+0000 7f0c1fa5d640 1 -- 172.21.15.88:0/3967702002 >> 172.21.15.88:0/3967702002 conn(0x7f0c1806f6d0 msgr2=0x7f0c18156a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:04.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.552+0000 7f0c1fa5d640 1 -- 172.21.15.88:0/3967702002 shutdown_connections 2023-11-27T20:55:04.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.552+0000 7f0c1fa5d640 1 -- 172.21.15.88:0/3967702002 wait complete. 2023-11-27T20:55:04.564 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-27T20:55:04.564 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:55:04.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.663+0000 7f62dc53c640 1 Processor -- start 2023-11-27T20:55:04.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.663+0000 7f62dc53c640 1 -- start start 2023-11-27T20:55:04.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.664+0000 7f62dc53c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62d4151680 0x7f62d41571d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:04.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.664+0000 7f62dc53c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f62d406f810 0x7f62d40ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:04.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.664+0000 7f62dc53c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d40c8240 con 0x7f62d406f3f0 2023-11-27T20:55:04.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.664+0000 7f62dc53c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62d4157880 con 0x7f62d406f810 2023-11-27T20:55:04.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.664+0000 7f62dc53c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d4157b60 con 0x7f62d4151680 2023-11-27T20:55:04.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.665+0000 7f62daad9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f62d406f810 0x7f62d40ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:04.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.666+0000 7f62daad9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f62d406f810 0x7f62d40ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50468/0 (socket says 172.21.15.88:50468) 2023-11-27T20:55:04.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.666+0000 7f62daad9640 1 -- 172.21.15.88:0/4293414609 learned_addr learned my addr 172.21.15.88:0/4293414609 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:04.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.669+0000 7f62daad9640 1 -- 172.21.15.88:0/4293414609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62d4151680 msgr2=0x7f62d41571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:04.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.669+0000 7f62daad9640 1 --2- 172.21.15.88:0/4293414609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62d4151680 0x7f62d41571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:04.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.669+0000 7f62daad9640 1 -- 172.21.15.88:0/4293414609 >> v1:172.21.15.88:6789/0 conn(0x7f62d406f3f0 legacy=0x7f62d40c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:04.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.669+0000 7f62daad9640 1 -- 172.21.15.88:0/4293414609 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d4157e40 con 0x7f62d406f810 2023-11-27T20:55:04.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.673+0000 7f62daad9640 1 --2- 172.21.15.88:0/4293414609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d406f810 0x7f62d40ccac0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f62cc009e50 tx=0x7f62cc02bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17caa2d5921e106 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:04.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.679+0000 7f62d92d6640 1 -- 172.21.15.88:0/4293414609 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62cc02cb90 con 0x7f62d406f810 2023-11-27T20:55:04.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.679+0000 7f62d92d6640 1 -- 172.21.15.88:0/4293414609 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62cc02ccf0 con 0x7f62d406f810 2023-11-27T20:55:04.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.679+0000 7f62d92d6640 1 -- 172.21.15.88:0/4293414609 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62cc034610 con 0x7f62d406f810 2023-11-27T20:55:04.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.679+0000 7f62dc53c640 1 -- 172.21.15.88:0/4293414609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d406f810 msgr2=0x7f62d40ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:04.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.679+0000 7f62dc53c640 1 --2- 172.21.15.88:0/4293414609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d406f810 0x7f62d40ccac0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f62cc009e50 tx=0x7f62cc02bff0 comp rx=0 tx=0).stop 2023-11-27T20:55:04.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.680+0000 7f62dc53c640 1 -- 172.21.15.88:0/4293414609 shutdown_connections 2023-11-27T20:55:04.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.680+0000 7f62dc53c640 1 --2- 172.21.15.88:0/4293414609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d406f810 0x7f62d40ccac0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:04.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.680+0000 7f62dc53c640 1 --2- 172.21.15.88:0/4293414609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62d4151680 0x7f62d41571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:04.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.680+0000 7f62dc53c640 1 -- 172.21.15.88:0/4293414609 >> 172.21.15.88:0/4293414609 conn(0x7f62d40707f0 msgr2=0x7f62d4070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:04.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.680+0000 7f62dc53c640 1 -- 172.21.15.88:0/4293414609 shutdown_connections 2023-11-27T20:55:04.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.680+0000 7f62dc53c640 1 -- 172.21.15.88:0/4293414609 wait complete. 2023-11-27T20:55:04.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.681+0000 7f62dc53c640 1 Processor -- start 2023-11-27T20:55:04.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.682+0000 7f62dc53c640 1 -- start start 2023-11-27T20:55:04.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.683+0000 7f62dc53c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d406f3f0 0x7f62d41492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:04.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.683+0000 7f62dc53c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62d406f810 0x7f62d41f04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:04.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.683+0000 7f62dc53c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62d4151680 0x7f62d4155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:04.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.683+0000 7f62dc53c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d41f1140 con 0x7f62d406f3f0 2023-11-27T20:55:04.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.683+0000 7f62dc53c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d4155170 con 0x7f62d406f810 2023-11-27T20:55:04.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.683+0000 7f62dc53c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d41f0e60 con 0x7f62d4151680 2023-11-27T20:55:04.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.683+0000 7f62da2d8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d406f3f0 0x7f62d41492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:04.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.683+0000 7f62d9ad7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62d406f810 0x7f62d41f04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:04.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.684+0000 7f62da2d8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d406f3f0 0x7f62d41492c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50484/0 (socket says 172.21.15.88:50484) 2023-11-27T20:55:04.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.684+0000 7f62da2d8640 1 -- 172.21.15.88:0/4043805642 learned_addr learned my addr 172.21.15.88:0/4043805642 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:04.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.687+0000 7f62da2d8640 1 -- 172.21.15.88:0/4043805642 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62d4151680 msgr2=0x7f62d4155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:04.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.687+0000 7f62da2d8640 1 --2- 172.21.15.88:0/4043805642 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62d4151680 0x7f62d4155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:04.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.687+0000 7f62da2d8640 1 -- 172.21.15.88:0/4043805642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62d406f810 msgr2=0x7f62d41f04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:04.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.687+0000 7f62da2d8640 1 --2- 172.21.15.88:0/4043805642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62d406f810 0x7f62d41f04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:04.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.687+0000 7f62da2d8640 1 -- 172.21.15.88:0/4043805642 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62cc009b30 con 0x7f62d406f3f0 2023-11-27T20:55:04.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.691+0000 7f62da2d8640 1 --2- 172.21.15.88:0/4043805642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d406f3f0 0x7f62d41492c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f62d000b4a0 tx=0x7f62d000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:04.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.694+0000 7f62caffd640 1 -- 172.21.15.88:0/4043805642 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d0010610 con 0x7f62d406f3f0 2023-11-27T20:55:04.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.694+0000 7f62caffd640 1 -- 172.21.15.88:0/4043805642 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d0010770 con 0x7f62d406f3f0 2023-11-27T20:55:04.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.694+0000 7f62caffd640 1 -- 172.21.15.88:0/4043805642 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d0010b20 con 0x7f62d406f3f0 2023-11-27T20:55:04.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.695+0000 7f62dc53c640 1 -- 172.21.15.88:0/4043805642 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d41462a0 con 0x7f62d406f3f0 2023-11-27T20:55:04.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.695+0000 7f62dc53c640 1 -- 172.21.15.88:0/4043805642 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d4146860 con 0x7f62d406f3f0 2023-11-27T20:55:04.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.696+0000 7f62dc53c640 1 -- 172.21.15.88:0/4043805642 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d4073dc0 con 0x7f62d406f3f0 2023-11-27T20:55:04.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.714+0000 7f62caffd640 1 -- 172.21.15.88:0/4043805642 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f62d0010c80 con 0x7f62d406f3f0 2023-11-27T20:55:04.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.714+0000 7f62caffd640 1 --2- 172.21.15.88:0/4043805642 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f62b806b210 0x7f62b806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:04.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.715+0000 7f62d9ad7640 1 --2- 172.21.15.88:0/4043805642 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f62b806b210 0x7f62b806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:04.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.715+0000 7f62d9ad7640 1 --2- 172.21.15.88:0/4043805642 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f62b806b210 0x7f62b806d6d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f62d4149800 tx=0x7f62c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:04.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.717+0000 7f62caffd640 1 -- 172.21.15.88:0/4043805642 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f62d00584a0 con 0x7f62d406f3f0 2023-11-27T20:55:04.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:04.949+0000 7f62caffd640 1 -- 172.21.15.88:0/4043805642 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f62d00547e0 con 0x7f62d406f3f0 2023-11-27T20:55:05.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.121+0000 7f62dc53c640 1 -- 172.21.15.88:0/4043805642 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62d40c8400 con 0x7f62d406f3f0 2023-11-27T20:55:05.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.159+0000 7f62caffd640 1 -- 172.21.15.88:0/4043805642 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18666 (secure 0 0 0) 0x7f62d001e020 con 0x7f62d406f3f0 2023-11-27T20:55:05.161 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:55:05.161 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":28,"fsid":"ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc","created":"2023-11-27T20:53:53.110827+0000","modified":"2023-11-27T20:55:00.550945+0000","last_up_change":"2023-11-27T20:54:08.219383+0000","last_in_change":"2023-11-27T20:53:59.022798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:54:09.277670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:54:24.503156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:54:25.744043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T20:54:29.704111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1207ca0f-bef1-44c6-b66b-58bf0e080ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6819","nonce":3952326022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6821","nonce":3952326022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6825","nonce":3952326022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6823","nonce":3952326022}]},"public_addr":"172.21.15.88:6819/3952326022","cluster_addr":"172.21.15.88:6821/3952326022","heartbeat_back_addr":"172.21.15.88:6825/3952326022","heartbeat_front_addr":"172.21.15.88:6823/3952326022","state":["exists","up"]},{"osd":1,"uuid":"8d1be479-4241-4335-9633-1394311fde76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6827","nonce":1788401966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6829","nonce":1788401966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6833","nonce":1788401966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6831","nonce":1788401966}]},"public_addr":"172.21.15.88:6827/1788401966","cluster_addr":"172.21.15.88:6829/1788401966","heartbeat_back_addr":"172.21.15.88:6833/1788401966","heartbeat_front_addr":"172.21.15.88:6831/1788401966","state":["exists","up"]},{"osd":2,"uuid":"7536b008-05dd-40eb-9d4a-bdac4b1c38c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6803","nonce":1166333913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6805","nonce":1166333913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6809","nonce":1166333913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6807","nonce":1166333913}]},"public_addr":"172.21.15.88:6803/1166333913","cluster_addr":"172.21.15.88:6805/1166333913","heartbeat_back_addr":"172.21.15.88:6809/1166333913","heartbeat_front_addr":"172.21.15.88:6807/1166333913","state":["exists","up"]},{"osd":3,"uuid":"47edd4d7-e99c-4ce3-851b-cc9c8e2d4480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6811","nonce":406887502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6813","nonce":406887502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6817","nonce":406887502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6815","nonce":406887502}]},"public_addr":"172.21.15.88:6811/406887502","cluster_addr":"172.21.15.88:6813/406887502","heartbeat_back_addr":"172.21.15.88:6817/406887502","heartbeat_front_addr":"172.21.15.88:6815/406887502","state":["exists","up"]},{"osd":4,"uuid":"0a81dd31-1a8b-41af-b933-d74aae63f3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6801","nonce":2551293703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6803","nonce":2551293703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6807","nonce":2551293703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6805","nonce":2551293703}]},"public_addr":"172.21.15.167:6801/2551293703","cluster_addr":"172.21.15.167:6803/2551293703","heartbeat_back_addr":"172.21.15.167:6807/2551293703","heartbeat_front_addr":"172.21.15.167:6805/2551293703","state":["exists","up"]},{"osd":5,"uuid":"1c462d0d-3361-48b3-a82a-86a920539e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6825","nonce":866085094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6827","nonce":866085094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6831","nonce":866085094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6829","nonce":866085094}]},"public_addr":"172.21.15.167:6825/866085094","cluster_addr":"172.21.15.167:6827/866085094","heartbeat_back_addr":"172.21.15.167:6831/866085094","heartbeat_front_addr":"172.21.15.167:6829/866085094","state":["exists","up"]},{"osd":6,"uuid":"d687c5ad-6c88-4a15-8120-0cdbc5610535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6809","nonce":2766725538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6811","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6813","nonce":2766725538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6819","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6821","nonce":2766725538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6815","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6817","nonce":2766725538}]},"public_addr":"172.21.15.167:6809/2766725538","cluster_addr":"172.21.15.167:6813/2766725538","heartbeat_back_addr":"172.21.15.167:6821/2766725538","heartbeat_front_addr":"172.21.15.167:6817/2766725538","state":["exists","up"]},{"osd":7,"uuid":"c9a50596-4981-4bd8-a8ef-d7679f8d9559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6812","nonce":2695037266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6816","nonce":2695037266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6823","nonce":2695037266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6820","nonce":2695037266}]},"public_addr":"172.21.15.167:6812/2695037266","cluster_addr":"172.21.15.167:6816/2695037266","heartbeat_back_addr":"172.21.15.167:6823/2695037266","heartbeat_front_addr":"172.21.15.167:6820/2695037266","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.522590+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.483170+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.492504+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.432204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.414964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.459803+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.437250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.460394+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.1d","mappings":[{"from":0,"to":1}]},{"pgid":"3.35","mappings":[{"from":0,"to":7}]},{"pgid":"4.4","mappings":[{"from":6,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":4}]},{"pgid":"4.e","mappings":[{"from":3,"to":5}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:55:05.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.161+0000 7f62dc53c640 1 -- 172.21.15.88:0/4043805642 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f62b806b210 msgr2=0x7f62b806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.161+0000 7f62dc53c640 1 --2- 172.21.15.88:0/4043805642 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f62b806b210 0x7f62b806d6d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f62d4149800 tx=0x7f62c4009040 comp rx=0 tx=0).stop 2023-11-27T20:55:05.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.161+0000 7f62dc53c640 1 -- 172.21.15.88:0/4043805642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d406f3f0 msgr2=0x7f62d41492c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.161+0000 7f62dc53c640 1 --2- 172.21.15.88:0/4043805642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d406f3f0 0x7f62d41492c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f62d000b4a0 tx=0x7f62d000b960 comp rx=0 tx=0).stop 2023-11-27T20:55:05.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.161+0000 7f62dc53c640 1 -- 172.21.15.88:0/4043805642 shutdown_connections 2023-11-27T20:55:05.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.161+0000 7f62dc53c640 1 --2- 172.21.15.88:0/4043805642 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f62b806b210 0x7f62b806d6d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.161+0000 7f62dc53c640 1 --2- 172.21.15.88:0/4043805642 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62d4151680 0x7f62d4155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.161+0000 7f62dc53c640 1 --2- 172.21.15.88:0/4043805642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62d406f810 0x7f62d41f04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.161+0000 7f62dc53c640 1 --2- 172.21.15.88:0/4043805642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d406f3f0 0x7f62d41492c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.161+0000 7f62dc53c640 1 -- 172.21.15.88:0/4043805642 >> 172.21.15.88:0/4043805642 conn(0x7f62d40707f0 msgr2=0x7f62d40afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:05.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.161+0000 7f62dc53c640 1 -- 172.21.15.88:0/4043805642 shutdown_connections 2023-11-27T20:55:05.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.161+0000 7f62dc53c640 1 -- 172.21.15.88:0/4043805642 wait complete. 2023-11-27T20:55:05.174 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-27T20:55:05.175 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-27T20:55:05.175 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-27T20:55:05.175 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-27T20:55:05.176 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-27T20:55:05.176 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-27T20:55:05.177 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-27T20:55:05.177 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-27T20:55:05.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.346+0000 7f3e80525640 1 Processor -- start 2023-11-27T20:55:05.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.346+0000 7f3e80525640 1 -- start start 2023-11-27T20:55:05.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.347+0000 7f9d893b3640 1 Processor -- start 2023-11-27T20:55:05.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.347+0000 7f9d893b3640 1 -- start start 2023-11-27T20:55:05.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.347+0000 7f216dd1d640 1 Processor -- start 2023-11-27T20:55:05.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.347+0000 7f216dd1d640 1 -- start start 2023-11-27T20:55:05.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.348+0000 7f216dd1d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2168070a00 0x7f2168160ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.348+0000 7f216dd1d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f216815e370 0x7f21680c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.348+0000 7f216dd1d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216815e7d0 con 0x7f2168157b30 2023-11-27T20:55:05.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.348+0000 7f216dd1d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f216815d8b0 con 0x7f216815e370 2023-11-27T20:55:05.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.348+0000 7f216dd1d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2168070f60 con 0x7f2168070a00 2023-11-27T20:55:05.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.348+0000 7f9d893b3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9d84157890 0x7f9d84161620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.348+0000 7f9d893b3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d8415e350 0x7f9d840c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.348+0000 7f9d893b3640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d84161b60 con 0x7f9d840714e0 2023-11-27T20:55:05.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.348+0000 7f9d893b3640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d8415d6a0 con 0x7f9d84157890 2023-11-27T20:55:05.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.348+0000 7f9d893b3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d840c7ca0 con 0x7f9d8415e350 2023-11-27T20:55:05.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.349+0000 7fa3629c9640 1 Processor -- start 2023-11-27T20:55:05.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.348+0000 7f3e80525640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3e780c4340 0x7f3e78168ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.348+0000 7f3e80525640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e78070e30 con 0x7f3e780c4720 2023-11-27T20:55:05.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.348+0000 7f3e80525640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e78168450 con 0x7f3e78070a00 2023-11-27T20:55:05.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.348+0000 7f3e80525640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e780c5be0 con 0x7f3e780c4340 2023-11-27T20:55:05.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.349+0000 7f2166ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2168070a00 0x7f2168160ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.349+0000 7fa3629c9640 1 -- start start 2023-11-27T20:55:05.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.349+0000 7f6689d61640 1 Processor -- start 2023-11-27T20:55:05.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.349+0000 7f2167fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f216815e370 0x7f21680c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.349+0000 7f6689d61640 1 -- start start 2023-11-27T20:55:05.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.350+0000 7f3e7eac2640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f3e78070a00 0x7f3e7806ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:59036/0 (socket says 172.21.15.88:59036) 2023-11-27T20:55:05.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.350+0000 7f3e7eac2640 1 -- 172.21.15.88:0/2402103595 learned_addr learned my addr 172.21.15.88:0/2402103595 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:55:05.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.350+0000 7f2166ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2168070a00 0x7f2168160ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:34182/0 (socket says 172.21.15.88:34182) 2023-11-27T20:55:05.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.350+0000 7f2166ffd640 1 -- 172.21.15.88:0/1726990737 learned_addr learned my addr 172.21.15.88:0/1726990737 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:05.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.350+0000 7f9d837fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d8415e350 0x7f9d840c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.350+0000 7fa3629c9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa3540e3760 0x7fa35404be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.350+0000 7fa3629c9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa354045410 con 0x7fa35404ba20 2023-11-27T20:55:05.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.350+0000 7fa3629c9640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa354045f90 con 0x7fa3540dd380 2023-11-27T20:55:05.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.350+0000 7fa3629c9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa354046b30 con 0x7fa3540e3760 2023-11-27T20:55:05.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.351+0000 7f6689d61640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6684152b30 0x7f6684156120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.351+0000 7f6689d61640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6684158aa0 0x7f6684071c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.351+0000 7f604fc26640 1 Processor -- start 2023-11-27T20:55:05.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.351+0000 7f6689d61640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66840c8270 con 0x7f668406d0e0 2023-11-27T20:55:05.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.351+0000 7f6689d61640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66840721b0 con 0x7f6684152b30 2023-11-27T20:55:05.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.351+0000 7f6689d61640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6684158ef0 con 0x7f6684158aa0 2023-11-27T20:55:05.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.351+0000 7f604fc26640 1 -- start start 2023-11-27T20:55:05.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.352+0000 7f9d837fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d8415e350 0x7f9d840c6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:34196/0 (socket says 172.21.15.88:34196) 2023-11-27T20:55:05.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.352+0000 7f9d837fe640 1 -- 172.21.15.88:0/1681823 learned_addr learned my addr 172.21.15.88:0/1681823 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:05.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.352+0000 7f9d83fff640 1 --2- 172.21.15.88:0/1681823 >> v2:172.21.15.88:3300/0 conn(0x7f9d84157890 0x7f9d84161620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.352+0000 7f3e7e2c1640 1 --2- 172.21.15.88:0/2402103595 >> v2:172.21.15.88:3300/0 conn(0x7f3e780c4340 0x7f3e78168ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.352+0000 7f604fc26640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6048158b70 0x7f6048158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.352+0000 7f604fc26640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6048159520 con 0x7f60480c5950 2023-11-27T20:55:05.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.353+0000 7f604fc26640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6048155380 con 0x7f604814f850 2023-11-27T20:55:05.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.353+0000 7f604fc26640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6048072540 con 0x7f6048158b70 2023-11-27T20:55:05.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.353+0000 7f2166ffd640 1 -- 172.21.15.88:0/1726990737 >> v2:172.21.15.167:3300/0 conn(0x7f216815e370 msgr2=0x7f21680c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:05.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.353+0000 7f2166ffd640 1 --2- 172.21.15.88:0/1726990737 >> v2:172.21.15.167:3300/0 conn(0x7f216815e370 0x7f21680c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.353+0000 7fa3621c8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa3540e3760 0x7fa35404be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.353+0000 7f2166ffd640 1 -- 172.21.15.88:0/1726990737 >> v1:172.21.15.88:6789/0 conn(0x7f2168157b30 legacy=0x7f21680c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:05.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.353+0000 7f2166ffd640 1 -- 172.21.15.88:0/1726990737 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2168071240 con 0x7f2168070a00 2023-11-27T20:55:05.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.353+0000 7fa3621c8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa3540e3760 0x7fa35404be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:41212/0 (socket says 172.21.15.88:41212) 2023-11-27T20:55:05.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.354+0000 7fa3621c8640 1 -- 172.21.15.88:0/1856600061 learned_addr learned my addr 172.21.15.88:0/1856600061 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:05.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.354+0000 7f6682ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6684158aa0 0x7f6684071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.354+0000 7f7742700640 1 Processor -- start 2023-11-27T20:55:05.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.354+0000 7f7742700640 1 -- start start 2023-11-27T20:55:05.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.355+0000 7f2935ad3640 1 Processor -- start 2023-11-27T20:55:05.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.355+0000 7f2935ad3640 1 -- start start 2023-11-27T20:55:05.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.355+0000 7f6682ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6684158aa0 0x7f6684071c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:34204/0 (socket says 172.21.15.88:34204) 2023-11-27T20:55:05.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.355+0000 7f7742700640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f773c14fcc0 0x7f773c0c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.355+0000 7f7742700640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f773c0c6250 0x7f773c155980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.355+0000 7f7742700640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f773c0c68b0 con 0x7f773c0bff30 2023-11-27T20:55:05.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.355+0000 7f7742700640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f773c0c75e0 con 0x7f773c14fcc0 2023-11-27T20:55:05.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.355+0000 7f7742700640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773c0c1970 con 0x7f773c0c6250 2023-11-27T20:55:05.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.355+0000 7f6682ffd640 1 -- 172.21.15.88:0/3895947149 learned_addr learned my addr 172.21.15.88:0/3895947149 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:05.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.355+0000 7f2935ad3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f293014fa40 0x7f29300c2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.356+0000 7f2935ad3640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2930155a80 con 0x7f293014fe20 2023-11-27T20:55:05.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.356+0000 7f2935ad3640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2930155d60 con 0x7f293006ba10 2023-11-27T20:55:05.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.356+0000 7f2935ad3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2930155890 con 0x7f293014fa40 2023-11-27T20:55:05.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.356+0000 7f9d83fff640 1 -- 172.21.15.88:0/1681823 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d8415e350 msgr2=0x7f9d840c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:05.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.356+0000 7f9d83fff640 1 --2- 172.21.15.88:0/1681823 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d8415e350 0x7f9d840c6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.356+0000 7f9d83fff640 1 -- 172.21.15.88:0/1681823 >> v1:172.21.15.88:6789/0 conn(0x7f9d840714e0 legacy=0x7f9d84070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:05.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.356+0000 7f9d83fff640 1 -- 172.21.15.88:0/1681823 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8415dec0 con 0x7f9d84157890 2023-11-27T20:55:05.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.358+0000 7fa3621c8640 1 -- 172.21.15.88:0/1856600061 >> v1:172.21.15.167:6789/0 conn(0x7fa3540dd380 legacy=0x7fa354046420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:05.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.358+0000 7fa3621c8640 1 -- 172.21.15.88:0/1856600061 >> v1:172.21.15.88:6789/0 conn(0x7fa35404ba20 legacy=0x7fa3540e3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:05.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.358+0000 7fa3621c8640 1 -- 172.21.15.88:0/1856600061 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3540dd760 con 0x7fa3540e3760 2023-11-27T20:55:05.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.359+0000 7f6682ffd640 1 -- 172.21.15.88:0/3895947149 >> v2:172.21.15.167:3300/0 conn(0x7f6684152b30 msgr2=0x7f6684156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:05.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.359+0000 7f6682ffd640 1 --2- 172.21.15.88:0/3895947149 >> v2:172.21.15.167:3300/0 conn(0x7f6684152b30 0x7f6684156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.359+0000 7f6682ffd640 1 -- 172.21.15.88:0/3895947149 >> v1:172.21.15.88:6789/0 conn(0x7f668406d0e0 legacy=0x7f66840c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:05.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.359+0000 7f6682ffd640 1 -- 172.21.15.88:0/3895947149 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66840723b0 con 0x7f6684158aa0 2023-11-27T20:55:05.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.359+0000 7f2166ffd640 1 --2- 172.21.15.88:0/1726990737 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2168070a00 0x7f2168160ea0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2160009e50 tx=0x7f216002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f874454dd116c389 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.359+0000 7f3e7d2bf640 1 -- 172.21.15.88:0/2402103595 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621908020 0 0) 0x7f3e78168450 con 0x7f3e78070a00 2023-11-27T20:55:05.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.359+0000 7f3e7d2bf640 1 -- 172.21.15.88:0/2402103595 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e64003520 con 0x7f3e78070a00 2023-11-27T20:55:05.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.359+0000 7f3e7e2c1640 1 -- 172.21.15.88:0/2402103595 >> v1:172.21.15.167:6789/0 conn(0x7f3e78070a00 legacy=0x7f3e7806ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.359+0000 7f3e7e2c1640 1 -- 172.21.15.88:0/2402103595 >> v1:172.21.15.88:6789/0 conn(0x7f3e780c4720 legacy=0x7f3e780c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:05.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.359+0000 7f3e7e2c1640 1 -- 172.21.15.88:0/2402103595 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e780c5ec0 con 0x7f3e780c4340 2023-11-27T20:55:05.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.362+0000 7fa3621c8640 1 --2- 172.21.15.88:0/1856600061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3540e3760 0x7fa35404be40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa35c0694c0 tx=0x7fa35c0a6250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cdacff7afad1979 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.363+0000 7f9d83fff640 1 --2- 172.21.15.88:0/1681823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d84157890 0x7f9d84161620 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9d740097a0 tx=0x7f9d7402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb40bedcc269ef8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.364+0000 7f3e7e2c1640 1 --2- 172.21.15.88:0/2402103595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e780c4340 0x7f3e78168ef0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3e740097a0 tx=0x7f3e7402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e69636b3856d690c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.364+0000 7f604e1c3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6048158b70 0x7f6048158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.365+0000 7f292ffff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f293006ba10 0x7f2930159260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:59046/0 (socket says 172.21.15.88:59046) 2023-11-27T20:55:05.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.365+0000 7f292ffff640 1 -- 172.21.15.88:0/2410958273 learned_addr learned my addr 172.21.15.88:0/2410958273 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:55:05.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.366+0000 7f6682ffd640 1 --2- 172.21.15.88:0/3895947149 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6684158aa0 0x7f6684071c70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f667400aa10 tx=0x7f667402cdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aede1c9734d84935 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.367+0000 7f604e1c3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6048158b70 0x7f6048158fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50522/0 (socket says 172.21.15.88:50522) 2023-11-27T20:55:05.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.367+0000 7f604e1c3640 1 -- 172.21.15.88:0/2106677057 learned_addr learned my addr 172.21.15.88:0/2106677057 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:05.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.373+0000 7f604e1c3640 1 -- 172.21.15.88:0/2106677057 >> v1:172.21.15.167:6789/0 conn(0x7f604814f850 legacy=0x7f6048071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.373+0000 7f604e1c3640 1 -- 172.21.15.88:0/2106677057 >> v1:172.21.15.88:6789/0 conn(0x7f60480c5950 legacy=0x7f60480710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:05.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.373+0000 7f604e1c3640 1 -- 172.21.15.88:0/2106677057 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6048155640 con 0x7f6048158b70 2023-11-27T20:55:05.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.374+0000 7f773bfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f773c14fcc0 0x7f773c0c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.374+0000 7f21667fc640 1 -- 172.21.15.88:0/1726990737 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216002cb00 con 0x7f2168070a00 2023-11-27T20:55:05.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.374+0000 7f21667fc640 1 -- 172.21.15.88:0/1726990737 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216002cc60 con 0x7f2168070a00 2023-11-27T20:55:05.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.374+0000 7f21667fc640 1 -- 172.21.15.88:0/1726990737 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21600343f0 con 0x7f2168070a00 2023-11-27T20:55:05.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.374+0000 7f7740c9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f773c0c6250 0x7f773c155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.375+0000 7f292f7fe640 1 --2- 172.21.15.88:0/2410958273 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f293014fa40 0x7f29300c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.375+0000 7f7740c9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f773c0c6250 0x7f773c155980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:34212/0 (socket says 172.21.15.88:34212) 2023-11-27T20:55:05.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.375+0000 7f7740c9d640 1 -- 172.21.15.88:0/436372014 learned_addr learned my addr 172.21.15.88:0/436372014 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:05.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.375+0000 7f216dd1d640 1 -- 172.21.15.88:0/1726990737 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2168070a00 msgr2=0x7f2168160ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.375+0000 7f216dd1d640 1 --2- 172.21.15.88:0/1726990737 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2168070a00 0x7f2168160ea0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2160009e50 tx=0x7f216002bf60 comp rx=0 tx=0).stop 2023-11-27T20:55:05.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.375+0000 7f216dd1d640 1 -- 172.21.15.88:0/1726990737 shutdown_connections 2023-11-27T20:55:05.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.375+0000 7f216dd1d640 1 --2- 172.21.15.88:0/1726990737 >> v2:172.21.15.167:3300/0 conn(0x7f216815e370 0x7f21680c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.375+0000 7f216dd1d640 1 --2- 172.21.15.88:0/1726990737 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2168070a00 0x7f2168160ea0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.375+0000 7f216dd1d640 1 -- 172.21.15.88:0/1726990737 >> 172.21.15.88:0/1726990737 conn(0x7f216806c5f0 msgr2=0x7f216806c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:05.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.375+0000 7f216dd1d640 1 -- 172.21.15.88:0/1726990737 shutdown_connections 2023-11-27T20:55:05.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.375+0000 7f216dd1d640 1 -- 172.21.15.88:0/1726990737 wait complete. 2023-11-27T20:55:05.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.376+0000 7f66827fc640 1 -- 172.21.15.88:0/3895947149 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667402db80 con 0x7f6684158aa0 2023-11-27T20:55:05.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.376+0000 7f66827fc640 1 -- 172.21.15.88:0/3895947149 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667402dce0 con 0x7f6684158aa0 2023-11-27T20:55:05.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.376+0000 7f66827fc640 1 -- 172.21.15.88:0/3895947149 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6674035660 con 0x7f6684158aa0 2023-11-27T20:55:05.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.377+0000 7f216dd1d640 1 Processor -- start 2023-11-27T20:55:05.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.377+0000 7f216dd1d640 1 -- start start 2023-11-27T20:55:05.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.377+0000 7f6689d61640 1 -- 172.21.15.88:0/3895947149 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6684158aa0 msgr2=0x7f6684071c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.377+0000 7f6689d61640 1 --2- 172.21.15.88:0/3895947149 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6684158aa0 0x7f6684071c70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f667400aa10 tx=0x7f667402cdd0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.377+0000 7fa3609c5640 1 -- 172.21.15.88:0/1856600061 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c0ae640 con 0x7fa3540e3760 2023-11-27T20:55:05.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.377+0000 7fa3609c5640 1 -- 172.21.15.88:0/1856600061 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35c0ae7a0 con 0x7fa3540e3760 2023-11-27T20:55:05.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.377+0000 7fa3609c5640 1 -- 172.21.15.88:0/1856600061 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c0aebd0 con 0x7fa3540e3760 2023-11-27T20:55:05.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.377+0000 7f6689d61640 1 -- 172.21.15.88:0/3895947149 shutdown_connections 2023-11-27T20:55:05.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.377+0000 7f6689d61640 1 --2- 172.21.15.88:0/3895947149 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6684158aa0 0x7f6684071c70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.377+0000 7f6689d61640 1 --2- 172.21.15.88:0/3895947149 >> v2:172.21.15.167:3300/0 conn(0x7f6684152b30 0x7f6684156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.377+0000 7f6689d61640 1 -- 172.21.15.88:0/3895947149 >> 172.21.15.88:0/3895947149 conn(0x7f668406c5f0 msgr2=0x7f668406c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:05.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.378+0000 7f216dd1d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2168070a00 0x7f21681f42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.378+0000 7f216dd1d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2168157b30 0x7f2168161680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.378+0000 7f216dd1d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f216815e370 0x7f216815fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.378+0000 7f216dd1d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216814e7c0 con 0x7f216815e370 2023-11-27T20:55:05.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.378+0000 7f216dd1d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2168161bc0 con 0x7f2168157b30 2023-11-27T20:55:05.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.378+0000 7f216dd1d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216815ff50 con 0x7f2168070a00 2023-11-27T20:55:05.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.378+0000 7f6689d61640 1 -- 172.21.15.88:0/3895947149 shutdown_connections 2023-11-27T20:55:05.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.378+0000 7f6689d61640 1 -- 172.21.15.88:0/3895947149 wait complete. 2023-11-27T20:55:05.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.378+0000 7f604e1c3640 1 --2- 172.21.15.88:0/2106677057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6048158b70 0x7f6048158fe0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f604000c770 tx=0x7f604002cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca4e1bb872f538 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.378+0000 7fa3629c9640 1 -- 172.21.15.88:0/1856600061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3540e3760 msgr2=0x7fa35404be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.378+0000 7fa3629c9640 1 --2- 172.21.15.88:0/1856600061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3540e3760 0x7fa35404be40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa35c0694c0 tx=0x7fa35c0a6250 comp rx=0 tx=0).stop 2023-11-27T20:55:05.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.378+0000 7fa3629c9640 1 -- 172.21.15.88:0/1856600061 shutdown_connections 2023-11-27T20:55:05.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.378+0000 7fa3629c9640 1 --2- 172.21.15.88:0/1856600061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3540e3760 0x7fa35404be40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.378+0000 7fa3629c9640 1 -- 172.21.15.88:0/1856600061 >> 172.21.15.88:0/1856600061 conn(0x7fa354050140 msgr2=0x7fa354050550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:05.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.378+0000 7fa3629c9640 1 -- 172.21.15.88:0/1856600061 shutdown_connections 2023-11-27T20:55:05.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.378+0000 7fa3629c9640 1 -- 172.21.15.88:0/1856600061 wait complete. 2023-11-27T20:55:05.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.379+0000 7f7740c9d640 1 -- 172.21.15.88:0/436372014 >> v2:172.21.15.88:3300/0 conn(0x7f773c14fcc0 msgr2=0x7f773c0c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:05.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.379+0000 7f7740c9d640 1 --2- 172.21.15.88:0/436372014 >> v2:172.21.15.88:3300/0 conn(0x7f773c14fcc0 0x7f773c0c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.379+0000 7f7740c9d640 1 -- 172.21.15.88:0/436372014 >> v1:172.21.15.88:6789/0 conn(0x7f773c0bff30 legacy=0x7f773c0c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:05.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.379+0000 7f7740c9d640 1 -- 172.21.15.88:0/436372014 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773c0c1c10 con 0x7f773c0c6250 2023-11-27T20:55:05.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.379+0000 7fa3629c9640 1 Processor -- start 2023-11-27T20:55:05.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.380+0000 7fa3629c9640 1 -- start start 2023-11-27T20:55:05.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.380+0000 7f6689d61640 1 Processor -- start 2023-11-27T20:55:05.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.380+0000 7f6689d61640 1 -- start start 2023-11-27T20:55:05.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.380+0000 7fa3629c9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa35404ba20 0x7fa3540e17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.380+0000 7fa3629c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3540dd380 0x7fa3540ddfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.380+0000 7fa3629c9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3540e3760 0x7fa3540d9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.380+0000 7fa3629c9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3540e03a0 con 0x7fa3540e3760 2023-11-27T20:55:05.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.380+0000 7fa3629c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35417a030 con 0x7fa3540dd380 2023-11-27T20:55:05.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.380+0000 7fa3629c9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa354179a70 con 0x7fa35404ba20 2023-11-27T20:55:05.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.381+0000 7f6689d61640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f668406d0e0 0x7f6684150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.381+0000 7f6689d61640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6684152b30 0x7f668414a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.381+0000 7f6689d61640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6684158aa0 0x7f66841ea480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.381+0000 7f6689d61640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66841ee320 con 0x7f6684158aa0 2023-11-27T20:55:05.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.381+0000 7f6689d61640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6684150700 con 0x7f668406d0e0 2023-11-27T20:55:05.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.381+0000 7f6689d61640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66841509e0 con 0x7f6684152b30 2023-11-27T20:55:05.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.381+0000 7f292f7fe640 1 -- 172.21.15.88:0/2410958273 >> v1:172.21.15.167:6789/0 conn(0x7f293006ba10 legacy=0x7f2930159260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.381+0000 7f292f7fe640 1 -- 172.21.15.88:0/2410958273 >> v1:172.21.15.88:6789/0 conn(0x7f293014fe20 legacy=0x7f293006acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:05.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.381+0000 7f292f7fe640 1 -- 172.21.15.88:0/2410958273 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2930156040 con 0x7f293014fa40 2023-11-27T20:55:05.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.382+0000 7f2166ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2168157b30 0x7f2168161680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.382+0000 7f2166ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2168157b30 0x7f2168161680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:41230/0 (socket says 172.21.15.88:41230) 2023-11-27T20:55:05.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.382+0000 7f2166ffd640 1 -- 172.21.15.88:0/1557120976 learned_addr learned my addr 172.21.15.88:0/1557120976 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:05.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.383+0000 7fa3611c6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3540dd380 0x7fa3540ddfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.384+0000 7f7740c9d640 1 --2- 172.21.15.88:0/436372014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f773c0c6250 0x7f773c155980 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f773400d150 tx=0x7f773402e0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf8ba7765512dd6c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.385+0000 7f292f7fe640 1 --2- 172.21.15.88:0/2410958273 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f293014fa40 0x7f29300c2820 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f29200097d0 tx=0x7f292002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86af23748dc732df server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.386+0000 7f2166ffd640 1 -- 172.21.15.88:0/1557120976 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2168070a00 msgr2=0x7f21681f42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.386+0000 7f2166ffd640 1 --2- 172.21.15.88:0/1557120976 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2168070a00 0x7f21681f42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.386+0000 7f2166ffd640 1 -- 172.21.15.88:0/1557120976 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f216815e370 msgr2=0x7f216815fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.386+0000 7f2166ffd640 1 --2- 172.21.15.88:0/1557120976 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f216815e370 0x7f216815fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.386+0000 7f2166ffd640 1 -- 172.21.15.88:0/1557120976 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2160009b30 con 0x7f2168157b30 2023-11-27T20:55:05.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.386+0000 7fa3611c6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3540dd380 0x7fa3540ddfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:41246/0 (socket says 172.21.15.88:41246) 2023-11-27T20:55:05.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.386+0000 7fa3611c6640 1 -- 172.21.15.88:0/3652330313 learned_addr learned my addr 172.21.15.88:0/3652330313 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:05.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.387+0000 7f66837fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f668406d0e0 0x7f6684150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.388+0000 7fa3619c7640 1 --2- 172.21.15.88:0/3652330313 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa35404ba20 0x7fa3540e17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.388+0000 7f3e7d2bf640 1 -- 172.21.15.88:0/2402103595 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e74030610 con 0x7f3e780c4340 2023-11-27T20:55:05.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.388+0000 7f3e7d2bf640 1 -- 172.21.15.88:0/2402103595 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e74030770 con 0x7f3e780c4340 2023-11-27T20:55:05.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.388+0000 7f3e7d2bf640 1 -- 172.21.15.88:0/2402103595 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e74030b00 con 0x7f3e780c4340 2023-11-27T20:55:05.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.388+0000 7f9d82ffd640 1 -- 172.21.15.88:0/1681823 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d74031830 con 0x7f9d84157890 2023-11-27T20:55:05.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.388+0000 7f9d82ffd640 1 -- 172.21.15.88:0/1681823 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d74031990 con 0x7f9d84157890 2023-11-27T20:55:05.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.388+0000 7f9d82ffd640 1 -- 172.21.15.88:0/1681823 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d74031d20 con 0x7f9d84157890 2023-11-27T20:55:05.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.388+0000 7f3e80525640 1 -- 172.21.15.88:0/2402103595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e780c4340 msgr2=0x7f3e78168ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.388+0000 7f66837fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f668406d0e0 0x7f6684150120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:41258/0 (socket says 172.21.15.88:41258) 2023-11-27T20:55:05.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.389+0000 7f66837fe640 1 -- 172.21.15.88:0/3094279757 learned_addr learned my addr 172.21.15.88:0/3094279757 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:05.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.388+0000 7f3e80525640 1 --2- 172.21.15.88:0/2402103595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e780c4340 0x7f3e78168ef0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3e740097a0 tx=0x7f3e7402b960 comp rx=0 tx=0).stop 2023-11-27T20:55:05.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.389+0000 7f3e80525640 1 -- 172.21.15.88:0/2402103595 shutdown_connections 2023-11-27T20:55:05.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.389+0000 7f3e80525640 1 --2- 172.21.15.88:0/2402103595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e780c4340 0x7f3e78168ef0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.389+0000 7f3e80525640 1 -- 172.21.15.88:0/2402103595 >> 172.21.15.88:0/2402103595 conn(0x7f3e7806c5f0 msgr2=0x7f3e7806c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.389+0000 7f3e80525640 1 -- 172.21.15.88:0/2402103595 shutdown_connections 2023-11-27T20:55:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.389+0000 7f3e80525640 1 -- 172.21.15.88:0/2402103595 wait complete. 2023-11-27T20:55:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.389+0000 7f9d893b3640 1 -- 172.21.15.88:0/1681823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d84157890 msgr2=0x7f9d84161620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.389+0000 7f9d893b3640 1 --2- 172.21.15.88:0/1681823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d84157890 0x7f9d84161620 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9d740097a0 tx=0x7f9d7402b8d0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.389+0000 7f9d893b3640 1 -- 172.21.15.88:0/1681823 shutdown_connections 2023-11-27T20:55:05.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.389+0000 7f9d893b3640 1 --2- 172.21.15.88:0/1681823 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d8415e350 0x7f9d840c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.389+0000 7f9d893b3640 1 --2- 172.21.15.88:0/1681823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d84157890 0x7f9d84161620 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.389+0000 7f9d893b3640 1 -- 172.21.15.88:0/1681823 >> 172.21.15.88:0/1681823 conn(0x7f9d84061640 msgr2=0x7f9d8406a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:05.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.389+0000 7f9d893b3640 1 -- 172.21.15.88:0/1681823 shutdown_connections 2023-11-27T20:55:05.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.389+0000 7f9d893b3640 1 -- 172.21.15.88:0/1681823 wait complete. 2023-11-27T20:55:05.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.390+0000 7f3e80525640 1 Processor -- start 2023-11-27T20:55:05.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.390+0000 7f3e80525640 1 -- start start 2023-11-27T20:55:05.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.390+0000 7f9d893b3640 1 Processor -- start 2023-11-27T20:55:05.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.390+0000 7f9d893b3640 1 -- start start 2023-11-27T20:55:05.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.391+0000 7f3e80525640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e78070a00 0x7f3e781613e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.391+0000 7f3e80525640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e780c4340 0x7f3e780c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.391+0000 7f3e80525640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e780c4720 0x7f3e78157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.391+0000 7f3e80525640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e780cb220 con 0x7f3e780c4340 2023-11-27T20:55:05.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.391+0000 7f3e80525640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7815f4e0 con 0x7f3e780c4720 2023-11-27T20:55:05.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.391+0000 7f3e80525640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7815b910 con 0x7f3e78070a00 2023-11-27T20:55:05.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.391+0000 7f9d893b3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d840714e0 0x7f9d841f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.391+0000 7f9d893b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d84157890 0x7f9d840c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.391+0000 7f9d893b3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d8415e350 0x7f9d8415e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.391+0000 7f9d893b3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8415fe10 con 0x7f9d8415e350 2023-11-27T20:55:05.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.391+0000 7f9d893b3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d841f72a0 con 0x7f9d84157890 2023-11-27T20:55:05.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.391+0000 7f9d893b3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d84161300 con 0x7f9d840714e0 2023-11-27T20:55:05.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.392+0000 7f292e7fc640 1 -- 172.21.15.88:0/2410958273 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2920031890 con 0x7f293014fa40 2023-11-27T20:55:05.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.393+0000 7fa3611c6640 1 -- 172.21.15.88:0/3652330313 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa35404ba20 msgr2=0x7fa3540e17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.393+0000 7fa3611c6640 1 --2- 172.21.15.88:0/3652330313 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa35404ba20 0x7fa3540e17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.393+0000 7fa3611c6640 1 -- 172.21.15.88:0/3652330313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3540e3760 msgr2=0x7fa3540d9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.393+0000 7fa3611c6640 1 --2- 172.21.15.88:0/3652330313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3540e3760 0x7fa3540d9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.393+0000 7fa3611c6640 1 -- 172.21.15.88:0/3652330313 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35c069d80 con 0x7fa3540dd380 2023-11-27T20:55:05.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.396+0000 7f2166ffd640 1 --2- 172.21.15.88:0/1557120976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2168157b30 0x7f2168161680 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2160009e50 tx=0x7f2160004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.398+0000 7f292e7fc640 1 -- 172.21.15.88:0/2410958273 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29200319f0 con 0x7f293014fa40 2023-11-27T20:55:05.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.398+0000 7f292e7fc640 1 -- 172.21.15.88:0/2410958273 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2920031d80 con 0x7f293014fa40 2023-11-27T20:55:05.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.399+0000 7f2935ad3640 1 -- 172.21.15.88:0/2410958273 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f293014fa40 msgr2=0x7f29300c2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.399+0000 7f2935ad3640 1 --2- 172.21.15.88:0/2410958273 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f293014fa40 0x7f29300c2820 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f29200097d0 tx=0x7f292002b930 comp rx=0 tx=0).stop 2023-11-27T20:55:05.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.399+0000 7f2935ad3640 1 -- 172.21.15.88:0/2410958273 shutdown_connections 2023-11-27T20:55:05.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.399+0000 7f2935ad3640 1 --2- 172.21.15.88:0/2410958273 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f293014fa40 0x7f29300c2820 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.399+0000 7f2935ad3640 1 -- 172.21.15.88:0/2410958273 >> 172.21.15.88:0/2410958273 conn(0x7f29300712f0 msgr2=0x7f29300716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:05.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.399+0000 7f2935ad3640 1 -- 172.21.15.88:0/2410958273 shutdown_connections 2023-11-27T20:55:05.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.399+0000 7f2935ad3640 1 -- 172.21.15.88:0/2410958273 wait complete. 2023-11-27T20:55:05.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.400+0000 7f6682ffd640 1 --2- 172.21.15.88:0/3094279757 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6684152b30 0x7f668414a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.400+0000 7f66837fe640 1 -- 172.21.15.88:0/3094279757 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6684152b30 msgr2=0x7f668414a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.400+0000 7f66837fe640 1 --2- 172.21.15.88:0/3094279757 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6684152b30 0x7f668414a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.400+0000 7f66837fe640 1 -- 172.21.15.88:0/3094279757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6684158aa0 msgr2=0x7f66841ea480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.400+0000 7f66837fe640 1 --2- 172.21.15.88:0/3094279757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6684158aa0 0x7f66841ea480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.400+0000 7f66837fe640 1 -- 172.21.15.88:0/3094279757 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667400a670 con 0x7f668406d0e0 2023-11-27T20:55:05.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.401+0000 7f2935ad3640 1 Processor -- start 2023-11-27T20:55:05.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.401+0000 7fa3611c6640 1 --2- 172.21.15.88:0/3652330313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3540dd380 0x7fa3540ddfa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa34c00b410 tx=0x7fa34c00b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.401+0000 7f2935ad3640 1 -- start start 2023-11-27T20:55:05.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.402+0000 7f2935ad3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f293006ba10 0x7f2930150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.402+0000 7f2935ad3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f293014fa40 0x7f29300cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.402+0000 7f2935ad3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f293014fe20 0x7f29301ed9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.402+0000 7f2935ad3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29300ca340 con 0x7f293014fa40 2023-11-27T20:55:05.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.402+0000 7f2935ad3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2930150a30 con 0x7f293006ba10 2023-11-27T20:55:05.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.402+0000 7f2935ad3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29301ed210 con 0x7f293014fe20 2023-11-27T20:55:05.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.402+0000 7f66837fe640 1 --2- 172.21.15.88:0/3094279757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f668406d0e0 0x7f6684150120 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f667800b4a0 tx=0x7f667800b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.405+0000 7f604c9c0640 1 -- 172.21.15.88:0/2106677057 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604002e690 con 0x7f6048158b70 2023-11-27T20:55:05.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.405+0000 7f604c9c0640 1 -- 172.21.15.88:0/2106677057 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604002e7f0 con 0x7f6048158b70 2023-11-27T20:55:05.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.405+0000 7f604c9c0640 1 -- 172.21.15.88:0/2106677057 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604002eb80 con 0x7f6048158b70 2023-11-27T20:55:05.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.406+0000 7f9d837fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d84157890 0x7f9d840c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.406+0000 7f604fc26640 1 -- 172.21.15.88:0/2106677057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6048158b70 msgr2=0x7f6048158fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.406+0000 7f604fc26640 1 --2- 172.21.15.88:0/2106677057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6048158b70 0x7f6048158fe0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f604000c770 tx=0x7f604002cae0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.406+0000 7f604fc26640 1 -- 172.21.15.88:0/2106677057 shutdown_connections 2023-11-27T20:55:05.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.406+0000 7f604fc26640 1 --2- 172.21.15.88:0/2106677057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6048158b70 0x7f6048158fe0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.406+0000 7f604fc26640 1 -- 172.21.15.88:0/2106677057 >> 172.21.15.88:0/2106677057 conn(0x7f604806d330 msgr2=0x7f604806a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:05.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.406+0000 7f604fc26640 1 -- 172.21.15.88:0/2106677057 shutdown_connections 2023-11-27T20:55:05.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.406+0000 7f604fc26640 1 -- 172.21.15.88:0/2106677057 wait complete. 2023-11-27T20:55:05.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.407+0000 7f292f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f293006ba10 0x7f2930150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.407+0000 7f9d837fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d84157890 0x7f9d840c6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:41270/0 (socket says 172.21.15.88:41270) 2023-11-27T20:55:05.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.407+0000 7f9d837fe640 1 -- 172.21.15.88:0/3456035891 learned_addr learned my addr 172.21.15.88:0/3456035891 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:05.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.407+0000 7f604fc26640 1 Processor -- start 2023-11-27T20:55:05.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.407+0000 7f604fc26640 1 -- start start 2023-11-27T20:55:05.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.408+0000 7f3e7eac2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e780c4720 0x7f3e78157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.408+0000 7f3e7eac2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e780c4720 0x7f3e78157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:41262/0 (socket says 172.21.15.88:41262) 2023-11-27T20:55:05.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.408+0000 7f3e7eac2640 1 -- 172.21.15.88:0/3246442886 learned_addr learned my addr 172.21.15.88:0/3246442886 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:05.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.408+0000 7f604fc26640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60480c5950 0x7f6048153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.408+0000 7f604fc26640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f604814f850 0x7f60481ede70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.408+0000 7f292f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f293006ba10 0x7f2930150240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:41282/0 (socket says 172.21.15.88:41282) 2023-11-27T20:55:05.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.408+0000 7f292f7fe640 1 -- 172.21.15.88:0/3061497942 learned_addr learned my addr 172.21.15.88:0/3061497942 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:05.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.408+0000 7f604fc26640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6048158b70 0x7f60481412f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.408+0000 7f604fc26640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60481de790 con 0x7f60480c5950 2023-11-27T20:55:05.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.408+0000 7f604fc26640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60480c79b0 con 0x7f6048158b70 2023-11-27T20:55:05.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.408+0000 7f604fc26640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60481de9c0 con 0x7f604814f850 2023-11-27T20:55:05.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.413+0000 7f3e7dac0640 1 --2- 172.21.15.88:0/3246442886 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e780c4340 0x7f3e780c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.414+0000 7f9d88bb2640 1 --2- 172.21.15.88:0/3456035891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d8415e350 0x7f9d8415e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.417+0000 7f3e7eac2640 1 -- 172.21.15.88:0/3246442886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e78070a00 msgr2=0x7f3e781613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.417+0000 7f3e7eac2640 1 --2- 172.21.15.88:0/3246442886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e78070a00 0x7f3e781613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.417+0000 7f3e7eac2640 1 -- 172.21.15.88:0/3246442886 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e780c4340 msgr2=0x7f3e780c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.417+0000 7f3e7eac2640 1 --2- 172.21.15.88:0/3246442886 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e780c4340 0x7f3e780c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.417+0000 7f3e7eac2640 1 -- 172.21.15.88:0/3246442886 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e74009400 con 0x7f3e780c4720 2023-11-27T20:55:05.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.420+0000 7f3e7eac2640 1 --2- 172.21.15.88:0/3246442886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e780c4720 0x7f3e78157770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800c430 tx=0x7f3e6800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.422+0000 7f9d837fe640 1 -- 172.21.15.88:0/3456035891 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d840714e0 msgr2=0x7f9d841f6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.422+0000 7f9d837fe640 1 --2- 172.21.15.88:0/3456035891 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d840714e0 0x7f9d841f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.423+0000 7f9d837fe640 1 -- 172.21.15.88:0/3456035891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d8415e350 msgr2=0x7f9d8415e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.423+0000 7f9d837fe640 1 --2- 172.21.15.88:0/3456035891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d8415e350 0x7f9d8415e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.423+0000 7f9d837fe640 1 -- 172.21.15.88:0/3456035891 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d74009400 con 0x7f9d84157890 2023-11-27T20:55:05.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.424+0000 7f773affd640 1 -- 172.21.15.88:0/436372014 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773402ee90 con 0x7f773c0c6250 2023-11-27T20:55:05.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.424+0000 7f773affd640 1 -- 172.21.15.88:0/436372014 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7734032070 con 0x7f773c0c6250 2023-11-27T20:55:05.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.424+0000 7f773affd640 1 -- 172.21.15.88:0/436372014 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7734038620 con 0x7f773c0c6250 2023-11-27T20:55:05.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.425+0000 7f7742700640 1 -- 172.21.15.88:0/436372014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f773c0c6250 msgr2=0x7f773c155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.425+0000 7f7742700640 1 --2- 172.21.15.88:0/436372014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f773c0c6250 0x7f773c155980 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f773400d150 tx=0x7f773402e0e0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.425+0000 7f7742700640 1 -- 172.21.15.88:0/436372014 shutdown_connections 2023-11-27T20:55:05.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.425+0000 7f7742700640 1 --2- 172.21.15.88:0/436372014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f773c0c6250 0x7f773c155980 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.425+0000 7f7742700640 1 --2- 172.21.15.88:0/436372014 >> v2:172.21.15.88:3300/0 conn(0x7f773c14fcc0 0x7f773c0c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.425+0000 7f7742700640 1 -- 172.21.15.88:0/436372014 >> 172.21.15.88:0/436372014 conn(0x7f773c06d330 msgr2=0x7f773c06a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:05.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.425+0000 7f7742700640 1 -- 172.21.15.88:0/436372014 shutdown_connections 2023-11-27T20:55:05.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.425+0000 7f7742700640 1 -- 172.21.15.88:0/436372014 wait complete. 2023-11-27T20:55:05.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.426+0000 7f7742700640 1 Processor -- start 2023-11-27T20:55:05.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.426+0000 7f7742700640 1 -- start start 2023-11-27T20:55:05.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.426+0000 7f292f7fe640 1 -- 172.21.15.88:0/3061497942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f293014fe20 msgr2=0x7f29301ed9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.426+0000 7f292f7fe640 1 --2- 172.21.15.88:0/3061497942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f293014fe20 0x7f29301ed9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.426+0000 7f292f7fe640 1 -- 172.21.15.88:0/3061497942 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f293014fa40 msgr2=0x7f29300cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.426+0000 7f292f7fe640 1 --2- 172.21.15.88:0/3061497942 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f293014fa40 0x7f29300cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.426+0000 7f292f7fe640 1 -- 172.21.15.88:0/3061497942 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2920009400 con 0x7f293006ba10 2023-11-27T20:55:05.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.427+0000 7f7742700640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f773c0bff30 0x7f773c1548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.427+0000 7f7742700640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f773c0c6250 0x7f773c158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.427+0000 7f7742700640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f773c14fcc0 0x7f773c155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.427+0000 7f7742700640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773c1decc0 con 0x7f773c0c6250 2023-11-27T20:55:05.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.427+0000 7f7742700640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773c1588a0 con 0x7f773c0bff30 2023-11-27T20:55:05.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.427+0000 7f7742700640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773c155890 con 0x7f773c14fcc0 2023-11-27T20:55:05.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.430+0000 7f9d837fe640 1 --2- 172.21.15.88:0/3456035891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d84157890 0x7f9d840c6010 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800e840 tx=0x7f9d7800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.435+0000 7f666bfff640 1 -- 172.21.15.88:0/3094279757 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678010610 con 0x7f668406d0e0 2023-11-27T20:55:05.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.435+0000 7f666bfff640 1 -- 172.21.15.88:0/3094279757 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6678010770 con 0x7f668406d0e0 2023-11-27T20:55:05.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.435+0000 7f666bfff640 1 -- 172.21.15.88:0/3094279757 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678010b20 con 0x7f668406d0e0 2023-11-27T20:55:05.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.435+0000 7f6689d61640 1 -- 172.21.15.88:0/3094279757 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66841ed9f0 con 0x7f668406d0e0 2023-11-27T20:55:05.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.435+0000 7f6689d61640 1 -- 172.21.15.88:0/3094279757 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66841edfb0 con 0x7f668406d0e0 2023-11-27T20:55:05.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.435+0000 7f604e1c3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6048158b70 0x7f60481412f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.436+0000 7f292f7fe640 1 --2- 172.21.15.88:0/3061497942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f293006ba10 0x7f2930150240 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f29200098f0 tx=0x7f29200046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.436+0000 7f6689d61640 1 -- 172.21.15.88:0/3094279757 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6684072970 con 0x7f668406d0e0 2023-11-27T20:55:05.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.440+0000 7f214ffff640 1 -- 172.21.15.88:0/1557120976 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216003e450 con 0x7f2168157b30 2023-11-27T20:55:05.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.440+0000 7f214ffff640 1 -- 172.21.15.88:0/1557120976 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216003e5f0 con 0x7f2168157b30 2023-11-27T20:55:05.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.440+0000 7f214ffff640 1 -- 172.21.15.88:0/1557120976 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216003e9a0 con 0x7f2168157b30 2023-11-27T20:55:05.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.440+0000 7f216dd1d640 1 -- 172.21.15.88:0/1557120976 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216815ea70 con 0x7f2168157b30 2023-11-27T20:55:05.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.440+0000 7f216dd1d640 1 -- 172.21.15.88:0/1557120976 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216815ecc0 con 0x7f2168157b30 2023-11-27T20:55:05.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.441+0000 7f216dd1d640 1 -- 172.21.15.88:0/1557120976 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f216815de50 con 0x7f2168157b30 2023-11-27T20:55:05.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.441+0000 7f773bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f773c0bff30 0x7f773c1548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.442+0000 7f604e1c3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6048158b70 0x7f60481412f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:41286/0 (socket says 172.21.15.88:41286) 2023-11-27T20:55:05.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.442+0000 7f604e1c3640 1 -- 172.21.15.88:0/2370200976 learned_addr learned my addr 172.21.15.88:0/2370200976 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:05.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.443+0000 7f773bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f773c0bff30 0x7f773c1548e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:41296/0 (socket says 172.21.15.88:41296) 2023-11-27T20:55:05.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.443+0000 7f773bfff640 1 -- 172.21.15.88:0/3129611542 learned_addr learned my addr 172.21.15.88:0/3129611542 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:05.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.444+0000 7fa3527fc640 1 -- 172.21.15.88:0/3652330313 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c011830 con 0x7fa3540dd380 2023-11-27T20:55:05.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.444+0000 7fa3527fc640 1 -- 172.21.15.88:0/3652330313 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34c011990 con 0x7fa3540dd380 2023-11-27T20:55:05.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.444+0000 7fa3629c9640 1 -- 172.21.15.88:0/3652330313 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa354179d50 con 0x7fa3540dd380 2023-11-27T20:55:05.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.444+0000 7fa3527fc640 1 -- 172.21.15.88:0/3652330313 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c011d40 con 0x7fa3540dd380 2023-11-27T20:55:05.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.445+0000 7fa3629c9640 1 -- 172.21.15.88:0/3652330313 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3540e0fd0 con 0x7fa3540dd380 2023-11-27T20:55:05.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.445+0000 7fa33ffff640 1 -- 172.21.15.88:0/3652330313 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa354045660 con 0x7fa3540dd380 2023-11-27T20:55:05.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.447+0000 7f604e1c3640 1 -- 172.21.15.88:0/2370200976 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f604814f850 msgr2=0x7f60481ede70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.447+0000 7f604e1c3640 1 --2- 172.21.15.88:0/2370200976 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f604814f850 0x7f60481ede70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.447+0000 7f604e1c3640 1 -- 172.21.15.88:0/2370200976 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60480c5950 msgr2=0x7f6048153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.447+0000 7f604e1c3640 1 --2- 172.21.15.88:0/2370200976 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60480c5950 0x7f6048153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.447+0000 7f604e1c3640 1 -- 172.21.15.88:0/2370200976 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604000c3d0 con 0x7f6048158b70 2023-11-27T20:55:05.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.454+0000 7f773bfff640 1 -- 172.21.15.88:0/3129611542 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f773c14fcc0 msgr2=0x7f773c155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.454+0000 7f773bfff640 1 --2- 172.21.15.88:0/3129611542 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f773c14fcc0 0x7f773c155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.454+0000 7f773bfff640 1 -- 172.21.15.88:0/3129611542 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f773c0c6250 msgr2=0x7f773c158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.454+0000 7f773bfff640 1 --2- 172.21.15.88:0/3129611542 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f773c0c6250 0x7f773c158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.455+0000 7f773bfff640 1 -- 172.21.15.88:0/3129611542 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773400bd40 con 0x7f773c0bff30 2023-11-27T20:55:05.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.455+0000 7f2917fff640 1 -- 172.21.15.88:0/3061497942 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2920031810 con 0x7f293006ba10 2023-11-27T20:55:05.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.455+0000 7f2917fff640 1 -- 172.21.15.88:0/3061497942 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2920046450 con 0x7f293006ba10 2023-11-27T20:55:05.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.455+0000 7f2935ad3640 1 -- 172.21.15.88:0/3061497942 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29300cc170 con 0x7f293006ba10 2023-11-27T20:55:05.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.455+0000 7f2917fff640 1 -- 172.21.15.88:0/3061497942 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2920046800 con 0x7f293006ba10 2023-11-27T20:55:05.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.455+0000 7f2935ad3640 1 -- 172.21.15.88:0/3061497942 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29300c94a0 con 0x7f293006ba10 2023-11-27T20:55:05.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.456+0000 7f2935ad3640 1 -- 172.21.15.88:0/3061497942 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f29300c2d60 con 0x7f293006ba10 2023-11-27T20:55:05.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.459+0000 7f604e1c3640 1 --2- 172.21.15.88:0/2370200976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6048158b70 0x7f60481412f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f604000c770 tx=0x7f6040004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.464+0000 7f773bfff640 1 --2- 172.21.15.88:0/3129611542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f773c0bff30 0x7f773c1548e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f772c00e9e0 tx=0x7f772c00eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.467+0000 7f3e6effd640 1 -- 172.21.15.88:0/3246442886 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68005ce0 con 0x7f3e780c4720 2023-11-27T20:55:05.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.467+0000 7f3e6effd640 1 -- 172.21.15.88:0/3246442886 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e68005e40 con 0x7f3e780c4720 2023-11-27T20:55:05.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.467+0000 7f3e6effd640 1 -- 172.21.15.88:0/3246442886 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68007310 con 0x7f3e780c4720 2023-11-27T20:55:05.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.467+0000 7f3e80525640 1 -- 172.21.15.88:0/3246442886 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e780c96f0 con 0x7f3e780c4720 2023-11-27T20:55:05.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.467+0000 7f3e80525640 1 -- 172.21.15.88:0/3246442886 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e7815ebb0 con 0x7f3e780c4720 2023-11-27T20:55:05.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.468+0000 7f3e80525640 1 -- 172.21.15.88:0/3246442886 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3e780c61a0 con 0x7f3e780c4720 2023-11-27T20:55:05.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.470+0000 7f9d80ff9640 1 -- 172.21.15.88:0/3456035891 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7800c8e0 con 0x7f9d84157890 2023-11-27T20:55:05.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.470+0000 7f9d893b3640 1 -- 172.21.15.88:0/3456035891 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d841f3cb0 con 0x7f9d84157890 2023-11-27T20:55:05.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.470+0000 7f9d893b3640 1 -- 172.21.15.88:0/3456035891 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d84161620 con 0x7f9d84157890 2023-11-27T20:55:05.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.470+0000 7f9d80ff9640 1 -- 172.21.15.88:0/3456035891 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7800ca40 con 0x7f9d84157890 2023-11-27T20:55:05.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.471+0000 7f9d80ff9640 1 -- 172.21.15.88:0/3456035891 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7800cdf0 con 0x7f9d84157890 2023-11-27T20:55:05.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.471+0000 7f9d893b3640 1 -- 172.21.15.88:0/3456035891 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9d64000fc0 con 0x7f9d84157890 2023-11-27T20:55:05.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.572+0000 7f2917fff640 1 -- 172.21.15.88:0/3061497942 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f292004f3f0 con 0x7f293006ba10 2023-11-27T20:55:05.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.572+0000 7f2917fff640 1 --2- 172.21.15.88:0/3061497942 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f291c06b210 0x7f291c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.573+0000 7f292effd640 1 --2- 172.21.15.88:0/3061497942 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f291c06b210 0x7f291c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.573+0000 7f292effd640 1 --2- 172.21.15.88:0/3061497942 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f291c06b210 0x7f291c06d6d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2930153410 tx=0x7f2924006ba0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.585+0000 7f2917fff640 1 -- 172.21.15.88:0/3061497942 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f292007bb30 con 0x7f293006ba10 2023-11-27T20:55:05.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.585+0000 7f2917fff640 1 --2- 172.21.15.88:0/3061497942 >> [v2:172.21.15.167:6800/2551293703,v1:172.21.15.167:6801/2551293703] conn(0x7f291c074a70 0x7f291c076f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.585+0000 7f2917fff640 1 -- 172.21.15.88:0/3061497942 --> [v2:172.21.15.167:6800/2551293703,v1:172.21.15.167:6801/2551293703] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f291c0775e0 con 0x7f291c074a70 2023-11-27T20:55:05.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.586+0000 7f292ffff640 1 --2- 172.21.15.88:0/3061497942 >> [v2:172.21.15.167:6800/2551293703,v1:172.21.15.167:6801/2551293703] conn(0x7f291c074a70 0x7f291c076f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.586+0000 7f292ffff640 1 --2- 172.21.15.88:0/3061497942 >> [v2:172.21.15.167:6800/2551293703,v1:172.21.15.167:6801/2551293703] conn(0x7f291c074a70 0x7f291c076f10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.586+0000 7f2917fff640 1 -- 172.21.15.88:0/3061497942 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2920077770 con 0x7f293006ba10 2023-11-27T20:55:05.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.587+0000 7f2917fff640 1 -- 172.21.15.88:0/3061497942 <== osd.4 v2:172.21.15.167:6800/2551293703 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f291c0775e0 con 0x7f291c074a70 2023-11-27T20:55:05.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.599+0000 7fa3527fc640 1 -- 172.21.15.88:0/3652330313 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa34c023430 con 0x7fa3540dd380 2023-11-27T20:55:05.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.600+0000 7fa3527fc640 1 --2- 172.21.15.88:0/3652330313 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa34006b240 0x7fa34006d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.600+0000 7fa3619c7640 1 --2- 172.21.15.88:0/3652330313 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa34006b240 0x7fa34006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.600+0000 7fa3619c7640 1 --2- 172.21.15.88:0/3652330313 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa34006b240 0x7fa34006d700 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa3580017f0 tx=0x7fa358009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.601+0000 7f2935ad3640 1 -- 172.21.15.88:0/3061497942 --> [v2:172.21.15.167:6800/2551293703,v1:172.21.15.167:6801/2551293703] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2930156600 con 0x7f291c074a70 2023-11-27T20:55:05.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.601+0000 7f2917fff640 1 -- 172.21.15.88:0/3061497942 <== osd.4 v2:172.21.15.167:6800/2551293703 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f29280020d0 con 0x7f291c074a70 2023-11-27T20:55:05.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.601+0000 7f2935ad3640 1 -- 172.21.15.88:0/3061497942 >> [v2:172.21.15.167:6800/2551293703,v1:172.21.15.167:6801/2551293703] conn(0x7f291c074a70 msgr2=0x7f291c076f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.601+0000 7f2935ad3640 1 --2- 172.21.15.88:0/3061497942 >> [v2:172.21.15.167:6800/2551293703,v1:172.21.15.167:6801/2551293703] conn(0x7f291c074a70 0x7f291c076f10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.602+0000 7f2935ad3640 1 -- 172.21.15.88:0/3061497942 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f291c06b210 msgr2=0x7f291c06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.602+0000 7f2935ad3640 1 --2- 172.21.15.88:0/3061497942 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f291c06b210 0x7f291c06d6d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2930153410 tx=0x7f2924006ba0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.602+0000 7f2935ad3640 1 -- 172.21.15.88:0/3061497942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f293006ba10 msgr2=0x7f2930150240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.602+0000 7f2935ad3640 1 --2- 172.21.15.88:0/3061497942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f293006ba10 0x7f2930150240 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f29200098f0 tx=0x7f29200046c0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.602+0000 7f292ffff640 1 -- 172.21.15.88:0/3061497942 reap_dead start 2023-11-27T20:55:05.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.602+0000 7f2935ad3640 1 -- 172.21.15.88:0/3061497942 shutdown_connections 2023-11-27T20:55:05.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.602+0000 7f2935ad3640 1 -- 172.21.15.88:0/3061497942 >> 172.21.15.88:0/3061497942 conn(0x7f29300712f0 msgr2=0x7f29300c6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:05.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.602+0000 7f2935ad3640 1 -- 172.21.15.88:0/3061497942 shutdown_connections 2023-11-27T20:55:05.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.602+0000 7f2935ad3640 1 -- 172.21.15.88:0/3061497942 wait complete. 2023-11-27T20:55:05.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.603+0000 7fa3527fc640 1 -- 172.21.15.88:0/3652330313 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa34c058d20 con 0x7fa3540dd380 2023-11-27T20:55:05.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.603+0000 7fa3527fc640 1 --2- 172.21.15.88:0/3652330313 >> [v2:172.21.15.88:6810/406887502,v1:172.21.15.88:6811/406887502] conn(0x7fa340074aa0 0x7fa340076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.603+0000 7fa3527fc640 1 -- 172.21.15.88:0/3652330313 --> [v2:172.21.15.88:6810/406887502,v1:172.21.15.88:6811/406887502] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa340077610 con 0x7fa340074aa0 2023-11-27T20:55:05.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.603+0000 7fa3621c8640 1 --2- 172.21.15.88:0/3652330313 >> [v2:172.21.15.88:6810/406887502,v1:172.21.15.88:6811/406887502] conn(0x7fa340074aa0 0x7fa340076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.603+0000 7f603e7fc640 1 -- 172.21.15.88:0/2370200976 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604003f070 con 0x7f6048158b70 2023-11-27T20:55:05.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.603+0000 7f603e7fc640 1 -- 172.21.15.88:0/2370200976 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6040009a50 con 0x7f6048158b70 2023-11-27T20:55:05.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.603+0000 7f604fc26640 1 -- 172.21.15.88:0/2370200976 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f604814a970 con 0x7f6048158b70 2023-11-27T20:55:05.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.603+0000 7f603e7fc640 1 -- 172.21.15.88:0/2370200976 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040009dc0 con 0x7f6048158b70 2023-11-27T20:55:05.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.603+0000 7f604fc26640 1 -- 172.21.15.88:0/2370200976 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60480c7ee0 con 0x7f6048158b70 2023-11-27T20:55:05.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.604+0000 7fa3621c8640 1 --2- 172.21.15.88:0/3652330313 >> [v2:172.21.15.88:6810/406887502,v1:172.21.15.88:6811/406887502] conn(0x7fa340074aa0 0x7fa340076f40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.604+0000 7fa3527fc640 1 -- 172.21.15.88:0/3652330313 <== osd.3 v2:172.21.15.88:6810/406887502 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa340077610 con 0x7fa340074aa0 2023-11-27T20:55:05.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.604+0000 7f604fc26640 1 -- 172.21.15.88:0/2370200976 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f60480c0060 con 0x7f6048158b70 2023-11-27T20:55:05.614 INFO:teuthology.orchestra.run.smithi088.stdout:60129542160 2023-11-27T20:55:05.615 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-27T20:55:05.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.619+0000 7fa33ffff640 1 -- 172.21.15.88:0/3652330313 --> [v2:172.21.15.88:6810/406887502,v1:172.21.15.88:6811/406887502] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa3540e3e50 con 0x7fa340074aa0 2023-11-27T20:55:05.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.620+0000 7fa3527fc640 1 -- 172.21.15.88:0/3652330313 <== osd.3 v2:172.21.15.88:6810/406887502 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa35c0ae440 con 0x7fa340074aa0 2023-11-27T20:55:05.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.620+0000 7fa33ffff640 1 -- 172.21.15.88:0/3652330313 >> [v2:172.21.15.88:6810/406887502,v1:172.21.15.88:6811/406887502] conn(0x7fa340074aa0 msgr2=0x7fa340076f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.620+0000 7fa33ffff640 1 --2- 172.21.15.88:0/3652330313 >> [v2:172.21.15.88:6810/406887502,v1:172.21.15.88:6811/406887502] conn(0x7fa340074aa0 0x7fa340076f40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.620+0000 7fa33ffff640 1 -- 172.21.15.88:0/3652330313 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa34006b240 msgr2=0x7fa34006d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.620+0000 7fa33ffff640 1 --2- 172.21.15.88:0/3652330313 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa34006b240 0x7fa34006d700 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa3580017f0 tx=0x7fa358009040 comp rx=0 tx=0).stop 2023-11-27T20:55:05.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.620+0000 7fa33ffff640 1 -- 172.21.15.88:0/3652330313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3540dd380 msgr2=0x7fa3540ddfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.620+0000 7fa33ffff640 1 --2- 172.21.15.88:0/3652330313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3540dd380 0x7fa3540ddfa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa34c00b410 tx=0x7fa34c00b8d0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.620+0000 7fa3621c8640 1 -- 172.21.15.88:0/3652330313 reap_dead start 2023-11-27T20:55:05.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.620+0000 7fa33ffff640 1 -- 172.21.15.88:0/3652330313 shutdown_connections 2023-11-27T20:55:05.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.620+0000 7fa33ffff640 1 -- 172.21.15.88:0/3652330313 >> 172.21.15.88:0/3652330313 conn(0x7fa354050140 msgr2=0x7fa354005d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:05.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.621+0000 7fa33ffff640 1 -- 172.21.15.88:0/3652330313 shutdown_connections 2023-11-27T20:55:05.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.621+0000 7fa33ffff640 1 -- 172.21.15.88:0/3652330313 wait complete. 2023-11-27T20:55:05.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.626+0000 7f7738ff9640 1 -- 172.21.15.88:0/3129611542 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c00c950 con 0x7f773c0bff30 2023-11-27T20:55:05.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.626+0000 7f7738ff9640 1 -- 172.21.15.88:0/3129611542 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772c00cab0 con 0x7f773c0bff30 2023-11-27T20:55:05.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.626+0000 7f7742700640 1 -- 172.21.15.88:0/3129611542 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f773c154e20 con 0x7f773c0bff30 2023-11-27T20:55:05.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.626+0000 7f7738ff9640 1 -- 172.21.15.88:0/3129611542 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c00ce60 con 0x7f773c0bff30 2023-11-27T20:55:05.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.626+0000 7f7742700640 1 -- 172.21.15.88:0/3129611542 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773c157320 con 0x7f773c0bff30 2023-11-27T20:55:05.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.626+0000 7f666bfff640 1 -- 172.21.15.88:0/3094279757 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6678010c80 con 0x7f668406d0e0 2023-11-27T20:55:05.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.627+0000 7f666bfff640 1 --2- 172.21.15.88:0/3094279757 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f667006b210 0x7f667006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.627+0000 7f7742700640 1 -- 172.21.15.88:0/3129611542 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f773c0c70c0 con 0x7f773c0bff30 2023-11-27T20:55:05.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.627+0000 7f6682ffd640 1 --2- 172.21.15.88:0/3094279757 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f667006b210 0x7f667006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.627+0000 7f6682ffd640 1 --2- 172.21.15.88:0/3094279757 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f667006b210 0x7f667006d6d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6674037000 tx=0x7f6674031000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.634 INFO:teuthology.orchestra.run.smithi088.stdout:60129542160 2023-11-27T20:55:05.634 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-27T20:55:05.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.639+0000 7f214ffff640 1 -- 172.21.15.88:0/1557120976 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f216003eb00 con 0x7f2168157b30 2023-11-27T20:55:05.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.639+0000 7f214ffff640 1 --2- 172.21.15.88:0/1557120976 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f215406b210 0x7f215406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.639+0000 7f21677fe640 1 --2- 172.21.15.88:0/1557120976 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f215406b210 0x7f215406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.640+0000 7f21677fe640 1 --2- 172.21.15.88:0/1557120976 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f215406b210 0x7f215406d6d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f215c001560 tx=0x7f215c007990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.644+0000 7f666bfff640 1 -- 172.21.15.88:0/3094279757 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6678058cb0 con 0x7f668406d0e0 2023-11-27T20:55:05.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.644+0000 7f666bfff640 1 --2- 172.21.15.88:0/3094279757 >> [v2:172.21.15.88:6818/3952326022,v1:172.21.15.88:6819/3952326022] conn(0x7f6670074a70 0x7f6670076f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.644+0000 7f666bfff640 1 -- 172.21.15.88:0/3094279757 --> [v2:172.21.15.88:6818/3952326022,v1:172.21.15.88:6819/3952326022] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66700775e0 con 0x7f6670074a70 2023-11-27T20:55:05.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.644+0000 7f666bfff640 1 -- 172.21.15.88:0/3094279757 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66780092d0 con 0x7f668406d0e0 2023-11-27T20:55:05.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.644+0000 7f6683fff640 1 --2- 172.21.15.88:0/3094279757 >> [v2:172.21.15.88:6818/3952326022,v1:172.21.15.88:6819/3952326022] conn(0x7f6670074a70 0x7f6670076f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.645+0000 7f6683fff640 1 --2- 172.21.15.88:0/3094279757 >> [v2:172.21.15.88:6818/3952326022,v1:172.21.15.88:6819/3952326022] conn(0x7f6670074a70 0x7f6670076f10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.645+0000 7f666bfff640 1 -- 172.21.15.88:0/3094279757 <== osd.0 v2:172.21.15.88:6818/3952326022 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f66700775e0 con 0x7f6670074a70 2023-11-27T20:55:05.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.648+0000 7f214ffff640 1 -- 172.21.15.88:0/1557120976 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2160040e70 con 0x7f2168157b30 2023-11-27T20:55:05.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.648+0000 7f214ffff640 1 --2- 172.21.15.88:0/1557120976 >> [v2:172.21.15.88:6826/1788401966,v1:172.21.15.88:6827/1788401966] conn(0x7f2154074a70 0x7f2154076f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.648+0000 7f214ffff640 1 -- 172.21.15.88:0/1557120976 --> [v2:172.21.15.88:6826/1788401966,v1:172.21.15.88:6827/1788401966] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f21540775e0 con 0x7f2154074a70 2023-11-27T20:55:05.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.649+0000 7f2167fff640 1 --2- 172.21.15.88:0/1557120976 >> [v2:172.21.15.88:6826/1788401966,v1:172.21.15.88:6827/1788401966] conn(0x7f2154074a70 0x7f2154076f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.649+0000 7f2167fff640 1 --2- 172.21.15.88:0/1557120976 >> [v2:172.21.15.88:6826/1788401966,v1:172.21.15.88:6827/1788401966] conn(0x7f2154074a70 0x7f2154076f10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.650+0000 7f214ffff640 1 -- 172.21.15.88:0/1557120976 <== osd.1 v2:172.21.15.88:6826/1788401966 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f21540775e0 con 0x7f2154074a70 2023-11-27T20:55:05.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.661+0000 7f6689d61640 1 -- 172.21.15.88:0/3094279757 --> [v2:172.21.15.88:6818/3952326022,v1:172.21.15.88:6819/3952326022] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6684155920 con 0x7f6670074a70 2023-11-27T20:55:05.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.661+0000 7f666bfff640 1 -- 172.21.15.88:0/3094279757 <== osd.0 v2:172.21.15.88:6818/3952326022 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f667c006b10 con 0x7f6670074a70 2023-11-27T20:55:05.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.662+0000 7f6689d61640 1 -- 172.21.15.88:0/3094279757 >> [v2:172.21.15.88:6818/3952326022,v1:172.21.15.88:6819/3952326022] conn(0x7f6670074a70 msgr2=0x7f6670076f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.662+0000 7f6689d61640 1 --2- 172.21.15.88:0/3094279757 >> [v2:172.21.15.88:6818/3952326022,v1:172.21.15.88:6819/3952326022] conn(0x7f6670074a70 0x7f6670076f10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.662+0000 7f6689d61640 1 -- 172.21.15.88:0/3094279757 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f667006b210 msgr2=0x7f667006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.662+0000 7f6689d61640 1 --2- 172.21.15.88:0/3094279757 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f667006b210 0x7f667006d6d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6674037000 tx=0x7f6674031000 comp rx=0 tx=0).stop 2023-11-27T20:55:05.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.662+0000 7f6689d61640 1 -- 172.21.15.88:0/3094279757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f668406d0e0 msgr2=0x7f6684150120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.662+0000 7f6689d61640 1 --2- 172.21.15.88:0/3094279757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f668406d0e0 0x7f6684150120 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f667800b4a0 tx=0x7f667800b960 comp rx=0 tx=0).stop 2023-11-27T20:55:05.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.662+0000 7f6683fff640 1 -- 172.21.15.88:0/3094279757 reap_dead start 2023-11-27T20:55:05.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.662+0000 7f6689d61640 1 -- 172.21.15.88:0/3094279757 shutdown_connections 2023-11-27T20:55:05.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.662+0000 7f6689d61640 1 -- 172.21.15.88:0/3094279757 >> 172.21.15.88:0/3094279757 conn(0x7f668406c5f0 msgr2=0x7f66840c1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:05.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.662+0000 7f6689d61640 1 -- 172.21.15.88:0/3094279757 shutdown_connections 2023-11-27T20:55:05.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.662+0000 7f6689d61640 1 -- 172.21.15.88:0/3094279757 wait complete. 2023-11-27T20:55:05.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.663+0000 7f214ffff640 1 -- 172.21.15.88:0/1557120976 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2160077830 con 0x7f2168157b30 2023-11-27T20:55:05.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.664+0000 7f3e6effd640 1 -- 172.21.15.88:0/3246442886 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3e68007470 con 0x7f3e780c4720 2023-11-27T20:55:05.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.665+0000 7f3e6effd640 1 --2- 172.21.15.88:0/3246442886 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3e5c06b210 0x7f3e5c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.665+0000 7f3e7e2c1640 1 --2- 172.21.15.88:0/3246442886 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3e5c06b210 0x7f3e5c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.665+0000 7f3e7e2c1640 1 --2- 172.21.15.88:0/3246442886 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3e5c06b210 0x7f3e5c06d6d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3e74036000 tx=0x7f3e7403b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.666+0000 7f216dd1d640 1 -- 172.21.15.88:0/1557120976 --> [v2:172.21.15.88:6826/1788401966,v1:172.21.15.88:6827/1788401966] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f216815db70 con 0x7f2154074a70 2023-11-27T20:55:05.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.666+0000 7f214ffff640 1 -- 172.21.15.88:0/1557120976 <== osd.1 v2:172.21.15.88:6826/1788401966 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f21580096c0 con 0x7f2154074a70 2023-11-27T20:55:05.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.666+0000 7f216dd1d640 1 -- 172.21.15.88:0/1557120976 >> [v2:172.21.15.88:6826/1788401966,v1:172.21.15.88:6827/1788401966] conn(0x7f2154074a70 msgr2=0x7f2154076f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.666+0000 7f216dd1d640 1 --2- 172.21.15.88:0/1557120976 >> [v2:172.21.15.88:6826/1788401966,v1:172.21.15.88:6827/1788401966] conn(0x7f2154074a70 0x7f2154076f10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.667+0000 7f216dd1d640 1 -- 172.21.15.88:0/1557120976 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f215406b210 msgr2=0x7f215406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.667+0000 7f216dd1d640 1 --2- 172.21.15.88:0/1557120976 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f215406b210 0x7f215406d6d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f215c001560 tx=0x7f215c007990 comp rx=0 tx=0).stop 2023-11-27T20:55:05.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.667+0000 7f216dd1d640 1 -- 172.21.15.88:0/1557120976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2168157b30 msgr2=0x7f2168161680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.667+0000 7f216dd1d640 1 --2- 172.21.15.88:0/1557120976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2168157b30 0x7f2168161680 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2160009e50 tx=0x7f2160004a40 comp rx=0 tx=0).stop 2023-11-27T20:55:05.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.667+0000 7f2167fff640 1 -- 172.21.15.88:0/1557120976 reap_dead start 2023-11-27T20:55:05.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.667+0000 7f216dd1d640 1 -- 172.21.15.88:0/1557120976 shutdown_connections 2023-11-27T20:55:05.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.667+0000 7f216dd1d640 1 -- 172.21.15.88:0/1557120976 >> 172.21.15.88:0/1557120976 conn(0x7f216806c5f0 msgr2=0x7f216815d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:05.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.667+0000 7f216dd1d640 1 -- 172.21.15.88:0/1557120976 shutdown_connections 2023-11-27T20:55:05.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.667+0000 7f216dd1d640 1 -- 172.21.15.88:0/1557120976 wait complete. 2023-11-27T20:55:05.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.669+0000 7f3e6effd640 1 -- 172.21.15.88:0/3246442886 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3e68013e70 con 0x7f3e780c4720 2023-11-27T20:55:05.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.669+0000 7f3e6effd640 1 --2- 172.21.15.88:0/3246442886 >> [v2:172.21.15.167:6810/2695037266,v1:172.21.15.167:6812/2695037266] conn(0x7f3e5c074a70 0x7f3e5c076f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.669+0000 7f3e6effd640 1 -- 172.21.15.88:0/3246442886 --> [v2:172.21.15.167:6810/2695037266,v1:172.21.15.167:6812/2695037266] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3e5c0775e0 con 0x7f3e5c074a70 2023-11-27T20:55:05.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.669+0000 7f3e7dac0640 1 --2- 172.21.15.88:0/3246442886 >> [v2:172.21.15.167:6810/2695037266,v1:172.21.15.167:6812/2695037266] conn(0x7f3e5c074a70 0x7f3e5c076f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.670+0000 7f3e7dac0640 1 --2- 172.21.15.88:0/3246442886 >> [v2:172.21.15.167:6810/2695037266,v1:172.21.15.167:6812/2695037266] conn(0x7f3e5c074a70 0x7f3e5c076f10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.670+0000 7f3e6effd640 1 -- 172.21.15.88:0/3246442886 <== osd.7 v2:172.21.15.167:6810/2695037266 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3e5c0775e0 con 0x7f3e5c074a70 2023-11-27T20:55:05.679 INFO:teuthology.orchestra.run.smithi088.stdout:64424509455 2023-11-27T20:55:05.679 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-27T20:55:05.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.682+0000 7f3e6effd640 1 -- 172.21.15.88:0/3246442886 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e680545a0 con 0x7f3e780c4720 2023-11-27T20:55:05.685 INFO:teuthology.orchestra.run.smithi088.stdout:64424509456 2023-11-27T20:55:05.685 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-27T20:55:05.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.683+0000 7f9d80ff9640 1 -- 172.21.15.88:0/3456035891 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9d78026480 con 0x7f9d84157890 2023-11-27T20:55:05.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.683+0000 7f9d80ff9640 1 --2- 172.21.15.88:0/3456035891 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f9d7006b240 0x7f9d7006d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.684+0000 7f9d83fff640 1 --2- 172.21.15.88:0/3456035891 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f9d7006b240 0x7f9d7006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.684+0000 7f9d83fff640 1 --2- 172.21.15.88:0/3456035891 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f9d7006b240 0x7f9d7006d700 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9d74036000 tx=0x7f9d74030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.688+0000 7f3e80525640 1 -- 172.21.15.88:0/3246442886 --> [v2:172.21.15.167:6810/2695037266,v1:172.21.15.167:6812/2695037266] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3e781689d0 con 0x7f3e5c074a70 2023-11-27T20:55:05.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.688+0000 7f3e6effd640 1 -- 172.21.15.88:0/3246442886 <== osd.7 v2:172.21.15.167:6810/2695037266 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3e70009b10 con 0x7f3e5c074a70 2023-11-27T20:55:05.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.689+0000 7f3e80525640 1 -- 172.21.15.88:0/3246442886 >> [v2:172.21.15.167:6810/2695037266,v1:172.21.15.167:6812/2695037266] conn(0x7f3e5c074a70 msgr2=0x7f3e5c076f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.689+0000 7f3e80525640 1 --2- 172.21.15.88:0/3246442886 >> [v2:172.21.15.167:6810/2695037266,v1:172.21.15.167:6812/2695037266] conn(0x7f3e5c074a70 0x7f3e5c076f10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.689+0000 7f3e80525640 1 -- 172.21.15.88:0/3246442886 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3e5c06b210 msgr2=0x7f3e5c06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.689+0000 7f3e80525640 1 --2- 172.21.15.88:0/3246442886 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3e5c06b210 0x7f3e5c06d6d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3e74036000 tx=0x7f3e7403b040 comp rx=0 tx=0).stop 2023-11-27T20:55:05.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.689+0000 7f3e80525640 1 -- 172.21.15.88:0/3246442886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e780c4720 msgr2=0x7f3e78157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.689+0000 7f3e80525640 1 --2- 172.21.15.88:0/3246442886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e780c4720 0x7f3e78157770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800c430 tx=0x7f3e6800c8f0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.689+0000 7f3e7eac2640 1 -- 172.21.15.88:0/3246442886 reap_dead start 2023-11-27T20:55:05.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.689+0000 7f9d80ff9640 1 -- 172.21.15.88:0/3456035891 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9d78059340 con 0x7f9d84157890 2023-11-27T20:55:05.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.689+0000 7f9d80ff9640 1 --2- 172.21.15.88:0/3456035891 >> [v2:172.21.15.88:6802/1166333913,v1:172.21.15.88:6803/1166333913] conn(0x7f9d70074aa0 0x7f9d70076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.689+0000 7f9d80ff9640 1 -- 172.21.15.88:0/3456035891 --> [v2:172.21.15.88:6802/1166333913,v1:172.21.15.88:6803/1166333913] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d70077610 con 0x7f9d70074aa0 2023-11-27T20:55:05.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.689+0000 7f9d88bb2640 1 --2- 172.21.15.88:0/3456035891 >> [v2:172.21.15.88:6802/1166333913,v1:172.21.15.88:6803/1166333913] conn(0x7f9d70074aa0 0x7f9d70076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.689+0000 7f3e80525640 1 -- 172.21.15.88:0/3246442886 shutdown_connections 2023-11-27T20:55:05.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.689+0000 7f3e80525640 1 -- 172.21.15.88:0/3246442886 >> 172.21.15.88:0/3246442886 conn(0x7f3e7806c5f0 msgr2=0x7f3e78167930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:05.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.689+0000 7f3e80525640 1 -- 172.21.15.88:0/3246442886 shutdown_connections 2023-11-27T20:55:05.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.689+0000 7f3e80525640 1 -- 172.21.15.88:0/3246442886 wait complete. 2023-11-27T20:55:05.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.690+0000 7f9d88bb2640 1 --2- 172.21.15.88:0/3456035891 >> [v2:172.21.15.88:6802/1166333913,v1:172.21.15.88:6803/1166333913] conn(0x7f9d70074aa0 0x7f9d70076f40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.691+0000 7f9d80ff9640 1 -- 172.21.15.88:0/3456035891 <== osd.2 v2:172.21.15.88:6802/1166333913 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9d70077610 con 0x7f9d70074aa0 2023-11-27T20:55:05.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.691+0000 7f9d80ff9640 1 -- 172.21.15.88:0/3456035891 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d78054f80 con 0x7f9d84157890 2023-11-27T20:55:05.707 INFO:teuthology.orchestra.run.smithi088.stdout:60129542160 2023-11-27T20:55:05.708 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-27T20:55:05.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.712+0000 7f9d893b3640 1 -- 172.21.15.88:0/3456035891 --> [v2:172.21.15.88:6802/1166333913,v1:172.21.15.88:6803/1166333913] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9d64002c70 con 0x7f9d70074aa0 2023-11-27T20:55:05.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.712+0000 7f9d80ff9640 1 -- 172.21.15.88:0/3456035891 <== osd.2 v2:172.21.15.88:6802/1166333913 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9d64002c70 con 0x7f9d70074aa0 2023-11-27T20:55:05.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.713+0000 7f9d893b3640 1 -- 172.21.15.88:0/3456035891 >> [v2:172.21.15.88:6802/1166333913,v1:172.21.15.88:6803/1166333913] conn(0x7f9d70074aa0 msgr2=0x7f9d70076f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.713+0000 7f9d893b3640 1 --2- 172.21.15.88:0/3456035891 >> [v2:172.21.15.88:6802/1166333913,v1:172.21.15.88:6803/1166333913] conn(0x7f9d70074aa0 0x7f9d70076f40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.713+0000 7f9d893b3640 1 -- 172.21.15.88:0/3456035891 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f9d7006b240 msgr2=0x7f9d7006d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.713+0000 7f9d893b3640 1 --2- 172.21.15.88:0/3456035891 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f9d7006b240 0x7f9d7006d700 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9d74036000 tx=0x7f9d74030000 comp rx=0 tx=0).stop 2023-11-27T20:55:05.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.713+0000 7f9d893b3640 1 -- 172.21.15.88:0/3456035891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d84157890 msgr2=0x7f9d840c6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.713+0000 7f9d893b3640 1 --2- 172.21.15.88:0/3456035891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d84157890 0x7f9d840c6010 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800e840 tx=0x7f9d7800ed00 comp rx=0 tx=0).stop 2023-11-27T20:55:05.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.713+0000 7f9d88bb2640 1 -- 172.21.15.88:0/3456035891 reap_dead start 2023-11-27T20:55:05.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.713+0000 7f9d893b3640 1 -- 172.21.15.88:0/3456035891 shutdown_connections 2023-11-27T20:55:05.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.713+0000 7f9d893b3640 1 -- 172.21.15.88:0/3456035891 >> 172.21.15.88:0/3456035891 conn(0x7f9d84061640 msgr2=0x7f9d840c5650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:05.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.713+0000 7f9d893b3640 1 -- 172.21.15.88:0/3456035891 shutdown_connections 2023-11-27T20:55:05.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.713+0000 7f9d893b3640 1 -- 172.21.15.88:0/3456035891 wait complete. 2023-11-27T20:55:05.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.731+0000 7f603e7fc640 1 -- 172.21.15.88:0/2370200976 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f604004d3f0 con 0x7f6048158b70 2023-11-27T20:55:05.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.731+0000 7f603e7fc640 1 --2- 172.21.15.88:0/2370200976 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f602c06b1f0 0x7f602c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.732+0000 7f604d9c2640 1 --2- 172.21.15.88:0/2370200976 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f602c06b1f0 0x7f602c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.733+0000 7f604d9c2640 1 --2- 172.21.15.88:0/2370200976 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f602c06b1f0 0x7f602c06d6b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6044000f60 tx=0x7f60440079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.734+0000 7f603e7fc640 1 -- 172.21.15.88:0/2370200976 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f604007b280 con 0x7f6048158b70 2023-11-27T20:55:05.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.734+0000 7f603e7fc640 1 --2- 172.21.15.88:0/2370200976 >> [v2:172.21.15.167:6808/2766725538,v1:172.21.15.167:6809/2766725538] conn(0x7f602c0749d0 0x7f602c076e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.734+0000 7f603e7fc640 1 -- 172.21.15.88:0/2370200976 --> [v2:172.21.15.167:6808/2766725538,v1:172.21.15.167:6809/2766725538] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f602c077540 con 0x7f602c0749d0 2023-11-27T20:55:05.737 INFO:teuthology.orchestra.run.smithi088.stdout:64424509456 2023-11-27T20:55:05.737 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-27T20:55:05.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.735+0000 7f604d1c1640 1 --2- 172.21.15.88:0/2370200976 >> [v2:172.21.15.167:6808/2766725538,v1:172.21.15.167:6809/2766725538] conn(0x7f602c0749d0 0x7f602c076e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.735+0000 7f604d1c1640 1 --2- 172.21.15.88:0/2370200976 >> [v2:172.21.15.167:6808/2766725538,v1:172.21.15.167:6809/2766725538] conn(0x7f602c0749d0 0x7f602c076e70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.736+0000 7f603e7fc640 1 -- 172.21.15.88:0/2370200976 <== osd.6 v2:172.21.15.167:6808/2766725538 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f602c077540 con 0x7f602c0749d0 2023-11-27T20:55:05.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.747+0000 7f9090c67640 1 Processor -- start 2023-11-27T20:55:05.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.747+0000 7f9090c67640 1 -- start start 2023-11-27T20:55:05.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.749+0000 7f9090c67640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f90840d5e80 0x7f9084007ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.749+0000 7f9090c67640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9084047e90 0x7f90840461f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.749+0000 7f9090c67640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90840dc560 con 0x7f908404c980 2023-11-27T20:55:05.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.749+0000 7f9090c67640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9084034bf0 con 0x7f9084047e90 2023-11-27T20:55:05.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.749+0000 7f9090c67640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9084046e60 con 0x7f90840d5e80 2023-11-27T20:55:05.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.749+0000 7f7738ff9640 1 -- 172.21.15.88:0/3129611542 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f772c013470 con 0x7f773c0bff30 2023-11-27T20:55:05.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.749+0000 7f7738ff9640 1 --2- 172.21.15.88:0/3129611542 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f772806b1f0 0x7f772806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.750+0000 7f773b7fe640 1 --2- 172.21.15.88:0/3129611542 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f772806b1f0 0x7f772806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.751+0000 7f773b7fe640 1 --2- 172.21.15.88:0/3129611542 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f772806b1f0 0x7f772806d6b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f773c14e7a0 tx=0x7f7730006ba0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.751+0000 7f7738ff9640 1 -- 172.21.15.88:0/3129611542 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f772c0590d0 con 0x7f773c0bff30 2023-11-27T20:55:05.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.752+0000 7f7738ff9640 1 --2- 172.21.15.88:0/3129611542 >> [v2:172.21.15.167:6824/866085094,v1:172.21.15.167:6825/866085094] conn(0x7f77280749d0 0x7f7728076e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.752+0000 7f7738ff9640 1 -- 172.21.15.88:0/3129611542 --> [v2:172.21.15.167:6824/866085094,v1:172.21.15.167:6825/866085094] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7728077540 con 0x7f77280749d0 2023-11-27T20:55:05.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.752+0000 7f7740c9d640 1 --2- 172.21.15.88:0/3129611542 >> [v2:172.21.15.167:6824/866085094,v1:172.21.15.167:6825/866085094] conn(0x7f77280749d0 0x7f7728076e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.753+0000 7f7740c9d640 1 --2- 172.21.15.88:0/3129611542 >> [v2:172.21.15.167:6824/866085094,v1:172.21.15.167:6825/866085094] conn(0x7f77280749d0 0x7f7728076e70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.753+0000 7f908b7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f90840d5e80 0x7f9084007ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.753+0000 7f908b7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f90840d5e80 0x7f9084007ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:41310/0 (socket says 172.21.15.88:41310) 2023-11-27T20:55:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.753+0000 7f908b7fe640 1 -- 172.21.15.88:0/1294293419 learned_addr learned my addr 172.21.15.88:0/1294293419 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.754+0000 7f7738ff9640 1 -- 172.21.15.88:0/3129611542 <== osd.5 v2:172.21.15.167:6824/866085094 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7728077540 con 0x7f77280749d0 2023-11-27T20:55:05.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.758+0000 7f908b7fe640 1 -- 172.21.15.88:0/1294293419 >> v2:172.21.15.88:3300/0 conn(0x7f9084047e90 msgr2=0x7f90840461f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:05.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.758+0000 7f908b7fe640 1 --2- 172.21.15.88:0/1294293419 >> v2:172.21.15.88:3300/0 conn(0x7f9084047e90 0x7f90840461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.758+0000 7f908b7fe640 1 -- 172.21.15.88:0/1294293419 >> v1:172.21.15.167:6789/0 conn(0x7f908404c980 legacy=0x7f90840def30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.758+0000 7f908b7fe640 1 -- 172.21.15.88:0/1294293419 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90840470d0 con 0x7f90840d5e80 2023-11-27T20:55:05.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.760+0000 7f908b7fe640 1 --2- 172.21.15.88:0/1294293419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90840d5e80 0x7f9084007ba0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f908400cdd0 tx=0x7f908002ba80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad577ef261438898 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.766+0000 7f908a7fc640 1 -- 172.21.15.88:0/1294293419 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908002d840 con 0x7f90840d5e80 2023-11-27T20:55:05.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.766+0000 7f908a7fc640 1 -- 172.21.15.88:0/1294293419 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908002d9a0 con 0x7f90840d5e80 2023-11-27T20:55:05.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.766+0000 7f908a7fc640 1 -- 172.21.15.88:0/1294293419 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908002dd50 con 0x7f90840d5e80 2023-11-27T20:55:05.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.766+0000 7f604fc26640 1 -- 172.21.15.88:0/2370200976 --> [v2:172.21.15.167:6808/2766725538,v1:172.21.15.167:6809/2766725538] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6048155ee0 con 0x7f602c0749d0 2023-11-27T20:55:05.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.767+0000 7f603e7fc640 1 -- 172.21.15.88:0/2370200976 <== osd.6 v2:172.21.15.167:6808/2766725538 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f602c077540 con 0x7f602c0749d0 2023-11-27T20:55:05.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.767+0000 7f604fc26640 1 -- 172.21.15.88:0/2370200976 >> [v2:172.21.15.167:6808/2766725538,v1:172.21.15.167:6809/2766725538] conn(0x7f602c0749d0 msgr2=0x7f602c076e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.767+0000 7f604fc26640 1 --2- 172.21.15.88:0/2370200976 >> [v2:172.21.15.167:6808/2766725538,v1:172.21.15.167:6809/2766725538] conn(0x7f602c0749d0 0x7f602c076e70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.767+0000 7f604fc26640 1 -- 172.21.15.88:0/2370200976 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f602c06b1f0 msgr2=0x7f602c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.767+0000 7f604fc26640 1 --2- 172.21.15.88:0/2370200976 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f602c06b1f0 0x7f602c06d6b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6044000f60 tx=0x7f60440079b0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.768+0000 7f604fc26640 1 -- 172.21.15.88:0/2370200976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6048158b70 msgr2=0x7f60481412f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.768+0000 7f604fc26640 1 --2- 172.21.15.88:0/2370200976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6048158b70 0x7f60481412f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f604000c770 tx=0x7f6040004a40 comp rx=0 tx=0).stop 2023-11-27T20:55:05.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.768+0000 7f604e1c3640 1 -- 172.21.15.88:0/2370200976 reap_dead start 2023-11-27T20:55:05.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.769+0000 7f9090c67640 1 -- 172.21.15.88:0/1294293419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90840d5e80 msgr2=0x7f9084007ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.769+0000 7f9090c67640 1 --2- 172.21.15.88:0/1294293419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90840d5e80 0x7f9084007ba0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f908400cdd0 tx=0x7f908002ba80 comp rx=0 tx=0).stop 2023-11-27T20:55:05.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.769+0000 7f604fc26640 1 -- 172.21.15.88:0/2370200976 shutdown_connections 2023-11-27T20:55:05.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.769+0000 7f604fc26640 1 -- 172.21.15.88:0/2370200976 >> 172.21.15.88:0/2370200976 conn(0x7f604806d330 msgr2=0x7f6048071070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:05.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.769+0000 7f604fc26640 1 -- 172.21.15.88:0/2370200976 shutdown_connections 2023-11-27T20:55:05.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.769+0000 7f604fc26640 1 -- 172.21.15.88:0/2370200976 wait complete. 2023-11-27T20:55:05.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.771+0000 7f9090c67640 1 -- 172.21.15.88:0/1294293419 shutdown_connections 2023-11-27T20:55:05.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.771+0000 7f9090c67640 1 --2- 172.21.15.88:0/1294293419 >> v2:172.21.15.88:3300/0 conn(0x7f9084047e90 0x7f90840461f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.771+0000 7f9090c67640 1 --2- 172.21.15.88:0/1294293419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90840d5e80 0x7f9084007ba0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.771+0000 7f9090c67640 1 -- 172.21.15.88:0/1294293419 >> 172.21.15.88:0/1294293419 conn(0x7f9084051250 msgr2=0x7f9084051660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:05.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.773+0000 7f9090c67640 1 -- 172.21.15.88:0/1294293419 shutdown_connections 2023-11-27T20:55:05.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.773+0000 7f9090c67640 1 -- 172.21.15.88:0/1294293419 wait complete. 2023-11-27T20:55:05.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.775+0000 7f9090c67640 1 Processor -- start 2023-11-27T20:55:05.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.775+0000 7f9090c67640 1 -- start start 2023-11-27T20:55:05.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.777+0000 7f9090c67640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9084047e90 0x7f9084036dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.777+0000 7f9090c67640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f908404c980 0x7f908404a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.777+0000 7f9090c67640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90840d5e80 0x7f908404a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.777+0000 7f9090c67640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9084049eb0 con 0x7f90840d5e80 2023-11-27T20:55:05.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.777+0000 7f9090c67640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90840d44b0 con 0x7f908404c980 2023-11-27T20:55:05.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.777+0000 7f9090c67640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90840d7460 con 0x7f9084047e90 2023-11-27T20:55:05.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.774+0000 7f5937f83640 1 Processor -- start 2023-11-27T20:55:05.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.774+0000 7f5937f83640 1 -- start start 2023-11-27T20:55:05.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.775+0000 7f5937f83640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f59300c5aa0 0x7f59300c6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.775+0000 7f5937f83640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f593016a1a0 0x7f59300c7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.775+0000 7f5937f83640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5930070bc0 con 0x7f59300c1680 2023-11-27T20:55:05.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.775+0000 7f5937f83640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59300715b0 con 0x7f59300c5aa0 2023-11-27T20:55:05.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.775+0000 7f5937f83640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59300c2770 con 0x7f593016a1a0 2023-11-27T20:55:05.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.783+0000 7f7742700640 1 -- 172.21.15.88:0/3129611542 --> [v2:172.21.15.167:6824/866085094,v1:172.21.15.167:6825/866085094] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f773c0c6de0 con 0x7f77280749d0 2023-11-27T20:55:05.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.784+0000 7f7738ff9640 1 -- 172.21.15.88:0/3129611542 <== osd.5 v2:172.21.15.167:6824/866085094 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7734000fb0 con 0x7f77280749d0 2023-11-27T20:55:05.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.786+0000 7f7742700640 1 -- 172.21.15.88:0/3129611542 >> [v2:172.21.15.167:6824/866085094,v1:172.21.15.167:6825/866085094] conn(0x7f77280749d0 msgr2=0x7f7728076e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.786+0000 7f7742700640 1 --2- 172.21.15.88:0/3129611542 >> [v2:172.21.15.167:6824/866085094,v1:172.21.15.167:6825/866085094] conn(0x7f77280749d0 0x7f7728076e70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.786+0000 7f7742700640 1 -- 172.21.15.88:0/3129611542 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f772806b1f0 msgr2=0x7f772806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.786+0000 7f7742700640 1 --2- 172.21.15.88:0/3129611542 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f772806b1f0 0x7f772806d6b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f773c14e7a0 tx=0x7f7730006ba0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.786+0000 7f7742700640 1 -- 172.21.15.88:0/3129611542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f773c0bff30 msgr2=0x7f773c1548e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.786+0000 7f7742700640 1 --2- 172.21.15.88:0/3129611542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f773c0bff30 0x7f773c1548e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f772c00e9e0 tx=0x7f772c00eea0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.786+0000 7f7740c9d640 1 -- 172.21.15.88:0/3129611542 reap_dead start 2023-11-27T20:55:05.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.786+0000 7f7742700640 1 -- 172.21.15.88:0/3129611542 shutdown_connections 2023-11-27T20:55:05.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.786+0000 7f7742700640 1 -- 172.21.15.88:0/3129611542 >> 172.21.15.88:0/3129611542 conn(0x7f773c06d330 msgr2=0x7f773c14d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:05.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.786+0000 7f7742700640 1 -- 172.21.15.88:0/3129611542 shutdown_connections 2023-11-27T20:55:05.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.786+0000 7f7742700640 1 -- 172.21.15.88:0/3129611542 wait complete. 2023-11-27T20:55:05.789 INFO:teuthology.orchestra.run.smithi088.stdout:64424509455 2023-11-27T20:55:05.789 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-27T20:55:05.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.794+0000 7f593551e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f59300c5aa0 0x7f59300c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.795+0000 7f593551e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f59300c5aa0 0x7f59300c6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50584/0 (socket says 172.21.15.88:50584) 2023-11-27T20:55:05.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.795+0000 7f593551e640 1 -- 172.21.15.88:0/1821490391 learned_addr learned my addr 172.21.15.88:0/1821490391 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:05.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.800+0000 7f593551e640 1 -- 172.21.15.88:0/1821490391 >> v2:172.21.15.167:3300/0 conn(0x7f593016a1a0 msgr2=0x7f59300c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:05.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.800+0000 7f593551e640 1 --2- 172.21.15.88:0/1821490391 >> v2:172.21.15.167:3300/0 conn(0x7f593016a1a0 0x7f59300c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.800+0000 7f593551e640 1 -- 172.21.15.88:0/1821490391 >> v1:172.21.15.88:6789/0 conn(0x7f59300c1680 legacy=0x7f5930166930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:05.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.800+0000 7f593551e640 1 -- 172.21.15.88:0/1821490391 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59301664a0 con 0x7f59300c5aa0 2023-11-27T20:55:05.805 INFO:teuthology.orchestra.run.smithi088.stdout:64424509455 2023-11-27T20:55:05.806 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-27T20:55:05.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.817+0000 7f908bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90840d5e80 0x7f908404a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.827+0000 7f908affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f908404c980 0x7f908404a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.828+0000 7f908affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f908404c980 0x7f908404a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:41328/0 (socket says 172.21.15.88:41328) 2023-11-27T20:55:05.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.828+0000 7f908affd640 1 -- 172.21.15.88:0/2887880621 learned_addr learned my addr 172.21.15.88:0/2887880621 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:05.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.831+0000 7f908b7fe640 1 --2- 172.21.15.88:0/2887880621 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9084047e90 0x7f9084036dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.833+0000 7f593551e640 1 --2- 172.21.15.88:0/1821490391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59300c5aa0 0x7f59300c6000 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f593006c100 tx=0x7f592c02dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e81b7a3327a2de5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.833+0000 7f908affd640 1 -- 172.21.15.88:0/2887880621 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9084047e90 msgr2=0x7f9084036dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.833+0000 7f908affd640 1 --2- 172.21.15.88:0/2887880621 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9084047e90 0x7f9084036dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.833+0000 7f908affd640 1 -- 172.21.15.88:0/2887880621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90840d5e80 msgr2=0x7f908404a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.833+0000 7f908affd640 1 --2- 172.21.15.88:0/2887880621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90840d5e80 0x7f908404a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.833+0000 7f908affd640 1 -- 172.21.15.88:0/2887880621 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90800094d0 con 0x7f908404c980 2023-11-27T20:55:05.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.837+0000 7f908affd640 1 --2- 172.21.15.88:0/2887880621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f908404c980 0x7f908404a2d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f907800b4d0 tx=0x7f907800b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.841+0000 7f9077fff640 1 -- 172.21.15.88:0/2887880621 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9078010610 con 0x7f908404c980 2023-11-27T20:55:05.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.841+0000 7f9077fff640 1 -- 172.21.15.88:0/2887880621 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9078010770 con 0x7f908404c980 2023-11-27T20:55:05.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.841+0000 7f9077fff640 1 -- 172.21.15.88:0/2887880621 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9078010b20 con 0x7f908404c980 2023-11-27T20:55:05.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.841+0000 7f9090c67640 1 -- 172.21.15.88:0/2887880621 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90840d3860 con 0x7f908404c980 2023-11-27T20:55:05.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.841+0000 7f9090c67640 1 -- 172.21.15.88:0/2887880621 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90840d3e20 con 0x7f908404c980 2023-11-27T20:55:05.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.842+0000 7f3b41b8a640 1 Processor -- start 2023-11-27T20:55:05.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.842+0000 7f3b41b8a640 1 -- start start 2023-11-27T20:55:05.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.843+0000 7f3b41b8a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3b3c150210 0x7f3b3c156b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.843+0000 7f3b41b8a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b3c157690 0x7f3b3c0cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.843+0000 7f3b41b8a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3b3c0c0ed0 0x7f3b3c0cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.843+0000 7f3b41b8a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b3c1561a0 con 0x7f3b3c150210 2023-11-27T20:55:05.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.843+0000 7f3b41b8a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b3c0c1cd0 con 0x7f3b3c0c0ed0 2023-11-27T20:55:05.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.843+0000 7f3b41b8a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c0c1430 con 0x7f3b3c157690 2023-11-27T20:55:05.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.844+0000 7f3b3affd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b3c157690 0x7f3b3c0cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.844+0000 7f3b3affd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b3c157690 0x7f3b3c0cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:34306/0 (socket says 172.21.15.88:34306) 2023-11-27T20:55:05.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.844+0000 7f3b3affd640 1 -- 172.21.15.88:0/2975038874 learned_addr learned my addr 172.21.15.88:0/2975038874 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:05.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.844+0000 7f9090c67640 1 -- 172.21.15.88:0/2887880621 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f906c005250 con 0x7f908404c980 2023-11-27T20:55:05.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.845+0000 7ff8a1eb4640 1 Processor -- start 2023-11-27T20:55:05.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.845+0000 7ff8a1eb4640 1 -- start start 2023-11-27T20:55:05.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.846+0000 7f3b3affd640 1 -- 172.21.15.88:0/2975038874 >> v2:172.21.15.167:3300/0 conn(0x7f3b3c0c0ed0 msgr2=0x7f3b3c0cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:05.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.846+0000 7f3b3affd640 1 --2- 172.21.15.88:0/2975038874 >> v2:172.21.15.167:3300/0 conn(0x7f3b3c0c0ed0 0x7f3b3c0cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.846+0000 7f3b3affd640 1 -- 172.21.15.88:0/2975038874 >> v2:172.21.15.88:3300/0 conn(0x7f3b3c150210 msgr2=0x7f3b3c156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:05.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.846+0000 7ff8a1eb4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff89c151330 0x7ff89c06ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.846+0000 7ff8a1eb4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff89c157e20 0x7ff89c071b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.846+0000 7ff8a1eb4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff89c0c6360 0x7ff89c0c5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.847+0000 7ff8a1eb4640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff89c157150 con 0x7ff89c157e20 2023-11-27T20:55:05.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.847+0000 7ff8a1eb4640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff89c0c71d0 con 0x7ff89c151330 2023-11-27T20:55:05.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.847+0000 7ff8a1eb4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c0720a0 con 0x7ff89c0c6360 2023-11-27T20:55:05.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.846+0000 7f3b3affd640 1 --2- 172.21.15.88:0/2975038874 >> v2:172.21.15.88:3300/0 conn(0x7f3b3c150210 0x7f3b3c156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.846+0000 7f3b3affd640 1 -- 172.21.15.88:0/2975038874 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3c0c1710 con 0x7f3b3c157690 2023-11-27T20:55:05.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.849+0000 7ff89bfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff89c0c6360 0x7ff89c0c5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.850+0000 7ff89bfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff89c0c6360 0x7ff89c0c5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:34318/0 (socket says 172.21.15.88:34318) 2023-11-27T20:55:05.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.850+0000 7ff89bfff640 1 -- 172.21.15.88:0/353472538 learned_addr learned my addr 172.21.15.88:0/353472538 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:05.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.850+0000 7f3b3affd640 1 --2- 172.21.15.88:0/2975038874 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b3c157690 0x7f3b3c0cbae0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c15a890 tx=0x7f3b2c02fd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0f265e690391a69 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.851+0000 7f5934d1d640 1 -- 172.21.15.88:0/1821490391 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c02e8f0 con 0x7f59300c5aa0 2023-11-27T20:55:05.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.851+0000 7f5934d1d640 1 -- 172.21.15.88:0/1821490391 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592c02ea50 con 0x7f59300c5aa0 2023-11-27T20:55:05.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.851+0000 7f5934d1d640 1 -- 172.21.15.88:0/1821490391 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c02ede0 con 0x7f59300c5aa0 2023-11-27T20:55:05.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.851+0000 7ff89affd640 1 --2- 172.21.15.88:0/353472538 >> v2:172.21.15.88:3300/0 conn(0x7ff89c157e20 0x7ff89c071b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.851+0000 7f5937f83640 1 -- 172.21.15.88:0/1821490391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59300c5aa0 msgr2=0x7f59300c6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.851+0000 7f5937f83640 1 --2- 172.21.15.88:0/1821490391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59300c5aa0 0x7f59300c6000 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f593006c100 tx=0x7f592c02dd50 comp rx=0 tx=0).stop 2023-11-27T20:55:05.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.852+0000 7f5937f83640 1 -- 172.21.15.88:0/1821490391 shutdown_connections 2023-11-27T20:55:05.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.852+0000 7f5937f83640 1 --2- 172.21.15.88:0/1821490391 >> v2:172.21.15.167:3300/0 conn(0x7f593016a1a0 0x7f59300c7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.852+0000 7f5937f83640 1 --2- 172.21.15.88:0/1821490391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59300c5aa0 0x7f59300c6000 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.852+0000 7f5937f83640 1 -- 172.21.15.88:0/1821490391 >> 172.21.15.88:0/1821490391 conn(0x7f593006c5f0 msgr2=0x7f593006c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:05.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.852+0000 7f5937f83640 1 -- 172.21.15.88:0/1821490391 shutdown_connections 2023-11-27T20:55:05.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.852+0000 7f5937f83640 1 -- 172.21.15.88:0/1821490391 wait complete. 2023-11-27T20:55:05.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.853+0000 7ff89bfff640 1 -- 172.21.15.88:0/353472538 >> v2:172.21.15.167:3300/0 conn(0x7ff89c151330 msgr2=0x7ff89c06ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:05.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.853+0000 7ff89bfff640 1 --2- 172.21.15.88:0/353472538 >> v2:172.21.15.167:3300/0 conn(0x7ff89c151330 0x7ff89c06ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.853+0000 7ff89bfff640 1 -- 172.21.15.88:0/353472538 >> v2:172.21.15.88:3300/0 conn(0x7ff89c157e20 msgr2=0x7ff89c071b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:05.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.853+0000 7ff89bfff640 1 --2- 172.21.15.88:0/353472538 >> v2:172.21.15.88:3300/0 conn(0x7ff89c157e20 0x7ff89c071b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.853+0000 7ff89bfff640 1 -- 172.21.15.88:0/353472538 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff89c0c6c10 con 0x7ff89c0c6360 2023-11-27T20:55:05.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.854+0000 7f5937f83640 1 Processor -- start 2023-11-27T20:55:05.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.854+0000 7f5937f83640 1 -- start start 2023-11-27T20:55:05.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.855+0000 7f5937f83640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59300c1680 0x7f5930072310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.855+0000 7f5937f83640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59300c5aa0 0x7f59301fbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.855+0000 7f5937f83640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f593016a1a0 0x7f59301fc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.856+0000 7f5937f83640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593015c070 con 0x7f593016a1a0 2023-11-27T20:55:05.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.856+0000 7f5937f83640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59301f3370 con 0x7f59300c1680 2023-11-27T20:55:05.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.856+0000 7f5937f83640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593015c2a0 con 0x7f59300c5aa0 2023-11-27T20:55:05.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.857+0000 7f5936520640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f593016a1a0 0x7f59301fc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.857+0000 7f5936520640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f593016a1a0 0x7f59301fc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50604/0 (socket says 172.21.15.88:50604) 2023-11-27T20:55:05.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.857+0000 7f5936520640 1 -- 172.21.15.88:0/1103017579 learned_addr learned my addr 172.21.15.88:0/1103017579 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:05.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.858+0000 7f593551e640 1 --2- 172.21.15.88:0/1103017579 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59300c5aa0 0x7f59301fbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.858+0000 7f3b3a7fc640 1 -- 172.21.15.88:0/2975038874 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c030b00 con 0x7f3b3c157690 2023-11-27T20:55:05.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.859+0000 7f3b3a7fc640 1 -- 172.21.15.88:0/2975038874 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2c030c60 con 0x7f3b3c157690 2023-11-27T20:55:05.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.859+0000 7f3b3a7fc640 1 -- 172.21.15.88:0/2975038874 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c038660 con 0x7f3b3c157690 2023-11-27T20:55:05.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.860+0000 7ff89bfff640 1 --2- 172.21.15.88:0/353472538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff89c0c6360 0x7ff89c0c5070 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff89c072ce0 tx=0x7ff89402bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e63d68e07a6ef0b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.860+0000 7f3b41b8a640 1 -- 172.21.15.88:0/2975038874 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b3c157690 msgr2=0x7f3b3c0cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.860+0000 7f3b41b8a640 1 --2- 172.21.15.88:0/2975038874 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b3c157690 0x7f3b3c0cbae0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c15a890 tx=0x7f3b2c02fd50 comp rx=0 tx=0).stop 2023-11-27T20:55:05.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.860+0000 7f3b41b8a640 1 -- 172.21.15.88:0/2975038874 shutdown_connections 2023-11-27T20:55:05.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.860+0000 7f3b41b8a640 1 --2- 172.21.15.88:0/2975038874 >> v2:172.21.15.167:3300/0 conn(0x7f3b3c0c0ed0 0x7f3b3c0cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.860+0000 7f3b41b8a640 1 --2- 172.21.15.88:0/2975038874 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b3c157690 0x7f3b3c0cbae0 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c15a890 tx=0x7f3b2c02fd50 comp rx=0 tx=0).stop 2023-11-27T20:55:05.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.860+0000 7f3b41b8a640 1 --2- 172.21.15.88:0/2975038874 >> v2:172.21.15.88:3300/0 conn(0x7f3b3c150210 0x7f3b3c156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.860+0000 7f3b41b8a640 1 -- 172.21.15.88:0/2975038874 >> 172.21.15.88:0/2975038874 conn(0x7f3b3c0700e0 msgr2=0x7f3b3c06b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:05.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.860+0000 7f3b41b8a640 1 -- 172.21.15.88:0/2975038874 shutdown_connections 2023-11-27T20:55:05.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.860+0000 7f3b41b8a640 1 -- 172.21.15.88:0/2975038874 wait complete. 2023-11-27T20:55:05.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.861+0000 7f5936520640 1 -- 172.21.15.88:0/1103017579 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59300c5aa0 msgr2=0x7f59301fbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.861+0000 7f5936520640 1 --2- 172.21.15.88:0/1103017579 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59300c5aa0 0x7f59301fbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.861+0000 7f5936520640 1 -- 172.21.15.88:0/1103017579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59300c1680 msgr2=0x7f5930072310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.861+0000 7f5936520640 1 --2- 172.21.15.88:0/1103017579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59300c1680 0x7f5930072310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.861+0000 7f5936520640 1 -- 172.21.15.88:0/1103017579 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c00d040 con 0x7f593016a1a0 2023-11-27T20:55:05.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.862+0000 7f3b41b8a640 1 Processor -- start 2023-11-27T20:55:05.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.862+0000 7f3b41b8a640 1 -- start start 2023-11-27T20:55:05.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.863+0000 7f3b41b8a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b3c0c0ed0 0x7f3b3c1e6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.863+0000 7f3b41b8a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b3c150210 0x7f3b3c14b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.864+0000 7f3b41b8a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b3c1495e0 0x7f3b3c14bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.864+0000 7f3b41b8a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c0c3350 con 0x7f3b3c150210 2023-11-27T20:55:05.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.864+0000 7f3b41b8a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c1f7820 con 0x7f3b3c1495e0 2023-11-27T20:55:05.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.864+0000 7f3b41b8a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c0c35a0 con 0x7f3b3c0c0ed0 2023-11-27T20:55:05.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.864+0000 7f5936520640 1 --2- 172.21.15.88:0/1103017579 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f593016a1a0 0x7f59301fc2d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f592000b410 tx=0x7f592000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.868+0000 7f59267fc640 1 -- 172.21.15.88:0/1103017579 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920011830 con 0x7f593016a1a0 2023-11-27T20:55:05.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.868+0000 7f59267fc640 1 -- 172.21.15.88:0/1103017579 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5920011990 con 0x7f593016a1a0 2023-11-27T20:55:05.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.868+0000 7f59267fc640 1 -- 172.21.15.88:0/1103017579 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920011830 con 0x7f593016a1a0 2023-11-27T20:55:05.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.868+0000 7f5937f83640 1 -- 172.21.15.88:0/1103017579 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593015fb30 con 0x7f593016a1a0 2023-11-27T20:55:05.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.869+0000 7f5937f83640 1 -- 172.21.15.88:0/1103017579 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59301f3000 con 0x7f593016a1a0 2023-11-27T20:55:05.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.870+0000 7f5937f83640 1 -- 172.21.15.88:0/1103017579 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5930067470 con 0x7f593016a1a0 2023-11-27T20:55:05.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.873+0000 7ff89a7fc640 1 -- 172.21.15.88:0/353472538 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89402ca80 con 0x7ff89c0c6360 2023-11-27T20:55:05.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.873+0000 7ff89a7fc640 1 -- 172.21.15.88:0/353472538 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89402cbe0 con 0x7ff89c0c6360 2023-11-27T20:55:05.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.873+0000 7ff89a7fc640 1 -- 172.21.15.88:0/353472538 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8940343f0 con 0x7ff89c0c6360 2023-11-27T20:55:05.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.873+0000 7f3b3b7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b3c0c0ed0 0x7f3b3c1e6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.873+0000 7f3b3b7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b3c0c0ed0 0x7f3b3c1e6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:34348/0 (socket says 172.21.15.88:34348) 2023-11-27T20:55:05.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.873+0000 7f3b3b7fe640 1 -- 172.21.15.88:0/1379289251 learned_addr learned my addr 172.21.15.88:0/1379289251 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:05.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.874+0000 7ff8a1eb4640 1 -- 172.21.15.88:0/353472538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff89c0c6360 msgr2=0x7ff89c0c5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.874+0000 7ff8a1eb4640 1 --2- 172.21.15.88:0/353472538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff89c0c6360 0x7ff89c0c5070 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff89c072ce0 tx=0x7ff89402bee0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.874+0000 7ff8a1eb4640 1 -- 172.21.15.88:0/353472538 shutdown_connections 2023-11-27T20:55:05.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.874+0000 7ff8a1eb4640 1 --2- 172.21.15.88:0/353472538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff89c0c6360 0x7ff89c0c5070 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.874+0000 7ff8a1eb4640 1 --2- 172.21.15.88:0/353472538 >> v2:172.21.15.88:3300/0 conn(0x7ff89c157e20 0x7ff89c071b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.874+0000 7ff8a1eb4640 1 --2- 172.21.15.88:0/353472538 >> v2:172.21.15.167:3300/0 conn(0x7ff89c151330 0x7ff89c06ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.874+0000 7ff8a1eb4640 1 -- 172.21.15.88:0/353472538 >> 172.21.15.88:0/353472538 conn(0x7ff89c06b5c0 msgr2=0x7ff89c06b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:05.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.874+0000 7ff8a1eb4640 1 -- 172.21.15.88:0/353472538 shutdown_connections 2023-11-27T20:55:05.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.875+0000 7ff8a1eb4640 1 -- 172.21.15.88:0/353472538 wait complete. 2023-11-27T20:55:05.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.877+0000 7ff8a1eb4640 1 Processor -- start 2023-11-27T20:55:05.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.877+0000 7ff8a1eb4640 1 -- start start 2023-11-27T20:55:05.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.877+0000 7f3b3b7fe640 1 -- 172.21.15.88:0/1379289251 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b3c1495e0 msgr2=0x7f3b3c14bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.877+0000 7f3b3b7fe640 1 --2- 172.21.15.88:0/1379289251 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b3c1495e0 0x7f3b3c14bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.877+0000 7f3b3b7fe640 1 -- 172.21.15.88:0/1379289251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b3c150210 msgr2=0x7f3b3c14b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.877+0000 7f3b3b7fe640 1 --2- 172.21.15.88:0/1379289251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b3c150210 0x7f3b3c14b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.877+0000 7f3b3b7fe640 1 -- 172.21.15.88:0/1379289251 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c0094d0 con 0x7f3b3c0c0ed0 2023-11-27T20:55:05.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.878+0000 7ff8a1eb4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff89c0c6360 0x7ff89c1449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.879+0000 7ff8a1eb4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff89c151330 0x7ff89c141350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.879+0000 7f27a3456640 1 Processor -- start 2023-11-27T20:55:05.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.879+0000 7ff8a1eb4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff89c157e20 0x7ff89c13cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.879+0000 7ff8a1eb4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c147950 con 0x7ff89c0c6360 2023-11-27T20:55:05.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.879+0000 7ff8a1eb4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c153ec0 con 0x7ff89c157e20 2023-11-27T20:55:05.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.879+0000 7ff8a1eb4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c154350 con 0x7ff89c151330 2023-11-27T20:55:05.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.879+0000 7f27a3456640 1 -- start start 2023-11-27T20:55:05.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.880+0000 7f27a3456640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f279c0cda70 0x7f279c0ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.880+0000 7f27a3456640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f279c0c9620 0x7f279c0c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.880+0000 7f27a3456640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f279c0cbda0 con 0x7f279c0cc420 2023-11-27T20:55:05.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.880+0000 7f27a3456640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f279c0cc230 con 0x7f279c0c9620 2023-11-27T20:55:05.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.880+0000 7f27a3456640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279c0cb4e0 con 0x7f279c0cda70 2023-11-27T20:55:05.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.883+0000 7f3b3b7fe640 1 --2- 172.21.15.88:0/1379289251 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b3c0c0ed0 0x7f3b3c1e6ee0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3b3000b4a0 tx=0x7f3b3000b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.886+0000 7ff89affd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff89c151330 0x7ff89c141350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.888+0000 7f27a11f2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f279c0cda70 0x7f279c0ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.888+0000 7f27a11f2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f279c0cda70 0x7f279c0ce350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:34368/0 (socket says 172.21.15.88:34368) 2023-11-27T20:55:05.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.888+0000 7f27a11f2640 1 -- 172.21.15.88:0/1217527412 learned_addr learned my addr 172.21.15.88:0/1217527412 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:05.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.889+0000 7ff89affd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff89c151330 0x7ff89c141350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:34360/0 (socket says 172.21.15.88:34360) 2023-11-27T20:55:05.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.889+0000 7ff89affd640 1 -- 172.21.15.88:0/523246499 learned_addr learned my addr 172.21.15.88:0/523246499 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:05.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.890+0000 7f3b23fff640 1 -- 172.21.15.88:0/1379289251 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b30010610 con 0x7f3b3c0c0ed0 2023-11-27T20:55:05.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.890+0000 7f3b23fff640 1 -- 172.21.15.88:0/1379289251 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b30010770 con 0x7f3b3c0c0ed0 2023-11-27T20:55:05.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.890+0000 7f3b23fff640 1 -- 172.21.15.88:0/1379289251 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b30010b20 con 0x7f3b3c0c0ed0 2023-11-27T20:55:05.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.891+0000 7f3b41b8a640 1 -- 172.21.15.88:0/1379289251 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b3c0c3880 con 0x7f3b3c0c0ed0 2023-11-27T20:55:05.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.891+0000 7f3b41b8a640 1 -- 172.21.15.88:0/1379289251 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b3c14a050 con 0x7f3b3c0c0ed0 2023-11-27T20:55:05.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.892+0000 7f3b41b8a640 1 -- 172.21.15.88:0/1379289251 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b3c06c4e0 con 0x7f3b3c0c0ed0 2023-11-27T20:55:05.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.892+0000 7f27a11f2640 1 -- 172.21.15.88:0/1217527412 >> v2:172.21.15.88:3300/0 conn(0x7f279c0c9620 msgr2=0x7f279c0c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:05.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.892+0000 7f27a11f2640 1 --2- 172.21.15.88:0/1217527412 >> v2:172.21.15.88:3300/0 conn(0x7f279c0c9620 0x7f279c0c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.892+0000 7f27a11f2640 1 -- 172.21.15.88:0/1217527412 >> v1:172.21.15.167:6789/0 conn(0x7f279c0cc420 legacy=0x7f279c159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:05.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.892+0000 7f27a11f2640 1 -- 172.21.15.88:0/1217527412 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279c0cce00 con 0x7f279c0cda70 2023-11-27T20:55:05.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.895+0000 7f59267fc640 1 -- 172.21.15.88:0/1103017579 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5920011b00 con 0x7f593016a1a0 2023-11-27T20:55:05.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.895+0000 7f59267fc640 1 --2- 172.21.15.88:0/1103017579 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f591406b280 0x7f591406d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.895+0000 7f5935d1f640 1 --2- 172.21.15.88:0/1103017579 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f591406b280 0x7f591406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:05.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.896+0000 7f5935d1f640 1 --2- 172.21.15.88:0/1103017579 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f591406b280 0x7f591406d740 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5928001c60 tx=0x7f5928007d10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:05.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.896+0000 7f34f9c10640 1 Processor -- start 2023-11-27T20:55:05.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.896+0000 7f34f9c10640 1 -- start start 2023-11-27T20:55:05.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.896+0000 7ff89affd640 1 -- 172.21.15.88:0/523246499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff89c157e20 msgr2=0x7ff89c13cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.896+0000 7ff89affd640 1 --2- 172.21.15.88:0/523246499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff89c157e20 0x7ff89c13cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.896+0000 7ff89affd640 1 -- 172.21.15.88:0/523246499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff89c0c6360 msgr2=0x7ff89c1449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:05.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.896+0000 7ff89affd640 1 --2- 172.21.15.88:0/523246499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff89c0c6360 0x7ff89c1449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:05.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.896+0000 7ff89affd640 1 -- 172.21.15.88:0/523246499 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff894009b30 con 0x7ff89c151330 2023-11-27T20:55:05.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.897+0000 7f34f9c10640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f34f40c6780 0x7f34f4072740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.897+0000 7f34f9c10640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f4159700 con 0x7f34f4153490 2023-11-27T20:55:05.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.897+0000 7f34f9c10640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f415d3b0 con 0x7f34f4153870 2023-11-27T20:55:05.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.897+0000 7f34f9c10640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f415d930 con 0x7f34f40c6780 2023-11-27T20:55:05.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.928+0000 7fc2eb856640 1 Processor -- start 2023-11-27T20:55:05.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.928+0000 7fc2eb856640 1 -- start start 2023-11-27T20:55:05.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.929+0000 7fc2eb856640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc2e40cc420 0x7fc2e4159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.929+0000 7fc2eb856640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc2e4159b50 0x7fc2e40c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.929+0000 7fc2eb856640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e40cbda0 con 0x7fc2e40cda70 2023-11-27T20:55:05.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.929+0000 7fc2eb856640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e40cc230 con 0x7fc2e4159b50 2023-11-27T20:55:05.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.929+0000 7fc2eb856640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e40cea60 con 0x7fc2e40cc420 2023-11-27T20:55:05.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.947+0000 7f59267fc640 1 -- 172.21.15.88:0/1103017579 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5920058d70 con 0x7f593016a1a0 2023-11-27T20:55:05.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.950+0000 7f294fea6640 1 Processor -- start 2023-11-27T20:55:05.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.950+0000 7f294fea6640 1 -- start start 2023-11-27T20:55:05.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.951+0000 7f294fea6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f29480cc420 0x7f2948159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.951+0000 7f294fea6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2948159b50 0x7f29480c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:05.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.951+0000 7f294fea6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29480cbda0 con 0x7f29480cda70 2023-11-27T20:55:05.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.951+0000 7f294fea6640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29480cc230 con 0x7f29480cc420 2023-11-27T20:55:05.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:05.951+0000 7f294fea6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29480cea60 con 0x7f2948159b50 2023-11-27T20:55:06.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.103+0000 7f9077fff640 1 -- 172.21.15.88:0/2887880621 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9078010c80 con 0x7f908404c980 2023-11-27T20:55:06.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.104+0000 7f9077fff640 1 --2- 172.21.15.88:0/2887880621 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f907006b210 0x7f907006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:06.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.104+0000 7f908b7fe640 1 --2- 172.21.15.88:0/2887880621 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f907006b210 0x7f907006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:06.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.104+0000 7f908b7fe640 1 --2- 172.21.15.88:0/2887880621 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f907006b210 0x7f907006d6d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9080036000 tx=0x7f9080008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:06.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.108+0000 7f9077fff640 1 -- 172.21.15.88:0/2887880621 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9078058480 con 0x7f908404c980 2023-11-27T20:55:06.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.118+0000 7f9077fff640 1 -- 172.21.15.88:0/2887880621 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9078058250 con 0x7f908404c980 2023-11-27T20:55:06.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.125+0000 7fc2e8df1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc2e40cc420 0x7fc2e4159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:06.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.126+0000 7fc2e8df1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc2e40cc420 0x7fc2e4159610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:41370/0 (socket says 172.21.15.88:41370) 2023-11-27T20:55:06.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.126+0000 7fc2e8df1640 1 -- 172.21.15.88:0/970866339 learned_addr learned my addr 172.21.15.88:0/970866339 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:06.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.130+0000 7fc2e8df1640 1 -- 172.21.15.88:0/970866339 >> v2:172.21.15.88:3300/0 conn(0x7fc2e4159b50 msgr2=0x7fc2e40c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:06.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.130+0000 7fc2e8df1640 1 --2- 172.21.15.88:0/970866339 >> v2:172.21.15.88:3300/0 conn(0x7fc2e4159b50 0x7fc2e40c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.130+0000 7fc2e8df1640 1 -- 172.21.15.88:0/970866339 >> v1:172.21.15.88:6789/0 conn(0x7fc2e40cda70 legacy=0x7fc2e40ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:06.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.130+0000 7fc2e8df1640 1 -- 172.21.15.88:0/970866339 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e40cb4e0 con 0x7fc2e40cc420 2023-11-27T20:55:06.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.134+0000 7f294dc42640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f29480cda70 0x7f29480ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:59092/0 (socket says 172.21.15.88:59092) 2023-11-27T20:55:06.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.134+0000 7f294dc42640 1 -- 172.21.15.88:0/2371205600 learned_addr learned my addr 172.21.15.88:0/2371205600 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:55:06.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.135+0000 7f294e443640 1 --2- 172.21.15.88:0/2371205600 >> v2:172.21.15.167:3300/0 conn(0x7f2948159b50 0x7f29480c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:06.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.135+0000 7fc2e8df1640 1 --2- 172.21.15.88:0/970866339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2e40cc420 0x7fc2e4159610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40cfda0 tx=0x7fc2d402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6c8aa266516a17e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:06.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.140+0000 7f34f2ffd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f34f4153870 0x7f34f40c83c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:59078/0 (socket says 172.21.15.88:59078) 2023-11-27T20:55:06.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.140+0000 7f34f2ffd640 1 -- 172.21.15.88:0/133820153 learned_addr learned my addr 172.21.15.88:0/133820153 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:55:06.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.141+0000 7ff89affd640 1 --2- 172.21.15.88:0/523246499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff89c151330 0x7ff89c141350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff89000d7b0 tx=0x7ff89000dc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:06.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.141+0000 7f27a11f2640 1 --2- 172.21.15.88:0/1217527412 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f279c0cda70 0x7f279c0ce350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f278c009870 tx=0x7f278c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad3aa97297ad517a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:06.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.142+0000 7f294e443640 1 -- 172.21.15.88:0/2371205600 >> v2:172.21.15.88:3300/0 conn(0x7f29480cc420 msgr2=0x7f2948159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:06.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.142+0000 7f294e443640 1 --2- 172.21.15.88:0/2371205600 >> v2:172.21.15.88:3300/0 conn(0x7f29480cc420 0x7f2948159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.142+0000 7f294e443640 1 -- 172.21.15.88:0/2371205600 >> v1:172.21.15.167:6789/0 conn(0x7f29480cda70 legacy=0x7f29480ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.142+0000 7f294e443640 1 -- 172.21.15.88:0/2371205600 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29480cb4e0 con 0x7f2948159b50 2023-11-27T20:55:06.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.146+0000 7f59267fc640 1 -- 172.21.15.88:0/1103017579 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f59200549b0 con 0x7f593016a1a0 2023-11-27T20:55:06.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.146+0000 7f294e443640 1 --2- 172.21.15.88:0/2371205600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2948159b50 0x7f29480c9620 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f294806d2d0 tx=0x7f294002bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=554f9b33656f957e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:06.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.149+0000 7fc2dbfff640 1 -- 172.21.15.88:0/970866339 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4030860 con 0x7fc2e40cc420 2023-11-27T20:55:06.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.149+0000 7fc2dbfff640 1 -- 172.21.15.88:0/970866339 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d40309c0 con 0x7fc2e40cc420 2023-11-27T20:55:06.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.149+0000 7fc2dbfff640 1 -- 172.21.15.88:0/970866339 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4030d50 con 0x7fc2e40cc420 2023-11-27T20:55:06.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.150+0000 7fc2eb856640 1 -- 172.21.15.88:0/970866339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2e40cc420 msgr2=0x7fc2e4159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.150+0000 7fc2eb856640 1 --2- 172.21.15.88:0/970866339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2e40cc420 0x7fc2e4159610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40cfda0 tx=0x7fc2d402b9a0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.150+0000 7fc2eb856640 1 -- 172.21.15.88:0/970866339 shutdown_connections 2023-11-27T20:55:06.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.150+0000 7fc2eb856640 1 --2- 172.21.15.88:0/970866339 >> v2:172.21.15.88:3300/0 conn(0x7fc2e4159b50 0x7fc2e40c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.150+0000 7fc2eb856640 1 --2- 172.21.15.88:0/970866339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2e40cc420 0x7fc2e4159610 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.150+0000 7fc2eb856640 1 -- 172.21.15.88:0/970866339 >> 172.21.15.88:0/970866339 conn(0x7fc2e40b07b0 msgr2=0x7fc2e40b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:06.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.150+0000 7fc2eb856640 1 -- 172.21.15.88:0/970866339 shutdown_connections 2023-11-27T20:55:06.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.150+0000 7fc2eb856640 1 -- 172.21.15.88:0/970866339 wait complete. 2023-11-27T20:55:06.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.152+0000 7fc2eb856640 1 Processor -- start 2023-11-27T20:55:06.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.152+0000 7fc2eb856640 1 -- start start 2023-11-27T20:55:06.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.153+0000 7fc2eb856640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2e40cc420 0x7fc2e40aa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:06.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.153+0000 7fc2eb856640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2e40cda70 0x7fc2e40aab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:06.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.153+0000 7fc2eb856640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2e4159b50 0x7fc2e40b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:06.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.153+0000 7fc2eb856640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e40ab380 con 0x7fc2e40cda70 2023-11-27T20:55:06.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.153+0000 7fc2eb856640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e41ef560 con 0x7fc2e4159b50 2023-11-27T20:55:06.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.153+0000 7fc2eb856640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e41ef840 con 0x7fc2e40cc420 2023-11-27T20:55:06.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.153+0000 7f294cc40640 1 -- 172.21.15.88:0/2371205600 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294002cd00 con 0x7f2948159b50 2023-11-27T20:55:06.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.154+0000 7f294cc40640 1 -- 172.21.15.88:0/2371205600 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294002ce60 con 0x7f2948159b50 2023-11-27T20:55:06.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.154+0000 7f294cc40640 1 -- 172.21.15.88:0/2371205600 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2940034660 con 0x7f2948159b50 2023-11-27T20:55:06.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.154+0000 7f294fea6640 1 -- 172.21.15.88:0/2371205600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2948159b50 msgr2=0x7f29480c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.154+0000 7f294fea6640 1 --2- 172.21.15.88:0/2371205600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2948159b50 0x7f29480c9620 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f294806d2d0 tx=0x7f294002bf50 comp rx=0 tx=0).stop 2023-11-27T20:55:06.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.154+0000 7f294fea6640 1 -- 172.21.15.88:0/2371205600 shutdown_connections 2023-11-27T20:55:06.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.154+0000 7f294fea6640 1 --2- 172.21.15.88:0/2371205600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2948159b50 0x7f29480c9620 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.154+0000 7f294fea6640 1 --2- 172.21.15.88:0/2371205600 >> v2:172.21.15.88:3300/0 conn(0x7f29480cc420 0x7f2948159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.154+0000 7f294fea6640 1 -- 172.21.15.88:0/2371205600 >> 172.21.15.88:0/2371205600 conn(0x7f29480b07b0 msgr2=0x7f29480b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:06.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.154+0000 7f294fea6640 1 -- 172.21.15.88:0/2371205600 shutdown_connections 2023-11-27T20:55:06.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.154+0000 7f294fea6640 1 -- 172.21.15.88:0/2371205600 wait complete. 2023-11-27T20:55:06.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.155+0000 7fc2e9df3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2e4159b50 0x7fc2e40b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:06.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.156+0000 7fc2e9df3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2e4159b50 0x7fc2e40b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:41380/0 (socket says 172.21.15.88:41380) 2023-11-27T20:55:06.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.156+0000 7fc2e9df3640 1 -- 172.21.15.88:0/237040845 learned_addr learned my addr 172.21.15.88:0/237040845 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:06.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.156+0000 7f294fea6640 1 Processor -- start 2023-11-27T20:55:06.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.156+0000 7f294fea6640 1 -- start start 2023-11-27T20:55:06.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.156+0000 7f294fea6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29480cc420 0x7f2948158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:06.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.156+0000 7f294fea6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29480cda70 0x7f29480b2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:06.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.156+0000 7f294fea6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2948159b50 0x7f2948155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:06.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.157+0000 7f294fea6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29480b2450 con 0x7f2948159b50 2023-11-27T20:55:06.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.157+0000 7f294fea6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2948159840 con 0x7f29480cc420 2023-11-27T20:55:06.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.157+0000 7f294fea6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29480b1840 con 0x7f29480cda70 2023-11-27T20:55:06.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.157+0000 7f3b23fff640 1 -- 172.21.15.88:0/1379289251 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3b30010c80 con 0x7f3b3c0c0ed0 2023-11-27T20:55:06.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.158+0000 7f3b23fff640 1 --2- 172.21.15.88:0/1379289251 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3b2806b240 0x7f3b2806d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:06.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.158+0000 7f3b3affd640 1 --2- 172.21.15.88:0/1379289251 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3b2806b240 0x7f3b2806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:06.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.158+0000 7f3b3affd640 1 --2- 172.21.15.88:0/1379289251 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3b2806b240 0x7f3b2806d700 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c03a000 tx=0x7f3b2c032000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:06.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.159+0000 7f34f3fff640 1 --2- 172.21.15.88:0/133820153 >> v2:172.21.15.88:3300/0 conn(0x7f34f40c6780 0x7f34f4072740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:06.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.160+0000 7fc2e9df3640 1 -- 172.21.15.88:0/237040845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2e40cc420 msgr2=0x7fc2e40aa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.160+0000 7fc2e9df3640 1 --2- 172.21.15.88:0/237040845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2e40cc420 0x7fc2e40aa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.160+0000 7fc2e9df3640 1 -- 172.21.15.88:0/237040845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2e40cda70 msgr2=0x7fc2e40aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.160+0000 7fc2e9df3640 1 --2- 172.21.15.88:0/237040845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2e40cda70 0x7fc2e40aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.160+0000 7fc2e9df3640 1 -- 172.21.15.88:0/237040845 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d40094d0 con 0x7fc2e4159b50 2023-11-27T20:55:06.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.162+0000 7f3b23fff640 1 -- 172.21.15.88:0/1379289251 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3b30058b40 con 0x7f3b3c0c0ed0 2023-11-27T20:55:06.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.164+0000 7f294dc42640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29480cc420 0x7f2948158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:06.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.165+0000 7f294dc42640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29480cc420 0x7f2948158630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:41386/0 (socket says 172.21.15.88:41386) 2023-11-27T20:55:06.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.165+0000 7f294dc42640 1 -- 172.21.15.88:0/3962182810 learned_addr learned my addr 172.21.15.88:0/3962182810 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:06.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.165+0000 7fc2e9df3640 1 --2- 172.21.15.88:0/237040845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2e4159b50 0x7fc2e40b3f30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00ba10 tx=0x7fc2dc00bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:06.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.169+0000 7f294dc42640 1 -- 172.21.15.88:0/3962182810 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29480cda70 msgr2=0x7f29480b2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.169+0000 7f294dc42640 1 --2- 172.21.15.88:0/3962182810 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29480cda70 0x7f29480b2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.169+0000 7f294dc42640 1 -- 172.21.15.88:0/3962182810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2948159b50 msgr2=0x7f2948155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.169+0000 7f294dc42640 1 --2- 172.21.15.88:0/3962182810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2948159b50 0x7f2948155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.169+0000 7f294dc42640 1 -- 172.21.15.88:0/3962182810 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2940009a70 con 0x7f29480cc420 2023-11-27T20:55:06.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.174+0000 7f294dc42640 1 --2- 172.21.15.88:0/3962182810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29480cc420 0x7f2948158630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f293800c400 tx=0x7f293800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:06.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.175+0000 7fc2d9ffb640 1 -- 172.21.15.88:0/237040845 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc00cac0 con 0x7fc2e4159b50 2023-11-27T20:55:06.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.175+0000 7fc2d9ffb640 1 -- 172.21.15.88:0/237040845 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2dc00cc40 con 0x7fc2e4159b50 2023-11-27T20:55:06.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.175+0000 7fc2eb856640 1 -- 172.21.15.88:0/237040845 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e41efb20 con 0x7fc2e4159b50 2023-11-27T20:55:06.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.175+0000 7fc2d9ffb640 1 -- 172.21.15.88:0/237040845 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc014440 con 0x7fc2e4159b50 2023-11-27T20:55:06.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.175+0000 7fc2eb856640 1 -- 172.21.15.88:0/237040845 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e40b3a10 con 0x7fc2e4159b50 2023-11-27T20:55:06.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.176+0000 7fc2eb856640 1 -- 172.21.15.88:0/237040845 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e41f0040 con 0x7fc2e4159b50 2023-11-27T20:55:06.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.177+0000 7ff883fff640 1 -- 172.21.15.88:0/523246499 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89000b6c0 con 0x7ff89c151330 2023-11-27T20:55:06.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.177+0000 7ff883fff640 1 -- 172.21.15.88:0/523246499 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89000b820 con 0x7ff89c151330 2023-11-27T20:55:06.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.177+0000 7ff8a1eb4640 1 -- 172.21.15.88:0/523246499 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff89c152fd0 con 0x7ff89c151330 2023-11-27T20:55:06.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.177+0000 7ff883fff640 1 -- 172.21.15.88:0/523246499 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89000bbb0 con 0x7ff89c151330 2023-11-27T20:55:06.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.177+0000 7ff8a1eb4640 1 -- 172.21.15.88:0/523246499 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff89c153590 con 0x7ff89c151330 2023-11-27T20:55:06.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.178+0000 7f293e7fc640 1 -- 172.21.15.88:0/3962182810 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2938005ce0 con 0x7f29480cc420 2023-11-27T20:55:06.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.178+0000 7f294fea6640 1 -- 172.21.15.88:0/3962182810 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29480b1b20 con 0x7f29480cc420 2023-11-27T20:55:06.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.178+0000 7f294fea6640 1 -- 172.21.15.88:0/3962182810 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29480b20e0 con 0x7f29480cc420 2023-11-27T20:55:06.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.178+0000 7f279bfff640 1 -- 172.21.15.88:0/1217527412 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c030840 con 0x7f279c0cda70 2023-11-27T20:55:06.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.178+0000 7f279bfff640 1 -- 172.21.15.88:0/1217527412 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278c0309a0 con 0x7f279c0cda70 2023-11-27T20:55:06.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.178+0000 7f279bfff640 1 -- 172.21.15.88:0/1217527412 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c030840 con 0x7f279c0cda70 2023-11-27T20:55:06.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.178+0000 7f3b23fff640 1 -- 172.21.15.88:0/1379289251 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3b30054780 con 0x7f3b3c0c0ed0 2023-11-27T20:55:06.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.179+0000 7f27a3456640 1 -- 172.21.15.88:0/1217527412 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f279c0cda70 msgr2=0x7f279c0ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.179+0000 7f27a3456640 1 --2- 172.21.15.88:0/1217527412 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f279c0cda70 0x7f279c0ce350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f278c009870 tx=0x7f278c02b980 comp rx=0 tx=0).stop 2023-11-27T20:55:06.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.179+0000 7ff8a1eb4640 1 -- 172.21.15.88:0/523246499 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff89c073dc0 con 0x7ff89c151330 2023-11-27T20:55:06.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.179+0000 7f27a3456640 1 -- 172.21.15.88:0/1217527412 shutdown_connections 2023-11-27T20:55:06.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.179+0000 7f27a3456640 1 --2- 172.21.15.88:0/1217527412 >> v2:172.21.15.88:3300/0 conn(0x7f279c0c9620 0x7f279c0c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.179+0000 7f27a3456640 1 --2- 172.21.15.88:0/1217527412 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f279c0cda70 0x7f279c0ce350 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.179+0000 7f27a3456640 1 -- 172.21.15.88:0/1217527412 >> 172.21.15.88:0/1217527412 conn(0x7f279c0b07b0 msgr2=0x7f279c0b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:06.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.179+0000 7f27a3456640 1 -- 172.21.15.88:0/1217527412 shutdown_connections 2023-11-27T20:55:06.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.179+0000 7f27a3456640 1 -- 172.21.15.88:0/1217527412 wait complete. 2023-11-27T20:55:06.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.179+0000 7f294fea6640 1 -- 172.21.15.88:0/3962182810 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29480b2730 con 0x7f29480cc420 2023-11-27T20:55:06.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.180+0000 7f27a3456640 1 Processor -- start 2023-11-27T20:55:06.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.181+0000 7f27a3456640 1 -- start start 2023-11-27T20:55:06.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.182+0000 7f27a3456640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f279c0c9620 0x7f279c14ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:06.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.182+0000 7f27a3456640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f279c0cc420 0x7f279c14b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:06.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.182+0000 7f27a3456640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f279c0cda70 0x7f279c1494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:06.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.182+0000 7f27a3456640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c150880 con 0x7f279c0c9620 2023-11-27T20:55:06.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.182+0000 7f27a3456640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c14e520 con 0x7f279c0cda70 2023-11-27T20:55:06.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.182+0000 7f27a3456640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279c14c940 con 0x7f279c0cc420 2023-11-27T20:55:06.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.214+0000 7f34f3fff640 1 -- 172.21.15.88:0/133820153 >> v1:172.21.15.167:6789/0 conn(0x7f34f4153870 legacy=0x7f34f40c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.214+0000 7f34f3fff640 1 -- 172.21.15.88:0/133820153 >> v1:172.21.15.88:6789/0 conn(0x7f34f4153490 legacy=0x7f34f4159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:06.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.214+0000 7f34f3fff640 1 -- 172.21.15.88:0/133820153 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f40c6cd0 con 0x7f34f40c6780 2023-11-27T20:55:06.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.217+0000 7f34f3fff640 1 --2- 172.21.15.88:0/133820153 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34f40c6780 0x7f34f4072740 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f34f40c6ec0 tx=0x7f34ec02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfcaa6af43e362dd server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:06.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.226+0000 7f27a11f2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f279c0c9620 0x7f279c14ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:06.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.227+0000 7f27a11f2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f279c0c9620 0x7f279c14ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50686/0 (socket says 172.21.15.88:50686) 2023-11-27T20:55:06.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.227+0000 7f27a11f2640 1 -- 172.21.15.88:0/292718578 learned_addr learned my addr 172.21.15.88:0/292718578 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:06.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.231+0000 7f27a11f2640 1 -- 172.21.15.88:0/292718578 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f279c0cc420 msgr2=0x7f279c14b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.231+0000 7f27a11f2640 1 --2- 172.21.15.88:0/292718578 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f279c0cc420 0x7f279c14b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.231+0000 7f27a11f2640 1 -- 172.21.15.88:0/292718578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f279c0cda70 msgr2=0x7f279c1494a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.231+0000 7f27a11f2640 1 --2- 172.21.15.88:0/292718578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f279c0cda70 0x7f279c1494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.231+0000 7f27a11f2640 1 -- 172.21.15.88:0/292718578 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c0094d0 con 0x7f279c0c9620 2023-11-27T20:55:06.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.233+0000 7f27a11f2640 1 --2- 172.21.15.88:0/292718578 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f279c0c9620 0x7f279c14ac10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f278c02b9c0 tx=0x7f278c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:06.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.237+0000 7f34f27fc640 1 -- 172.21.15.88:0/133820153 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec02cc50 con 0x7f34f40c6780 2023-11-27T20:55:06.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.237+0000 7f34f27fc640 1 -- 172.21.15.88:0/133820153 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ec02cdb0 con 0x7f34f40c6780 2023-11-27T20:55:06.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.237+0000 7f34f27fc640 1 -- 172.21.15.88:0/133820153 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec034660 con 0x7f34f40c6780 2023-11-27T20:55:06.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.237+0000 7f34f9c10640 1 -- 172.21.15.88:0/133820153 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34f40c6780 msgr2=0x7f34f4072740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.237+0000 7f34f9c10640 1 --2- 172.21.15.88:0/133820153 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34f40c6780 0x7f34f4072740 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f34f40c6ec0 tx=0x7f34ec02bea0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.237+0000 7f34f9c10640 1 -- 172.21.15.88:0/133820153 shutdown_connections 2023-11-27T20:55:06.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.237+0000 7f34f9c10640 1 --2- 172.21.15.88:0/133820153 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34f40c6780 0x7f34f4072740 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.237+0000 7f34f9c10640 1 -- 172.21.15.88:0/133820153 >> 172.21.15.88:0/133820153 conn(0x7f34f406b5c0 msgr2=0x7f34f406b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:06.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.238+0000 7f34f9c10640 1 -- 172.21.15.88:0/133820153 shutdown_connections 2023-11-27T20:55:06.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.238+0000 7f34f9c10640 1 -- 172.21.15.88:0/133820153 wait complete. 2023-11-27T20:55:06.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.238+0000 7f2799ffb640 1 -- 172.21.15.88:0/292718578 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c03e070 con 0x7f279c0c9620 2023-11-27T20:55:06.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.238+0000 7f2799ffb640 1 -- 172.21.15.88:0/292718578 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278c003610 con 0x7f279c0c9620 2023-11-27T20:55:06.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.238+0000 7f27a3456640 1 -- 172.21.15.88:0/292718578 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f279c14e7c0 con 0x7f279c0c9620 2023-11-27T20:55:06.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.238+0000 7f2799ffb640 1 -- 172.21.15.88:0/292718578 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c0039c0 con 0x7f279c0c9620 2023-11-27T20:55:06.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.238+0000 7f27a3456640 1 -- 172.21.15.88:0/292718578 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f279c14cdc0 con 0x7f279c0c9620 2023-11-27T20:55:06.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.239+0000 7f34f9c10640 1 Processor -- start 2023-11-27T20:55:06.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.239+0000 7f27a3456640 1 -- 172.21.15.88:0/292718578 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f279c072670 con 0x7f279c0c9620 2023-11-27T20:55:06.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.239+0000 7f34f9c10640 1 -- start start 2023-11-27T20:55:06.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.240+0000 7f34f9c10640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34f40c6780 0x7f34f41f19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:06.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.240+0000 7f34f9c10640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34f4153490 0x7f34f4155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:06.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.240+0000 7f34f9c10640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34f4153870 0x7f34f414f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:06.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.240+0000 7f34f9c10640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f41f1ee0 con 0x7f34f4153490 2023-11-27T20:55:06.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.240+0000 7f34f9c10640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f40bbc20 con 0x7f34f40c6780 2023-11-27T20:55:06.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.240+0000 7f34f9c10640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f415a570 con 0x7f34f4153870 2023-11-27T20:55:06.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.241+0000 7f34f2ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34f4153490 0x7f34f4155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:06.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.251+0000 7f34f2ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34f4153490 0x7f34f4155ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50696/0 (socket says 172.21.15.88:50696) 2023-11-27T20:55:06.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.251+0000 7f34f2ffd640 1 -- 172.21.15.88:0/1083246018 learned_addr learned my addr 172.21.15.88:0/1083246018 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:06.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.344+0000 7f9090c67640 1 -- 172.21.15.88:0/2887880621 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f906c0057d0 con 0x7f908404c980 2023-11-27T20:55:06.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.381+0000 7f5937f83640 1 -- 172.21.15.88:0/1103017579 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f59300c6670 con 0x7f593016a1a0 2023-11-27T20:55:06.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.395+0000 7f3b41b8a640 1 -- 172.21.15.88:0/1379289251 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3b3c073dc0 con 0x7f3b3c0c0ed0 2023-11-27T20:55:06.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.429+0000 7f293e7fc640 1 -- 172.21.15.88:0/3962182810 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2938005e40 con 0x7f29480cc420 2023-11-27T20:55:06.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.429+0000 7f293e7fc640 1 -- 172.21.15.88:0/3962182810 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2938004a00 con 0x7f29480cc420 2023-11-27T20:55:06.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.443+0000 7fc2d9ffb640 1 -- 172.21.15.88:0/237040845 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc2dc01d3b0 con 0x7fc2e4159b50 2023-11-27T20:55:06.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.443+0000 7fc2d9ffb640 1 --2- 172.21.15.88:0/237040845 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fc2c806b1c0 0x7fc2c806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:06.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.444+0000 7fc2e95f2640 1 --2- 172.21.15.88:0/237040845 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fc2c806b1c0 0x7fc2c806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:06.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.444+0000 7fc2e95f2640 1 --2- 172.21.15.88:0/237040845 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fc2c806b1c0 0x7fc2c806d680 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0001560 tx=0x7fc2e0007990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:06.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.447+0000 7fc2d9ffb640 1 -- 172.21.15.88:0/237040845 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc2dc058cb0 con 0x7fc2e4159b50 2023-11-27T20:55:06.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.450+0000 7ff883fff640 1 -- 172.21.15.88:0/523246499 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff89000bd10 con 0x7ff89c151330 2023-11-27T20:55:06.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.450+0000 7ff883fff640 1 --2- 172.21.15.88:0/523246499 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff88806b210 0x7ff88806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:06.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.450+0000 7ff89b7fe640 1 --2- 172.21.15.88:0/523246499 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff88806b210 0x7ff88806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:06.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.450+0000 7ff89b7fe640 1 --2- 172.21.15.88:0/523246499 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff88806b210 0x7ff88806d6d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff88c009670 tx=0x7ff88c006bf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:06.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.455+0000 7ff883fff640 1 -- 172.21.15.88:0/523246499 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff890059ae0 con 0x7ff89c151330 2023-11-27T20:55:06.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.455+0000 7f3b23fff640 1 -- 172.21.15.88:0/1379289251 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3b3001e020 con 0x7f3b3c0c0ed0 2023-11-27T20:55:06.457 INFO:teuthology.orchestra.run.smithi088.stdout:64424509454 2023-11-27T20:55:06.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.458+0000 7f3b41b8a640 1 -- 172.21.15.88:0/1379289251 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3b2806b240 msgr2=0x7f3b2806d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.458+0000 7f3b41b8a640 1 --2- 172.21.15.88:0/1379289251 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3b2806b240 0x7f3b2806d700 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c03a000 tx=0x7f3b2c032000 comp rx=0 tx=0).stop 2023-11-27T20:55:06.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.458+0000 7f3b41b8a640 1 -- 172.21.15.88:0/1379289251 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b3c0c0ed0 msgr2=0x7f3b3c1e6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.458+0000 7f3b41b8a640 1 --2- 172.21.15.88:0/1379289251 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b3c0c0ed0 0x7f3b3c1e6ee0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3b3000b4a0 tx=0x7f3b3000b960 comp rx=0 tx=0).stop 2023-11-27T20:55:06.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.458+0000 7f3b41b8a640 1 -- 172.21.15.88:0/1379289251 shutdown_connections 2023-11-27T20:55:06.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.458+0000 7f3b41b8a640 1 --2- 172.21.15.88:0/1379289251 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3b2806b240 0x7f3b2806d700 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.458+0000 7f3b41b8a640 1 --2- 172.21.15.88:0/1379289251 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b3c1495e0 0x7f3b3c14bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.458+0000 7f3b41b8a640 1 --2- 172.21.15.88:0/1379289251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b3c150210 0x7f3b3c14b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.458+0000 7f3b41b8a640 1 --2- 172.21.15.88:0/1379289251 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b3c0c0ed0 0x7f3b3c1e6ee0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.458+0000 7f3b41b8a640 1 -- 172.21.15.88:0/1379289251 >> 172.21.15.88:0/1379289251 conn(0x7f3b3c0700e0 msgr2=0x7f3b3c06b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:06.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.458+0000 7f3b41b8a640 1 -- 172.21.15.88:0/1379289251 shutdown_connections 2023-11-27T20:55:06.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.458+0000 7f3b41b8a640 1 -- 172.21.15.88:0/1379289251 wait complete. 2023-11-27T20:55:06.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.459+0000 7fc2d9ffb640 1 -- 172.21.15.88:0/237040845 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc2dc0548f0 con 0x7fc2e4159b50 2023-11-27T20:55:06.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509454 for osd.0 2023-11-27T20:55:06.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.469+0000 7ff883fff640 1 -- 172.21.15.88:0/523246499 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff890055720 con 0x7ff89c151330 2023-11-27T20:55:06.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.474+0000 7f34f3fff640 1 --2- 172.21.15.88:0/1083246018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34f4153870 0x7f34f414f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:06.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.510+0000 7f34f37fe640 1 --2- 172.21.15.88:0/1083246018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34f40c6780 0x7f34f41f19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:06.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.531+0000 7f34f3fff640 1 -- 172.21.15.88:0/1083246018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34f40c6780 msgr2=0x7f34f41f19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.531+0000 7f34f3fff640 1 --2- 172.21.15.88:0/1083246018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34f40c6780 0x7f34f41f19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.531+0000 7f34f3fff640 1 -- 172.21.15.88:0/1083246018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34f4153490 msgr2=0x7f34f4155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.531+0000 7f34f3fff640 1 --2- 172.21.15.88:0/1083246018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34f4153490 0x7f34f4155ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.531+0000 7f34f3fff640 1 -- 172.21.15.88:0/1083246018 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ec009a70 con 0x7f34f4153870 2023-11-27T20:55:06.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.533+0000 7f34f3fff640 1 --2- 172.21.15.88:0/1083246018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34f4153870 0x7f34f414f410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f34f40c6730 tx=0x7f34ec004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:06.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.535+0000 7f2799ffb640 1 -- 172.21.15.88:0/292718578 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f278c042070 con 0x7f279c0c9620 2023-11-27T20:55:06.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.535+0000 7f2799ffb640 1 --2- 172.21.15.88:0/292718578 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f278806b1f0 0x7f278806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:06.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.535+0000 7f27a09f1640 1 --2- 172.21.15.88:0/292718578 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f278806b1f0 0x7f278806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:06.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.536+0000 7f27a09f1640 1 --2- 172.21.15.88:0/292718578 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f278806b1f0 0x7f278806d6b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f279c0c2110 tx=0x7f2790007990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:06.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.537+0000 7f34dbfff640 1 -- 172.21.15.88:0/1083246018 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec03e610 con 0x7f34f4153870 2023-11-27T20:55:06.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.537+0000 7f34dbfff640 1 -- 172.21.15.88:0/1083246018 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ec03e770 con 0x7f34f4153870 2023-11-27T20:55:06.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.537+0000 7f34dbfff640 1 -- 172.21.15.88:0/1083246018 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec03eb20 con 0x7f34f4153870 2023-11-27T20:55:06.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.537+0000 7f34f9c10640 1 -- 172.21.15.88:0/1083246018 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f4154b60 con 0x7f34f4153870 2023-11-27T20:55:06.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.537+0000 7f34f9c10640 1 -- 172.21.15.88:0/1083246018 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f4155120 con 0x7f34f4153870 2023-11-27T20:55:06.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.539+0000 7f34f9c10640 1 -- 172.21.15.88:0/1083246018 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f4073dc0 con 0x7f34f4153870 2023-11-27T20:55:06.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.549+0000 7f2799ffb640 1 -- 172.21.15.88:0/292718578 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f278c07ae30 con 0x7f279c0c9620 2023-11-27T20:55:06.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.549+0000 7f2799ffb640 1 -- 172.21.15.88:0/292718578 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f278c076a70 con 0x7f279c0c9620 2023-11-27T20:55:06.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.557+0000 7f34dbfff640 1 -- 172.21.15.88:0/1083246018 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f34ec03b050 con 0x7f34f4153870 2023-11-27T20:55:06.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.557+0000 7f34dbfff640 1 --2- 172.21.15.88:0/1083246018 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f34e006b210 0x7f34e006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:06.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.557+0000 7f34f37fe640 1 --2- 172.21.15.88:0/1083246018 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f34e006b210 0x7f34e006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:06.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.558+0000 7f34f37fe640 1 --2- 172.21.15.88:0/1083246018 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f34e006b210 0x7f34e006d6d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f34e4007fd0 tx=0x7f34e4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:06.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.559+0000 7f34dbfff640 1 -- 172.21.15.88:0/1083246018 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f34ec07b3d0 con 0x7f34f4153870 2023-11-27T20:55:06.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.585+0000 7f59267fc640 1 -- 172.21.15.88:0/1103017579 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5920015070 con 0x7f593016a1a0 2023-11-27T20:55:06.587 INFO:teuthology.orchestra.run.smithi088.stdout:60129542159 2023-11-27T20:55:06.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.587+0000 7f5937f83640 1 -- 172.21.15.88:0/1103017579 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f591406b280 msgr2=0x7f591406d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.587+0000 7f5937f83640 1 --2- 172.21.15.88:0/1103017579 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f591406b280 0x7f591406d740 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5928001c60 tx=0x7f5928007d10 comp rx=0 tx=0).stop 2023-11-27T20:55:06.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.587+0000 7f5937f83640 1 -- 172.21.15.88:0/1103017579 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f593016a1a0 msgr2=0x7f59301fc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.587+0000 7f5937f83640 1 --2- 172.21.15.88:0/1103017579 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f593016a1a0 0x7f59301fc2d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f592000b410 tx=0x7f592000b8d0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.587+0000 7f5937f83640 1 -- 172.21.15.88:0/1103017579 shutdown_connections 2023-11-27T20:55:06.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.587+0000 7f5937f83640 1 --2- 172.21.15.88:0/1103017579 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f591406b280 0x7f591406d740 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.587+0000 7f5937f83640 1 --2- 172.21.15.88:0/1103017579 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f593016a1a0 0x7f59301fc2d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.587+0000 7f5937f83640 1 --2- 172.21.15.88:0/1103017579 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59300c5aa0 0x7f59301fbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.587+0000 7f5937f83640 1 --2- 172.21.15.88:0/1103017579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59300c1680 0x7f5930072310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.587+0000 7f5937f83640 1 -- 172.21.15.88:0/1103017579 >> 172.21.15.88:0/1103017579 conn(0x7f593006c5f0 msgr2=0x7f5930165cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.587+0000 7f5937f83640 1 -- 172.21.15.88:0/1103017579 shutdown_connections 2023-11-27T20:55:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.587+0000 7f5937f83640 1 -- 172.21.15.88:0/1103017579 wait complete. 2023-11-27T20:55:06.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542160 got 60129542159 for osd.3 2023-11-27T20:55:06.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.646+0000 7fc2eb856640 1 -- 172.21.15.88:0/237040845 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc2e40b3870 con 0x7fc2e4159b50 2023-11-27T20:55:06.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.657+0000 7ff8a1eb4640 1 -- 172.21.15.88:0/523246499 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff89c06b330 con 0x7ff89c151330 2023-11-27T20:55:06.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.731+0000 7f27a3456640 1 -- 172.21.15.88:0/292718578 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f279c0ccaa0 con 0x7f279c0c9620 2023-11-27T20:55:06.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.735+0000 7f2799ffb640 1 -- 172.21.15.88:0/292718578 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f278c049090 con 0x7f279c0c9620 2023-11-27T20:55:06.736 INFO:teuthology.orchestra.run.smithi088.stdout:60129542159 2023-11-27T20:55:06.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.737+0000 7f27a3456640 1 -- 172.21.15.88:0/292718578 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f278806b1f0 msgr2=0x7f278806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.737+0000 7f27a3456640 1 --2- 172.21.15.88:0/292718578 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f278806b1f0 0x7f278806d6b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f279c0c2110 tx=0x7f2790007990 comp rx=0 tx=0).stop 2023-11-27T20:55:06.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.737+0000 7f27a3456640 1 -- 172.21.15.88:0/292718578 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f279c0c9620 msgr2=0x7f279c14ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.737+0000 7f27a3456640 1 --2- 172.21.15.88:0/292718578 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f279c0c9620 0x7f279c14ac10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f278c02b9c0 tx=0x7f278c0046c0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.737+0000 7f27a3456640 1 -- 172.21.15.88:0/292718578 shutdown_connections 2023-11-27T20:55:06.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.737+0000 7f27a3456640 1 --2- 172.21.15.88:0/292718578 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f278806b1f0 0x7f278806d6b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.737+0000 7f27a3456640 1 --2- 172.21.15.88:0/292718578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f279c0cda70 0x7f279c1494a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.737+0000 7f27a3456640 1 --2- 172.21.15.88:0/292718578 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f279c0cc420 0x7f279c14b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.737+0000 7f27a3456640 1 --2- 172.21.15.88:0/292718578 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f279c0c9620 0x7f279c14ac10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.737+0000 7f27a3456640 1 -- 172.21.15.88:0/292718578 >> 172.21.15.88:0/292718578 conn(0x7f279c0b07b0 msgr2=0x7f279c0c6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:06.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.738+0000 7f27a3456640 1 -- 172.21.15.88:0/292718578 shutdown_connections 2023-11-27T20:55:06.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.738+0000 7f27a3456640 1 -- 172.21.15.88:0/292718578 wait complete. 2023-11-27T20:55:06.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542160 got 60129542159 for osd.7 2023-11-27T20:55:06.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.768+0000 7f9077fff640 1 -- 172.21.15.88:0/2887880621 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9078014090 con 0x7f908404c980 2023-11-27T20:55:06.770 INFO:teuthology.orchestra.run.smithi088.stdout:60129542159 2023-11-27T20:55:06.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.770+0000 7f9090c67640 1 -- 172.21.15.88:0/2887880621 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f907006b210 msgr2=0x7f907006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.770+0000 7f9090c67640 1 --2- 172.21.15.88:0/2887880621 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f907006b210 0x7f907006d6d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9080036000 tx=0x7f9080008030 comp rx=0 tx=0).stop 2023-11-27T20:55:06.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.770+0000 7f9090c67640 1 -- 172.21.15.88:0/2887880621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f908404c980 msgr2=0x7f908404a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.770+0000 7f9090c67640 1 --2- 172.21.15.88:0/2887880621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f908404c980 0x7f908404a2d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f907800b4d0 tx=0x7f907800b990 comp rx=0 tx=0).stop 2023-11-27T20:55:06.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.770+0000 7f9090c67640 1 -- 172.21.15.88:0/2887880621 shutdown_connections 2023-11-27T20:55:06.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.770+0000 7f9090c67640 1 --2- 172.21.15.88:0/2887880621 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f907006b210 0x7f907006d6d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.770+0000 7f9090c67640 1 --2- 172.21.15.88:0/2887880621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90840d5e80 0x7f908404a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.770+0000 7f9090c67640 1 --2- 172.21.15.88:0/2887880621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f908404c980 0x7f908404a2d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.770+0000 7f9090c67640 1 --2- 172.21.15.88:0/2887880621 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9084047e90 0x7f9084036dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.770+0000 7f9090c67640 1 -- 172.21.15.88:0/2887880621 >> 172.21.15.88:0/2887880621 conn(0x7f9084051250 msgr2=0x7f9084006a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:06.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.770+0000 7f9090c67640 1 -- 172.21.15.88:0/2887880621 shutdown_connections 2023-11-27T20:55:06.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.770+0000 7f9090c67640 1 -- 172.21.15.88:0/2887880621 wait complete. 2023-11-27T20:55:06.782 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542160 got 60129542159 for osd.4 2023-11-27T20:55:06.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.781+0000 7f293e7fc640 1 -- 172.21.15.88:0/3962182810 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2938007070 con 0x7f29480cc420 2023-11-27T20:55:06.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.782+0000 7f293e7fc640 1 --2- 172.21.15.88:0/3962182810 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f292c06b1f0 0x7f292c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:06.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.782+0000 7f294d441640 1 --2- 172.21.15.88:0/3962182810 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f292c06b1f0 0x7f292c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:06.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.782+0000 7f294d441640 1 --2- 172.21.15.88:0/3962182810 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f292c06b1f0 0x7f292c06d6b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2948159020 tx=0x7f2944006c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:06.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.785+0000 7f293e7fc640 1 -- 172.21.15.88:0/3962182810 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2938057da0 con 0x7f29480cc420 2023-11-27T20:55:06.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.796+0000 7f293e7fc640 1 -- 172.21.15.88:0/3962182810 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f29380540e0 con 0x7f29480cc420 2023-11-27T20:55:06.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.811+0000 7fc2d9ffb640 1 -- 172.21.15.88:0/237040845 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc2e40b3870 con 0x7fc2e4159b50 2023-11-27T20:55:06.813 INFO:teuthology.orchestra.run.smithi088.stdout:64424509454 2023-11-27T20:55:06.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.813+0000 7fc2eb856640 1 -- 172.21.15.88:0/237040845 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fc2c806b1c0 msgr2=0x7fc2c806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.813+0000 7fc2eb856640 1 --2- 172.21.15.88:0/237040845 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fc2c806b1c0 0x7fc2c806d680 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0001560 tx=0x7fc2e0007990 comp rx=0 tx=0).stop 2023-11-27T20:55:06.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.813+0000 7fc2eb856640 1 -- 172.21.15.88:0/237040845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2e4159b50 msgr2=0x7fc2e40b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.813+0000 7fc2eb856640 1 --2- 172.21.15.88:0/237040845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2e4159b50 0x7fc2e40b3f30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00ba10 tx=0x7fc2dc00bed0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.813+0000 7fc2eb856640 1 -- 172.21.15.88:0/237040845 shutdown_connections 2023-11-27T20:55:06.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.813+0000 7fc2eb856640 1 --2- 172.21.15.88:0/237040845 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fc2c806b1c0 0x7fc2c806d680 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.813+0000 7fc2eb856640 1 --2- 172.21.15.88:0/237040845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2e4159b50 0x7fc2e40b3f30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.813+0000 7fc2eb856640 1 --2- 172.21.15.88:0/237040845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2e40cda70 0x7fc2e40aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.813+0000 7fc2eb856640 1 --2- 172.21.15.88:0/237040845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2e40cc420 0x7fc2e40aa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.813+0000 7fc2eb856640 1 -- 172.21.15.88:0/237040845 >> 172.21.15.88:0/237040845 conn(0x7fc2e40b07b0 msgr2=0x7fc2e40c6be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:06.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.813+0000 7fc2eb856640 1 -- 172.21.15.88:0/237040845 shutdown_connections 2023-11-27T20:55:06.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.813+0000 7fc2eb856640 1 -- 172.21.15.88:0/237040845 wait complete. 2023-11-27T20:55:06.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.815+0000 7f34dbfff640 1 -- 172.21.15.88:0/1083246018 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f34ec077710 con 0x7f34f4153870 2023-11-27T20:55:06.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.821+0000 7ff883fff640 1 -- 172.21.15.88:0/523246499 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff890058d40 con 0x7ff89c151330 2023-11-27T20:55:06.823 INFO:teuthology.orchestra.run.smithi088.stdout:64424509455 2023-11-27T20:55:06.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.824+0000 7ff8a1eb4640 1 -- 172.21.15.88:0/523246499 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff88806b210 msgr2=0x7ff88806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.824+0000 7ff8a1eb4640 1 --2- 172.21.15.88:0/523246499 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff88806b210 0x7ff88806d6d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff88c009670 tx=0x7ff88c006bf0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.824+0000 7ff8a1eb4640 1 -- 172.21.15.88:0/523246499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff89c151330 msgr2=0x7ff89c141350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.824+0000 7ff8a1eb4640 1 --2- 172.21.15.88:0/523246499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff89c151330 0x7ff89c141350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff89000d7b0 tx=0x7ff89000dc70 comp rx=0 tx=0).stop 2023-11-27T20:55:06.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.824+0000 7ff8a1eb4640 1 -- 172.21.15.88:0/523246499 shutdown_connections 2023-11-27T20:55:06.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.824+0000 7ff8a1eb4640 1 --2- 172.21.15.88:0/523246499 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff88806b210 0x7ff88806d6d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.824+0000 7ff8a1eb4640 1 --2- 172.21.15.88:0/523246499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff89c157e20 0x7ff89c13cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.824+0000 7ff8a1eb4640 1 --2- 172.21.15.88:0/523246499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff89c151330 0x7ff89c141350 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.824+0000 7ff8a1eb4640 1 --2- 172.21.15.88:0/523246499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff89c0c6360 0x7ff89c1449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.824+0000 7ff8a1eb4640 1 -- 172.21.15.88:0/523246499 >> 172.21.15.88:0/523246499 conn(0x7ff89c06b5c0 msgr2=0x7ff89c06b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:06.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.824+0000 7ff8a1eb4640 1 -- 172.21.15.88:0/523246499 shutdown_connections 2023-11-27T20:55:06.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.824+0000 7ff8a1eb4640 1 -- 172.21.15.88:0/523246499 wait complete. 2023-11-27T20:55:06.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509454 for osd.6 2023-11-27T20:55:06.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509456 got 64424509455 for osd.1 2023-11-27T20:55:06.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.974+0000 7f294fea6640 1 -- 172.21.15.88:0/3962182810 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f2948067470 con 0x7f29480cc420 2023-11-27T20:55:06.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.980+0000 7f293e7fc640 1 -- 172.21.15.88:0/3962182810 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2938017090 con 0x7f29480cc420 2023-11-27T20:55:06.982 INFO:teuthology.orchestra.run.smithi088.stdout:64424509454 2023-11-27T20:55:06.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.982+0000 7f294fea6640 1 -- 172.21.15.88:0/3962182810 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f292c06b1f0 msgr2=0x7f292c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.982+0000 7f294fea6640 1 --2- 172.21.15.88:0/3962182810 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f292c06b1f0 0x7f292c06d6b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2948159020 tx=0x7f2944006c90 comp rx=0 tx=0).stop 2023-11-27T20:55:06.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.982+0000 7f294fea6640 1 -- 172.21.15.88:0/3962182810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29480cc420 msgr2=0x7f2948158630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:06.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.982+0000 7f294fea6640 1 --2- 172.21.15.88:0/3962182810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29480cc420 0x7f2948158630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f293800c400 tx=0x7f293800c8c0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.982+0000 7f294fea6640 1 -- 172.21.15.88:0/3962182810 shutdown_connections 2023-11-27T20:55:06.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.982+0000 7f294fea6640 1 --2- 172.21.15.88:0/3962182810 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f292c06b1f0 0x7f292c06d6b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.982+0000 7f294fea6640 1 --2- 172.21.15.88:0/3962182810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2948159b50 0x7f2948155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.982+0000 7f294fea6640 1 --2- 172.21.15.88:0/3962182810 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29480cda70 0x7f29480b2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.982+0000 7f294fea6640 1 --2- 172.21.15.88:0/3962182810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29480cc420 0x7f2948158630 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:06.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.982+0000 7f294fea6640 1 -- 172.21.15.88:0/3962182810 >> 172.21.15.88:0/3962182810 conn(0x7f29480b07b0 msgr2=0x7f29480c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:06.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.982+0000 7f294fea6640 1 -- 172.21.15.88:0/3962182810 shutdown_connections 2023-11-27T20:55:06.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:06.982+0000 7f294fea6640 1 -- 172.21.15.88:0/3962182810 wait complete. 2023-11-27T20:55:06.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509454 for osd.5 2023-11-27T20:55:07.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.014+0000 7f34f9c10640 1 -- 172.21.15.88:0/1083246018 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f34f4070190 con 0x7f34f4153870 2023-11-27T20:55:07.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.018+0000 7f34dbfff640 1 -- 172.21.15.88:0/1083246018 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f34ec04e070 con 0x7f34f4153870 2023-11-27T20:55:07.020 INFO:teuthology.orchestra.run.smithi088.stdout:64424509455 2023-11-27T20:55:07.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.020+0000 7f34f9c10640 1 -- 172.21.15.88:0/1083246018 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f34e006b210 msgr2=0x7f34e006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:07.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.020+0000 7f34f9c10640 1 --2- 172.21.15.88:0/1083246018 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f34e006b210 0x7f34e006d6d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f34e4007fd0 tx=0x7f34e4009040 comp rx=0 tx=0).stop 2023-11-27T20:55:07.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.020+0000 7f34f9c10640 1 -- 172.21.15.88:0/1083246018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34f4153870 msgr2=0x7f34f414f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:07.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.020+0000 7f34f9c10640 1 --2- 172.21.15.88:0/1083246018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34f4153870 0x7f34f414f410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f34f40c6730 tx=0x7f34ec004a40 comp rx=0 tx=0).stop 2023-11-27T20:55:07.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.021+0000 7f34f9c10640 1 -- 172.21.15.88:0/1083246018 shutdown_connections 2023-11-27T20:55:07.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.021+0000 7f34f9c10640 1 --2- 172.21.15.88:0/1083246018 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f34e006b210 0x7f34e006d6d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:07.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.021+0000 7f34f9c10640 1 --2- 172.21.15.88:0/1083246018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34f4153870 0x7f34f414f410 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:07.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.021+0000 7f34f9c10640 1 --2- 172.21.15.88:0/1083246018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34f4153490 0x7f34f4155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:07.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.021+0000 7f34f9c10640 1 --2- 172.21.15.88:0/1083246018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34f40c6780 0x7f34f41f19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:07.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.021+0000 7f34f9c10640 1 -- 172.21.15.88:0/1083246018 >> 172.21.15.88:0/1083246018 conn(0x7f34f406b5c0 msgr2=0x7f34f4072130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:07.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.021+0000 7f34f9c10640 1 -- 172.21.15.88:0/1083246018 shutdown_connections 2023-11-27T20:55:07.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.021+0000 7f34f9c10640 1 -- 172.21.15.88:0/1083246018 wait complete. 2023-11-27T20:55:07.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509456 got 64424509455 for osd.2 2023-11-27T20:55:07.394 INFO:tasks.ceph.mds.c.smithi088.stderr:2023-11-27T20:55:07.390+0000 f5b2640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2023-11-27T20:55:07.472 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-27T20:55:07.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.575+0000 7fafc3d25640 1 Processor -- start 2023-11-27T20:55:07.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.575+0000 7fafc3d25640 1 -- start start 2023-11-27T20:55:07.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.576+0000 7fafc3d25640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fafbc0cda70 0x7fafbc0ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:07.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.576+0000 7fafc3d25640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafbc0c9620 0x7fafbc0c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:07.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.576+0000 7fafc3d25640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafbc0cbda0 con 0x7fafbc0cc420 2023-11-27T20:55:07.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.576+0000 7fafc3d25640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafbc0cc230 con 0x7fafbc0cda70 2023-11-27T20:55:07.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.576+0000 7fafc3d25640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc0cb4e0 con 0x7fafbc0c9620 2023-11-27T20:55:07.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.577+0000 7fafc1ac1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fafbc0cda70 0x7fafbc0ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:07.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.577+0000 7fafc1ac1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fafbc0cda70 0x7fafbc0ce350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50702/0 (socket says 172.21.15.88:50702) 2023-11-27T20:55:07.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.577+0000 7fafc1ac1640 1 -- 172.21.15.88:0/3572309403 learned_addr learned my addr 172.21.15.88:0/3572309403 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:07.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.578+0000 7fafc22c2640 1 --2- 172.21.15.88:0/3572309403 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafbc0c9620 0x7fafbc0c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:07.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.581+0000 7fafc1ac1640 1 -- 172.21.15.88:0/3572309403 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafbc0c9620 msgr2=0x7fafbc0c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:07.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.581+0000 7fafc1ac1640 1 --2- 172.21.15.88:0/3572309403 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafbc0c9620 0x7fafbc0c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:07.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.581+0000 7fafc1ac1640 1 -- 172.21.15.88:0/3572309403 >> v1:172.21.15.88:6789/0 conn(0x7fafbc0cc420 legacy=0x7fafbc159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:07.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.581+0000 7fafc1ac1640 1 -- 172.21.15.88:0/3572309403 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafbc0cce00 con 0x7fafbc0cda70 2023-11-27T20:55:07.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.585+0000 7fafc1ac1640 1 --2- 172.21.15.88:0/3572309403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafbc0cda70 0x7fafbc0ce350 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fafac009870 tx=0x7fafac02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b157aa452157c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:07.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.592+0000 7fafc0abf640 1 -- 172.21.15.88:0/3572309403 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac02f840 con 0x7fafbc0cda70 2023-11-27T20:55:07.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.592+0000 7fafc0abf640 1 -- 172.21.15.88:0/3572309403 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafac02f9a0 con 0x7fafbc0cda70 2023-11-27T20:55:07.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.592+0000 7fafc0abf640 1 -- 172.21.15.88:0/3572309403 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac02fd30 con 0x7fafbc0cda70 2023-11-27T20:55:07.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.593+0000 7fafc3d25640 1 -- 172.21.15.88:0/3572309403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafbc0cda70 msgr2=0x7fafbc0ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:07.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.593+0000 7fafc3d25640 1 --2- 172.21.15.88:0/3572309403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafbc0cda70 0x7fafbc0ce350 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fafac009870 tx=0x7fafac02ba20 comp rx=0 tx=0).stop 2023-11-27T20:55:07.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.593+0000 7fafc3d25640 1 -- 172.21.15.88:0/3572309403 shutdown_connections 2023-11-27T20:55:07.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.593+0000 7fafc3d25640 1 --2- 172.21.15.88:0/3572309403 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafbc0c9620 0x7fafbc0c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:07.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.593+0000 7fafc3d25640 1 --2- 172.21.15.88:0/3572309403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafbc0cda70 0x7fafbc0ce350 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:07.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.593+0000 7fafc3d25640 1 -- 172.21.15.88:0/3572309403 >> 172.21.15.88:0/3572309403 conn(0x7fafbc0b07b0 msgr2=0x7fafbc0b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:07.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.593+0000 7fafc3d25640 1 -- 172.21.15.88:0/3572309403 shutdown_connections 2023-11-27T20:55:07.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.593+0000 7fafc3d25640 1 -- 172.21.15.88:0/3572309403 wait complete. 2023-11-27T20:55:07.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.595+0000 7fafc3d25640 1 Processor -- start 2023-11-27T20:55:07.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.595+0000 7fafc3d25640 1 -- start start 2023-11-27T20:55:07.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.595+0000 7fafc3d25640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafbc0c9620 0x7fafbc14b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:07.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.595+0000 7fafc3d25640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafbc0cc420 0x7fafbc14a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:07.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.595+0000 7fafc3d25640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafbc0cda70 0x7fafbc1ef650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:07.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.595+0000 7fafc3d25640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc0b21e0 con 0x7fafbc0c9620 2023-11-27T20:55:07.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.595+0000 7fafc3d25640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc1eef20 con 0x7fafbc0cda70 2023-11-27T20:55:07.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.595+0000 7fafc3d25640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc0b19d0 con 0x7fafbc0cc420 2023-11-27T20:55:07.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.596+0000 7fafc1ac1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafbc0c9620 0x7fafbc14b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:07.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.596+0000 7fafc12c0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafbc0cc420 0x7fafbc14a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:07.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.596+0000 7fafc22c2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafbc0cda70 0x7fafbc1ef650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:07.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.596+0000 7fafc1ac1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafbc0c9620 0x7fafbc14b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50710/0 (socket says 172.21.15.88:50710) 2023-11-27T20:55:07.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.596+0000 7fafc1ac1640 1 -- 172.21.15.88:0/739757965 learned_addr learned my addr 172.21.15.88:0/739757965 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:07.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.600+0000 7fafc1ac1640 1 -- 172.21.15.88:0/739757965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafbc0cc420 msgr2=0x7fafbc14a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:07.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.600+0000 7fafc1ac1640 1 --2- 172.21.15.88:0/739757965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafbc0cc420 0x7fafbc14a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:07.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.600+0000 7fafc1ac1640 1 -- 172.21.15.88:0/739757965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafbc0cda70 msgr2=0x7fafbc1ef650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:07.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.600+0000 7fafc1ac1640 1 --2- 172.21.15.88:0/739757965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafbc0cda70 0x7fafbc1ef650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:07.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.600+0000 7fafc1ac1640 1 -- 172.21.15.88:0/739757965 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac0094d0 con 0x7fafbc0c9620 2023-11-27T20:55:07.603 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-27T20:55:07.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.602+0000 7fafc1ac1640 1 --2- 172.21.15.88:0/739757965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafbc0c9620 0x7fafbc14b620 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fafac000c00 tx=0x7fafac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:07.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.606+0000 7fafb27fc640 1 -- 172.21.15.88:0/739757965 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac03b040 con 0x7fafbc0c9620 2023-11-27T20:55:07.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.606+0000 7fafb27fc640 1 -- 172.21.15.88:0/739757965 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafac037c60 con 0x7fafbc0c9620 2023-11-27T20:55:07.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.606+0000 7fafc3d25640 1 -- 172.21.15.88:0/739757965 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafbc0b1c70 con 0x7fafbc0c9620 2023-11-27T20:55:07.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.606+0000 7fafb27fc640 1 -- 172.21.15.88:0/739757965 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac042480 con 0x7fafbc0c9620 2023-11-27T20:55:07.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.606+0000 7fafc3d25640 1 -- 172.21.15.88:0/739757965 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafbc0b4500 con 0x7fafbc0c9620 2023-11-27T20:55:07.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.607+0000 7fafc3d25640 1 -- 172.21.15.88:0/739757965 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafbc0b4720 con 0x7fafbc0c9620 2023-11-27T20:55:07.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.704+0000 7f24d8f16640 1 Processor -- start 2023-11-27T20:55:07.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.704+0000 7f24d8f16640 1 -- start start 2023-11-27T20:55:07.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.705+0000 7f24d8f16640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f24d40c9620 0x7f24d40c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:07.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.705+0000 7f24d8f16640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d40cbda0 con 0x7f24d40cda70 2023-11-27T20:55:07.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.705+0000 7f24d8f16640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d40cea60 con 0x7f24d40cc420 2023-11-27T20:55:07.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.705+0000 7f24d8f16640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d40cc230 con 0x7f24d40c9620 2023-11-27T20:55:07.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.706+0000 7f24d2d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f24d40c9620 0x7f24d40c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:07.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.706+0000 7f24d1d9b640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f24d40cc420 0x7f24d4159610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:59100/0 (socket says 172.21.15.88:59100) 2023-11-27T20:55:07.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.706+0000 7f24d1d9b640 1 -- 172.21.15.88:0/1539278991 learned_addr learned my addr 172.21.15.88:0/1539278991 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:55:07.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.709+0000 7f24d2d9d640 1 -- 172.21.15.88:0/1539278991 >> v1:172.21.15.167:6789/0 conn(0x7f24d40cc420 legacy=0x7f24d4159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:07.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.709+0000 7f24d2d9d640 1 -- 172.21.15.88:0/1539278991 >> v1:172.21.15.88:6789/0 conn(0x7f24d40cda70 legacy=0x7f24d40ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:07.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.709+0000 7f24d2d9d640 1 -- 172.21.15.88:0/1539278991 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d40cb4e0 con 0x7f24d40c9620 2023-11-27T20:55:07.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.712+0000 7f24d2d9d640 1 --2- 172.21.15.88:0/1539278991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d40c9620 0x7f24d40c9a50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f24cc009d90 tx=0x7f24cc02bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e32050d530cc59f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:07.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.716+0000 7f24d159a640 1 -- 172.21.15.88:0/1539278991 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc02cd00 con 0x7f24d40c9620 2023-11-27T20:55:07.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.716+0000 7f24d159a640 1 -- 172.21.15.88:0/1539278991 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24cc02ce60 con 0x7f24d40c9620 2023-11-27T20:55:07.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.716+0000 7f24d159a640 1 -- 172.21.15.88:0/1539278991 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc034660 con 0x7f24d40c9620 2023-11-27T20:55:07.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.717+0000 7f24d8f16640 1 -- 172.21.15.88:0/1539278991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d40c9620 msgr2=0x7f24d40c9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:07.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.717+0000 7f24d8f16640 1 --2- 172.21.15.88:0/1539278991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d40c9620 0x7f24d40c9a50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f24cc009d90 tx=0x7f24cc02bf50 comp rx=0 tx=0).stop 2023-11-27T20:55:07.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.717+0000 7f24d8f16640 1 -- 172.21.15.88:0/1539278991 shutdown_connections 2023-11-27T20:55:07.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.717+0000 7f24d8f16640 1 --2- 172.21.15.88:0/1539278991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d40c9620 0x7f24d40c9a50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:07.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.717+0000 7f24d8f16640 1 -- 172.21.15.88:0/1539278991 >> 172.21.15.88:0/1539278991 conn(0x7f24d40b07b0 msgr2=0x7f24d40b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:07.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.717+0000 7f24d8f16640 1 -- 172.21.15.88:0/1539278991 shutdown_connections 2023-11-27T20:55:07.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.717+0000 7f24d8f16640 1 -- 172.21.15.88:0/1539278991 wait complete. 2023-11-27T20:55:07.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.718+0000 7f24d8f16640 1 Processor -- start 2023-11-27T20:55:07.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.718+0000 7f24d8f16640 1 -- start start 2023-11-27T20:55:07.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.719+0000 7f24d8f16640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d40c9620 0x7f24d40ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:07.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.719+0000 7f24d8f16640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d40cc420 0x7f24d40aa350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:07.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.719+0000 7f24d8f16640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24d40cda70 0x7f24d41efbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:07.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.719+0000 7f24d8f16640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d41f27f0 con 0x7f24d40cda70 2023-11-27T20:55:07.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.719+0000 7f24d8f16640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d41520f0 con 0x7f24d40c9620 2023-11-27T20:55:07.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.719+0000 7f24d8f16640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d41523d0 con 0x7f24d40cc420 2023-11-27T20:55:07.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.719+0000 7f24d259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d40c9620 0x7f24d40ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:07.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.719+0000 7f24d1d9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d40cc420 0x7f24d40aa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:07.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.720+0000 7f24d259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d40c9620 0x7f24d40ae030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:41450/0 (socket says 172.21.15.88:41450) 2023-11-27T20:55:07.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.720+0000 7f24d259c640 1 -- 172.21.15.88:0/2929438586 learned_addr learned my addr 172.21.15.88:0/2929438586 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:07.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.723+0000 7f24d259c640 1 -- 172.21.15.88:0/2929438586 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d40cc420 msgr2=0x7f24d40aa350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:07.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.723+0000 7f24d259c640 1 --2- 172.21.15.88:0/2929438586 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d40cc420 0x7f24d40aa350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:07.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.723+0000 7f24d259c640 1 -- 172.21.15.88:0/2929438586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24d40cda70 msgr2=0x7f24d41efbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:07.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.723+0000 7f24d259c640 1 --2- 172.21.15.88:0/2929438586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24d40cda70 0x7f24d41efbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:07.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.723+0000 7f24d259c640 1 -- 172.21.15.88:0/2929438586 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24cc009a70 con 0x7f24d40c9620 2023-11-27T20:55:07.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.726+0000 7f24d259c640 1 --2- 172.21.15.88:0/2929438586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d40c9620 0x7f24d40ae030 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f24c400b3e0 tx=0x7f24c400b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:07.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.729+0000 7f24c2ffd640 1 -- 172.21.15.88:0/2929438586 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c4011830 con 0x7f24d40c9620 2023-11-27T20:55:07.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.729+0000 7f24c2ffd640 1 -- 172.21.15.88:0/2929438586 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c40119b0 con 0x7f24d40c9620 2023-11-27T20:55:07.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.729+0000 7f24c2ffd640 1 -- 172.21.15.88:0/2929438586 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c4011d60 con 0x7f24d40c9620 2023-11-27T20:55:07.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.729+0000 7f24d8f16640 1 -- 172.21.15.88:0/2929438586 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d41526b0 con 0x7f24d40c9620 2023-11-27T20:55:07.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.729+0000 7f24d8f16640 1 -- 172.21.15.88:0/2929438586 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d41f2a40 con 0x7f24d40c9620 2023-11-27T20:55:07.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.730+0000 7f24d8f16640 1 -- 172.21.15.88:0/2929438586 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d406d340 con 0x7f24d40c9620 2023-11-27T20:55:07.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.748+0000 7f24c2ffd640 1 -- 172.21.15.88:0/2929438586 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f24c401a400 con 0x7f24d40c9620 2023-11-27T20:55:07.750 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-27T20:55:07.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.749+0000 7f24c2ffd640 1 --2- 172.21.15.88:0/2929438586 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f24b406b210 0x7f24b406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:07.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.749+0000 7f24d1d9b640 1 --2- 172.21.15.88:0/2929438586 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f24b406b210 0x7f24b406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:07.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.749+0000 7f24d1d9b640 1 --2- 172.21.15.88:0/2929438586 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f24b406b210 0x7f24b406d6d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f24d40ae570 tx=0x7f24c8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:07.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.751+0000 7f24c2ffd640 1 -- 172.21.15.88:0/2929438586 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f24c4059280 con 0x7f24d40c9620 2023-11-27T20:55:07.783 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-27T20:55:07.828 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-27T20:55:07.838 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-27T20:55:07.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.861+0000 7fed65c7c640 1 Processor -- start 2023-11-27T20:55:07.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.861+0000 7fed65c7c640 1 -- start start 2023-11-27T20:55:07.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.862+0000 7fed65c7c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fed6013d1a0 0x7fed6015adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:07.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.862+0000 7fed65c7c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed6015b330 0x7fed6013fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:07.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.862+0000 7fed65c7c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed6006a770 con 0x7fed601403a0 2023-11-27T20:55:07.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.862+0000 7fed65c7c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed60157140 con 0x7fed6013d1a0 2023-11-27T20:55:07.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.862+0000 7fed65c7c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed600c8180 con 0x7fed6015b330 2023-11-27T20:55:07.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.863+0000 7fed5effd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed6015b330 0x7fed6013fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:07.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.863+0000 7fed5effd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed6015b330 0x7fed6013fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:34464/0 (socket says 172.21.15.88:34464) 2023-11-27T20:55:07.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.863+0000 7fed5effd640 1 -- 172.21.15.88:0/3232141458 learned_addr learned my addr 172.21.15.88:0/3232141458 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:07.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.865+0000 7fed5effd640 1 -- 172.21.15.88:0/3232141458 >> v2:172.21.15.167:3300/0 conn(0x7fed6013d1a0 msgr2=0x7fed6015adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:07.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.865+0000 7fed5effd640 1 --2- 172.21.15.88:0/3232141458 >> v2:172.21.15.167:3300/0 conn(0x7fed6013d1a0 0x7fed6015adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:07.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.865+0000 7fed5effd640 1 -- 172.21.15.88:0/3232141458 >> v1:172.21.15.167:6789/0 conn(0x7fed601403a0 legacy=0x7fed600c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:07.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.865+0000 7fed5effd640 1 -- 172.21.15.88:0/3232141458 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed600c8460 con 0x7fed6015b330 2023-11-27T20:55:07.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.868+0000 7fed5effd640 1 --2- 172.21.15.88:0/3232141458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed6015b330 0x7fed6013fe60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fed54009870 tx=0x7fed5402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2475cc20d1be0bb server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:07.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.872+0000 7fed5e7fc640 1 -- 172.21.15.88:0/3232141458 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54030840 con 0x7fed6015b330 2023-11-27T20:55:07.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.872+0000 7fed5e7fc640 1 -- 172.21.15.88:0/3232141458 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed540309a0 con 0x7fed6015b330 2023-11-27T20:55:07.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.873+0000 7fed65c7c640 1 -- 172.21.15.88:0/3232141458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed6015b330 msgr2=0x7fed6013fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:07.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.873+0000 7fed65c7c640 1 --2- 172.21.15.88:0/3232141458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed6015b330 0x7fed6013fe60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fed54009870 tx=0x7fed5402b980 comp rx=0 tx=0).stop 2023-11-27T20:55:07.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.873+0000 7fed65c7c640 1 -- 172.21.15.88:0/3232141458 shutdown_connections 2023-11-27T20:55:07.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.873+0000 7fed65c7c640 1 --2- 172.21.15.88:0/3232141458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed6015b330 0x7fed6013fe60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:07.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.873+0000 7fed65c7c640 1 --2- 172.21.15.88:0/3232141458 >> v2:172.21.15.167:3300/0 conn(0x7fed6013d1a0 0x7fed6015adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:07.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.873+0000 7fed65c7c640 1 -- 172.21.15.88:0/3232141458 >> 172.21.15.88:0/3232141458 conn(0x7fed600712f0 msgr2=0x7fed600716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:07.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.873+0000 7fed65c7c640 1 -- 172.21.15.88:0/3232141458 shutdown_connections 2023-11-27T20:55:07.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.873+0000 7fed65c7c640 1 -- 172.21.15.88:0/3232141458 wait complete. 2023-11-27T20:55:07.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.875+0000 7fed65c7c640 1 Processor -- start 2023-11-27T20:55:07.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.875+0000 7fed65c7c640 1 -- start start 2023-11-27T20:55:07.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.875+0000 7fafb27fc640 1 -- 172.21.15.88:0/739757965 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fafac0425e0 con 0x7fafbc0c9620 2023-11-27T20:55:07.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.876+0000 7fafb27fc640 1 --2- 172.21.15.88:0/739757965 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fafa006b210 0x7fafa006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:07.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.876+0000 7fafc12c0640 1 --2- 172.21.15.88:0/739757965 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fafa006b210 0x7fafa006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:07.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.876+0000 7fed65c7c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed6013d1a0 0x7fed60152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:07.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.876+0000 7fed65c7c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed601403a0 0x7fed6013c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:07.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.876+0000 7fed65c7c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed6015b330 0x7fed600c3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:07.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.877+0000 7fed65c7c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed60139a10 con 0x7fed601403a0 2023-11-27T20:55:07.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.877+0000 7fed65c7c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6013a4c0 con 0x7fed6013d1a0 2023-11-27T20:55:07.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.877+0000 7fed65c7c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed600caca0 con 0x7fed6015b330 2023-11-27T20:55:07.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.877+0000 7fafc12c0640 1 --2- 172.21.15.88:0/739757965 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fafa006b210 0x7fafa006d6d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fafbc0b3e30 tx=0x7fafb8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:07.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.878+0000 7fed5ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed6015b330 0x7fed600c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:07.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.878+0000 7fed5ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed6015b330 0x7fed600c3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:34472/0 (socket says 172.21.15.88:34472) 2023-11-27T20:55:07.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.878+0000 7fed5ffff640 1 -- 172.21.15.88:0/3189439474 learned_addr learned my addr 172.21.15.88:0/3189439474 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:07.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.882+0000 7fed5ffff640 1 -- 172.21.15.88:0/3189439474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed6013d1a0 msgr2=0x7fed60152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:07.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.882+0000 7fed5ffff640 1 --2- 172.21.15.88:0/3189439474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed6013d1a0 0x7fed60152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:07.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.882+0000 7fed5ffff640 1 -- 172.21.15.88:0/3189439474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed601403a0 msgr2=0x7fed6013c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:07.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.882+0000 7fed5ffff640 1 --2- 172.21.15.88:0/3189439474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed601403a0 0x7fed6013c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:07.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.882+0000 7fed5ffff640 1 -- 172.21.15.88:0/3189439474 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed540094d0 con 0x7fed6015b330 2023-11-27T20:55:07.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.884+0000 7fed5ffff640 1 --2- 172.21.15.88:0/3189439474 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed6015b330 0x7fed600c3770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fed5800c780 tx=0x7fed5800cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:07.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.888+0000 7fed47fff640 1 -- 172.21.15.88:0/3189439474 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed58003d80 con 0x7fed6015b330 2023-11-27T20:55:07.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.888+0000 7fed47fff640 1 -- 172.21.15.88:0/3189439474 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5800ce30 con 0x7fed6015b330 2023-11-27T20:55:07.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.888+0000 7fed47fff640 1 -- 172.21.15.88:0/3189439474 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed580052b0 con 0x7fed6015b330 2023-11-27T20:55:07.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.888+0000 7fed65c7c640 1 -- 172.21.15.88:0/3189439474 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed60153170 con 0x7fed6015b330 2023-11-27T20:55:07.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.889+0000 7fed65c7c640 1 -- 172.21.15.88:0/3189439474 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed6013a1e0 con 0x7fed6015b330 2023-11-27T20:55:07.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.890+0000 7fed65c7c640 1 -- 172.21.15.88:0/3189439474 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed6006e030 con 0x7fed6015b330 2023-11-27T20:55:07.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.894+0000 7fafb27fc640 1 -- 172.21.15.88:0/739757965 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fafac07be00 con 0x7fafbc0c9620 2023-11-27T20:55:07.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.894+0000 7fafb27fc640 1 -- 172.21.15.88:0/739757965 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fafac078180 con 0x7fafbc0c9620 2023-11-27T20:55:07.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.905+0000 7f3f98105640 1 Processor -- start 2023-11-27T20:55:07.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.906+0000 7f3f98105640 1 -- start start 2023-11-27T20:55:07.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.906+0000 7f3f98105640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3f900c9c70 0x7f3f901594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:07.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.906+0000 7f3f98105640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3f900cd430 0x7f3f900cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:07.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.906+0000 7f3f98105640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f900cba70 con 0x7f3f900cbf00 2023-11-27T20:55:07.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.906+0000 7f3f98105640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f90153c60 con 0x7f3f900cd430 2023-11-27T20:55:07.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.906+0000 7f3f98105640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f900cb490 con 0x7f3f900c9c70 2023-11-27T20:55:07.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.907+0000 7f3f966a2640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3f900cd430 0x7f3f900cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:07.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.908+0000 7f3f956a0640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3f900cbf00 0x7f3f900ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34538/0 (socket says 172.21.15.88:34538) 2023-11-27T20:55:07.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.908+0000 7f3f956a0640 1 -- 172.21.15.88:0/1629990149 learned_addr learned my addr 172.21.15.88:0/1629990149 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:55:07.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.908+0000 7fed47fff640 1 -- 172.21.15.88:0/3189439474 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fed58006b10 con 0x7fed6015b330 2023-11-27T20:55:07.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.908+0000 7fed47fff640 1 --2- 172.21.15.88:0/3189439474 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fed4c06b1c0 0x7fed4c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:07.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.909+0000 7fed5f7fe640 1 --2- 172.21.15.88:0/3189439474 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fed4c06b1c0 0x7fed4c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:07.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.909+0000 7fed5f7fe640 1 --2- 172.21.15.88:0/3189439474 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fed4c06b1c0 0x7fed4c06d680 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fed50009710 tx=0x7fed50006c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:07.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.913+0000 7f3f966a2640 1 -- 172.21.15.88:0/1629990149 >> v2:172.21.15.167:3300/0 conn(0x7f3f900c9c70 msgr2=0x7f3f901594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:07.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.913+0000 7f3f966a2640 1 --2- 172.21.15.88:0/1629990149 >> v2:172.21.15.167:3300/0 conn(0x7f3f900c9c70 0x7f3f901594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:07.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.913+0000 7f3f966a2640 1 -- 172.21.15.88:0/1629990149 >> v1:172.21.15.88:6789/0 conn(0x7f3f900cbf00 legacy=0x7f3f900ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:07.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.913+0000 7f3f966a2640 1 -- 172.21.15.88:0/1629990149 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f900ce2f0 con 0x7f3f900cd430 2023-11-27T20:55:07.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.916+0000 7f3f966a2640 1 --2- 172.21.15.88:0/1629990149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f900cd430 0x7f3f900cd8e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3f90068040 tx=0x7f3f8802bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23ca19ffc3b9ea5d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:07.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.920+0000 7f3f94e9f640 1 -- 172.21.15.88:0/1629990149 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8802cc70 con 0x7f3f900cd430 2023-11-27T20:55:07.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.920+0000 7f3f94e9f640 1 -- 172.21.15.88:0/1629990149 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8802cdd0 con 0x7f3f900cd430 2023-11-27T20:55:07.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.920+0000 7f3f94e9f640 1 -- 172.21.15.88:0/1629990149 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f88034660 con 0x7f3f900cd430 2023-11-27T20:55:07.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.921+0000 7f3f98105640 1 -- 172.21.15.88:0/1629990149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f900cd430 msgr2=0x7f3f900cd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:07.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.921+0000 7f3f98105640 1 --2- 172.21.15.88:0/1629990149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f900cd430 0x7f3f900cd8e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3f90068040 tx=0x7f3f8802bec0 comp rx=0 tx=0).stop 2023-11-27T20:55:07.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.921+0000 7f3f98105640 1 -- 172.21.15.88:0/1629990149 shutdown_connections 2023-11-27T20:55:07.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.921+0000 7f3f98105640 1 --2- 172.21.15.88:0/1629990149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f900cd430 0x7f3f900cd8e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:07.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.921+0000 7f3f98105640 1 --2- 172.21.15.88:0/1629990149 >> v2:172.21.15.167:3300/0 conn(0x7f3f900c9c70 0x7f3f901594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:07.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.921+0000 7f3f98105640 1 -- 172.21.15.88:0/1629990149 >> 172.21.15.88:0/1629990149 conn(0x7f3f900b07d0 msgr2=0x7f3f900b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:07.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.921+0000 7f3f98105640 1 -- 172.21.15.88:0/1629990149 shutdown_connections 2023-11-27T20:55:07.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.921+0000 7f3f98105640 1 -- 172.21.15.88:0/1629990149 wait complete. 2023-11-27T20:55:07.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.922+0000 7f3f98105640 1 Processor -- start 2023-11-27T20:55:07.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.922+0000 7f3f98105640 1 -- start start 2023-11-27T20:55:07.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.923+0000 7f3f98105640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f900c9c70 0x7f3f901e2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:07.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.923+0000 7f3f98105640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f900cbf00 0x7f3f901e3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:07.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.923+0000 7f3f98105640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f900cd430 0x7f3f901563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:07.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.923+0000 7f3f98105640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f901e4af0 con 0x7f3f900c9c70 2023-11-27T20:55:07.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.923+0000 7f3f98105640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f90159200 con 0x7f3f900cbf00 2023-11-27T20:55:07.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.923+0000 7f3f98105640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f901e2960 con 0x7f3f900cd430 2023-11-27T20:55:07.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.923+0000 7f3f95ea1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f900c9c70 0x7f3f901e2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:07.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.924+0000 7f3f95ea1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f900c9c70 0x7f3f901e2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50762/0 (socket says 172.21.15.88:50762) 2023-11-27T20:55:07.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.924+0000 7f3f95ea1640 1 -- 172.21.15.88:0/2429664517 learned_addr learned my addr 172.21.15.88:0/2429664517 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:07.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.927+0000 7f3f95ea1640 1 -- 172.21.15.88:0/2429664517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f900cd430 msgr2=0x7f3f901563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:07.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.927+0000 7f3f95ea1640 1 --2- 172.21.15.88:0/2429664517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f900cd430 0x7f3f901563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:07.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.927+0000 7f3f95ea1640 1 -- 172.21.15.88:0/2429664517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f900cbf00 msgr2=0x7f3f901e3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:07.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.927+0000 7f3f95ea1640 1 --2- 172.21.15.88:0/2429664517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f900cbf00 0x7f3f901e3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:07.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.927+0000 7f3f95ea1640 1 -- 172.21.15.88:0/2429664517 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f88009a70 con 0x7f3f900c9c70 2023-11-27T20:55:07.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.930+0000 7f3f95ea1640 1 --2- 172.21.15.88:0/2429664517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f900c9c70 0x7f3f901e2df0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00b3c0 tx=0x7f3f8c00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:07.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.933+0000 7f3f867fc640 1 -- 172.21.15.88:0/2429664517 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c011830 con 0x7f3f900c9c70 2023-11-27T20:55:07.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.933+0000 7f3f867fc640 1 -- 172.21.15.88:0/2429664517 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8c011990 con 0x7f3f900c9c70 2023-11-27T20:55:07.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.933+0000 7f3f98105640 1 -- 172.21.15.88:0/2429664517 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f901e4d00 con 0x7f3f900c9c70 2023-11-27T20:55:07.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.933+0000 7f3f867fc640 1 -- 172.21.15.88:0/2429664517 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c011d40 con 0x7f3f900c9c70 2023-11-27T20:55:07.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.934+0000 7f3f98105640 1 -- 172.21.15.88:0/2429664517 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f901e52c0 con 0x7f3f900c9c70 2023-11-27T20:55:07.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.935+0000 7f3f98105640 1 -- 172.21.15.88:0/2429664517 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9006d3e0 con 0x7f3f900c9c70 2023-11-27T20:55:07.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.978+0000 7f39e20c2640 1 Processor -- start 2023-11-27T20:55:07.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.978+0000 7f39e20c2640 1 -- start start 2023-11-27T20:55:07.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.979+0000 7f39e20c2640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f39dc0ce510 0x7f39dc0c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:07.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.979+0000 7f39e20c2640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f39dc0cc420 0x7f39dc0c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:07.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.979+0000 7f39e20c2640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39dc06ba50 con 0x7f39dc0cbf10 2023-11-27T20:55:07.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.979+0000 7f39e20c2640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39dc15db50 con 0x7f39dc0ce510 2023-11-27T20:55:07.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.979+0000 7f39e20c2640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39dc15de10 con 0x7f39dc0cc420 2023-11-27T20:55:07.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.987+0000 7f968a568640 1 Processor -- start 2023-11-27T20:55:07.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.987+0000 7f968a568640 1 -- start start 2023-11-27T20:55:07.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.988+0000 7f968a568640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f968414fdc0 0x7f968406aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:07.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.988+0000 7f968a568640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96840c2820 con 0x7f96840cb2b0 2023-11-27T20:55:07.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.988+0000 7f968a568640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96840c3030 con 0x7f9684156ee0 2023-11-27T20:55:07.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.988+0000 7f968a568640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96841559f0 con 0x7f968414fdc0 2023-11-27T20:55:07.996 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-27T20:55:07.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.995+0000 7f24c2ffd640 1 -- 172.21.15.88:0/2929438586 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f24c4054ec0 con 0x7f24d40c9620 2023-11-27T20:55:08.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:07.999+0000 7f9683fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f968414fdc0 0x7f968406aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:08.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.000+0000 7f9683fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f968414fdc0 0x7f968406aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:41504/0 (socket says 172.21.15.88:41504) 2023-11-27T20:55:08.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.000+0000 7f9683fff640 1 -- 172.21.15.88:0/2205535818 learned_addr learned my addr 172.21.15.88:0/2205535818 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:08.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.002+0000 7f39daffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f39dc0cc420 0x7f39dc0c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:08.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.003+0000 7f9683fff640 1 -- 172.21.15.88:0/2205535818 >> v1:172.21.15.167:6789/0 conn(0x7f9684156ee0 legacy=0x7f9684156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:08.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.003+0000 7f9683fff640 1 -- 172.21.15.88:0/2205535818 >> v1:172.21.15.88:6789/0 conn(0x7f96840cb2b0 legacy=0x7f9684160370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:08.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.003+0000 7f9683fff640 1 -- 172.21.15.88:0/2205535818 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96840c2a70 con 0x7f968414fdc0 2023-11-27T20:55:08.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.003+0000 7f39daffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f39dc0cc420 0x7f39dc0c9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:41490/0 (socket says 172.21.15.88:41490) 2023-11-27T20:55:08.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.003+0000 7f39daffd640 1 -- 172.21.15.88:0/185904297 learned_addr learned my addr 172.21.15.88:0/185904297 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:08.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.010+0000 7f39daffd640 1 -- 172.21.15.88:0/185904297 >> v2:172.21.15.88:3300/0 conn(0x7f39dc0ce510 msgr2=0x7f39dc0c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:08.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.010+0000 7f39daffd640 1 --2- 172.21.15.88:0/185904297 >> v2:172.21.15.88:3300/0 conn(0x7f39dc0ce510 0x7f39dc0c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.010+0000 7f39daffd640 1 -- 172.21.15.88:0/185904297 >> v1:172.21.15.167:6789/0 conn(0x7f39dc0cbf10 legacy=0x7f39dc06bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:08.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.010+0000 7f39daffd640 1 -- 172.21.15.88:0/185904297 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39dc15e0f0 con 0x7f39dc0cc420 2023-11-27T20:55:08.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.012+0000 7f9683fff640 1 --2- 172.21.15.88:0/2205535818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f968414fdc0 0x7f968406aeb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9674009870 tx=0x7f967402ccc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62c320ca663085f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:08.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.019+0000 7f39daffd640 1 --2- 172.21.15.88:0/185904297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39dc0cc420 0x7f39dc0c9b60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f39dc0cfda0 tx=0x7f39d002ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcc7385b836febc7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:08.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.020+0000 7f9682ffd640 1 -- 172.21.15.88:0/2205535818 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967402da70 con 0x7f968414fdc0 2023-11-27T20:55:08.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.020+0000 7f9682ffd640 1 -- 172.21.15.88:0/2205535818 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967402dbd0 con 0x7f968414fdc0 2023-11-27T20:55:08.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.020+0000 7f9682ffd640 1 -- 172.21.15.88:0/2205535818 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9674035440 con 0x7f968414fdc0 2023-11-27T20:55:08.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.021+0000 7f968a568640 1 -- 172.21.15.88:0/2205535818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f968414fdc0 msgr2=0x7f968406aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:08.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.021+0000 7f968a568640 1 --2- 172.21.15.88:0/2205535818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f968414fdc0 0x7f968406aeb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9674009870 tx=0x7f967402ccc0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.021+0000 7f968a568640 1 -- 172.21.15.88:0/2205535818 shutdown_connections 2023-11-27T20:55:08.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.021+0000 7f968a568640 1 --2- 172.21.15.88:0/2205535818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f968414fdc0 0x7f968406aeb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.021+0000 7f968a568640 1 -- 172.21.15.88:0/2205535818 >> 172.21.15.88:0/2205535818 conn(0x7f968406d170 msgr2=0x7f968406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:08.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.021+0000 7f968a568640 1 -- 172.21.15.88:0/2205535818 shutdown_connections 2023-11-27T20:55:08.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.021+0000 7f968a568640 1 -- 172.21.15.88:0/2205535818 wait complete. 2023-11-27T20:55:08.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.023+0000 7f968a568640 1 Processor -- start 2023-11-27T20:55:08.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.024+0000 7f968a568640 1 -- start start 2023-11-27T20:55:08.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.025+0000 7f968a568640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96840cb2b0 0x7f9684150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:08.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.025+0000 7f39da7fc640 1 -- 172.21.15.88:0/185904297 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d002f850 con 0x7f39dc0cc420 2023-11-27T20:55:08.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.025+0000 7f39da7fc640 1 -- 172.21.15.88:0/185904297 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d002f9b0 con 0x7f39dc0cc420 2023-11-27T20:55:08.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.025+0000 7f39da7fc640 1 -- 172.21.15.88:0/185904297 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d002fd40 con 0x7f39dc0cc420 2023-11-27T20:55:08.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.025+0000 7f968a568640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f968414fdc0 0x7f96841eac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:08.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.025+0000 7f968a568640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9684156ee0 0x7f96841eb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:08.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.025+0000 7f968a568640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968414afa0 con 0x7f968414fdc0 2023-11-27T20:55:08.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.026+0000 7f968a568640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9684152f90 con 0x7f9684156ee0 2023-11-27T20:55:08.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.026+0000 7f968a568640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968414ad00 con 0x7f96840cb2b0 2023-11-27T20:55:08.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.026+0000 7f9688b05640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9684156ee0 0x7f96841eb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:08.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.026+0000 7f39e20c2640 1 -- 172.21.15.88:0/185904297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39dc0cc420 msgr2=0x7f39dc0c9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:08.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.026+0000 7f39e20c2640 1 --2- 172.21.15.88:0/185904297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39dc0cc420 0x7f39dc0c9b60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f39dc0cfda0 tx=0x7f39d002ba30 comp rx=0 tx=0).stop 2023-11-27T20:55:08.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.026+0000 7f39e20c2640 1 -- 172.21.15.88:0/185904297 shutdown_connections 2023-11-27T20:55:08.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.026+0000 7f39e20c2640 1 --2- 172.21.15.88:0/185904297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39dc0cc420 0x7f39dc0c9b60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.026+0000 7f39e20c2640 1 --2- 172.21.15.88:0/185904297 >> v2:172.21.15.88:3300/0 conn(0x7f39dc0ce510 0x7f39dc0c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.026+0000 7f39e20c2640 1 -- 172.21.15.88:0/185904297 >> 172.21.15.88:0/185904297 conn(0x7f39dc0b07b0 msgr2=0x7f39dc0b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:08.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.026+0000 7f9688b05640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9684156ee0 0x7f96841eb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:41508/0 (socket says 172.21.15.88:41508) 2023-11-27T20:55:08.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.026+0000 7f9688b05640 1 -- 172.21.15.88:0/3096191397 learned_addr learned my addr 172.21.15.88:0/3096191397 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:08.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.026+0000 7f39e20c2640 1 -- 172.21.15.88:0/185904297 shutdown_connections 2023-11-27T20:55:08.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.027+0000 7f39e20c2640 1 -- 172.21.15.88:0/185904297 wait complete. 2023-11-27T20:55:08.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.029+0000 7f39e20c2640 1 Processor -- start 2023-11-27T20:55:08.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.029+0000 7f39e20c2640 1 -- start start 2023-11-27T20:55:08.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.031+0000 7f39e20c2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39dc0cbf10 0x7f39dc1591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:08.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.031+0000 7f39e20c2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39dc0cc420 0x7f39dc15b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:08.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.031+0000 7f39e20c2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39dc0ce510 0x7f39dc1610b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:08.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.031+0000 7f39e20c2640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc15ed50 con 0x7f39dc0cc420 2023-11-27T20:55:08.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.031+0000 7f9688b05640 1 -- 172.21.15.88:0/3096191397 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96840cb2b0 msgr2=0x7f9684150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:08.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.031+0000 7f9688b05640 1 --2- 172.21.15.88:0/3096191397 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96840cb2b0 0x7f9684150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.031+0000 7f9688b05640 1 -- 172.21.15.88:0/3096191397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f968414fdc0 msgr2=0x7f96841eac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:08.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.031+0000 7f9688b05640 1 --2- 172.21.15.88:0/3096191397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f968414fdc0 0x7f96841eac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.031+0000 7f9688b05640 1 -- 172.21.15.88:0/3096191397 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96740094d0 con 0x7f9684156ee0 2023-11-27T20:55:08.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.031+0000 7f39e20c2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc15f030 con 0x7f39dc0ce510 2023-11-27T20:55:08.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.031+0000 7f39e20c2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc15f310 con 0x7f39dc0cbf10 2023-11-27T20:55:08.034 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-27T20:55:08.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.033+0000 7f39dbfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39dc0ce510 0x7f39dc1610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:08.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.034+0000 7f39dbfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39dc0ce510 0x7f39dc1610b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:41514/0 (socket says 172.21.15.88:41514) 2023-11-27T20:55:08.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.034+0000 7f39dbfff640 1 -- 172.21.15.88:0/1023320689 learned_addr learned my addr 172.21.15.88:0/1023320689 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:08.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.034+0000 7f9688b05640 1 --2- 172.21.15.88:0/3096191397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9684156ee0 0x7f96841eb150 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f967c00e9f0 tx=0x7f967c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:08.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.038+0000 7f39dbfff640 1 -- 172.21.15.88:0/1023320689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39dc0cbf10 msgr2=0x7f39dc1591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:08.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.038+0000 7f39dbfff640 1 --2- 172.21.15.88:0/1023320689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39dc0cbf10 0x7f39dc1591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.038+0000 7f39dbfff640 1 -- 172.21.15.88:0/1023320689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39dc0cc420 msgr2=0x7f39dc15b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:08.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.038+0000 7f39dbfff640 1 --2- 172.21.15.88:0/1023320689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39dc0cc420 0x7f39dc15b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.038+0000 7f39dbfff640 1 -- 172.21.15.88:0/1023320689 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d00094d0 con 0x7f39dc0ce510 2023-11-27T20:55:08.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.041+0000 7f39dbfff640 1 --2- 172.21.15.88:0/1023320689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39dc0ce510 0x7f39dc1610b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f39d400c730 tx=0x7f39d400cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:08.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.046+0000 7f9680ff9640 1 -- 172.21.15.88:0/3096191397 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c003d80 con 0x7f9684156ee0 2023-11-27T20:55:08.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.046+0000 7f968a568640 1 -- 172.21.15.88:0/3096191397 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96840c79e0 con 0x7f9684156ee0 2023-11-27T20:55:08.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.046+0000 7f9680ff9640 1 -- 172.21.15.88:0/3096191397 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967c001ae0 con 0x7f9684156ee0 2023-11-27T20:55:08.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.046+0000 7f9680ff9640 1 -- 172.21.15.88:0/3096191397 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c001ed0 con 0x7f9684156ee0 2023-11-27T20:55:08.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.046+0000 7f968a568640 1 -- 172.21.15.88:0/3096191397 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9684152c20 con 0x7f9684156ee0 2023-11-27T20:55:08.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.048+0000 7f968a568640 1 -- 172.21.15.88:0/3096191397 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9684073dc0 con 0x7f9684156ee0 2023-11-27T20:55:08.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.048+0000 7f39c3fff640 1 -- 172.21.15.88:0/1023320689 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d4006d50 con 0x7f39dc0ce510 2023-11-27T20:55:08.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.048+0000 7f39c3fff640 1 -- 172.21.15.88:0/1023320689 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d4003970 con 0x7f39dc0ce510 2023-11-27T20:55:08.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.048+0000 7f39c3fff640 1 -- 172.21.15.88:0/1023320689 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d4003d20 con 0x7f39dc0ce510 2023-11-27T20:55:08.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.048+0000 7f39e20c2640 1 -- 172.21.15.88:0/1023320689 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39dc15f5f0 con 0x7f39dc0ce510 2023-11-27T20:55:08.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.048+0000 7f39e20c2640 1 -- 172.21.15.88:0/1023320689 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39dc15f8d0 con 0x7f39dc0ce510 2023-11-27T20:55:08.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.050+0000 7f39e20c2640 1 -- 172.21.15.88:0/1023320689 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39dc15b430 con 0x7f39dc0ce510 2023-11-27T20:55:08.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.068+0000 7f9680ff9640 1 -- 172.21.15.88:0/3096191397 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f967c013770 con 0x7f9684156ee0 2023-11-27T20:55:08.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.068+0000 7f9680ff9640 1 --2- 172.21.15.88:0/3096191397 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f967006b1f0 0x7f967006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:08.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.069+0000 7f9683fff640 1 --2- 172.21.15.88:0/3096191397 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f967006b1f0 0x7f967006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:08.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.070+0000 7f9680ff9640 1 -- 172.21.15.88:0/3096191397 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f967c05d340 con 0x7f9684156ee0 2023-11-27T20:55:08.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.070+0000 7f9683fff640 1 --2- 172.21.15.88:0/3096191397 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f967006b1f0 0x7f967006d6b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9674037000 tx=0x7f967402f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:08.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.132+0000 7f3f867fc640 1 -- 172.21.15.88:0/2429664517 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3f8c01a400 con 0x7f3f900c9c70 2023-11-27T20:55:08.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.132+0000 7f3f867fc640 1 --2- 172.21.15.88:0/2429664517 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3f7406b240 0x7f3f7406d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:08.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.133+0000 7f3f956a0640 1 --2- 172.21.15.88:0/2429664517 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3f7406b240 0x7f3f7406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:08.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.134+0000 7f3f956a0640 1 --2- 172.21.15.88:0/2429664517 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3f7406b240 0x7f3f7406d700 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3f80000f60 tx=0x7f3f80007a80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:08.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.147+0000 7fed47fff640 1 -- 172.21.15.88:0/3189439474 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fed5801ce60 con 0x7fed6015b330 2023-11-27T20:55:08.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.149+0000 7fafc3d25640 1 -- 172.21.15.88:0/739757965 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fafbc0c7460 con 0x7fafbc0c9620 2023-11-27T20:55:08.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.156+0000 7fa07fde5640 1 Processor -- start 2023-11-27T20:55:08.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.156+0000 7fa07fde5640 1 -- start start 2023-11-27T20:55:08.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.157+0000 7fa07fde5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa0780cda70 0x7fa0780ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:08.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.157+0000 7fa07fde5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0780cbda0 con 0x7fa0780cc420 2023-11-27T20:55:08.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.157+0000 7fa07fde5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0780cb4e0 con 0x7fa0780c9620 2023-11-27T20:55:08.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.157+0000 7fa07fde5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0780cc230 con 0x7fa0780cda70 2023-11-27T20:55:08.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.157+0000 7fed47fff640 1 -- 172.21.15.88:0/3189439474 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fed58053d20 con 0x7fed6015b330 2023-11-27T20:55:08.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.171+0000 7f4cb5a36640 1 Processor -- start 2023-11-27T20:55:08.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.171+0000 7f4cb5a36640 1 -- start start 2023-11-27T20:55:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.172+0000 7f4cb5a36640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4cb0151680 0x7f4cb01571d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.172+0000 7f4cb5a36640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4cb006f810 0x7f4cb00ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:08.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.172+0000 7f4cb5a36640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb00c8240 con 0x7f4cb006f3f0 2023-11-27T20:55:08.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.172+0000 7f4cb5a36640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb0157880 con 0x7f4cb0151680 2023-11-27T20:55:08.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.172+0000 7f4cb5a36640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb0157b60 con 0x7f4cb006f810 2023-11-27T20:55:08.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.192+0000 7f3f867fc640 1 -- 172.21.15.88:0/2429664517 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3f8c059200 con 0x7f3f900c9c70 2023-11-27T20:55:08.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.193+0000 7f24d8f16640 1 -- 172.21.15.88:0/2929438586 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f24d40c74d0 con 0x7f24d40c9620 2023-11-27T20:55:08.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.277+0000 7fa07d380640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa0780cc420 0x7fa078159610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34562/0 (socket says 172.21.15.88:34562) 2023-11-27T20:55:08.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.277+0000 7fa07d380640 1 -- 172.21.15.88:0/739028446 learned_addr learned my addr 172.21.15.88:0/739028446 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:55:08.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.288+0000 7f3f867fc640 1 -- 172.21.15.88:0/2429664517 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3f8c054e40 con 0x7f3f900c9c70 2023-11-27T20:55:08.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.290+0000 7f4cae7fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4cb006f3f0 0x7f4cb00c7b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34578/0 (socket says 172.21.15.88:34578) 2023-11-27T20:55:08.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.290+0000 7f4cae7fc640 1 -- 172.21.15.88:0/1157053218 learned_addr learned my addr 172.21.15.88:0/1157053218 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:55:08.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.294+0000 7f4caeffd640 1 --2- 172.21.15.88:0/1157053218 >> v2:172.21.15.88:3300/0 conn(0x7f4cb0151680 0x7f4cb01571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:08.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.296+0000 7fafb27fc640 1 -- 172.21.15.88:0/739757965 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fafac07b760 con 0x7fafbc0c9620 2023-11-27T20:55:08.297 INFO:teuthology.orchestra.run.smithi088.stdout:64424509455 2023-11-27T20:55:08.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.299+0000 7fafc3d25640 1 -- 172.21.15.88:0/739757965 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fafa006b210 msgr2=0x7fafa006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:08.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.299+0000 7fafc3d25640 1 --2- 172.21.15.88:0/739757965 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fafa006b210 0x7fafa006d6d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fafbc0b3e30 tx=0x7fafb8009040 comp rx=0 tx=0).stop 2023-11-27T20:55:08.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.299+0000 7fafc3d25640 1 -- 172.21.15.88:0/739757965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafbc0c9620 msgr2=0x7fafbc14b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:08.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.299+0000 7fafc3d25640 1 --2- 172.21.15.88:0/739757965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafbc0c9620 0x7fafbc14b620 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fafac000c00 tx=0x7fafac0046c0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.299+0000 7fafc3d25640 1 -- 172.21.15.88:0/739757965 shutdown_connections 2023-11-27T20:55:08.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.299+0000 7fafc3d25640 1 --2- 172.21.15.88:0/739757965 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fafa006b210 0x7fafa006d6d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.299+0000 7fafc3d25640 1 --2- 172.21.15.88:0/739757965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafbc0cda70 0x7fafbc1ef650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.299+0000 7fafc3d25640 1 --2- 172.21.15.88:0/739757965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafbc0cc420 0x7fafbc14a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.299+0000 7fafc3d25640 1 --2- 172.21.15.88:0/739757965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafbc0c9620 0x7fafbc14b620 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.299+0000 7fafc3d25640 1 -- 172.21.15.88:0/739757965 >> 172.21.15.88:0/739757965 conn(0x7fafbc0b07b0 msgr2=0x7fafbc0c8110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:08.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.299+0000 7fafc3d25640 1 -- 172.21.15.88:0/739757965 shutdown_connections 2023-11-27T20:55:08.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.299+0000 7fafc3d25640 1 -- 172.21.15.88:0/739757965 wait complete. 2023-11-27T20:55:08.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.303+0000 7fa07cb7f640 1 -- 172.21.15.88:0/739028446 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4092295186 0 0) 0x7fa0780cbda0 con 0x7fa0780cc420 2023-11-27T20:55:08.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.303+0000 7fa07cb7f640 1 -- 172.21.15.88:0/739028446 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa064003520 con 0x7fa0780cc420 2023-11-27T20:55:08.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.306+0000 7f4caeffd640 1 -- 172.21.15.88:0/1157053218 >> v2:172.21.15.167:3300/0 conn(0x7f4cb006f810 msgr2=0x7f4cb00ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:08.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.306+0000 7f4caeffd640 1 --2- 172.21.15.88:0/1157053218 >> v2:172.21.15.167:3300/0 conn(0x7f4cb006f810 0x7f4cb00ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.306+0000 7f4caeffd640 1 -- 172.21.15.88:0/1157053218 >> v1:172.21.15.88:6789/0 conn(0x7f4cb006f3f0 legacy=0x7f4cb00c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:08.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.306+0000 7f4caeffd640 1 -- 172.21.15.88:0/1157053218 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb0157e40 con 0x7f4cb0151680 2023-11-27T20:55:08.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509455 for osd.0 2023-11-27T20:55:08.313 DEBUG:teuthology.parallel:result is None 2023-11-27T20:55:08.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.316+0000 7f4caeffd640 1 --2- 172.21.15.88:0/1157053218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb0151680 0x7f4cb01571d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0154dc0 tx=0x7f4ca002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e677bc59e423534 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:08.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.316+0000 7fa07cb7f640 1 -- 172.21.15.88:0/739028446 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3719290960 0 0) 0x7fa064003520 con 0x7fa0780cc420 2023-11-27T20:55:08.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.316+0000 7fa07cb7f640 1 -- 172.21.15.88:0/739028446 >> v2:172.21.15.167:3300/0 conn(0x7fa0780cda70 msgr2=0x7fa0780ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:08.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.316+0000 7fa07cb7f640 1 --2- 172.21.15.88:0/739028446 >> v2:172.21.15.167:3300/0 conn(0x7fa0780cda70 0x7fa0780ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.316+0000 7fa07cb7f640 1 -- 172.21.15.88:0/739028446 >> v1:172.21.15.167:6789/0 conn(0x7fa0780c9620 legacy=0x7fa078163eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:08.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.316+0000 7fa07cb7f640 1 -- 172.21.15.88:0/739028446 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0780cce00 con 0x7fa0780cc420 2023-11-27T20:55:08.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.316+0000 7fa07cb7f640 1 -- 172.21.15.88:0/739028446 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1067350109 0 0) 0x7fa068001670 con 0x7fa0780cc420 2023-11-27T20:55:08.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.317+0000 7fa07cb7f640 1 -- 172.21.15.88:0/739028446 >> v1:172.21.15.88:6789/0 conn(0x7fa0780cc420 legacy=0x7fa078159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:08.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.317+0000 7fa07cb7f640 1 --2- 172.21.15.88:0/739028446 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0640039e0 0x7fa064003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:08.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.317+0000 7fa07cb7f640 1 --2- 172.21.15.88:0/739028446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0640047c0 0x7fa064004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:08.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.317+0000 7fa07cb7f640 1 --2- 172.21.15.88:0/739028446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa064005380 0x7fa06400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:08.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.317+0000 7fa07cb7f640 1 -- 172.21.15.88:0/739028446 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780cc230 con 0x7fa064005380 2023-11-27T20:55:08.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.317+0000 7fa07cb7f640 1 -- 172.21.15.88:0/739028446 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06400c1e0 con 0x7fa0640047c0 2023-11-27T20:55:08.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.317+0000 7fa07cb7f640 1 -- 172.21.15.88:0/739028446 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06400c3a0 con 0x7fa0640039e0 2023-11-27T20:55:08.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.317+0000 7fa07db81640 1 --2- 172.21.15.88:0/739028446 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0640039e0 0x7fa064003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:08.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.320+0000 7fa07db81640 1 -- 172.21.15.88:0/739028446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0640047c0 msgr2=0x7fa064004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:08.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.320+0000 7fa07db81640 1 --2- 172.21.15.88:0/739028446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0640047c0 0x7fa064004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.320+0000 7fa07db81640 1 -- 172.21.15.88:0/739028446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa064005380 msgr2=0x7fa06400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:08.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.320+0000 7fa07db81640 1 --2- 172.21.15.88:0/739028446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa064005380 0x7fa06400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.320+0000 7fa07db81640 1 -- 172.21.15.88:0/739028446 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa064003520 con 0x7fa0640039e0 2023-11-27T20:55:08.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.320+0000 7fa07e382640 1 -- 172.21.15.88:0/739028446 reap_dead start 2023-11-27T20:55:08.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.322+0000 7fa07db81640 1 --2- 172.21.15.88:0/739028446 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0640039e0 0x7fa064003de0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa074009860 tx=0x7fa0640057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fe42811f8773ac1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:08.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.325+0000 7f4cadffb640 1 -- 172.21.15.88:0/1157053218 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0030610 con 0x7f4cb0151680 2023-11-27T20:55:08.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.325+0000 7f4cadffb640 1 -- 172.21.15.88:0/1157053218 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca0030770 con 0x7f4cb0151680 2023-11-27T20:55:08.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.325+0000 7f4cadffb640 1 -- 172.21.15.88:0/1157053218 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0030b00 con 0x7f4cb0151680 2023-11-27T20:55:08.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.326+0000 7f4cb5a36640 1 -- 172.21.15.88:0/1157053218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb0151680 msgr2=0x7f4cb01571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:08.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.326+0000 7f4cb5a36640 1 --2- 172.21.15.88:0/1157053218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb0151680 0x7f4cb01571d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0154dc0 tx=0x7f4ca002b960 comp rx=0 tx=0).stop 2023-11-27T20:55:08.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.326+0000 7f4cb5a36640 1 -- 172.21.15.88:0/1157053218 shutdown_connections 2023-11-27T20:55:08.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.326+0000 7f4cb5a36640 1 --2- 172.21.15.88:0/1157053218 >> v2:172.21.15.167:3300/0 conn(0x7f4cb006f810 0x7f4cb00ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.326+0000 7f4cb5a36640 1 --2- 172.21.15.88:0/1157053218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb0151680 0x7f4cb01571d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.326+0000 7f4cb5a36640 1 -- 172.21.15.88:0/1157053218 >> 172.21.15.88:0/1157053218 conn(0x7f4cb00707f0 msgr2=0x7f4cb0070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:08.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.326+0000 7f4cb5a36640 1 -- 172.21.15.88:0/1157053218 shutdown_connections 2023-11-27T20:55:08.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.326+0000 7f4cb5a36640 1 -- 172.21.15.88:0/1157053218 wait complete. 2023-11-27T20:55:08.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.326+0000 7fa07cb7f640 1 -- 172.21.15.88:0/739028446 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa074032600 con 0x7fa0640039e0 2023-11-27T20:55:08.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.326+0000 7fa07cb7f640 1 -- 172.21.15.88:0/739028446 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07402e050 con 0x7fa0640039e0 2023-11-27T20:55:08.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.326+0000 7fa07cb7f640 1 -- 172.21.15.88:0/739028446 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0740329c0 con 0x7fa0640039e0 2023-11-27T20:55:08.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.327+0000 7fa07fde5640 1 -- 172.21.15.88:0/739028446 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0640039e0 msgr2=0x7fa064003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:08.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.327+0000 7fa07fde5640 1 --2- 172.21.15.88:0/739028446 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0640039e0 0x7fa064003de0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa074009860 tx=0x7fa0640057f0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.327+0000 7fa07fde5640 1 -- 172.21.15.88:0/739028446 shutdown_connections 2023-11-27T20:55:08.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.327+0000 7fa07fde5640 1 --2- 172.21.15.88:0/739028446 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0640039e0 0x7fa064003de0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.327+0000 7fa07fde5640 1 -- 172.21.15.88:0/739028446 >> 172.21.15.88:0/739028446 conn(0x7fa0780b07b0 msgr2=0x7fa0780b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:08.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.328+0000 7fa07fde5640 1 -- 172.21.15.88:0/739028446 shutdown_connections 2023-11-27T20:55:08.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.328+0000 7fa07fde5640 1 -- 172.21.15.88:0/739028446 wait complete. 2023-11-27T20:55:08.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.328+0000 7f4cb5a36640 1 Processor -- start 2023-11-27T20:55:08.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.328+0000 7f4cb5a36640 1 -- start start 2023-11-27T20:55:08.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.329+0000 7fa07fde5640 1 Processor -- start 2023-11-27T20:55:08.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.329+0000 7fa07fde5640 1 -- start start 2023-11-27T20:55:08.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.329+0000 7f4cb5a36640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cb006f3f0 0x7f4cb006cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:08.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.329+0000 7f4cb5a36640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4cb006f810 0x7f4cb015ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:08.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.330+0000 7f4cb5a36640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb0151680 0x7f4cb015b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:08.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.330+0000 7f4cb5a36640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb0153190 con 0x7f4cb0151680 2023-11-27T20:55:08.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.330+0000 7f4cb5a36640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb0151c10 con 0x7f4cb006f3f0 2023-11-27T20:55:08.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.330+0000 7f4cb5a36640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb00cc810 con 0x7f4cb006f810 2023-11-27T20:55:08.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.330+0000 7fa07fde5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0640039e0 0x7fa07814fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:08.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.330+0000 7fa07fde5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa078152810 0x7fa078150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:08.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.330+0000 7f4caf7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb0151680 0x7f4cb015b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:08.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.330+0000 7fa07fde5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa07814ee40 0x7fa07814f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:08.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.330+0000 7fa07fde5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0781519a0 con 0x7fa07814ee40 2023-11-27T20:55:08.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.330+0000 7fa07fde5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780b3a50 con 0x7fa0640039e0 2023-11-27T20:55:08.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.330+0000 7fa07fde5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780b3e40 con 0x7fa078152810 2023-11-27T20:55:08.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.330+0000 7f4cae7fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4cb006f810 0x7f4cb015ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:08.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.331+0000 7f4caf7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb0151680 0x7f4cb015b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50814/0 (socket says 172.21.15.88:50814) 2023-11-27T20:55:08.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.331+0000 7f4caf7fe640 1 -- 172.21.15.88:0/107498923 learned_addr learned my addr 172.21.15.88:0/107498923 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:08.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.331+0000 7fa07d380640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa078152810 0x7fa078150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:08.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.331+0000 7fa07e382640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa07814ee40 0x7fa07814f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:08.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.332+0000 7fa07d380640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa078152810 0x7fa078150230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:34524/0 (socket says 172.21.15.88:34524) 2023-11-27T20:55:08.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.332+0000 7fa07d380640 1 -- 172.21.15.88:0/2685808022 learned_addr learned my addr 172.21.15.88:0/2685808022 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:08.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.335+0000 7f4cae7fc640 1 -- 172.21.15.88:0/107498923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cb006f3f0 msgr2=0x7f4cb006cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:08.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.335+0000 7f4cae7fc640 1 --2- 172.21.15.88:0/107498923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cb006f3f0 0x7f4cb006cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.335+0000 7f4cae7fc640 1 -- 172.21.15.88:0/107498923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb0151680 msgr2=0x7f4cb015b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:08.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.335+0000 7f4cae7fc640 1 --2- 172.21.15.88:0/107498923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb0151680 0x7f4cb015b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.335+0000 7f4cae7fc640 1 -- 172.21.15.88:0/107498923 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca0009400 con 0x7f4cb006f810 2023-11-27T20:55:08.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.340+0000 7fa07d380640 1 -- 172.21.15.88:0/2685808022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0640039e0 msgr2=0x7fa07814fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:08.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.340+0000 7fa07d380640 1 --2- 172.21.15.88:0/2685808022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0640039e0 0x7fa07814fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.340+0000 7fa07d380640 1 -- 172.21.15.88:0/2685808022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa07814ee40 msgr2=0x7fa07814f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:08.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.340+0000 7fa07d380640 1 --2- 172.21.15.88:0/2685808022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa07814ee40 0x7fa07814f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.340+0000 7fa07d380640 1 -- 172.21.15.88:0/2685808022 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0780b4090 con 0x7fa078152810 2023-11-27T20:55:08.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.340+0000 7f4cae7fc640 1 --2- 172.21.15.88:0/107498923 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4cb006f810 0x7f4cb015ac30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4000f60 tx=0x7f4ca400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:08.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.346+0000 7fa07d380640 1 --2- 172.21.15.88:0/2685808022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa078152810 0x7fa078150230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa06800c770 tx=0x7fa06800cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:08.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.346+0000 7f4c97fff640 1 -- 172.21.15.88:0/107498923 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4005ce0 con 0x7f4cb006f810 2023-11-27T20:55:08.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.347+0000 7f4c97fff640 1 -- 172.21.15.88:0/107498923 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca4005e40 con 0x7f4cb006f810 2023-11-27T20:55:08.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.347+0000 7f4c97fff640 1 -- 172.21.15.88:0/107498923 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4007310 con 0x7f4cb006f810 2023-11-27T20:55:08.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.347+0000 7f4cb5a36640 1 -- 172.21.15.88:0/107498923 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb0159580 con 0x7f4cb006f810 2023-11-27T20:55:08.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.347+0000 7f4cb5a36640 1 -- 172.21.15.88:0/107498923 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb015a710 con 0x7f4cb006f810 2023-11-27T20:55:08.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.348+0000 7f4cb5a36640 1 -- 172.21.15.88:0/107498923 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb0073dc0 con 0x7f4cb006f810 2023-11-27T20:55:08.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.368+0000 7fed65c7c640 1 -- 172.21.15.88:0/3189439474 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fed60073dc0 con 0x7fed6015b330 2023-11-27T20:55:08.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.469+0000 7f3f98105640 1 -- 172.21.15.88:0/2429664517 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3f900aea20 con 0x7f3f900c9c70 2023-11-27T20:55:08.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.472+0000 7f3f867fc640 1 -- 172.21.15.88:0/2429664517 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3f8c015070 con 0x7f3f900c9c70 2023-11-27T20:55:08.474 INFO:teuthology.orchestra.run.smithi088.stdout:60129542160 2023-11-27T20:55:08.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.475+0000 7f3f98105640 1 -- 172.21.15.88:0/2429664517 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3f7406b240 msgr2=0x7f3f7406d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:08.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.475+0000 7f3f98105640 1 --2- 172.21.15.88:0/2429664517 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3f7406b240 0x7f3f7406d700 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3f80000f60 tx=0x7f3f80007a80 comp rx=0 tx=0).stop 2023-11-27T20:55:08.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.475+0000 7f3f98105640 1 -- 172.21.15.88:0/2429664517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f900c9c70 msgr2=0x7f3f901e2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:08.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.475+0000 7f3f98105640 1 --2- 172.21.15.88:0/2429664517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f900c9c70 0x7f3f901e2df0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00b3c0 tx=0x7f3f8c00b880 comp rx=0 tx=0).stop 2023-11-27T20:55:08.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.475+0000 7f3f98105640 1 -- 172.21.15.88:0/2429664517 shutdown_connections 2023-11-27T20:55:08.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.475+0000 7f3f98105640 1 --2- 172.21.15.88:0/2429664517 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3f7406b240 0x7f3f7406d700 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.475+0000 7f3f98105640 1 --2- 172.21.15.88:0/2429664517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f900cd430 0x7f3f901563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.475+0000 7f3f98105640 1 --2- 172.21.15.88:0/2429664517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f900cbf00 0x7f3f901e3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.475+0000 7f3f98105640 1 --2- 172.21.15.88:0/2429664517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f900c9c70 0x7f3f901e2df0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.475+0000 7f3f98105640 1 -- 172.21.15.88:0/2429664517 >> 172.21.15.88:0/2429664517 conn(0x7f3f900b07d0 msgr2=0x7f3f9006ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:08.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.475+0000 7f3f98105640 1 -- 172.21.15.88:0/2429664517 shutdown_connections 2023-11-27T20:55:08.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.475+0000 7f3f98105640 1 -- 172.21.15.88:0/2429664517 wait complete. 2023-11-27T20:55:08.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542160 got 60129542160 for osd.4 2023-11-27T20:55:08.487 DEBUG:teuthology.parallel:result is None 2023-11-27T20:55:08.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.558+0000 7f39c3fff640 1 -- 172.21.15.88:0/1023320689 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f39d40050d0 con 0x7f39dc0ce510 2023-11-27T20:55:08.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.559+0000 7f39c3fff640 1 --2- 172.21.15.88:0/1023320689 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f39c806b210 0x7f39c806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:08.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.559+0000 7f39db7fe640 1 --2- 172.21.15.88:0/1023320689 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f39c806b210 0x7f39c806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:08.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.559+0000 7f39db7fe640 1 --2- 172.21.15.88:0/1023320689 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f39c806b210 0x7f39c806d6d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f39cc009710 tx=0x7f39cc006c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:08.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.562+0000 7f39c3fff640 1 -- 172.21.15.88:0/1023320689 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f39d4023e20 con 0x7f39dc0ce510 2023-11-27T20:55:08.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.573+0000 7f39c3fff640 1 -- 172.21.15.88:0/1023320689 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f39d4054e60 con 0x7f39dc0ce510 2023-11-27T20:55:08.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.584+0000 7f9680ff9640 1 -- 172.21.15.88:0/3096191397 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f967c058f80 con 0x7f9684156ee0 2023-11-27T20:55:08.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.605+0000 7f24c2ffd640 1 -- 172.21.15.88:0/2929438586 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f24c4015070 con 0x7f24d40c9620 2023-11-27T20:55:08.607 INFO:teuthology.orchestra.run.smithi088.stdout:60129542160 2023-11-27T20:55:08.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.608+0000 7f24d8f16640 1 -- 172.21.15.88:0/2929438586 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f24b406b210 msgr2=0x7f24b406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:08.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.608+0000 7f24d8f16640 1 --2- 172.21.15.88:0/2929438586 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f24b406b210 0x7f24b406d6d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f24d40ae570 tx=0x7f24c8009040 comp rx=0 tx=0).stop 2023-11-27T20:55:08.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.608+0000 7f24d8f16640 1 -- 172.21.15.88:0/2929438586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d40c9620 msgr2=0x7f24d40ae030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:08.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.608+0000 7f24d8f16640 1 --2- 172.21.15.88:0/2929438586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d40c9620 0x7f24d40ae030 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f24c400b3e0 tx=0x7f24c400b8a0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.608+0000 7f24d8f16640 1 -- 172.21.15.88:0/2929438586 shutdown_connections 2023-11-27T20:55:08.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.608+0000 7f24d8f16640 1 --2- 172.21.15.88:0/2929438586 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f24b406b210 0x7f24b406d6d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.608+0000 7f24d8f16640 1 --2- 172.21.15.88:0/2929438586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24d40cda70 0x7f24d41efbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.608+0000 7f24d8f16640 1 --2- 172.21.15.88:0/2929438586 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d40cc420 0x7f24d40aa350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.608+0000 7f24d8f16640 1 --2- 172.21.15.88:0/2929438586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d40c9620 0x7f24d40ae030 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.608+0000 7f24d8f16640 1 -- 172.21.15.88:0/2929438586 >> 172.21.15.88:0/2929438586 conn(0x7f24d40b07b0 msgr2=0x7f24d40afbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:08.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.608+0000 7f24d8f16640 1 -- 172.21.15.88:0/2929438586 shutdown_connections 2023-11-27T20:55:08.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.608+0000 7f24d8f16640 1 -- 172.21.15.88:0/2929438586 wait complete. 2023-11-27T20:55:08.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.614+0000 7f4c97fff640 1 -- 172.21.15.88:0/107498923 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4ca4007470 con 0x7f4cb006f810 2023-11-27T20:55:08.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.615+0000 7f4c97fff640 1 --2- 172.21.15.88:0/107498923 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4c9c06b1f0 0x7f4c9c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:08.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.615+0000 7f4caeffd640 1 --2- 172.21.15.88:0/107498923 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4c9c06b1f0 0x7f4c9c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:08.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.616+0000 7f4caeffd640 1 --2- 172.21.15.88:0/107498923 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4c9c06b1f0 0x7f4c9c06d6b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0036000 tx=0x7f4ca0030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:08.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.620+0000 7f4c97fff640 1 -- 172.21.15.88:0/107498923 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4ca4007720 con 0x7f4cb006f810 2023-11-27T20:55:08.624 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542160 got 60129542160 for osd.3 2023-11-27T20:55:08.625 DEBUG:teuthology.parallel:result is None 2023-11-27T20:55:08.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.638+0000 7fa06e7fc640 1 -- 172.21.15.88:0/2685808022 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0680074e0 con 0x7fa078152810 2023-11-27T20:55:08.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.638+0000 7fa06e7fc640 1 -- 172.21.15.88:0/2685808022 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa068007640 con 0x7fa078152810 2023-11-27T20:55:08.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.638+0000 7fa06e7fc640 1 -- 172.21.15.88:0/2685808022 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa068004a20 con 0x7fa078152810 2023-11-27T20:55:08.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.638+0000 7fa07fde5640 1 -- 172.21.15.88:0/2685808022 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0780b4370 con 0x7fa078152810 2023-11-27T20:55:08.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.638+0000 7fa07fde5640 1 -- 172.21.15.88:0/2685808022 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0780b3390 con 0x7fa078152810 2023-11-27T20:55:08.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.639+0000 7fa07fde5640 1 -- 172.21.15.88:0/2685808022 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0780b3b90 con 0x7fa078152810 2023-11-27T20:55:08.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.641+0000 7f4c97fff640 1 -- 172.21.15.88:0/107498923 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4ca4054140 con 0x7f4cb006f810 2023-11-27T20:55:08.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.644+0000 7fed47fff640 1 -- 172.21.15.88:0/3189439474 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fed58017090 con 0x7fed6015b330 2023-11-27T20:55:08.646 INFO:teuthology.orchestra.run.smithi088.stdout:60129542160 2023-11-27T20:55:08.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.647+0000 7fed65c7c640 1 -- 172.21.15.88:0/3189439474 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fed4c06b1c0 msgr2=0x7fed4c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:08.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.647+0000 7fed65c7c640 1 --2- 172.21.15.88:0/3189439474 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fed4c06b1c0 0x7fed4c06d680 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fed50009710 tx=0x7fed50006c90 comp rx=0 tx=0).stop 2023-11-27T20:55:08.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.647+0000 7fed65c7c640 1 -- 172.21.15.88:0/3189439474 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed6015b330 msgr2=0x7fed600c3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:08.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.647+0000 7fed65c7c640 1 --2- 172.21.15.88:0/3189439474 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed6015b330 0x7fed600c3770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fed5800c780 tx=0x7fed5800cc40 comp rx=0 tx=0).stop 2023-11-27T20:55:08.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.647+0000 7fed65c7c640 1 -- 172.21.15.88:0/3189439474 shutdown_connections 2023-11-27T20:55:08.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.647+0000 7fed65c7c640 1 --2- 172.21.15.88:0/3189439474 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fed4c06b1c0 0x7fed4c06d680 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.647+0000 7fed65c7c640 1 --2- 172.21.15.88:0/3189439474 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed6015b330 0x7fed600c3770 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.647+0000 7fed65c7c640 1 --2- 172.21.15.88:0/3189439474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed601403a0 0x7fed6013c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.647+0000 7fed65c7c640 1 --2- 172.21.15.88:0/3189439474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed6013d1a0 0x7fed60152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.647+0000 7fed65c7c640 1 -- 172.21.15.88:0/3189439474 >> 172.21.15.88:0/3189439474 conn(0x7fed600712f0 msgr2=0x7fed60156890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:08.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.648+0000 7fed65c7c640 1 -- 172.21.15.88:0/3189439474 shutdown_connections 2023-11-27T20:55:08.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.648+0000 7fed65c7c640 1 -- 172.21.15.88:0/3189439474 wait complete. 2023-11-27T20:55:08.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542160 got 60129542160 for osd.7 2023-11-27T20:55:08.665 DEBUG:teuthology.parallel:result is None 2023-11-27T20:55:08.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.780+0000 7f39e20c2640 1 -- 172.21.15.88:0/1023320689 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f39dc15b430 con 0x7f39dc0ce510 2023-11-27T20:55:08.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.783+0000 7f39c3fff640 1 -- 172.21.15.88:0/1023320689 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f39dc15b430 con 0x7f39dc0ce510 2023-11-27T20:55:08.785 INFO:teuthology.orchestra.run.smithi088.stdout:64424509455 2023-11-27T20:55:08.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.785+0000 7f39e20c2640 1 -- 172.21.15.88:0/1023320689 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f39c806b210 msgr2=0x7f39c806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:08.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.785+0000 7f39e20c2640 1 --2- 172.21.15.88:0/1023320689 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f39c806b210 0x7f39c806d6d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f39cc009710 tx=0x7f39cc006c90 comp rx=0 tx=0).stop 2023-11-27T20:55:08.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.785+0000 7f39e20c2640 1 -- 172.21.15.88:0/1023320689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39dc0ce510 msgr2=0x7f39dc1610b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:08.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.785+0000 7f39e20c2640 1 --2- 172.21.15.88:0/1023320689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39dc0ce510 0x7f39dc1610b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f39d400c730 tx=0x7f39d400cbf0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.785+0000 7f39e20c2640 1 -- 172.21.15.88:0/1023320689 shutdown_connections 2023-11-27T20:55:08.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.785+0000 7f39e20c2640 1 --2- 172.21.15.88:0/1023320689 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f39c806b210 0x7f39c806d6d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.785+0000 7f39e20c2640 1 --2- 172.21.15.88:0/1023320689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39dc0ce510 0x7f39dc1610b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.785+0000 7f39e20c2640 1 --2- 172.21.15.88:0/1023320689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39dc0cc420 0x7f39dc15b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.785+0000 7f39e20c2640 1 --2- 172.21.15.88:0/1023320689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39dc0cbf10 0x7f39dc1591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.785+0000 7f39e20c2640 1 -- 172.21.15.88:0/1023320689 >> 172.21.15.88:0/1023320689 conn(0x7f39dc0b07b0 msgr2=0x7f39dc0ae6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:08.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.785+0000 7f39e20c2640 1 -- 172.21.15.88:0/1023320689 shutdown_connections 2023-11-27T20:55:08.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.785+0000 7f39e20c2640 1 -- 172.21.15.88:0/1023320689 wait complete. 2023-11-27T20:55:08.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509455 for osd.6 2023-11-27T20:55:08.799 DEBUG:teuthology.parallel:result is None 2023-11-27T20:55:08.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.798+0000 7f968a568640 1 -- 172.21.15.88:0/3096191397 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f96841530d0 con 0x7f9684156ee0 2023-11-27T20:55:08.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.802+0000 7f9680ff9640 1 -- 172.21.15.88:0/3096191397 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f967c05c5a0 con 0x7f9684156ee0 2023-11-27T20:55:08.803 INFO:teuthology.orchestra.run.smithi088.stdout:64424509456 2023-11-27T20:55:08.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.803+0000 7f968a568640 1 -- 172.21.15.88:0/3096191397 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f967006b1f0 msgr2=0x7f967006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:08.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.803+0000 7f968a568640 1 --2- 172.21.15.88:0/3096191397 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f967006b1f0 0x7f967006d6b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9674037000 tx=0x7f967402f000 comp rx=0 tx=0).stop 2023-11-27T20:55:08.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.803+0000 7f968a568640 1 -- 172.21.15.88:0/3096191397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9684156ee0 msgr2=0x7f96841eb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:08.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.803+0000 7f968a568640 1 --2- 172.21.15.88:0/3096191397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9684156ee0 0x7f96841eb150 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f967c00e9f0 tx=0x7f967c00eeb0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.804+0000 7f968a568640 1 -- 172.21.15.88:0/3096191397 shutdown_connections 2023-11-27T20:55:08.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.804+0000 7f968a568640 1 --2- 172.21.15.88:0/3096191397 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f967006b1f0 0x7f967006d6b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.804+0000 7f968a568640 1 --2- 172.21.15.88:0/3096191397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9684156ee0 0x7f96841eb150 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.804+0000 7f968a568640 1 --2- 172.21.15.88:0/3096191397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f968414fdc0 0x7f96841eac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.804+0000 7f968a568640 1 --2- 172.21.15.88:0/3096191397 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96840cb2b0 0x7f9684150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:08.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.804+0000 7f968a568640 1 -- 172.21.15.88:0/3096191397 >> 172.21.15.88:0/3096191397 conn(0x7f968406d170 msgr2=0x7f96840caac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:08.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.804+0000 7f968a568640 1 -- 172.21.15.88:0/3096191397 shutdown_connections 2023-11-27T20:55:08.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.804+0000 7f968a568640 1 -- 172.21.15.88:0/3096191397 wait complete. 2023-11-27T20:55:08.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509456 got 64424509456 for osd.1 2023-11-27T20:55:08.816 DEBUG:teuthology.parallel:result is None 2023-11-27T20:55:08.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.842+0000 7f4cb5a36640 1 -- 172.21.15.88:0/107498923 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4cb00b2070 con 0x7f4cb006f810 2023-11-27T20:55:08.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.919+0000 7fa06e7fc640 1 -- 172.21.15.88:0/2685808022 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa06800a640 con 0x7fa078152810 2023-11-27T20:55:08.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.919+0000 7fa06e7fc640 1 --2- 172.21.15.88:0/2685808022 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa05c06b240 0x7fa05c06d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:08.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.920+0000 7fa07db81640 1 --2- 172.21.15.88:0/2685808022 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa05c06b240 0x7fa05c06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:08.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.920+0000 7fa07db81640 1 --2- 172.21.15.88:0/2685808022 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa05c06b240 0x7fa05c06d700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa074034000 tx=0x7fa07402f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:08.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.928+0000 7fa06e7fc640 1 -- 172.21.15.88:0/2685808022 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa068058870 con 0x7fa078152810 2023-11-27T20:55:08.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:08.939+0000 7fa06e7fc640 1 -- 172.21.15.88:0/2685808022 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa0680544b0 con 0x7fa078152810 2023-11-27T20:55:09.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.027+0000 7f4c97fff640 1 -- 172.21.15.88:0/107498923 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4ca4017020 con 0x7f4cb006f810 2023-11-27T20:55:09.029 INFO:teuthology.orchestra.run.smithi088.stdout:64424509456 2023-11-27T20:55:09.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.029+0000 7f4cb5a36640 1 -- 172.21.15.88:0/107498923 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4c9c06b1f0 msgr2=0x7f4c9c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:09.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.029+0000 7f4cb5a36640 1 --2- 172.21.15.88:0/107498923 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4c9c06b1f0 0x7f4c9c06d6b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0036000 tx=0x7f4ca0030000 comp rx=0 tx=0).stop 2023-11-27T20:55:09.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.029+0000 7f4cb5a36640 1 -- 172.21.15.88:0/107498923 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4cb006f810 msgr2=0x7f4cb015ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:09.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.029+0000 7f4cb5a36640 1 --2- 172.21.15.88:0/107498923 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4cb006f810 0x7f4cb015ac30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4000f60 tx=0x7f4ca400c800 comp rx=0 tx=0).stop 2023-11-27T20:55:09.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.029+0000 7f4cb5a36640 1 -- 172.21.15.88:0/107498923 shutdown_connections 2023-11-27T20:55:09.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.029+0000 7f4cb5a36640 1 --2- 172.21.15.88:0/107498923 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4c9c06b1f0 0x7f4c9c06d6b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:09.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.029+0000 7f4cb5a36640 1 --2- 172.21.15.88:0/107498923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb0151680 0x7f4cb015b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:09.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.029+0000 7f4cb5a36640 1 --2- 172.21.15.88:0/107498923 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4cb006f810 0x7f4cb015ac30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:09.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.029+0000 7f4cb5a36640 1 --2- 172.21.15.88:0/107498923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cb006f3f0 0x7f4cb006cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:09.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.029+0000 7f4cb5a36640 1 -- 172.21.15.88:0/107498923 >> 172.21.15.88:0/107498923 conn(0x7f4cb00707f0 msgr2=0x7f4cb00cbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:09.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.030+0000 7f4cb5a36640 1 -- 172.21.15.88:0/107498923 shutdown_connections 2023-11-27T20:55:09.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.030+0000 7f4cb5a36640 1 -- 172.21.15.88:0/107498923 wait complete. 2023-11-27T20:55:09.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509456 got 64424509456 for osd.2 2023-11-27T20:55:09.043 DEBUG:teuthology.parallel:result is None 2023-11-27T20:55:09.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.134+0000 7fa07fde5640 1 -- 172.21.15.88:0/2685808022 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa0780c85a0 con 0x7fa078152810 2023-11-27T20:55:09.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.137+0000 7fa06e7fc640 1 -- 172.21.15.88:0/2685808022 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa068018070 con 0x7fa078152810 2023-11-27T20:55:09.139 INFO:teuthology.orchestra.run.smithi088.stdout:64424509455 2023-11-27T20:55:09.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.139+0000 7fa07fde5640 1 -- 172.21.15.88:0/2685808022 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa05c06b240 msgr2=0x7fa05c06d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:09.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.139+0000 7fa07fde5640 1 --2- 172.21.15.88:0/2685808022 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa05c06b240 0x7fa05c06d700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa074034000 tx=0x7fa07402f000 comp rx=0 tx=0).stop 2023-11-27T20:55:09.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.139+0000 7fa07fde5640 1 -- 172.21.15.88:0/2685808022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa078152810 msgr2=0x7fa078150230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:09.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.139+0000 7fa07fde5640 1 --2- 172.21.15.88:0/2685808022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa078152810 0x7fa078150230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa06800c770 tx=0x7fa06800cc30 comp rx=0 tx=0).stop 2023-11-27T20:55:09.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.139+0000 7fa07fde5640 1 -- 172.21.15.88:0/2685808022 shutdown_connections 2023-11-27T20:55:09.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.139+0000 7fa07fde5640 1 --2- 172.21.15.88:0/2685808022 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa05c06b240 0x7fa05c06d700 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:09.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.139+0000 7fa07fde5640 1 --2- 172.21.15.88:0/2685808022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa07814ee40 0x7fa07814f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:09.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.139+0000 7fa07fde5640 1 --2- 172.21.15.88:0/2685808022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa078152810 0x7fa078150230 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:09.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.139+0000 7fa07fde5640 1 --2- 172.21.15.88:0/2685808022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0640039e0 0x7fa07814fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:09.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.139+0000 7fa07fde5640 1 -- 172.21.15.88:0/2685808022 >> 172.21.15.88:0/2685808022 conn(0x7fa0780b07b0 msgr2=0x7fa0780b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:09.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.139+0000 7fa07fde5640 1 -- 172.21.15.88:0/2685808022 shutdown_connections 2023-11-27T20:55:09.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.139+0000 7fa07fde5640 1 -- 172.21.15.88:0/2685808022 wait complete. 2023-11-27T20:55:09.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509455 for osd.5 2023-11-27T20:55:09.153 DEBUG:teuthology.parallel:result is None 2023-11-27T20:55:09.153 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-27T20:55:09.153 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:55:09.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.250+0000 7fcfc7b61640 1 Processor -- start 2023-11-27T20:55:09.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.251+0000 7fcfc7b61640 1 -- start start 2023-11-27T20:55:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.251+0000 7fcfc7b61640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfc006a4b0 0x7fcfc006a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.251+0000 7fcfc7b61640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcfc015c9c0 0x7fcfc015ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.251+0000 7fcfc7b61640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc0159f80 con 0x7fcfc00c59e0 2023-11-27T20:55:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.251+0000 7fcfc7b61640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc006adf0 con 0x7fcfc015c9c0 2023-11-27T20:55:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.251+0000 7fcfc7b61640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc015d350 con 0x7fcfc006a4b0 2023-11-27T20:55:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.252+0000 7fcfc50fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfc006a4b0 0x7fcfc006a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:09.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.253+0000 7fcfc58fd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fcfc00c59e0 0x7fcfc006d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:59144/0 (socket says 172.21.15.88:59144) 2023-11-27T20:55:09.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.253+0000 7fcfc58fd640 1 -- 172.21.15.88:0/3422946367 learned_addr learned my addr 172.21.15.88:0/3422946367 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:55:09.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.253+0000 7fcfc60fe640 1 --2- 172.21.15.88:0/3422946367 >> v2:172.21.15.167:3300/0 conn(0x7fcfc015c9c0 0x7fcfc015ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:09.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.255+0000 7fcfc50fc640 1 -- 172.21.15.88:0/3422946367 >> v2:172.21.15.167:3300/0 conn(0x7fcfc015c9c0 msgr2=0x7fcfc015ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:09.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.255+0000 7fcfc50fc640 1 --2- 172.21.15.88:0/3422946367 >> v2:172.21.15.167:3300/0 conn(0x7fcfc015c9c0 0x7fcfc015ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:09.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.255+0000 7fcfc50fc640 1 -- 172.21.15.88:0/3422946367 >> v1:172.21.15.167:6789/0 conn(0x7fcfc00c59e0 legacy=0x7fcfc006d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:09.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.256+0000 7fcfc50fc640 1 -- 172.21.15.88:0/3422946367 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc01593d0 con 0x7fcfc006a4b0 2023-11-27T20:55:09.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.258+0000 7fcfc50fc640 1 --2- 172.21.15.88:0/3422946367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfc006a4b0 0x7fcfc006a8b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcfb00097a0 tx=0x7fcfb002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f09cdc1451f9e45f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:09.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.262+0000 7fcfc48fb640 1 -- 172.21.15.88:0/3422946367 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0030610 con 0x7fcfc006a4b0 2023-11-27T20:55:09.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.262+0000 7fcfc48fb640 1 -- 172.21.15.88:0/3422946367 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb0030770 con 0x7fcfc006a4b0 2023-11-27T20:55:09.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.262+0000 7fcfc48fb640 1 -- 172.21.15.88:0/3422946367 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0030b00 con 0x7fcfc006a4b0 2023-11-27T20:55:09.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.262+0000 7fcfc7b61640 1 -- 172.21.15.88:0/3422946367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfc006a4b0 msgr2=0x7fcfc006a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:09.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.262+0000 7fcfc7b61640 1 --2- 172.21.15.88:0/3422946367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfc006a4b0 0x7fcfc006a8b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcfb00097a0 tx=0x7fcfb002b960 comp rx=0 tx=0).stop 2023-11-27T20:55:09.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.263+0000 7fcfc7b61640 1 -- 172.21.15.88:0/3422946367 shutdown_connections 2023-11-27T20:55:09.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.263+0000 7fcfc7b61640 1 --2- 172.21.15.88:0/3422946367 >> v2:172.21.15.167:3300/0 conn(0x7fcfc015c9c0 0x7fcfc015ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:09.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.263+0000 7fcfc7b61640 1 --2- 172.21.15.88:0/3422946367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfc006a4b0 0x7fcfc006a8b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:09.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.263+0000 7fcfc7b61640 1 -- 172.21.15.88:0/3422946367 >> 172.21.15.88:0/3422946367 conn(0x7fcfc006f6d0 msgr2=0x7fcfc006fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:09.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.263+0000 7fcfc7b61640 1 -- 172.21.15.88:0/3422946367 shutdown_connections 2023-11-27T20:55:09.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.263+0000 7fcfc7b61640 1 -- 172.21.15.88:0/3422946367 wait complete. 2023-11-27T20:55:09.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.264+0000 7fcfc7b61640 1 Processor -- start 2023-11-27T20:55:09.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.264+0000 7fcfc7b61640 1 -- start start 2023-11-27T20:55:09.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.264+0000 7fcfc7b61640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfc006a4b0 0x7fcfc0149110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:09.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.264+0000 7fcfc7b61640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfc00c59e0 0x7fcfc01ef460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:09.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.264+0000 7fcfc7b61640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfc015c9c0 0x7fcfc01ef9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:09.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.264+0000 7fcfc7b61640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc01ef040 con 0x7fcfc00c59e0 2023-11-27T20:55:09.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.264+0000 7fcfc7b61640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc0149e60 con 0x7fcfc015c9c0 2023-11-27T20:55:09.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.264+0000 7fcfc7b61640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc015c2f0 con 0x7fcfc006a4b0 2023-11-27T20:55:09.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.265+0000 7fcfc58fd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfc006a4b0 0x7fcfc0149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:09.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.265+0000 7fcfc50fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfc00c59e0 0x7fcfc01ef460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:09.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.265+0000 7fcfc60fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfc015c9c0 0x7fcfc01ef9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:09.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.265+0000 7fcfc58fd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfc006a4b0 0x7fcfc0149110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:34540/0 (socket says 172.21.15.88:34540) 2023-11-27T20:55:09.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.265+0000 7fcfc58fd640 1 -- 172.21.15.88:0/921138938 learned_addr learned my addr 172.21.15.88:0/921138938 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:09.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.269+0000 7fcfc50fc640 1 -- 172.21.15.88:0/921138938 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfc006a4b0 msgr2=0x7fcfc0149110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:09.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.269+0000 7fcfc50fc640 1 --2- 172.21.15.88:0/921138938 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfc006a4b0 0x7fcfc0149110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:09.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.269+0000 7fcfc50fc640 1 -- 172.21.15.88:0/921138938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfc015c9c0 msgr2=0x7fcfc01ef9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:09.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.269+0000 7fcfc50fc640 1 --2- 172.21.15.88:0/921138938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfc015c9c0 0x7fcfc01ef9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:09.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.269+0000 7fcfc50fc640 1 -- 172.21.15.88:0/921138938 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb0009400 con 0x7fcfc00c59e0 2023-11-27T20:55:09.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.271+0000 7fcfc50fc640 1 --2- 172.21.15.88:0/921138938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfc00c59e0 0x7fcfc01ef460 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0033000 tx=0x7fcfb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:09.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.275+0000 7fcfb67fc640 1 -- 172.21.15.88:0/921138938 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb003e070 con 0x7fcfc00c59e0 2023-11-27T20:55:09.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.275+0000 7fcfb67fc640 1 -- 172.21.15.88:0/921138938 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb00397a0 con 0x7fcfc00c59e0 2023-11-27T20:55:09.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.275+0000 7fcfb67fc640 1 -- 172.21.15.88:0/921138938 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0039b30 con 0x7fcfc00c59e0 2023-11-27T20:55:09.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.275+0000 7fcfc7b61640 1 -- 172.21.15.88:0/921138938 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc015c590 con 0x7fcfc00c59e0 2023-11-27T20:55:09.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.275+0000 7fcfc7b61640 1 -- 172.21.15.88:0/921138938 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc014a070 con 0x7fcfc00c59e0 2023-11-27T20:55:09.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.276+0000 7fcfc7b61640 1 -- 172.21.15.88:0/921138938 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc01ef180 con 0x7fcfc00c59e0 2023-11-27T20:55:09.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.518+0000 7fcfb67fc640 1 -- 172.21.15.88:0/921138938 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fcfb0039c90 con 0x7fcfc00c59e0 2023-11-27T20:55:09.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.518+0000 7fcfb67fc640 1 --2- 172.21.15.88:0/921138938 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fcfa406b210 0x7fcfa406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:09.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.518+0000 7fcfc58fd640 1 --2- 172.21.15.88:0/921138938 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fcfa406b210 0x7fcfa406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:09.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.519+0000 7fcfc58fd640 1 --2- 172.21.15.88:0/921138938 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fcfa406b210 0x7fcfa406d6d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc004e40 tx=0x7fcfbc007f10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:09.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.530+0000 7fcfb67fc640 1 -- 172.21.15.88:0/921138938 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcfb007a2e0 con 0x7fcfc00c59e0 2023-11-27T20:55:09.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.530+0000 7fcfb67fc640 1 -- 172.21.15.88:0/921138938 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fcfb0076620 con 0x7fcfc00c59e0 2023-11-27T20:55:09.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.704+0000 7fcfc7b61640 1 -- 172.21.15.88:0/921138938 --> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcfc00728f0 con 0x7fcfa406b210 2023-11-27T20:55:09.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.712+0000 7fcfb67fc640 1 -- 172.21.15.88:0/921138938 <== mgr.4105 v2:172.21.15.88:6800/352455703 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+346223 (secure 0 0 0) 0x7fcfbc001460 con 0x7fcfa406b210 2023-11-27T20:55:09.717 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:55:09.719 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-11-27T20:55:09.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.715+0000 7fcfc7b61640 1 -- 172.21.15.88:0/921138938 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fcfa406b210 msgr2=0x7fcfa406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:09.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.715+0000 7fcfc7b61640 1 --2- 172.21.15.88:0/921138938 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fcfa406b210 0x7fcfa406d6d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc004e40 tx=0x7fcfbc007f10 comp rx=0 tx=0).stop 2023-11-27T20:55:09.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.715+0000 7fcfc7b61640 1 -- 172.21.15.88:0/921138938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfc00c59e0 msgr2=0x7fcfc01ef460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:09.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.715+0000 7fcfc7b61640 1 --2- 172.21.15.88:0/921138938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfc00c59e0 0x7fcfc01ef460 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0033000 tx=0x7fcfb00046c0 comp rx=0 tx=0).stop 2023-11-27T20:55:09.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.715+0000 7fcfc7b61640 1 -- 172.21.15.88:0/921138938 shutdown_connections 2023-11-27T20:55:09.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.715+0000 7fcfc7b61640 1 --2- 172.21.15.88:0/921138938 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fcfa406b210 0x7fcfa406d6d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:09.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.715+0000 7fcfc7b61640 1 --2- 172.21.15.88:0/921138938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfc015c9c0 0x7fcfc01ef9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:09.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.715+0000 7fcfc7b61640 1 --2- 172.21.15.88:0/921138938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfc00c59e0 0x7fcfc01ef460 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:09.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.715+0000 7fcfc7b61640 1 --2- 172.21.15.88:0/921138938 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfc006a4b0 0x7fcfc0149110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:09.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.715+0000 7fcfc7b61640 1 -- 172.21.15.88:0/921138938 >> 172.21.15.88:0/921138938 conn(0x7fcfc006f6d0 msgr2=0x7fcfc006fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:09.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.715+0000 7fcfc7b61640 1 -- 172.21.15.88:0/921138938 shutdown_connections 2023-11-27T20:55:09.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.716+0000 7fcfc7b61640 1 -- 172.21.15.88:0/921138938 wait complete. 2023-11-27T20:55:09.728 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2023-11-27T20:55:08.908682+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597232,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":283,"num_write_kb":2452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219752,"kb_used_data":3604,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754968,"statfs":{"total":773094113280,"available":772869087232,"internally_reserved":0,"allocated":3690496,"data_stored":2154076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2224,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.239944"},"pg_stats":[{"pgid":"2.1f","version":"28'9","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:05.779122+0000","last_change":"2023-11-27T20:54:26.222003+0000","last_active":"2023-11-27T20:55:05.779122+0000","last_peered":"2023-11-27T20:55:05.779122+0000","last_clean":"2023-11-27T20:55:05.779122+0000","last_became_active":"2023-11-27T20:54:26.221715+0000","last_became_peered":"2023-11-27T20:54:26.221715+0000","last_unstale":"2023-11-27T20:55:05.779122+0000","last_undegraded":"2023-11-27T20:55:05.779122+0000","last_fullsized":"2023-11-27T20:55:05.779122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:36:45.301515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.611291+0000","last_change":"2023-11-27T20:54:27.508401+0000","last_active":"2023-11-27T20:54:59.611291+0000","last_peered":"2023-11-27T20:54:59.611291+0000","last_clean":"2023-11-27T20:54:59.611291+0000","last_became_active":"2023-11-27T20:54:27.508003+0000","last_became_peered":"2023-11-27T20:54:27.508003+0000","last_unstale":"2023-11-27T20:54:59.611291+0000","last_undegraded":"2023-11-27T20:54:59.611291+0000","last_fullsized":"2023-11-27T20:54:59.611291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:11:42.954310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607401+0000","last_change":"2023-11-27T20:54:31.837226+0000","last_active":"2023-11-27T20:54:59.607401+0000","last_peered":"2023-11-27T20:54:59.607401+0000","last_clean":"2023-11-27T20:54:59.607401+0000","last_became_active":"2023-11-27T20:54:31.836803+0000","last_became_peered":"2023-11-27T20:54:31.836803+0000","last_unstale":"2023-11-27T20:54:59.607401+0000","last_undegraded":"2023-11-27T20:54:59.607401+0000","last_fullsized":"2023-11-27T20:54:59.607401+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:06.363326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:01.285560+0000","last_change":"2023-11-27T20:54:26.227906+0000","last_active":"2023-11-27T20:55:01.285560+0000","last_peered":"2023-11-27T20:55:01.285560+0000","last_clean":"2023-11-27T20:55:01.285560+0000","last_became_active":"2023-11-27T20:54:26.227620+0000","last_became_peered":"2023-11-27T20:54:26.227620+0000","last_unstale":"2023-11-27T20:55:01.285560+0000","last_undegraded":"2023-11-27T20:55:01.285560+0000","last_fullsized":"2023-11-27T20:55:01.285560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:35.560769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.611137+0000","last_change":"2023-11-27T20:54:27.507740+0000","last_active":"2023-11-27T20:54:59.611137+0000","last_peered":"2023-11-27T20:54:59.611137+0000","last_clean":"2023-11-27T20:54:59.611137+0000","last_became_active":"2023-11-27T20:54:27.507460+0000","last_became_peered":"2023-11-27T20:54:27.507460+0000","last_unstale":"2023-11-27T20:54:59.611137+0000","last_undegraded":"2023-11-27T20:54:59.611137+0000","last_fullsized":"2023-11-27T20:54:59.611137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:24:30.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:00.593902+0000","last_change":"2023-11-27T20:55:00.593902+0000","last_active":"2023-11-27T20:55:00.593902+0000","last_peered":"2023-11-27T20:55:00.593902+0000","last_clean":"2023-11-27T20:55:00.593902+0000","last_became_active":"2023-11-27T20:55:00.593543+0000","last_became_peered":"2023-11-27T20:55:00.593543+0000","last_unstale":"2023-11-27T20:55:00.593902+0000","last_undegraded":"2023-11-27T20:55:00.593902+0000","last_fullsized":"2023-11-27T20:55:00.593902+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:57:38.465675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.608082+0000","last_change":"2023-11-27T20:54:26.226645+0000","last_active":"2023-11-27T20:54:59.608082+0000","last_peered":"2023-11-27T20:54:59.608082+0000","last_clean":"2023-11-27T20:54:59.608082+0000","last_became_active":"2023-11-27T20:54:26.226407+0000","last_became_peered":"2023-11-27T20:54:26.226407+0000","last_unstale":"2023-11-27T20:54:59.608082+0000","last_undegraded":"2023-11-27T20:54:59.608082+0000","last_fullsized":"2023-11-27T20:54:59.608082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:32:19.691350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.606758+0000","last_change":"2023-11-27T20:54:27.512803+0000","last_active":"2023-11-27T20:54:59.606758+0000","last_peered":"2023-11-27T20:54:59.606758+0000","last_clean":"2023-11-27T20:54:59.606758+0000","last_became_active":"2023-11-27T20:54:27.512548+0000","last_became_peered":"2023-11-27T20:54:27.512548+0000","last_unstale":"2023-11-27T20:54:59.606758+0000","last_undegraded":"2023-11-27T20:54:59.606758+0000","last_fullsized":"2023-11-27T20:54:59.606758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:36.652979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.605044+0000","last_change":"2023-11-27T20:54:31.828391+0000","last_active":"2023-11-27T20:54:59.605044+0000","last_peered":"2023-11-27T20:54:59.605044+0000","last_clean":"2023-11-27T20:54:59.605044+0000","last_became_active":"2023-11-27T20:54:31.828045+0000","last_became_peered":"2023-11-27T20:54:31.828045+0000","last_unstale":"2023-11-27T20:54:59.605044+0000","last_undegraded":"2023-11-27T20:54:59.605044+0000","last_fullsized":"2023-11-27T20:54:59.605044+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:58.308604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.608051+0000","last_change":"2023-11-27T20:54:26.226762+0000","last_active":"2023-11-27T20:54:59.608051+0000","last_peered":"2023-11-27T20:54:59.608051+0000","last_clean":"2023-11-27T20:54:59.608051+0000","last_became_active":"2023-11-27T20:54:26.226522+0000","last_became_peered":"2023-11-27T20:54:26.226522+0000","last_unstale":"2023-11-27T20:54:59.608051+0000","last_undegraded":"2023-11-27T20:54:59.608051+0000","last_fullsized":"2023-11-27T20:54:59.608051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:31.269905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:00.790042+0000","last_change":"2023-11-27T20:55:00.790042+0000","last_active":"2023-11-27T20:55:00.790042+0000","last_peered":"2023-11-27T20:55:00.790042+0000","last_clean":"2023-11-27T20:55:00.790042+0000","last_became_active":"2023-11-27T20:55:00.789772+0000","last_became_peered":"2023-11-27T20:55:00.789772+0000","last_unstale":"2023-11-27T20:55:00.790042+0000","last_undegraded":"2023-11-27T20:55:00.790042+0000","last_fullsized":"2023-11-27T20:55:00.790042+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:51:32.237462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.604962+0000","last_change":"2023-11-27T20:54:31.828759+0000","last_active":"2023-11-27T20:54:59.604962+0000","last_peered":"2023-11-27T20:54:59.604962+0000","last_clean":"2023-11-27T20:54:59.604962+0000","last_became_active":"2023-11-27T20:54:31.828371+0000","last_became_peered":"2023-11-27T20:54:31.828371+0000","last_unstale":"2023-11-27T20:54:59.604962+0000","last_undegraded":"2023-11-27T20:54:59.604962+0000","last_fullsized":"2023-11-27T20:54:59.604962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:40.986177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609966+0000","last_change":"2023-11-27T20:54:27.498572+0000","last_active":"2023-11-27T20:54:59.609966+0000","last_peered":"2023-11-27T20:54:59.609966+0000","last_clean":"2023-11-27T20:54:59.609966+0000","last_became_active":"2023-11-27T20:54:27.498279+0000","last_became_peered":"2023-11-27T20:54:27.498279+0000","last_unstale":"2023-11-27T20:54:59.609966+0000","last_undegraded":"2023-11-27T20:54:59.609966+0000","last_fullsized":"2023-11-27T20:54:59.609966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:23:57.929109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610059+0000","last_change":"2023-11-27T20:54:26.227734+0000","last_active":"2023-11-27T20:54:59.610059+0000","last_peered":"2023-11-27T20:54:59.610059+0000","last_clean":"2023-11-27T20:54:59.610059+0000","last_became_active":"2023-11-27T20:54:26.227503+0000","last_became_peered":"2023-11-27T20:54:26.227503+0000","last_unstale":"2023-11-27T20:54:59.610059+0000","last_undegraded":"2023-11-27T20:54:59.610059+0000","last_fullsized":"2023-11-27T20:54:59.610059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:08.206775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610029+0000","last_change":"2023-11-27T20:54:31.827976+0000","last_active":"2023-11-27T20:54:59.610029+0000","last_peered":"2023-11-27T20:54:59.610029+0000","last_clean":"2023-11-27T20:54:59.610029+0000","last_became_active":"2023-11-27T20:54:31.827631+0000","last_became_peered":"2023-11-27T20:54:31.827631+0000","last_unstale":"2023-11-27T20:54:59.610029+0000","last_undegraded":"2023-11-27T20:54:59.610029+0000","last_fullsized":"2023-11-27T20:54:59.610029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:58:58.404897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607133+0000","last_change":"2023-11-27T20:54:27.510917+0000","last_active":"2023-11-27T20:54:59.607133+0000","last_peered":"2023-11-27T20:54:59.607133+0000","last_clean":"2023-11-27T20:54:59.607133+0000","last_became_active":"2023-11-27T20:54:27.510668+0000","last_became_peered":"2023-11-27T20:54:27.510668+0000","last_unstale":"2023-11-27T20:54:59.607133+0000","last_undegraded":"2023-11-27T20:54:59.607133+0000","last_fullsized":"2023-11-27T20:54:59.607133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:27:15.390631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'1","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:00.584675+0000","last_change":"2023-11-27T20:54:26.231461+0000","last_active":"2023-11-27T20:55:00.584675+0000","last_peered":"2023-11-27T20:55:00.584675+0000","last_clean":"2023-11-27T20:55:00.584675+0000","last_became_active":"2023-11-27T20:54:26.231081+0000","last_became_peered":"2023-11-27T20:54:26.231081+0000","last_unstale":"2023-11-27T20:55:00.584675+0000","last_undegraded":"2023-11-27T20:55:00.584675+0000","last_fullsized":"2023-11-27T20:55:00.584675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:35.560769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607858+0000","last_change":"2023-11-27T20:54:31.817058+0000","last_active":"2023-11-27T20:54:59.607858+0000","last_peered":"2023-11-27T20:54:59.607858+0000","last_clean":"2023-11-27T20:54:59.607858+0000","last_became_active":"2023-11-27T20:54:31.816700+0000","last_became_peered":"2023-11-27T20:54:31.816700+0000","last_unstale":"2023-11-27T20:54:59.607858+0000","last_undegraded":"2023-11-27T20:54:59.607858+0000","last_fullsized":"2023-11-27T20:54:59.607858+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:02.384459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609645+0000","last_change":"2023-11-27T20:54:27.510195+0000","last_active":"2023-11-27T20:54:59.609645+0000","last_peered":"2023-11-27T20:54:59.609645+0000","last_clean":"2023-11-27T20:54:59.609645+0000","last_became_active":"2023-11-27T20:54:27.509961+0000","last_became_peered":"2023-11-27T20:54:27.509961+0000","last_unstale":"2023-11-27T20:54:59.609645+0000","last_undegraded":"2023-11-27T20:54:59.609645+0000","last_fullsized":"2023-11-27T20:54:59.609645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:15:47.196613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610048+0000","last_change":"2023-11-27T20:54:26.223978+0000","last_active":"2023-11-27T20:54:59.610048+0000","last_peered":"2023-11-27T20:54:59.610048+0000","last_clean":"2023-11-27T20:54:59.610048+0000","last_became_active":"2023-11-27T20:54:26.223717+0000","last_became_peered":"2023-11-27T20:54:26.223717+0000","last_unstale":"2023-11-27T20:54:59.610048+0000","last_undegraded":"2023-11-27T20:54:59.610048+0000","last_fullsized":"2023-11-27T20:54:59.610048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:19:35.269523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607267+0000","last_change":"2023-11-27T20:54:31.836718+0000","last_active":"2023-11-27T20:54:59.607267+0000","last_peered":"2023-11-27T20:54:59.607267+0000","last_clean":"2023-11-27T20:54:59.607267+0000","last_became_active":"2023-11-27T20:54:31.836346+0000","last_became_peered":"2023-11-27T20:54:31.836346+0000","last_unstale":"2023-11-27T20:54:59.607267+0000","last_undegraded":"2023-11-27T20:54:59.607267+0000","last_fullsized":"2023-11-27T20:54:59.607267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:29:03.931226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609830+0000","last_change":"2023-11-27T20:54:27.493578+0000","last_active":"2023-11-27T20:54:59.609830+0000","last_peered":"2023-11-27T20:54:59.609830+0000","last_clean":"2023-11-27T20:54:59.609830+0000","last_became_active":"2023-11-27T20:54:27.493327+0000","last_became_peered":"2023-11-27T20:54:27.493327+0000","last_unstale":"2023-11-27T20:54:59.609830+0000","last_undegraded":"2023-11-27T20:54:59.609830+0000","last_fullsized":"2023-11-27T20:54:59.609830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:48:56.464995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607152+0000","last_change":"2023-11-27T20:54:26.227383+0000","last_active":"2023-11-27T20:54:59.607152+0000","last_peered":"2023-11-27T20:54:59.607152+0000","last_clean":"2023-11-27T20:54:59.607152+0000","last_became_active":"2023-11-27T20:54:26.227120+0000","last_became_peered":"2023-11-27T20:54:26.227120+0000","last_unstale":"2023-11-27T20:54:59.607152+0000","last_undegraded":"2023-11-27T20:54:59.607152+0000","last_fullsized":"2023-11-27T20:54:59.607152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:20.644474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:01.286453+0000","last_change":"2023-11-27T20:55:01.286453+0000","last_active":"2023-11-27T20:55:01.286453+0000","last_peered":"2023-11-27T20:55:01.286453+0000","last_clean":"2023-11-27T20:55:01.286453+0000","last_became_active":"2023-11-27T20:55:01.286057+0000","last_became_peered":"2023-11-27T20:55:01.286057+0000","last_unstale":"2023-11-27T20:55:01.286453+0000","last_undegraded":"2023-11-27T20:55:01.286453+0000","last_fullsized":"2023-11-27T20:55:01.286453+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:17.334107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5,7],"acting":[2,1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609925+0000","last_change":"2023-11-27T20:54:27.510815+0000","last_active":"2023-11-27T20:54:59.609925+0000","last_peered":"2023-11-27T20:54:59.609925+0000","last_clean":"2023-11-27T20:54:59.609925+0000","last_became_active":"2023-11-27T20:54:27.510573+0000","last_became_peered":"2023-11-27T20:54:27.510573+0000","last_unstale":"2023-11-27T20:54:59.609925+0000","last_undegraded":"2023-11-27T20:54:59.609925+0000","last_fullsized":"2023-11-27T20:54:59.609925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:44:21.573980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610389+0000","last_change":"2023-11-27T20:54:26.224703+0000","last_active":"2023-11-27T20:54:59.610389+0000","last_peered":"2023-11-27T20:54:59.610389+0000","last_clean":"2023-11-27T20:54:59.610389+0000","last_became_active":"2023-11-27T20:54:26.224412+0000","last_became_peered":"2023-11-27T20:54:26.224412+0000","last_unstale":"2023-11-27T20:54:59.610389+0000","last_undegraded":"2023-11-27T20:54:59.610389+0000","last_fullsized":"2023-11-27T20:54:59.610389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:02.889092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.604878+0000","last_change":"2023-11-27T20:54:31.819739+0000","last_active":"2023-11-27T20:54:59.604878+0000","last_peered":"2023-11-27T20:54:59.604878+0000","last_clean":"2023-11-27T20:54:59.604878+0000","last_became_active":"2023-11-27T20:54:31.819371+0000","last_became_peered":"2023-11-27T20:54:31.819371+0000","last_unstale":"2023-11-27T20:54:59.604878+0000","last_undegraded":"2023-11-27T20:54:59.604878+0000","last_fullsized":"2023-11-27T20:54:59.604878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:35.147110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610181+0000","last_change":"2023-11-27T20:54:27.500858+0000","last_active":"2023-11-27T20:54:59.610181+0000","last_peered":"2023-11-27T20:54:59.610181+0000","last_clean":"2023-11-27T20:54:59.610181+0000","last_became_active":"2023-11-27T20:54:27.500455+0000","last_became_peered":"2023-11-27T20:54:27.500455+0000","last_unstale":"2023-11-27T20:54:59.610181+0000","last_undegraded":"2023-11-27T20:54:59.610181+0000","last_fullsized":"2023-11-27T20:54:59.610181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:12:05.775037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'3","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:05.776264+0000","last_change":"2023-11-27T20:54:26.223401+0000","last_active":"2023-11-27T20:55:05.776264+0000","last_peered":"2023-11-27T20:55:05.776264+0000","last_clean":"2023-11-27T20:55:05.776264+0000","last_became_active":"2023-11-27T20:54:26.222981+0000","last_became_peered":"2023-11-27T20:54:26.222981+0000","last_unstale":"2023-11-27T20:55:05.776264+0000","last_undegraded":"2023-11-27T20:55:05.776264+0000","last_fullsized":"2023-11-27T20:55:05.776264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:43:11.830626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609560+0000","last_change":"2023-11-27T20:54:31.814118+0000","last_active":"2023-11-27T20:54:59.609560+0000","last_peered":"2023-11-27T20:54:59.609560+0000","last_clean":"2023-11-27T20:54:59.609560+0000","last_became_active":"2023-11-27T20:54:31.813765+0000","last_became_peered":"2023-11-27T20:54:31.813765+0000","last_unstale":"2023-11-27T20:54:59.609560+0000","last_undegraded":"2023-11-27T20:54:59.609560+0000","last_fullsized":"2023-11-27T20:54:59.609560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:28:56.396805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.603593+0000","last_change":"2023-11-27T20:54:27.506449+0000","last_active":"2023-11-27T20:54:59.603593+0000","last_peered":"2023-11-27T20:54:59.603593+0000","last_clean":"2023-11-27T20:54:59.603593+0000","last_became_active":"2023-11-27T20:54:27.506210+0000","last_became_peered":"2023-11-27T20:54:27.506210+0000","last_unstale":"2023-11-27T20:54:59.603593+0000","last_undegraded":"2023-11-27T20:54:59.603593+0000","last_fullsized":"2023-11-27T20:54:59.603593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:32:20.783560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610771+0000","last_change":"2023-11-27T20:54:26.220043+0000","last_active":"2023-11-27T20:54:59.610771+0000","last_peered":"2023-11-27T20:54:59.610771+0000","last_clean":"2023-11-27T20:54:59.610771+0000","last_became_active":"2023-11-27T20:54:26.219775+0000","last_became_peered":"2023-11-27T20:54:26.219775+0000","last_unstale":"2023-11-27T20:54:59.610771+0000","last_undegraded":"2023-11-27T20:54:59.610771+0000","last_fullsized":"2023-11-27T20:54:59.610771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:33.812297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.603159+0000","last_change":"2023-11-27T20:54:31.825960+0000","last_active":"2023-11-27T20:54:59.603159+0000","last_peered":"2023-11-27T20:54:59.603159+0000","last_clean":"2023-11-27T20:54:59.603159+0000","last_became_active":"2023-11-27T20:54:31.825591+0000","last_became_peered":"2023-11-27T20:54:31.825591+0000","last_unstale":"2023-11-27T20:54:59.603159+0000","last_undegraded":"2023-11-27T20:54:59.603159+0000","last_fullsized":"2023-11-27T20:54:59.603159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:24:35.498899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.605517+0000","last_change":"2023-11-27T20:54:27.500927+0000","last_active":"2023-11-27T20:54:59.605517+0000","last_peered":"2023-11-27T20:54:59.605517+0000","last_clean":"2023-11-27T20:54:59.605517+0000","last_became_active":"2023-11-27T20:54:27.500677+0000","last_became_peered":"2023-11-27T20:54:27.500677+0000","last_unstale":"2023-11-27T20:54:59.605517+0000","last_undegraded":"2023-11-27T20:54:59.605517+0000","last_fullsized":"2023-11-27T20:54:59.605517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:56.708375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610778+0000","last_change":"2023-11-27T20:54:26.227877+0000","last_active":"2023-11-27T20:54:59.610778+0000","last_peered":"2023-11-27T20:54:59.610778+0000","last_clean":"2023-11-27T20:54:59.610778+0000","last_became_active":"2023-11-27T20:54:26.227605+0000","last_became_peered":"2023-11-27T20:54:26.227605+0000","last_unstale":"2023-11-27T20:54:59.610778+0000","last_undegraded":"2023-11-27T20:54:59.610778+0000","last_fullsized":"2023-11-27T20:54:59.610778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:40.031252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.603087+0000","last_change":"2023-11-27T20:54:31.826732+0000","last_active":"2023-11-27T20:54:59.603087+0000","last_peered":"2023-11-27T20:54:59.603087+0000","last_clean":"2023-11-27T20:54:59.603087+0000","last_became_active":"2023-11-27T20:54:31.826406+0000","last_became_peered":"2023-11-27T20:54:31.826406+0000","last_unstale":"2023-11-27T20:54:59.603087+0000","last_undegraded":"2023-11-27T20:54:59.603087+0000","last_fullsized":"2023-11-27T20:54:59.603087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:54.926925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607395+0000","last_change":"2023-11-27T20:54:27.517007+0000","last_active":"2023-11-27T20:54:59.607395+0000","last_peered":"2023-11-27T20:54:59.607395+0000","last_clean":"2023-11-27T20:54:59.607395+0000","last_became_active":"2023-11-27T20:54:27.516686+0000","last_became_peered":"2023-11-27T20:54:27.516686+0000","last_unstale":"2023-11-27T20:54:59.607395+0000","last_undegraded":"2023-11-27T20:54:59.607395+0000","last_fullsized":"2023-11-27T20:54:59.607395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:50.369518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'1","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:00.584884+0000","last_change":"2023-11-27T20:54:26.230192+0000","last_active":"2023-11-27T20:55:00.584884+0000","last_peered":"2023-11-27T20:55:00.584884+0000","last_clean":"2023-11-27T20:55:00.584884+0000","last_became_active":"2023-11-27T20:54:26.229985+0000","last_became_peered":"2023-11-27T20:54:26.229985+0000","last_unstale":"2023-11-27T20:55:00.584884+0000","last_undegraded":"2023-11-27T20:55:00.584884+0000","last_fullsized":"2023-11-27T20:55:00.584884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:58:59.280763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:00.588970+0000","last_change":"2023-11-27T20:55:00.588512+0000","last_active":"2023-11-27T20:55:00.588970+0000","last_peered":"2023-11-27T20:55:00.588970+0000","last_clean":"2023-11-27T20:55:00.588970+0000","last_became_active":"2023-11-27T20:55:00.588018+0000","last_became_peered":"2023-11-27T20:55:00.588018+0000","last_unstale":"2023-11-27T20:55:00.588970+0000","last_undegraded":"2023-11-27T20:55:00.588970+0000","last_fullsized":"2023-11-27T20:55:00.588970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:06.015093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,0,3],"acting":[2,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610582+0000","last_change":"2023-11-27T20:54:27.513378+0000","last_active":"2023-11-27T20:54:59.610582+0000","last_peered":"2023-11-27T20:54:59.610582+0000","last_clean":"2023-11-27T20:54:59.610582+0000","last_became_active":"2023-11-27T20:54:27.512093+0000","last_became_peered":"2023-11-27T20:54:27.512093+0000","last_unstale":"2023-11-27T20:54:59.610582+0000","last_undegraded":"2023-11-27T20:54:59.610582+0000","last_fullsized":"2023-11-27T20:54:59.610582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:24:36.921232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'4","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:05.779737+0000","last_change":"2023-11-27T20:54:26.230913+0000","last_active":"2023-11-27T20:55:05.779737+0000","last_peered":"2023-11-27T20:55:05.779737+0000","last_clean":"2023-11-27T20:55:05.779737+0000","last_became_active":"2023-11-27T20:54:26.230548+0000","last_became_peered":"2023-11-27T20:54:26.230548+0000","last_unstale":"2023-11-27T20:55:05.779737+0000","last_undegraded":"2023-11-27T20:55:05.779737+0000","last_fullsized":"2023-11-27T20:55:05.779737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:42:11.153092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:00.595104+0000","last_change":"2023-11-27T20:55:00.595104+0000","last_active":"2023-11-27T20:55:00.595104+0000","last_peered":"2023-11-27T20:55:00.595104+0000","last_clean":"2023-11-27T20:55:00.595104+0000","last_became_active":"2023-11-27T20:55:00.594705+0000","last_became_peered":"2023-11-27T20:55:00.594705+0000","last_unstale":"2023-11-27T20:55:00.595104+0000","last_undegraded":"2023-11-27T20:55:00.595104+0000","last_fullsized":"2023-11-27T20:55:00.595104+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:06.015093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.603091+0000","last_change":"2023-11-27T20:54:27.503689+0000","last_active":"2023-11-27T20:54:59.603091+0000","last_peered":"2023-11-27T20:54:59.603091+0000","last_clean":"2023-11-27T20:54:59.603091+0000","last_became_active":"2023-11-27T20:54:27.502941+0000","last_became_peered":"2023-11-27T20:54:27.502941+0000","last_unstale":"2023-11-27T20:54:59.603091+0000","last_undegraded":"2023-11-27T20:54:59.603091+0000","last_fullsized":"2023-11-27T20:54:59.603091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:59:41.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'3","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:05.783768+0000","last_change":"2023-11-27T20:54:26.214419+0000","last_active":"2023-11-27T20:55:05.783768+0000","last_peered":"2023-11-27T20:55:05.783768+0000","last_clean":"2023-11-27T20:55:05.783768+0000","last_became_active":"2023-11-27T20:54:26.214166+0000","last_became_peered":"2023-11-27T20:54:26.214166+0000","last_unstale":"2023-11-27T20:55:05.783768+0000","last_undegraded":"2023-11-27T20:55:05.783768+0000","last_fullsized":"2023-11-27T20:55:05.783768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:44:20.481769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610511+0000","last_change":"2023-11-27T20:54:31.832551+0000","last_active":"2023-11-27T20:54:59.610511+0000","last_peered":"2023-11-27T20:54:59.610511+0000","last_clean":"2023-11-27T20:54:59.610511+0000","last_became_active":"2023-11-27T20:54:31.832196+0000","last_became_peered":"2023-11-27T20:54:31.832196+0000","last_unstale":"2023-11-27T20:54:59.610511+0000","last_undegraded":"2023-11-27T20:54:59.610511+0000","last_fullsized":"2023-11-27T20:54:59.610511+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:26:46.712422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609820+0000","last_change":"2023-11-27T20:54:27.433404+0000","last_active":"2023-11-27T20:54:59.609820+0000","last_peered":"2023-11-27T20:54:59.609820+0000","last_clean":"2023-11-27T20:54:59.609820+0000","last_became_active":"2023-11-27T20:54:27.433161+0000","last_became_peered":"2023-11-27T20:54:27.433161+0000","last_unstale":"2023-11-27T20:54:59.609820+0000","last_undegraded":"2023-11-27T20:54:59.609820+0000","last_fullsized":"2023-11-27T20:54:59.609820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:09.298985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'3","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:00.585518+0000","last_change":"2023-11-27T20:54:26.227451+0000","last_active":"2023-11-27T20:55:00.585518+0000","last_peered":"2023-11-27T20:55:00.585518+0000","last_clean":"2023-11-27T20:55:00.585518+0000","last_became_active":"2023-11-27T20:54:26.227133+0000","last_became_peered":"2023-11-27T20:54:26.227133+0000","last_unstale":"2023-11-27T20:55:00.585518+0000","last_undegraded":"2023-11-27T20:55:00.585518+0000","last_fullsized":"2023-11-27T20:55:00.585518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:58.281608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607563+0000","last_change":"2023-11-27T20:54:11.452973+0000","last_active":"2023-11-27T20:54:59.607563+0000","last_peered":"2023-11-27T20:54:59.607563+0000","last_clean":"2023-11-27T20:54:59.607563+0000","last_became_active":"2023-11-27T20:54:11.452181+0000","last_became_peered":"2023-11-27T20:54:11.452181+0000","last_unstale":"2023-11-27T20:54:59.607563+0000","last_undegraded":"2023-11-27T20:54:59.607563+0000","last_fullsized":"2023-11-27T20:54:59.607563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:09.564478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:09.564478+0000","last_clean_scrub_stamp":"2023-11-27T20:54:09.564478+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:07.792065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610624+0000","last_change":"2023-11-27T20:54:31.818408+0000","last_active":"2023-11-27T20:54:59.610624+0000","last_peered":"2023-11-27T20:54:59.610624+0000","last_clean":"2023-11-27T20:54:59.610624+0000","last_became_active":"2023-11-27T20:54:31.818048+0000","last_became_peered":"2023-11-27T20:54:31.818048+0000","last_unstale":"2023-11-27T20:54:59.610624+0000","last_undegraded":"2023-11-27T20:54:59.610624+0000","last_fullsized":"2023-11-27T20:54:59.610624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:48:53.892148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610546+0000","last_change":"2023-11-27T20:54:27.493626+0000","last_active":"2023-11-27T20:54:59.610546+0000","last_peered":"2023-11-27T20:54:59.610546+0000","last_clean":"2023-11-27T20:54:59.610546+0000","last_became_active":"2023-11-27T20:54:27.493256+0000","last_became_peered":"2023-11-27T20:54:27.493256+0000","last_unstale":"2023-11-27T20:54:59.610546+0000","last_undegraded":"2023-11-27T20:54:59.610546+0000","last_fullsized":"2023-11-27T20:54:59.610546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:40:57.665118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'3","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:05.710162+0000","last_change":"2023-11-27T20:54:26.230079+0000","last_active":"2023-11-27T20:55:05.710162+0000","last_peered":"2023-11-27T20:55:05.710162+0000","last_clean":"2023-11-27T20:55:05.710162+0000","last_became_active":"2023-11-27T20:54:26.229796+0000","last_became_peered":"2023-11-27T20:54:26.229796+0000","last_unstale":"2023-11-27T20:55:05.710162+0000","last_undegraded":"2023-11-27T20:55:05.710162+0000","last_fullsized":"2023-11-27T20:55:05.710162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:55.616164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.605097+0000","last_change":"2023-11-27T20:54:31.825472+0000","last_active":"2023-11-27T20:54:59.605097+0000","last_peered":"2023-11-27T20:54:59.605097+0000","last_clean":"2023-11-27T20:54:59.605097+0000","last_became_active":"2023-11-27T20:54:31.825080+0000","last_became_peered":"2023-11-27T20:54:31.825080+0000","last_unstale":"2023-11-27T20:54:59.605097+0000","last_undegraded":"2023-11-27T20:54:59.605097+0000","last_fullsized":"2023-11-27T20:54:59.605097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:56:07.208945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:00.595764+0000","last_change":"2023-11-27T20:55:00.593751+0000","last_active":"2023-11-27T20:55:00.595764+0000","last_peered":"2023-11-27T20:55:00.595764+0000","last_clean":"2023-11-27T20:55:00.595764+0000","last_became_active":"2023-11-27T20:55:00.593249+0000","last_became_peered":"2023-11-27T20:55:00.593249+0000","last_unstale":"2023-11-27T20:55:00.595764+0000","last_undegraded":"2023-11-27T20:55:00.595764+0000","last_fullsized":"2023-11-27T20:55:00.595764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:10.486151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.611072+0000","last_change":"2023-11-27T20:54:26.226148+0000","last_active":"2023-11-27T20:54:59.611072+0000","last_peered":"2023-11-27T20:54:59.611072+0000","last_clean":"2023-11-27T20:54:59.611072+0000","last_became_active":"2023-11-27T20:54:26.225886+0000","last_became_peered":"2023-11-27T20:54:26.225886+0000","last_unstale":"2023-11-27T20:54:59.611072+0000","last_undegraded":"2023-11-27T20:54:59.611072+0000","last_fullsized":"2023-11-27T20:54:59.611072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:32:19.691350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610672+0000","last_change":"2023-11-27T20:54:31.828729+0000","last_active":"2023-11-27T20:54:59.610672+0000","last_peered":"2023-11-27T20:54:59.610672+0000","last_clean":"2023-11-27T20:54:59.610672+0000","last_became_active":"2023-11-27T20:54:31.828368+0000","last_became_peered":"2023-11-27T20:54:31.828368+0000","last_unstale":"2023-11-27T20:54:59.610672+0000","last_undegraded":"2023-11-27T20:54:59.610672+0000","last_fullsized":"2023-11-27T20:54:59.610672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:02.384459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.608484+0000","last_change":"2023-11-27T20:54:27.515800+0000","last_active":"2023-11-27T20:54:59.608484+0000","last_peered":"2023-11-27T20:54:59.608484+0000","last_clean":"2023-11-27T20:54:59.608484+0000","last_became_active":"2023-11-27T20:54:27.515416+0000","last_became_peered":"2023-11-27T20:54:27.515416+0000","last_unstale":"2023-11-27T20:54:59.608484+0000","last_undegraded":"2023-11-27T20:54:59.608484+0000","last_fullsized":"2023-11-27T20:54:59.608484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:03:00.166936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610003+0000","last_change":"2023-11-27T20:54:26.224880+0000","last_active":"2023-11-27T20:54:59.610003+0000","last_peered":"2023-11-27T20:54:59.610003+0000","last_clean":"2023-11-27T20:54:59.610003+0000","last_became_active":"2023-11-27T20:54:26.224604+0000","last_became_peered":"2023-11-27T20:54:26.224604+0000","last_unstale":"2023-11-27T20:54:59.610003+0000","last_undegraded":"2023-11-27T20:54:59.610003+0000","last_fullsized":"2023-11-27T20:54:59.610003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:15:45.927622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609459+0000","last_change":"2023-11-27T20:54:31.819648+0000","last_active":"2023-11-27T20:54:59.609459+0000","last_peered":"2023-11-27T20:54:59.609459+0000","last_clean":"2023-11-27T20:54:59.609459+0000","last_became_active":"2023-11-27T20:54:31.819294+0000","last_became_peered":"2023-11-27T20:54:31.819294+0000","last_unstale":"2023-11-27T20:54:59.609459+0000","last_undegraded":"2023-11-27T20:54:59.609459+0000","last_fullsized":"2023-11-27T20:54:59.609459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:15.043559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.606415+0000","last_change":"2023-11-27T20:54:27.512925+0000","last_active":"2023-11-27T20:54:59.606415+0000","last_peered":"2023-11-27T20:54:59.606415+0000","last_clean":"2023-11-27T20:54:59.606415+0000","last_became_active":"2023-11-27T20:54:27.512663+0000","last_became_peered":"2023-11-27T20:54:27.512663+0000","last_unstale":"2023-11-27T20:54:59.606415+0000","last_undegraded":"2023-11-27T20:54:59.606415+0000","last_fullsized":"2023-11-27T20:54:59.606415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:41.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.608545+0000","last_change":"2023-11-27T20:54:26.225344+0000","last_active":"2023-11-27T20:54:59.608545+0000","last_peered":"2023-11-27T20:54:59.608545+0000","last_clean":"2023-11-27T20:54:59.608545+0000","last_became_active":"2023-11-27T20:54:26.225056+0000","last_became_peered":"2023-11-27T20:54:26.225056+0000","last_unstale":"2023-11-27T20:54:59.608545+0000","last_undegraded":"2023-11-27T20:54:59.608545+0000","last_fullsized":"2023-11-27T20:54:59.608545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:39.965666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.606158+0000","last_change":"2023-11-27T20:54:31.827590+0000","last_active":"2023-11-27T20:54:59.606158+0000","last_peered":"2023-11-27T20:54:59.606158+0000","last_clean":"2023-11-27T20:54:59.606158+0000","last_became_active":"2023-11-27T20:54:31.827175+0000","last_became_peered":"2023-11-27T20:54:31.827175+0000","last_unstale":"2023-11-27T20:54:59.606158+0000","last_undegraded":"2023-11-27T20:54:59.606158+0000","last_fullsized":"2023-11-27T20:54:59.606158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:07:26.372924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609706+0000","last_change":"2023-11-27T20:54:27.498488+0000","last_active":"2023-11-27T20:54:59.609706+0000","last_peered":"2023-11-27T20:54:59.609706+0000","last_clean":"2023-11-27T20:54:59.609706+0000","last_became_active":"2023-11-27T20:54:27.498225+0000","last_became_peered":"2023-11-27T20:54:27.498225+0000","last_unstale":"2023-11-27T20:54:59.609706+0000","last_undegraded":"2023-11-27T20:54:59.609706+0000","last_fullsized":"2023-11-27T20:54:59.609706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:20:24.928142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'15","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:05.781453+0000","last_change":"2023-11-27T20:54:26.225580+0000","last_active":"2023-11-27T20:55:05.781453+0000","last_peered":"2023-11-27T20:55:05.781453+0000","last_clean":"2023-11-27T20:55:05.781453+0000","last_became_active":"2023-11-27T20:54:26.225333+0000","last_became_peered":"2023-11-27T20:54:26.225333+0000","last_unstale":"2023-11-27T20:55:05.781453+0000","last_undegraded":"2023-11-27T20:55:05.781453+0000","last_fullsized":"2023-11-27T20:55:05.781453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:46:01.797509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.611223+0000","last_change":"2023-11-27T20:54:31.836029+0000","last_active":"2023-11-27T20:54:59.611223+0000","last_peered":"2023-11-27T20:54:59.611223+0000","last_clean":"2023-11-27T20:54:59.611223+0000","last_became_active":"2023-11-27T20:54:31.835629+0000","last_became_peered":"2023-11-27T20:54:31.835629+0000","last_unstale":"2023-11-27T20:54:59.611223+0000","last_undegraded":"2023-11-27T20:54:59.611223+0000","last_fullsized":"2023-11-27T20:54:59.611223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:06.015093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607367+0000","last_change":"2023-11-27T20:54:27.511034+0000","last_active":"2023-11-27T20:54:59.607367+0000","last_peered":"2023-11-27T20:54:59.607367+0000","last_clean":"2023-11-27T20:54:59.607367+0000","last_became_active":"2023-11-27T20:54:27.510775+0000","last_became_peered":"2023-11-27T20:54:27.510775+0000","last_unstale":"2023-11-27T20:54:59.607367+0000","last_undegraded":"2023-11-27T20:54:59.607367+0000","last_fullsized":"2023-11-27T20:54:59.607367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:56.708375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.606897+0000","last_change":"2023-11-27T20:54:26.227007+0000","last_active":"2023-11-27T20:54:59.606897+0000","last_peered":"2023-11-27T20:54:59.606897+0000","last_clean":"2023-11-27T20:54:59.606897+0000","last_became_active":"2023-11-27T20:54:26.226745+0000","last_became_peered":"2023-11-27T20:54:26.226745+0000","last_unstale":"2023-11-27T20:54:59.606897+0000","last_undegraded":"2023-11-27T20:54:59.606897+0000","last_fullsized":"2023-11-27T20:54:59.606897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:41:46.312385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.611070+0000","last_change":"2023-11-27T20:54:31.831969+0000","last_active":"2023-11-27T20:54:59.611070+0000","last_peered":"2023-11-27T20:54:59.611070+0000","last_clean":"2023-11-27T20:54:59.611070+0000","last_became_active":"2023-11-27T20:54:31.831620+0000","last_became_peered":"2023-11-27T20:54:31.831620+0000","last_unstale":"2023-11-27T20:54:59.611070+0000","last_undegraded":"2023-11-27T20:54:59.611070+0000","last_fullsized":"2023-11-27T20:54:59.611070+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:57:38.465675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609895+0000","last_change":"2023-11-27T20:54:27.515785+0000","last_active":"2023-11-27T20:54:59.609895+0000","last_peered":"2023-11-27T20:54:59.609895+0000","last_clean":"2023-11-27T20:54:59.609895+0000","last_became_active":"2023-11-27T20:54:27.515524+0000","last_became_peered":"2023-11-27T20:54:27.515524+0000","last_unstale":"2023-11-27T20:54:59.609895+0000","last_undegraded":"2023-11-27T20:54:59.609895+0000","last_fullsized":"2023-11-27T20:54:59.609895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:40:33.267986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610197+0000","last_change":"2023-11-27T20:54:26.225975+0000","last_active":"2023-11-27T20:54:59.610197+0000","last_peered":"2023-11-27T20:54:59.610197+0000","last_clean":"2023-11-27T20:54:59.610197+0000","last_became_active":"2023-11-27T20:54:26.225691+0000","last_became_peered":"2023-11-27T20:54:26.225691+0000","last_unstale":"2023-11-27T20:54:59.610197+0000","last_undegraded":"2023-11-27T20:54:59.610197+0000","last_fullsized":"2023-11-27T20:54:59.610197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:25.427192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.603433+0000","last_change":"2023-11-27T20:54:31.827058+0000","last_active":"2023-11-27T20:54:59.603433+0000","last_peered":"2023-11-27T20:54:59.603433+0000","last_clean":"2023-11-27T20:54:59.603433+0000","last_became_active":"2023-11-27T20:54:31.826669+0000","last_became_peered":"2023-11-27T20:54:31.826669+0000","last_unstale":"2023-11-27T20:54:59.603433+0000","last_undegraded":"2023-11-27T20:54:59.603433+0000","last_fullsized":"2023-11-27T20:54:59.603433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:40.986177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.603162+0000","last_change":"2023-11-27T20:54:27.503066+0000","last_active":"2023-11-27T20:54:59.603162+0000","last_peered":"2023-11-27T20:54:59.603162+0000","last_clean":"2023-11-27T20:54:59.603162+0000","last_became_active":"2023-11-27T20:54:27.502677+0000","last_became_peered":"2023-11-27T20:54:27.502677+0000","last_unstale":"2023-11-27T20:54:59.603162+0000","last_undegraded":"2023-11-27T20:54:59.603162+0000","last_fullsized":"2023-11-27T20:54:59.603162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:41.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'6","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:05.787593+0000","last_change":"2023-11-27T20:54:26.228175+0000","last_active":"2023-11-27T20:55:05.787593+0000","last_peered":"2023-11-27T20:55:05.787593+0000","last_clean":"2023-11-27T20:55:05.787593+0000","last_became_active":"2023-11-27T20:54:26.227911+0000","last_became_peered":"2023-11-27T20:54:26.227911+0000","last_unstale":"2023-11-27T20:55:05.787593+0000","last_undegraded":"2023-11-27T20:55:05.787593+0000","last_fullsized":"2023-11-27T20:55:05.787593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:57.995466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610892+0000","last_change":"2023-11-27T20:54:31.828136+0000","last_active":"2023-11-27T20:54:59.610892+0000","last_peered":"2023-11-27T20:54:59.610892+0000","last_clean":"2023-11-27T20:54:59.610892+0000","last_became_active":"2023-11-27T20:54:31.827785+0000","last_became_peered":"2023-11-27T20:54:31.827785+0000","last_unstale":"2023-11-27T20:54:59.610892+0000","last_undegraded":"2023-11-27T20:54:59.610892+0000","last_fullsized":"2023-11-27T20:54:59.610892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:28:18.206490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607483+0000","last_change":"2023-11-27T20:54:27.514185+0000","last_active":"2023-11-27T20:54:59.607483+0000","last_peered":"2023-11-27T20:54:59.607483+0000","last_clean":"2023-11-27T20:54:59.607483+0000","last_became_active":"2023-11-27T20:54:27.513655+0000","last_became_peered":"2023-11-27T20:54:27.513655+0000","last_unstale":"2023-11-27T20:54:59.607483+0000","last_undegraded":"2023-11-27T20:54:59.607483+0000","last_fullsized":"2023-11-27T20:54:59.607483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:52.629755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'12","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.605715+0000","last_change":"2023-11-27T20:54:26.230827+0000","last_active":"2023-11-27T20:54:59.605715+0000","last_peered":"2023-11-27T20:54:59.605715+0000","last_clean":"2023-11-27T20:54:59.605715+0000","last_became_active":"2023-11-27T20:54:26.230570+0000","last_became_peered":"2023-11-27T20:54:26.230570+0000","last_unstale":"2023-11-27T20:54:59.605715+0000","last_undegraded":"2023-11-27T20:54:59.605715+0000","last_fullsized":"2023-11-27T20:54:59.605715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:42:04.480038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609727+0000","last_change":"2023-11-27T20:54:31.828482+0000","last_active":"2023-11-27T20:54:59.609727+0000","last_peered":"2023-11-27T20:54:59.609727+0000","last_clean":"2023-11-27T20:54:59.609727+0000","last_became_active":"2023-11-27T20:54:31.827872+0000","last_became_peered":"2023-11-27T20:54:31.827872+0000","last_unstale":"2023-11-27T20:54:59.609727+0000","last_undegraded":"2023-11-27T20:54:59.609727+0000","last_fullsized":"2023-11-27T20:54:59.609727+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:32:35.015914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610523+0000","last_change":"2023-11-27T20:54:27.493526+0000","last_active":"2023-11-27T20:54:59.610523+0000","last_peered":"2023-11-27T20:54:59.610523+0000","last_clean":"2023-11-27T20:54:59.610523+0000","last_became_active":"2023-11-27T20:54:27.493257+0000","last_became_peered":"2023-11-27T20:54:27.493257+0000","last_unstale":"2023-11-27T20:54:59.610523+0000","last_undegraded":"2023-11-27T20:54:59.610523+0000","last_fullsized":"2023-11-27T20:54:59.610523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:04.222900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607560+0000","last_change":"2023-11-27T20:54:26.231237+0000","last_active":"2023-11-27T20:54:59.607560+0000","last_peered":"2023-11-27T20:54:59.607560+0000","last_clean":"2023-11-27T20:54:59.607560+0000","last_became_active":"2023-11-27T20:54:26.230963+0000","last_became_peered":"2023-11-27T20:54:26.230963+0000","last_unstale":"2023-11-27T20:54:59.607560+0000","last_undegraded":"2023-11-27T20:54:59.607560+0000","last_fullsized":"2023-11-27T20:54:59.607560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:11:24.730507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.604887+0000","last_change":"2023-11-27T20:54:31.825391+0000","last_active":"2023-11-27T20:54:59.604887+0000","last_peered":"2023-11-27T20:54:59.604887+0000","last_clean":"2023-11-27T20:54:59.604887+0000","last_became_active":"2023-11-27T20:54:31.825038+0000","last_became_peered":"2023-11-27T20:54:31.825038+0000","last_unstale":"2023-11-27T20:54:59.604887+0000","last_undegraded":"2023-11-27T20:54:59.604887+0000","last_fullsized":"2023-11-27T20:54:59.604887+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:11:47.511718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.611154+0000","last_change":"2023-11-27T20:54:27.508226+0000","last_active":"2023-11-27T20:54:59.611154+0000","last_peered":"2023-11-27T20:54:59.611154+0000","last_clean":"2023-11-27T20:54:59.611154+0000","last_became_active":"2023-11-27T20:54:27.507805+0000","last_became_peered":"2023-11-27T20:54:27.507805+0000","last_unstale":"2023-11-27T20:54:59.611154+0000","last_undegraded":"2023-11-27T20:54:59.611154+0000","last_fullsized":"2023-11-27T20:54:59.611154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:43:42.137077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.608316+0000","last_change":"2023-11-27T20:54:26.226915+0000","last_active":"2023-11-27T20:54:59.608316+0000","last_peered":"2023-11-27T20:54:59.608316+0000","last_clean":"2023-11-27T20:54:59.608316+0000","last_became_active":"2023-11-27T20:54:26.226679+0000","last_became_peered":"2023-11-27T20:54:26.226679+0000","last_unstale":"2023-11-27T20:54:59.608316+0000","last_undegraded":"2023-11-27T20:54:59.608316+0000","last_fullsized":"2023-11-27T20:54:59.608316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:05:08.792958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.606773+0000","last_change":"2023-11-27T20:54:31.834934+0000","last_active":"2023-11-27T20:54:59.606773+0000","last_peered":"2023-11-27T20:54:59.606773+0000","last_clean":"2023-11-27T20:54:59.606773+0000","last_became_active":"2023-11-27T20:54:31.834569+0000","last_became_peered":"2023-11-27T20:54:31.834569+0000","last_unstale":"2023-11-27T20:54:59.606773+0000","last_undegraded":"2023-11-27T20:54:59.606773+0000","last_fullsized":"2023-11-27T20:54:59.606773+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:15:51.754021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.606349+0000","last_change":"2023-11-27T20:54:27.498841+0000","last_active":"2023-11-27T20:54:59.606349+0000","last_peered":"2023-11-27T20:54:59.606349+0000","last_clean":"2023-11-27T20:54:59.606349+0000","last_became_active":"2023-11-27T20:54:27.498535+0000","last_became_peered":"2023-11-27T20:54:27.498535+0000","last_unstale":"2023-11-27T20:54:59.606349+0000","last_undegraded":"2023-11-27T20:54:59.606349+0000","last_fullsized":"2023-11-27T20:54:59.606349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:21.736684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.608227+0000","last_change":"2023-11-27T20:54:26.228140+0000","last_active":"2023-11-27T20:54:59.608227+0000","last_peered":"2023-11-27T20:54:59.608227+0000","last_clean":"2023-11-27T20:54:59.608227+0000","last_became_active":"2023-11-27T20:54:26.227878+0000","last_became_peered":"2023-11-27T20:54:26.227878+0000","last_unstale":"2023-11-27T20:54:59.608227+0000","last_undegraded":"2023-11-27T20:54:59.608227+0000","last_fullsized":"2023-11-27T20:54:59.608227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:21:36.965668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609901+0000","last_change":"2023-11-27T20:54:31.825264+0000","last_active":"2023-11-27T20:54:59.609901+0000","last_peered":"2023-11-27T20:54:59.609901+0000","last_clean":"2023-11-27T20:54:59.609901+0000","last_became_active":"2023-11-27T20:54:31.824914+0000","last_became_peered":"2023-11-27T20:54:31.824914+0000","last_unstale":"2023-11-27T20:54:59.609901+0000","last_undegraded":"2023-11-27T20:54:59.609901+0000","last_fullsized":"2023-11-27T20:54:59.609901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:49:01.022403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609853+0000","last_change":"2023-11-27T20:54:31.828359+0000","last_active":"2023-11-27T20:54:59.609853+0000","last_peered":"2023-11-27T20:54:59.609853+0000","last_clean":"2023-11-27T20:54:59.609853+0000","last_became_active":"2023-11-27T20:54:31.827971+0000","last_became_peered":"2023-11-27T20:54:31.827971+0000","last_unstale":"2023-11-27T20:54:59.609853+0000","last_undegraded":"2023-11-27T20:54:59.609853+0000","last_fullsized":"2023-11-27T20:54:59.609853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:02.858386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609971+0000","last_change":"2023-11-27T20:54:27.434914+0000","last_active":"2023-11-27T20:54:59.609971+0000","last_peered":"2023-11-27T20:54:59.609971+0000","last_clean":"2023-11-27T20:54:59.609971+0000","last_became_active":"2023-11-27T20:54:27.434635+0000","last_became_peered":"2023-11-27T20:54:27.434635+0000","last_unstale":"2023-11-27T20:54:59.609971+0000","last_undegraded":"2023-11-27T20:54:59.609971+0000","last_fullsized":"2023-11-27T20:54:59.609971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:59.373818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609710+0000","last_change":"2023-11-27T20:54:26.224770+0000","last_active":"2023-11-27T20:54:59.609710+0000","last_peered":"2023-11-27T20:54:59.609710+0000","last_clean":"2023-11-27T20:54:59.609710+0000","last_became_active":"2023-11-27T20:54:26.224502+0000","last_became_peered":"2023-11-27T20:54:26.224502+0000","last_unstale":"2023-11-27T20:54:59.609710+0000","last_undegraded":"2023-11-27T20:54:59.609710+0000","last_fullsized":"2023-11-27T20:54:59.609710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:51:28.157451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609919+0000","last_change":"2023-11-27T20:54:31.827147+0000","last_active":"2023-11-27T20:54:59.609919+0000","last_peered":"2023-11-27T20:54:59.609919+0000","last_clean":"2023-11-27T20:54:59.609919+0000","last_became_active":"2023-11-27T20:54:31.826790+0000","last_became_peered":"2023-11-27T20:54:31.826790+0000","last_unstale":"2023-11-27T20:54:59.609919+0000","last_undegraded":"2023-11-27T20:54:59.609919+0000","last_fullsized":"2023-11-27T20:54:59.609919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:11:33.954256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610782+0000","last_change":"2023-11-27T20:54:27.507947+0000","last_active":"2023-11-27T20:54:59.610782+0000","last_peered":"2023-11-27T20:54:59.610782+0000","last_clean":"2023-11-27T20:54:59.610782+0000","last_became_active":"2023-11-27T20:54:27.507698+0000","last_became_peered":"2023-11-27T20:54:27.507698+0000","last_unstale":"2023-11-27T20:54:59.610782+0000","last_undegraded":"2023-11-27T20:54:59.610782+0000","last_fullsized":"2023-11-27T20:54:59.610782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:50.369518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'2","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:05.708459+0000","last_change":"2023-11-27T20:54:26.230417+0000","last_active":"2023-11-27T20:55:05.708459+0000","last_peered":"2023-11-27T20:55:05.708459+0000","last_clean":"2023-11-27T20:55:05.708459+0000","last_became_active":"2023-11-27T20:54:26.229725+0000","last_became_peered":"2023-11-27T20:54:26.229725+0000","last_unstale":"2023-11-27T20:55:05.708459+0000","last_undegraded":"2023-11-27T20:55:05.708459+0000","last_fullsized":"2023-11-27T20:55:05.708459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:01.075715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'3","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:05.786177+0000","last_change":"2023-11-27T20:54:26.221975+0000","last_active":"2023-11-27T20:55:05.786177+0000","last_peered":"2023-11-27T20:55:05.786177+0000","last_clean":"2023-11-27T20:55:05.786177+0000","last_became_active":"2023-11-27T20:54:26.221715+0000","last_became_peered":"2023-11-27T20:54:26.221715+0000","last_unstale":"2023-11-27T20:55:05.786177+0000","last_undegraded":"2023-11-27T20:55:05.786177+0000","last_fullsized":"2023-11-27T20:55:05.786177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:15.156440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609797+0000","last_change":"2023-11-27T20:54:27.517213+0000","last_active":"2023-11-27T20:54:59.609797+0000","last_peered":"2023-11-27T20:54:59.609797+0000","last_clean":"2023-11-27T20:54:59.609797+0000","last_became_active":"2023-11-27T20:54:27.516887+0000","last_became_peered":"2023-11-27T20:54:27.516887+0000","last_unstale":"2023-11-27T20:54:59.609797+0000","last_undegraded":"2023-11-27T20:54:59.609797+0000","last_fullsized":"2023-11-27T20:54:59.609797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:51:29.249661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610033+0000","last_change":"2023-11-27T20:54:31.827740+0000","last_active":"2023-11-27T20:54:59.610033+0000","last_peered":"2023-11-27T20:54:59.610033+0000","last_clean":"2023-11-27T20:54:59.610033+0000","last_became_active":"2023-11-27T20:54:31.827395+0000","last_became_peered":"2023-11-27T20:54:31.827395+0000","last_unstale":"2023-11-27T20:54:59.610033+0000","last_undegraded":"2023-11-27T20:54:59.610033+0000","last_fullsized":"2023-11-27T20:54:59.610033+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:20:29.485550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'5","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610823+0000","last_change":"2023-11-27T20:54:26.227971+0000","last_active":"2023-11-27T20:54:59.610823+0000","last_peered":"2023-11-27T20:54:59.610823+0000","last_clean":"2023-11-27T20:54:59.610823+0000","last_became_active":"2023-11-27T20:54:26.227713+0000","last_became_peered":"2023-11-27T20:54:26.227713+0000","last_unstale":"2023-11-27T20:54:59.610823+0000","last_undegraded":"2023-11-27T20:54:59.610823+0000","last_fullsized":"2023-11-27T20:54:59.610823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:39.965666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.606399+0000","last_change":"2023-11-27T20:54:27.506394+0000","last_active":"2023-11-27T20:54:59.606399+0000","last_peered":"2023-11-27T20:54:59.606399+0000","last_clean":"2023-11-27T20:54:59.606399+0000","last_became_active":"2023-11-27T20:54:27.506119+0000","last_became_peered":"2023-11-27T20:54:27.506119+0000","last_unstale":"2023-11-27T20:54:59.606399+0000","last_undegraded":"2023-11-27T20:54:59.606399+0000","last_fullsized":"2023-11-27T20:54:59.606399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:21.736684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.606972+0000","last_change":"2023-11-27T20:54:31.833185+0000","last_active":"2023-11-27T20:54:59.606972+0000","last_peered":"2023-11-27T20:54:59.606972+0000","last_clean":"2023-11-27T20:54:59.606972+0000","last_became_active":"2023-11-27T20:54:31.832813+0000","last_became_peered":"2023-11-27T20:54:31.832813+0000","last_unstale":"2023-11-27T20:54:59.606972+0000","last_undegraded":"2023-11-27T20:54:59.606972+0000","last_fullsized":"2023-11-27T20:54:59.606972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:13.856393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.605669+0000","last_change":"2023-11-27T20:54:27.500687+0000","last_active":"2023-11-27T20:54:59.605669+0000","last_peered":"2023-11-27T20:54:59.605669+0000","last_clean":"2023-11-27T20:54:59.605669+0000","last_became_active":"2023-11-27T20:54:27.500394+0000","last_became_peered":"2023-11-27T20:54:27.500394+0000","last_unstale":"2023-11-27T20:54:59.605669+0000","last_undegraded":"2023-11-27T20:54:59.605669+0000","last_fullsized":"2023-11-27T20:54:59.605669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:15:32.173306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607085+0000","last_change":"2023-11-27T20:54:27.515441+0000","last_active":"2023-11-27T20:54:59.607085+0000","last_peered":"2023-11-27T20:54:59.607085+0000","last_clean":"2023-11-27T20:54:59.607085+0000","last_became_active":"2023-11-27T20:54:27.515173+0000","last_became_peered":"2023-11-27T20:54:27.515173+0000","last_unstale":"2023-11-27T20:54:59.607085+0000","last_undegraded":"2023-11-27T20:54:59.607085+0000","last_fullsized":"2023-11-27T20:54:59.607085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:19:36.361734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609870+0000","last_change":"2023-11-27T20:54:27.506358+0000","last_active":"2023-11-27T20:54:59.609870+0000","last_peered":"2023-11-27T20:54:59.609870+0000","last_clean":"2023-11-27T20:54:59.609870+0000","last_became_active":"2023-11-27T20:54:27.506112+0000","last_became_peered":"2023-11-27T20:54:27.506112+0000","last_unstale":"2023-11-27T20:54:59.609870+0000","last_undegraded":"2023-11-27T20:54:59.609870+0000","last_fullsized":"2023-11-27T20:54:59.609870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:58.300979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610743+0000","last_change":"2023-11-27T20:54:27.510776+0000","last_active":"2023-11-27T20:54:59.610743+0000","last_peered":"2023-11-27T20:54:59.610743+0000","last_clean":"2023-11-27T20:54:59.610743+0000","last_became_active":"2023-11-27T20:54:27.510532+0000","last_became_peered":"2023-11-27T20:54:27.510532+0000","last_unstale":"2023-11-27T20:54:59.610743+0000","last_undegraded":"2023-11-27T20:54:59.610743+0000","last_fullsized":"2023-11-27T20:54:59.610743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:36.428770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.603513+0000","last_change":"2023-11-27T20:54:27.513775+0000","last_active":"2023-11-27T20:54:59.603513+0000","last_peered":"2023-11-27T20:54:59.603513+0000","last_clean":"2023-11-27T20:54:59.603513+0000","last_became_active":"2023-11-27T20:54:27.513517+0000","last_became_peered":"2023-11-27T20:54:27.513517+0000","last_unstale":"2023-11-27T20:54:59.603513+0000","last_undegraded":"2023-11-27T20:54:59.603513+0000","last_fullsized":"2023-11-27T20:54:59.603513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:07:21.815516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.603564+0000","last_change":"2023-11-27T20:54:27.511798+0000","last_active":"2023-11-27T20:54:59.603564+0000","last_peered":"2023-11-27T20:54:59.603564+0000","last_clean":"2023-11-27T20:54:59.603564+0000","last_became_active":"2023-11-27T20:54:27.511559+0000","last_became_peered":"2023-11-27T20:54:27.511559+0000","last_unstale":"2023-11-27T20:54:59.603564+0000","last_undegraded":"2023-11-27T20:54:59.603564+0000","last_fullsized":"2023-11-27T20:54:59.603564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:41.057877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.606280+0000","last_change":"2023-11-27T20:54:27.499585+0000","last_active":"2023-11-27T20:54:59.606280+0000","last_peered":"2023-11-27T20:54:59.606280+0000","last_clean":"2023-11-27T20:54:59.606280+0000","last_became_active":"2023-11-27T20:54:27.499323+0000","last_became_peered":"2023-11-27T20:54:27.499323+0000","last_unstale":"2023-11-27T20:54:59.606280+0000","last_undegraded":"2023-11-27T20:54:59.606280+0000","last_fullsized":"2023-11-27T20:54:59.606280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:59:41.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610994+0000","last_change":"2023-11-27T20:54:27.508846+0000","last_active":"2023-11-27T20:54:59.610994+0000","last_peered":"2023-11-27T20:54:59.610994+0000","last_clean":"2023-11-27T20:54:59.610994+0000","last_became_active":"2023-11-27T20:54:27.508615+0000","last_became_peered":"2023-11-27T20:54:27.508615+0000","last_unstale":"2023-11-27T20:54:59.610994+0000","last_undegraded":"2023-11-27T20:54:59.610994+0000","last_fullsized":"2023-11-27T20:54:59.610994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:53.751196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609632+0000","last_change":"2023-11-27T20:54:27.510920+0000","last_active":"2023-11-27T20:54:59.609632+0000","last_peered":"2023-11-27T20:54:59.609632+0000","last_clean":"2023-11-27T20:54:59.609632+0000","last_became_active":"2023-11-27T20:54:27.510647+0000","last_became_peered":"2023-11-27T20:54:27.510647+0000","last_unstale":"2023-11-27T20:54:59.609632+0000","last_undegraded":"2023-11-27T20:54:59.609632+0000","last_fullsized":"2023-11-27T20:54:59.609632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:32:30.458506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610169+0000","last_change":"2023-11-27T20:54:27.508596+0000","last_active":"2023-11-27T20:54:59.610169+0000","last_peered":"2023-11-27T20:54:59.610169+0000","last_clean":"2023-11-27T20:54:59.610169+0000","last_became_active":"2023-11-27T20:54:27.508360+0000","last_became_peered":"2023-11-27T20:54:27.508360+0000","last_unstale":"2023-11-27T20:54:59.610169+0000","last_undegraded":"2023-11-27T20:54:59.610169+0000","last_fullsized":"2023-11-27T20:54:59.610169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:58.794639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.606330+0000","last_change":"2023-11-27T20:54:27.513374+0000","last_active":"2023-11-27T20:54:59.606330+0000","last_peered":"2023-11-27T20:54:59.606330+0000","last_clean":"2023-11-27T20:54:59.606330+0000","last_became_active":"2023-11-27T20:54:27.513105+0000","last_became_peered":"2023-11-27T20:54:27.513105+0000","last_unstale":"2023-11-27T20:54:59.606330+0000","last_undegraded":"2023-11-27T20:54:59.606330+0000","last_fullsized":"2023-11-27T20:54:59.606330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:59:41.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609724+0000","last_change":"2023-11-27T20:54:27.433370+0000","last_active":"2023-11-27T20:54:59.609724+0000","last_peered":"2023-11-27T20:54:59.609724+0000","last_clean":"2023-11-27T20:54:59.609724+0000","last_became_active":"2023-11-27T20:54:27.433179+0000","last_became_peered":"2023-11-27T20:54:27.433179+0000","last_unstale":"2023-11-27T20:54:59.609724+0000","last_undegraded":"2023-11-27T20:54:59.609724+0000","last_fullsized":"2023-11-27T20:54:59.609724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:01.805918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607240+0000","last_change":"2023-11-27T20:54:27.515324+0000","last_active":"2023-11-27T20:54:59.607240+0000","last_peered":"2023-11-27T20:54:59.607240+0000","last_clean":"2023-11-27T20:54:59.607240+0000","last_became_active":"2023-11-27T20:54:27.515068+0000","last_became_peered":"2023-11-27T20:54:27.515068+0000","last_unstale":"2023-11-27T20:54:59.607240+0000","last_undegraded":"2023-11-27T20:54:59.607240+0000","last_fullsized":"2023-11-27T20:54:59.607240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:11:42.954310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610694+0000","last_change":"2023-11-27T20:54:27.498621+0000","last_active":"2023-11-27T20:54:59.610694+0000","last_peered":"2023-11-27T20:54:59.610694+0000","last_clean":"2023-11-27T20:54:59.610694+0000","last_became_active":"2023-11-27T20:54:27.498306+0000","last_became_peered":"2023-11-27T20:54:27.498306+0000","last_unstale":"2023-11-27T20:54:59.610694+0000","last_undegraded":"2023-11-27T20:54:59.610694+0000","last_fullsized":"2023-11-27T20:54:59.610694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:20:24.529896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607257+0000","last_change":"2023-11-27T20:54:27.513134+0000","last_active":"2023-11-27T20:54:59.607257+0000","last_peered":"2023-11-27T20:54:59.607257+0000","last_clean":"2023-11-27T20:54:59.607257+0000","last_became_active":"2023-11-27T20:54:27.512897+0000","last_became_peered":"2023-11-27T20:54:27.512897+0000","last_unstale":"2023-11-27T20:54:59.607257+0000","last_undegraded":"2023-11-27T20:54:59.607257+0000","last_fullsized":"2023-11-27T20:54:59.607257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:13:40.877792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610185+0000","last_change":"2023-11-27T20:54:27.515196+0000","last_active":"2023-11-27T20:54:59.610185+0000","last_peered":"2023-11-27T20:54:59.610185+0000","last_clean":"2023-11-27T20:54:59.610185+0000","last_became_active":"2023-11-27T20:54:27.514946+0000","last_became_peered":"2023-11-27T20:54:27.514946+0000","last_unstale":"2023-11-27T20:54:59.610185+0000","last_undegraded":"2023-11-27T20:54:59.610185+0000","last_fullsized":"2023-11-27T20:54:59.610185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:06:07.940123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609907+0000","last_change":"2023-11-27T20:54:27.493565+0000","last_active":"2023-11-27T20:54:59.609907+0000","last_peered":"2023-11-27T20:54:59.609907+0000","last_clean":"2023-11-27T20:54:59.609907+0000","last_became_active":"2023-11-27T20:54:27.493297+0000","last_became_peered":"2023-11-27T20:54:27.493297+0000","last_unstale":"2023-11-27T20:54:59.609907+0000","last_undegraded":"2023-11-27T20:54:59.609907+0000","last_fullsized":"2023-11-27T20:54:59.609907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:28:51.839397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610095+0000","last_change":"2023-11-27T20:54:27.512910+0000","last_active":"2023-11-27T20:54:59.610095+0000","last_peered":"2023-11-27T20:54:59.610095+0000","last_clean":"2023-11-27T20:54:59.610095+0000","last_became_active":"2023-11-27T20:54:27.512662+0000","last_became_peered":"2023-11-27T20:54:27.512662+0000","last_unstale":"2023-11-27T20:54:59.610095+0000","last_undegraded":"2023-11-27T20:54:59.610095+0000","last_fullsized":"2023-11-27T20:54:59.610095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:52.629755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.603080+0000","last_change":"2023-11-27T20:54:27.512406+0000","last_active":"2023-11-27T20:54:59.603080+0000","last_peered":"2023-11-27T20:54:59.603080+0000","last_clean":"2023-11-27T20:54:59.603080+0000","last_became_active":"2023-11-27T20:54:27.512124+0000","last_became_peered":"2023-11-27T20:54:27.512124+0000","last_unstale":"2023-11-27T20:54:59.603080+0000","last_undegraded":"2023-11-27T20:54:59.603080+0000","last_fullsized":"2023-11-27T20:54:59.603080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:21.736684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.603234+0000","last_change":"2023-11-27T20:54:27.517262+0000","last_active":"2023-11-27T20:54:59.603234+0000","last_peered":"2023-11-27T20:54:59.603234+0000","last_clean":"2023-11-27T20:54:59.603234+0000","last_became_active":"2023-11-27T20:54:27.516907+0000","last_became_peered":"2023-11-27T20:54:27.516907+0000","last_unstale":"2023-11-27T20:54:59.603234+0000","last_undegraded":"2023-11-27T20:54:59.603234+0000","last_fullsized":"2023-11-27T20:54:59.603234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:05:09.885169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607166+0000","last_change":"2023-11-27T20:54:27.515432+0000","last_active":"2023-11-27T20:54:59.607166+0000","last_peered":"2023-11-27T20:54:59.607166+0000","last_clean":"2023-11-27T20:54:59.607166+0000","last_became_active":"2023-11-27T20:54:27.515182+0000","last_became_peered":"2023-11-27T20:54:27.515182+0000","last_unstale":"2023-11-27T20:54:59.607166+0000","last_undegraded":"2023-11-27T20:54:59.607166+0000","last_fullsized":"2023-11-27T20:54:59.607166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:36.428770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:00.589255+0000","last_change":"2023-11-27T20:55:00.588607+0000","last_active":"2023-11-27T20:55:00.589255+0000","last_peered":"2023-11-27T20:55:00.589255+0000","last_clean":"2023-11-27T20:55:00.589255+0000","last_became_active":"2023-11-27T20:55:00.588298+0000","last_became_peered":"2023-11-27T20:55:00.588298+0000","last_unstale":"2023-11-27T20:55:00.589255+0000","last_undegraded":"2023-11-27T20:55:00.589255+0000","last_fullsized":"2023-11-27T20:55:00.589255+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:32:30.458506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.608232+0000","last_change":"2023-11-27T20:54:27.512956+0000","last_active":"2023-11-27T20:54:59.608232+0000","last_peered":"2023-11-27T20:54:59.608232+0000","last_clean":"2023-11-27T20:54:59.608232+0000","last_became_active":"2023-11-27T20:54:27.512692+0000","last_became_peered":"2023-11-27T20:54:27.512692+0000","last_unstale":"2023-11-27T20:54:59.608232+0000","last_undegraded":"2023-11-27T20:54:59.608232+0000","last_fullsized":"2023-11-27T20:54:59.608232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:53.751196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.608133+0000","last_change":"2023-11-27T20:54:27.499043+0000","last_active":"2023-11-27T20:54:59.608133+0000","last_peered":"2023-11-27T20:54:59.608133+0000","last_clean":"2023-11-27T20:54:59.608133+0000","last_became_active":"2023-11-27T20:54:27.498790+0000","last_became_peered":"2023-11-27T20:54:27.498790+0000","last_unstale":"2023-11-27T20:54:59.608133+0000","last_undegraded":"2023-11-27T20:54:59.608133+0000","last_fullsized":"2023-11-27T20:54:59.608133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:41.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610491+0000","last_change":"2023-11-27T20:54:27.513089+0000","last_active":"2023-11-27T20:54:59.610491+0000","last_peered":"2023-11-27T20:54:59.610491+0000","last_clean":"2023-11-27T20:54:59.610491+0000","last_became_active":"2023-11-27T20:54:27.512777+0000","last_became_peered":"2023-11-27T20:54:27.512777+0000","last_unstale":"2023-11-27T20:54:59.610491+0000","last_undegraded":"2023-11-27T20:54:59.610491+0000","last_fullsized":"2023-11-27T20:54:59.610491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:32.362116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.606813+0000","last_change":"2023-11-27T20:54:27.512691+0000","last_active":"2023-11-27T20:54:59.606813+0000","last_peered":"2023-11-27T20:54:59.606813+0000","last_clean":"2023-11-27T20:54:59.606813+0000","last_became_active":"2023-11-27T20:54:27.512433+0000","last_became_peered":"2023-11-27T20:54:27.512433+0000","last_unstale":"2023-11-27T20:54:59.606813+0000","last_undegraded":"2023-11-27T20:54:59.606813+0000","last_fullsized":"2023-11-27T20:54:59.606813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:30.589702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.605221+0000","last_change":"2023-11-27T20:54:27.432322+0000","last_active":"2023-11-27T20:54:59.605221+0000","last_peered":"2023-11-27T20:54:59.605221+0000","last_clean":"2023-11-27T20:54:59.605221+0000","last_became_active":"2023-11-27T20:54:27.432152+0000","last_became_peered":"2023-11-27T20:54:27.432152+0000","last_unstale":"2023-11-27T20:54:59.605221+0000","last_undegraded":"2023-11-27T20:54:59.605221+0000","last_fullsized":"2023-11-27T20:54:59.605221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:02.167926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607606+0000","last_change":"2023-11-27T20:54:27.516081+0000","last_active":"2023-11-27T20:54:59.607606+0000","last_peered":"2023-11-27T20:54:59.607606+0000","last_clean":"2023-11-27T20:54:59.607606+0000","last_became_active":"2023-11-27T20:54:27.515801+0000","last_became_peered":"2023-11-27T20:54:27.515801+0000","last_unstale":"2023-11-27T20:54:59.607606+0000","last_undegraded":"2023-11-27T20:54:59.607606+0000","last_fullsized":"2023-11-27T20:54:59.607606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:24:30.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.605533+0000","last_change":"2023-11-27T20:54:27.432375+0000","last_active":"2023-11-27T20:54:59.605533+0000","last_peered":"2023-11-27T20:54:59.605533+0000","last_clean":"2023-11-27T20:54:59.605533+0000","last_became_active":"2023-11-27T20:54:27.432160+0000","last_became_peered":"2023-11-27T20:54:27.432160+0000","last_unstale":"2023-11-27T20:54:59.605533+0000","last_undegraded":"2023-11-27T20:54:59.605533+0000","last_fullsized":"2023-11-27T20:54:59.605533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:36.652979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610944+0000","last_change":"2023-11-27T20:54:27.505374+0000","last_active":"2023-11-27T20:54:59.610944+0000","last_peered":"2023-11-27T20:54:59.610944+0000","last_clean":"2023-11-27T20:54:59.610944+0000","last_became_active":"2023-11-27T20:54:27.505122+0000","last_became_peered":"2023-11-27T20:54:27.505122+0000","last_unstale":"2023-11-27T20:54:59.610944+0000","last_undegraded":"2023-11-27T20:54:59.610944+0000","last_fullsized":"2023-11-27T20:54:59.610944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:30.589702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610652+0000","last_change":"2023-11-27T20:54:27.505531+0000","last_active":"2023-11-27T20:54:59.610652+0000","last_peered":"2023-11-27T20:54:59.610652+0000","last_clean":"2023-11-27T20:54:59.610652+0000","last_became_active":"2023-11-27T20:54:27.505236+0000","last_became_peered":"2023-11-27T20:54:27.505236+0000","last_unstale":"2023-11-27T20:54:59.610652+0000","last_undegraded":"2023-11-27T20:54:59.610652+0000","last_fullsized":"2023-11-27T20:54:59.610652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:56:02.651538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.608460+0000","last_change":"2023-11-27T20:54:27.515185+0000","last_active":"2023-11-27T20:54:59.608460+0000","last_peered":"2023-11-27T20:54:59.608460+0000","last_clean":"2023-11-27T20:54:59.608460+0000","last_became_active":"2023-11-27T20:54:27.514846+0000","last_became_peered":"2023-11-27T20:54:27.514846+0000","last_unstale":"2023-11-27T20:54:59.608460+0000","last_undegraded":"2023-11-27T20:54:59.608460+0000","last_fullsized":"2023-11-27T20:54:59.608460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:43:42.137077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6864,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":13700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":120661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":905216,"data_stored":711121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":123881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]}]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":897024,"data_stored":710567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]}]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":120185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":120947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":3,"last update":"Mon Nov 27 20:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.40799999999999997}]},{"osd":4,"last update":"Mon Nov 27 20:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":125449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":121265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:55:09.736 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:55:09.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.874+0000 7fa23ef39640 1 Processor -- start 2023-11-27T20:55:09.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.874+0000 7fa23ef39640 1 -- start start 2023-11-27T20:55:09.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.874+0000 7fa23ef39640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa2380cda70 0x7fa2380ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:09.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.874+0000 7fa23ef39640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2380cbda0 con 0x7fa2380c9620 2023-11-27T20:55:09.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.874+0000 7fa23ef39640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2380cb4e0 con 0x7fa2380cc420 2023-11-27T20:55:09.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.874+0000 7fa23ef39640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2380cc230 con 0x7fa2380cda70 2023-11-27T20:55:09.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.875+0000 7fa23ccd5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa2380cda70 0x7fa2380ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:09.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.875+0000 7fa237fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fa2380cc420 0x7fa238159610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:59154/0 (socket says 172.21.15.88:59154) 2023-11-27T20:55:09.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.875+0000 7fa237fff640 1 -- 172.21.15.88:0/2277576762 learned_addr learned my addr 172.21.15.88:0/2277576762 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:55:09.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.879+0000 7fa23ccd5640 1 -- 172.21.15.88:0/2277576762 >> v1:172.21.15.167:6789/0 conn(0x7fa2380cc420 legacy=0x7fa238159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:09.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.879+0000 7fa23ccd5640 1 -- 172.21.15.88:0/2277576762 >> v1:172.21.15.88:6789/0 conn(0x7fa2380c9620 legacy=0x7fa238163eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:09.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.879+0000 7fa23ccd5640 1 -- 172.21.15.88:0/2277576762 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2380cce00 con 0x7fa2380cda70 2023-11-27T20:55:09.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.884+0000 7fa23ccd5640 1 --2- 172.21.15.88:0/2277576762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2380cda70 0x7fa2380ce350 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa22c0097a0 tx=0x7fa22c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff96daf813ac4da4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:09.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.946+0000 7fa2377fe640 1 -- 172.21.15.88:0/2277576762 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c030610 con 0x7fa2380cda70 2023-11-27T20:55:09.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.946+0000 7fa2377fe640 1 -- 172.21.15.88:0/2277576762 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22c030770 con 0x7fa2380cda70 2023-11-27T20:55:09.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.946+0000 7fa2377fe640 1 -- 172.21.15.88:0/2277576762 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c030b00 con 0x7fa2380cda70 2023-11-27T20:55:09.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.946+0000 7fa23ef39640 1 -- 172.21.15.88:0/2277576762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2380cda70 msgr2=0x7fa2380ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:09.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.946+0000 7fa23ef39640 1 --2- 172.21.15.88:0/2277576762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2380cda70 0x7fa2380ce350 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa22c0097a0 tx=0x7fa22c02b960 comp rx=0 tx=0).stop 2023-11-27T20:55:09.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.946+0000 7fa23ef39640 1 -- 172.21.15.88:0/2277576762 shutdown_connections 2023-11-27T20:55:09.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.946+0000 7fa23ef39640 1 --2- 172.21.15.88:0/2277576762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2380cda70 0x7fa2380ce350 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:09.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.946+0000 7fa23ef39640 1 -- 172.21.15.88:0/2277576762 >> 172.21.15.88:0/2277576762 conn(0x7fa2380b07b0 msgr2=0x7fa2380b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:09.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.946+0000 7fa23ef39640 1 -- 172.21.15.88:0/2277576762 shutdown_connections 2023-11-27T20:55:09.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.946+0000 7fa23ef39640 1 -- 172.21.15.88:0/2277576762 wait complete. 2023-11-27T20:55:09.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.948+0000 7fa23ef39640 1 Processor -- start 2023-11-27T20:55:09.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.948+0000 7fa23ef39640 1 -- start start 2023-11-27T20:55:09.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.949+0000 7fa23ef39640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2380c9620 0x7fa238157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:09.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.949+0000 7fa23ef39640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2380cc420 0x7fa238153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:09.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.949+0000 7fa23ef39640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2380cda70 0x7fa2381f2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:09.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.949+0000 7fa23ef39640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2381f3250 con 0x7fa2380c9620 2023-11-27T20:55:09.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.949+0000 7fa23ef39640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa238159960 con 0x7fa2380cc420 2023-11-27T20:55:09.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.949+0000 7fa23ef39640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2381567d0 con 0x7fa2380cda70 2023-11-27T20:55:09.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.949+0000 7fa237fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2380cc420 0x7fa238153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:09.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.949+0000 7fa23d4d6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2380cda70 0x7fa2381f2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:09.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.949+0000 7fa237fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2380cc420 0x7fa238153df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:41582/0 (socket says 172.21.15.88:41582) 2023-11-27T20:55:09.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.949+0000 7fa237fff640 1 -- 172.21.15.88:0/337630092 learned_addr learned my addr 172.21.15.88:0/337630092 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:09.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.953+0000 7fa237fff640 1 -- 172.21.15.88:0/337630092 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2380cda70 msgr2=0x7fa2381f2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:09.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.953+0000 7fa237fff640 1 --2- 172.21.15.88:0/337630092 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2380cda70 0x7fa2381f2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:09.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.953+0000 7fa237fff640 1 -- 172.21.15.88:0/337630092 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2380c9620 msgr2=0x7fa238157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:09.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.953+0000 7fa237fff640 1 --2- 172.21.15.88:0/337630092 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2380c9620 0x7fa238157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:09.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.953+0000 7fa237fff640 1 -- 172.21.15.88:0/337630092 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22c009400 con 0x7fa2380cc420 2023-11-27T20:55:09.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.955+0000 7fa237fff640 1 --2- 172.21.15.88:0/337630092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2380cc420 0x7fa238153df0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa22400c470 tx=0x7fa224001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:09.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.959+0000 7fa2357fa640 1 -- 172.21.15.88:0/337630092 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa224005ce0 con 0x7fa2380cc420 2023-11-27T20:55:09.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.959+0000 7fa2357fa640 1 -- 172.21.15.88:0/337630092 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa224005e40 con 0x7fa2380cc420 2023-11-27T20:55:09.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.959+0000 7fa23ef39640 1 -- 172.21.15.88:0/337630092 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa238157520 con 0x7fa2380cc420 2023-11-27T20:55:09.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.959+0000 7fa2357fa640 1 -- 172.21.15.88:0/337630092 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2240072f0 con 0x7fa2380cc420 2023-11-27T20:55:09.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.959+0000 7fa23ef39640 1 -- 172.21.15.88:0/337630092 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2381593a0 con 0x7fa2380cc420 2023-11-27T20:55:09.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:09.960+0000 7fa23ef39640 1 -- 172.21.15.88:0/337630092 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa238067470 con 0x7fa2380cc420 2023-11-27T20:55:10.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.208+0000 7fa2357fa640 1 -- 172.21.15.88:0/337630092 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa224007510 con 0x7fa2380cc420 2023-11-27T20:55:10.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.208+0000 7fa2357fa640 1 --2- 172.21.15.88:0/337630092 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa21c06b210 0x7fa21c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:10.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.208+0000 7fa23ccd5640 1 --2- 172.21.15.88:0/337630092 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa21c06b210 0x7fa21c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:10.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.209+0000 7fa23ccd5640 1 --2- 172.21.15.88:0/337630092 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa21c06b210 0x7fa21c06d6d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa22c036000 tx=0x7fa22c030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:10.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.211+0000 7fa2357fa640 1 -- 172.21.15.88:0/337630092 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa224013e70 con 0x7fa2380cc420 2023-11-27T20:55:10.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.221+0000 7fa2357fa640 1 -- 172.21.15.88:0/337630092 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa224054520 con 0x7fa2380cc420 2023-11-27T20:55:10.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.385+0000 7fa23ef39640 1 -- 172.21.15.88:0/337630092 --> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa2380cba30 con 0x7fa21c06b210 2023-11-27T20:55:10.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.401+0000 7fa2357fa640 1 -- 172.21.15.88:0/337630092 <== mgr.4105 v2:172.21.15.88:6800/352455703 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+346223 (secure 0 0 0) 0x7fa22c0308e0 con 0x7fa21c06b210 2023-11-27T20:55:10.410 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:55:10.412 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-11-27T20:55:10.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.404+0000 7fa23ef39640 1 -- 172.21.15.88:0/337630092 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa21c06b210 msgr2=0x7fa21c06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:10.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.404+0000 7fa23ef39640 1 --2- 172.21.15.88:0/337630092 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa21c06b210 0x7fa21c06d6d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa22c036000 tx=0x7fa22c030000 comp rx=0 tx=0).stop 2023-11-27T20:55:10.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.405+0000 7fa23ef39640 1 -- 172.21.15.88:0/337630092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2380cc420 msgr2=0x7fa238153df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:10.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.405+0000 7fa23ef39640 1 --2- 172.21.15.88:0/337630092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2380cc420 0x7fa238153df0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa22400c470 tx=0x7fa224001e70 comp rx=0 tx=0).stop 2023-11-27T20:55:10.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.405+0000 7fa23ef39640 1 -- 172.21.15.88:0/337630092 shutdown_connections 2023-11-27T20:55:10.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.405+0000 7fa23ef39640 1 --2- 172.21.15.88:0/337630092 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa21c06b210 0x7fa21c06d6d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:10.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.405+0000 7fa23ef39640 1 --2- 172.21.15.88:0/337630092 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2380cda70 0x7fa2381f2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:10.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.405+0000 7fa23ef39640 1 --2- 172.21.15.88:0/337630092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2380cc420 0x7fa238153df0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:10.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.405+0000 7fa23ef39640 1 --2- 172.21.15.88:0/337630092 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2380c9620 0x7fa238157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:10.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.405+0000 7fa23ef39640 1 -- 172.21.15.88:0/337630092 >> 172.21.15.88:0/337630092 conn(0x7fa2380b07b0 msgr2=0x7fa2380ae720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:10.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.405+0000 7fa23ef39640 1 -- 172.21.15.88:0/337630092 shutdown_connections 2023-11-27T20:55:10.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.405+0000 7fa23ef39640 1 -- 172.21.15.88:0/337630092 wait complete. 2023-11-27T20:55:10.418 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2023-11-27T20:55:08.908682+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597232,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":283,"num_write_kb":2452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219752,"kb_used_data":3604,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754968,"statfs":{"total":773094113280,"available":772869087232,"internally_reserved":0,"allocated":3690496,"data_stored":2154076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2224,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.239944"},"pg_stats":[{"pgid":"2.1f","version":"28'9","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:05.779122+0000","last_change":"2023-11-27T20:54:26.222003+0000","last_active":"2023-11-27T20:55:05.779122+0000","last_peered":"2023-11-27T20:55:05.779122+0000","last_clean":"2023-11-27T20:55:05.779122+0000","last_became_active":"2023-11-27T20:54:26.221715+0000","last_became_peered":"2023-11-27T20:54:26.221715+0000","last_unstale":"2023-11-27T20:55:05.779122+0000","last_undegraded":"2023-11-27T20:55:05.779122+0000","last_fullsized":"2023-11-27T20:55:05.779122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:36:45.301515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.611291+0000","last_change":"2023-11-27T20:54:27.508401+0000","last_active":"2023-11-27T20:54:59.611291+0000","last_peered":"2023-11-27T20:54:59.611291+0000","last_clean":"2023-11-27T20:54:59.611291+0000","last_became_active":"2023-11-27T20:54:27.508003+0000","last_became_peered":"2023-11-27T20:54:27.508003+0000","last_unstale":"2023-11-27T20:54:59.611291+0000","last_undegraded":"2023-11-27T20:54:59.611291+0000","last_fullsized":"2023-11-27T20:54:59.611291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:11:42.954310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607401+0000","last_change":"2023-11-27T20:54:31.837226+0000","last_active":"2023-11-27T20:54:59.607401+0000","last_peered":"2023-11-27T20:54:59.607401+0000","last_clean":"2023-11-27T20:54:59.607401+0000","last_became_active":"2023-11-27T20:54:31.836803+0000","last_became_peered":"2023-11-27T20:54:31.836803+0000","last_unstale":"2023-11-27T20:54:59.607401+0000","last_undegraded":"2023-11-27T20:54:59.607401+0000","last_fullsized":"2023-11-27T20:54:59.607401+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:06.363326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:01.285560+0000","last_change":"2023-11-27T20:54:26.227906+0000","last_active":"2023-11-27T20:55:01.285560+0000","last_peered":"2023-11-27T20:55:01.285560+0000","last_clean":"2023-11-27T20:55:01.285560+0000","last_became_active":"2023-11-27T20:54:26.227620+0000","last_became_peered":"2023-11-27T20:54:26.227620+0000","last_unstale":"2023-11-27T20:55:01.285560+0000","last_undegraded":"2023-11-27T20:55:01.285560+0000","last_fullsized":"2023-11-27T20:55:01.285560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:35.560769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.611137+0000","last_change":"2023-11-27T20:54:27.507740+0000","last_active":"2023-11-27T20:54:59.611137+0000","last_peered":"2023-11-27T20:54:59.611137+0000","last_clean":"2023-11-27T20:54:59.611137+0000","last_became_active":"2023-11-27T20:54:27.507460+0000","last_became_peered":"2023-11-27T20:54:27.507460+0000","last_unstale":"2023-11-27T20:54:59.611137+0000","last_undegraded":"2023-11-27T20:54:59.611137+0000","last_fullsized":"2023-11-27T20:54:59.611137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:24:30.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:00.593902+0000","last_change":"2023-11-27T20:55:00.593902+0000","last_active":"2023-11-27T20:55:00.593902+0000","last_peered":"2023-11-27T20:55:00.593902+0000","last_clean":"2023-11-27T20:55:00.593902+0000","last_became_active":"2023-11-27T20:55:00.593543+0000","last_became_peered":"2023-11-27T20:55:00.593543+0000","last_unstale":"2023-11-27T20:55:00.593902+0000","last_undegraded":"2023-11-27T20:55:00.593902+0000","last_fullsized":"2023-11-27T20:55:00.593902+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:57:38.465675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.608082+0000","last_change":"2023-11-27T20:54:26.226645+0000","last_active":"2023-11-27T20:54:59.608082+0000","last_peered":"2023-11-27T20:54:59.608082+0000","last_clean":"2023-11-27T20:54:59.608082+0000","last_became_active":"2023-11-27T20:54:26.226407+0000","last_became_peered":"2023-11-27T20:54:26.226407+0000","last_unstale":"2023-11-27T20:54:59.608082+0000","last_undegraded":"2023-11-27T20:54:59.608082+0000","last_fullsized":"2023-11-27T20:54:59.608082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:32:19.691350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.606758+0000","last_change":"2023-11-27T20:54:27.512803+0000","last_active":"2023-11-27T20:54:59.606758+0000","last_peered":"2023-11-27T20:54:59.606758+0000","last_clean":"2023-11-27T20:54:59.606758+0000","last_became_active":"2023-11-27T20:54:27.512548+0000","last_became_peered":"2023-11-27T20:54:27.512548+0000","last_unstale":"2023-11-27T20:54:59.606758+0000","last_undegraded":"2023-11-27T20:54:59.606758+0000","last_fullsized":"2023-11-27T20:54:59.606758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:36.652979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.605044+0000","last_change":"2023-11-27T20:54:31.828391+0000","last_active":"2023-11-27T20:54:59.605044+0000","last_peered":"2023-11-27T20:54:59.605044+0000","last_clean":"2023-11-27T20:54:59.605044+0000","last_became_active":"2023-11-27T20:54:31.828045+0000","last_became_peered":"2023-11-27T20:54:31.828045+0000","last_unstale":"2023-11-27T20:54:59.605044+0000","last_undegraded":"2023-11-27T20:54:59.605044+0000","last_fullsized":"2023-11-27T20:54:59.605044+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:58.308604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.608051+0000","last_change":"2023-11-27T20:54:26.226762+0000","last_active":"2023-11-27T20:54:59.608051+0000","last_peered":"2023-11-27T20:54:59.608051+0000","last_clean":"2023-11-27T20:54:59.608051+0000","last_became_active":"2023-11-27T20:54:26.226522+0000","last_became_peered":"2023-11-27T20:54:26.226522+0000","last_unstale":"2023-11-27T20:54:59.608051+0000","last_undegraded":"2023-11-27T20:54:59.608051+0000","last_fullsized":"2023-11-27T20:54:59.608051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:31.269905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:00.790042+0000","last_change":"2023-11-27T20:55:00.790042+0000","last_active":"2023-11-27T20:55:00.790042+0000","last_peered":"2023-11-27T20:55:00.790042+0000","last_clean":"2023-11-27T20:55:00.790042+0000","last_became_active":"2023-11-27T20:55:00.789772+0000","last_became_peered":"2023-11-27T20:55:00.789772+0000","last_unstale":"2023-11-27T20:55:00.790042+0000","last_undegraded":"2023-11-27T20:55:00.790042+0000","last_fullsized":"2023-11-27T20:55:00.790042+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:51:32.237462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.604962+0000","last_change":"2023-11-27T20:54:31.828759+0000","last_active":"2023-11-27T20:54:59.604962+0000","last_peered":"2023-11-27T20:54:59.604962+0000","last_clean":"2023-11-27T20:54:59.604962+0000","last_became_active":"2023-11-27T20:54:31.828371+0000","last_became_peered":"2023-11-27T20:54:31.828371+0000","last_unstale":"2023-11-27T20:54:59.604962+0000","last_undegraded":"2023-11-27T20:54:59.604962+0000","last_fullsized":"2023-11-27T20:54:59.604962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:40.986177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609966+0000","last_change":"2023-11-27T20:54:27.498572+0000","last_active":"2023-11-27T20:54:59.609966+0000","last_peered":"2023-11-27T20:54:59.609966+0000","last_clean":"2023-11-27T20:54:59.609966+0000","last_became_active":"2023-11-27T20:54:27.498279+0000","last_became_peered":"2023-11-27T20:54:27.498279+0000","last_unstale":"2023-11-27T20:54:59.609966+0000","last_undegraded":"2023-11-27T20:54:59.609966+0000","last_fullsized":"2023-11-27T20:54:59.609966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:23:57.929109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610059+0000","last_change":"2023-11-27T20:54:26.227734+0000","last_active":"2023-11-27T20:54:59.610059+0000","last_peered":"2023-11-27T20:54:59.610059+0000","last_clean":"2023-11-27T20:54:59.610059+0000","last_became_active":"2023-11-27T20:54:26.227503+0000","last_became_peered":"2023-11-27T20:54:26.227503+0000","last_unstale":"2023-11-27T20:54:59.610059+0000","last_undegraded":"2023-11-27T20:54:59.610059+0000","last_fullsized":"2023-11-27T20:54:59.610059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:08.206775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610029+0000","last_change":"2023-11-27T20:54:31.827976+0000","last_active":"2023-11-27T20:54:59.610029+0000","last_peered":"2023-11-27T20:54:59.610029+0000","last_clean":"2023-11-27T20:54:59.610029+0000","last_became_active":"2023-11-27T20:54:31.827631+0000","last_became_peered":"2023-11-27T20:54:31.827631+0000","last_unstale":"2023-11-27T20:54:59.610029+0000","last_undegraded":"2023-11-27T20:54:59.610029+0000","last_fullsized":"2023-11-27T20:54:59.610029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:58:58.404897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607133+0000","last_change":"2023-11-27T20:54:27.510917+0000","last_active":"2023-11-27T20:54:59.607133+0000","last_peered":"2023-11-27T20:54:59.607133+0000","last_clean":"2023-11-27T20:54:59.607133+0000","last_became_active":"2023-11-27T20:54:27.510668+0000","last_became_peered":"2023-11-27T20:54:27.510668+0000","last_unstale":"2023-11-27T20:54:59.607133+0000","last_undegraded":"2023-11-27T20:54:59.607133+0000","last_fullsized":"2023-11-27T20:54:59.607133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:27:15.390631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'1","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:00.584675+0000","last_change":"2023-11-27T20:54:26.231461+0000","last_active":"2023-11-27T20:55:00.584675+0000","last_peered":"2023-11-27T20:55:00.584675+0000","last_clean":"2023-11-27T20:55:00.584675+0000","last_became_active":"2023-11-27T20:54:26.231081+0000","last_became_peered":"2023-11-27T20:54:26.231081+0000","last_unstale":"2023-11-27T20:55:00.584675+0000","last_undegraded":"2023-11-27T20:55:00.584675+0000","last_fullsized":"2023-11-27T20:55:00.584675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:35.560769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607858+0000","last_change":"2023-11-27T20:54:31.817058+0000","last_active":"2023-11-27T20:54:59.607858+0000","last_peered":"2023-11-27T20:54:59.607858+0000","last_clean":"2023-11-27T20:54:59.607858+0000","last_became_active":"2023-11-27T20:54:31.816700+0000","last_became_peered":"2023-11-27T20:54:31.816700+0000","last_unstale":"2023-11-27T20:54:59.607858+0000","last_undegraded":"2023-11-27T20:54:59.607858+0000","last_fullsized":"2023-11-27T20:54:59.607858+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:02.384459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609645+0000","last_change":"2023-11-27T20:54:27.510195+0000","last_active":"2023-11-27T20:54:59.609645+0000","last_peered":"2023-11-27T20:54:59.609645+0000","last_clean":"2023-11-27T20:54:59.609645+0000","last_became_active":"2023-11-27T20:54:27.509961+0000","last_became_peered":"2023-11-27T20:54:27.509961+0000","last_unstale":"2023-11-27T20:54:59.609645+0000","last_undegraded":"2023-11-27T20:54:59.609645+0000","last_fullsized":"2023-11-27T20:54:59.609645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:15:47.196613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610048+0000","last_change":"2023-11-27T20:54:26.223978+0000","last_active":"2023-11-27T20:54:59.610048+0000","last_peered":"2023-11-27T20:54:59.610048+0000","last_clean":"2023-11-27T20:54:59.610048+0000","last_became_active":"2023-11-27T20:54:26.223717+0000","last_became_peered":"2023-11-27T20:54:26.223717+0000","last_unstale":"2023-11-27T20:54:59.610048+0000","last_undegraded":"2023-11-27T20:54:59.610048+0000","last_fullsized":"2023-11-27T20:54:59.610048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:19:35.269523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607267+0000","last_change":"2023-11-27T20:54:31.836718+0000","last_active":"2023-11-27T20:54:59.607267+0000","last_peered":"2023-11-27T20:54:59.607267+0000","last_clean":"2023-11-27T20:54:59.607267+0000","last_became_active":"2023-11-27T20:54:31.836346+0000","last_became_peered":"2023-11-27T20:54:31.836346+0000","last_unstale":"2023-11-27T20:54:59.607267+0000","last_undegraded":"2023-11-27T20:54:59.607267+0000","last_fullsized":"2023-11-27T20:54:59.607267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:29:03.931226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609830+0000","last_change":"2023-11-27T20:54:27.493578+0000","last_active":"2023-11-27T20:54:59.609830+0000","last_peered":"2023-11-27T20:54:59.609830+0000","last_clean":"2023-11-27T20:54:59.609830+0000","last_became_active":"2023-11-27T20:54:27.493327+0000","last_became_peered":"2023-11-27T20:54:27.493327+0000","last_unstale":"2023-11-27T20:54:59.609830+0000","last_undegraded":"2023-11-27T20:54:59.609830+0000","last_fullsized":"2023-11-27T20:54:59.609830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:48:56.464995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607152+0000","last_change":"2023-11-27T20:54:26.227383+0000","last_active":"2023-11-27T20:54:59.607152+0000","last_peered":"2023-11-27T20:54:59.607152+0000","last_clean":"2023-11-27T20:54:59.607152+0000","last_became_active":"2023-11-27T20:54:26.227120+0000","last_became_peered":"2023-11-27T20:54:26.227120+0000","last_unstale":"2023-11-27T20:54:59.607152+0000","last_undegraded":"2023-11-27T20:54:59.607152+0000","last_fullsized":"2023-11-27T20:54:59.607152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:20.644474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:01.286453+0000","last_change":"2023-11-27T20:55:01.286453+0000","last_active":"2023-11-27T20:55:01.286453+0000","last_peered":"2023-11-27T20:55:01.286453+0000","last_clean":"2023-11-27T20:55:01.286453+0000","last_became_active":"2023-11-27T20:55:01.286057+0000","last_became_peered":"2023-11-27T20:55:01.286057+0000","last_unstale":"2023-11-27T20:55:01.286453+0000","last_undegraded":"2023-11-27T20:55:01.286453+0000","last_fullsized":"2023-11-27T20:55:01.286453+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:17.334107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5,7],"acting":[2,1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609925+0000","last_change":"2023-11-27T20:54:27.510815+0000","last_active":"2023-11-27T20:54:59.609925+0000","last_peered":"2023-11-27T20:54:59.609925+0000","last_clean":"2023-11-27T20:54:59.609925+0000","last_became_active":"2023-11-27T20:54:27.510573+0000","last_became_peered":"2023-11-27T20:54:27.510573+0000","last_unstale":"2023-11-27T20:54:59.609925+0000","last_undegraded":"2023-11-27T20:54:59.609925+0000","last_fullsized":"2023-11-27T20:54:59.609925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:44:21.573980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610389+0000","last_change":"2023-11-27T20:54:26.224703+0000","last_active":"2023-11-27T20:54:59.610389+0000","last_peered":"2023-11-27T20:54:59.610389+0000","last_clean":"2023-11-27T20:54:59.610389+0000","last_became_active":"2023-11-27T20:54:26.224412+0000","last_became_peered":"2023-11-27T20:54:26.224412+0000","last_unstale":"2023-11-27T20:54:59.610389+0000","last_undegraded":"2023-11-27T20:54:59.610389+0000","last_fullsized":"2023-11-27T20:54:59.610389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:02.889092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.604878+0000","last_change":"2023-11-27T20:54:31.819739+0000","last_active":"2023-11-27T20:54:59.604878+0000","last_peered":"2023-11-27T20:54:59.604878+0000","last_clean":"2023-11-27T20:54:59.604878+0000","last_became_active":"2023-11-27T20:54:31.819371+0000","last_became_peered":"2023-11-27T20:54:31.819371+0000","last_unstale":"2023-11-27T20:54:59.604878+0000","last_undegraded":"2023-11-27T20:54:59.604878+0000","last_fullsized":"2023-11-27T20:54:59.604878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:35.147110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610181+0000","last_change":"2023-11-27T20:54:27.500858+0000","last_active":"2023-11-27T20:54:59.610181+0000","last_peered":"2023-11-27T20:54:59.610181+0000","last_clean":"2023-11-27T20:54:59.610181+0000","last_became_active":"2023-11-27T20:54:27.500455+0000","last_became_peered":"2023-11-27T20:54:27.500455+0000","last_unstale":"2023-11-27T20:54:59.610181+0000","last_undegraded":"2023-11-27T20:54:59.610181+0000","last_fullsized":"2023-11-27T20:54:59.610181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:12:05.775037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'3","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:05.776264+0000","last_change":"2023-11-27T20:54:26.223401+0000","last_active":"2023-11-27T20:55:05.776264+0000","last_peered":"2023-11-27T20:55:05.776264+0000","last_clean":"2023-11-27T20:55:05.776264+0000","last_became_active":"2023-11-27T20:54:26.222981+0000","last_became_peered":"2023-11-27T20:54:26.222981+0000","last_unstale":"2023-11-27T20:55:05.776264+0000","last_undegraded":"2023-11-27T20:55:05.776264+0000","last_fullsized":"2023-11-27T20:55:05.776264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:43:11.830626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609560+0000","last_change":"2023-11-27T20:54:31.814118+0000","last_active":"2023-11-27T20:54:59.609560+0000","last_peered":"2023-11-27T20:54:59.609560+0000","last_clean":"2023-11-27T20:54:59.609560+0000","last_became_active":"2023-11-27T20:54:31.813765+0000","last_became_peered":"2023-11-27T20:54:31.813765+0000","last_unstale":"2023-11-27T20:54:59.609560+0000","last_undegraded":"2023-11-27T20:54:59.609560+0000","last_fullsized":"2023-11-27T20:54:59.609560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:28:56.396805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.603593+0000","last_change":"2023-11-27T20:54:27.506449+0000","last_active":"2023-11-27T20:54:59.603593+0000","last_peered":"2023-11-27T20:54:59.603593+0000","last_clean":"2023-11-27T20:54:59.603593+0000","last_became_active":"2023-11-27T20:54:27.506210+0000","last_became_peered":"2023-11-27T20:54:27.506210+0000","last_unstale":"2023-11-27T20:54:59.603593+0000","last_undegraded":"2023-11-27T20:54:59.603593+0000","last_fullsized":"2023-11-27T20:54:59.603593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:32:20.783560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610771+0000","last_change":"2023-11-27T20:54:26.220043+0000","last_active":"2023-11-27T20:54:59.610771+0000","last_peered":"2023-11-27T20:54:59.610771+0000","last_clean":"2023-11-27T20:54:59.610771+0000","last_became_active":"2023-11-27T20:54:26.219775+0000","last_became_peered":"2023-11-27T20:54:26.219775+0000","last_unstale":"2023-11-27T20:54:59.610771+0000","last_undegraded":"2023-11-27T20:54:59.610771+0000","last_fullsized":"2023-11-27T20:54:59.610771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:33.812297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.603159+0000","last_change":"2023-11-27T20:54:31.825960+0000","last_active":"2023-11-27T20:54:59.603159+0000","last_peered":"2023-11-27T20:54:59.603159+0000","last_clean":"2023-11-27T20:54:59.603159+0000","last_became_active":"2023-11-27T20:54:31.825591+0000","last_became_peered":"2023-11-27T20:54:31.825591+0000","last_unstale":"2023-11-27T20:54:59.603159+0000","last_undegraded":"2023-11-27T20:54:59.603159+0000","last_fullsized":"2023-11-27T20:54:59.603159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:24:35.498899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.605517+0000","last_change":"2023-11-27T20:54:27.500927+0000","last_active":"2023-11-27T20:54:59.605517+0000","last_peered":"2023-11-27T20:54:59.605517+0000","last_clean":"2023-11-27T20:54:59.605517+0000","last_became_active":"2023-11-27T20:54:27.500677+0000","last_became_peered":"2023-11-27T20:54:27.500677+0000","last_unstale":"2023-11-27T20:54:59.605517+0000","last_undegraded":"2023-11-27T20:54:59.605517+0000","last_fullsized":"2023-11-27T20:54:59.605517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:56.708375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610778+0000","last_change":"2023-11-27T20:54:26.227877+0000","last_active":"2023-11-27T20:54:59.610778+0000","last_peered":"2023-11-27T20:54:59.610778+0000","last_clean":"2023-11-27T20:54:59.610778+0000","last_became_active":"2023-11-27T20:54:26.227605+0000","last_became_peered":"2023-11-27T20:54:26.227605+0000","last_unstale":"2023-11-27T20:54:59.610778+0000","last_undegraded":"2023-11-27T20:54:59.610778+0000","last_fullsized":"2023-11-27T20:54:59.610778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:40.031252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.603087+0000","last_change":"2023-11-27T20:54:31.826732+0000","last_active":"2023-11-27T20:54:59.603087+0000","last_peered":"2023-11-27T20:54:59.603087+0000","last_clean":"2023-11-27T20:54:59.603087+0000","last_became_active":"2023-11-27T20:54:31.826406+0000","last_became_peered":"2023-11-27T20:54:31.826406+0000","last_unstale":"2023-11-27T20:54:59.603087+0000","last_undegraded":"2023-11-27T20:54:59.603087+0000","last_fullsized":"2023-11-27T20:54:59.603087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:54.926925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607395+0000","last_change":"2023-11-27T20:54:27.517007+0000","last_active":"2023-11-27T20:54:59.607395+0000","last_peered":"2023-11-27T20:54:59.607395+0000","last_clean":"2023-11-27T20:54:59.607395+0000","last_became_active":"2023-11-27T20:54:27.516686+0000","last_became_peered":"2023-11-27T20:54:27.516686+0000","last_unstale":"2023-11-27T20:54:59.607395+0000","last_undegraded":"2023-11-27T20:54:59.607395+0000","last_fullsized":"2023-11-27T20:54:59.607395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:50.369518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'1","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:00.584884+0000","last_change":"2023-11-27T20:54:26.230192+0000","last_active":"2023-11-27T20:55:00.584884+0000","last_peered":"2023-11-27T20:55:00.584884+0000","last_clean":"2023-11-27T20:55:00.584884+0000","last_became_active":"2023-11-27T20:54:26.229985+0000","last_became_peered":"2023-11-27T20:54:26.229985+0000","last_unstale":"2023-11-27T20:55:00.584884+0000","last_undegraded":"2023-11-27T20:55:00.584884+0000","last_fullsized":"2023-11-27T20:55:00.584884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:58:59.280763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:00.588970+0000","last_change":"2023-11-27T20:55:00.588512+0000","last_active":"2023-11-27T20:55:00.588970+0000","last_peered":"2023-11-27T20:55:00.588970+0000","last_clean":"2023-11-27T20:55:00.588970+0000","last_became_active":"2023-11-27T20:55:00.588018+0000","last_became_peered":"2023-11-27T20:55:00.588018+0000","last_unstale":"2023-11-27T20:55:00.588970+0000","last_undegraded":"2023-11-27T20:55:00.588970+0000","last_fullsized":"2023-11-27T20:55:00.588970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:06.015093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,0,3],"acting":[2,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610582+0000","last_change":"2023-11-27T20:54:27.513378+0000","last_active":"2023-11-27T20:54:59.610582+0000","last_peered":"2023-11-27T20:54:59.610582+0000","last_clean":"2023-11-27T20:54:59.610582+0000","last_became_active":"2023-11-27T20:54:27.512093+0000","last_became_peered":"2023-11-27T20:54:27.512093+0000","last_unstale":"2023-11-27T20:54:59.610582+0000","last_undegraded":"2023-11-27T20:54:59.610582+0000","last_fullsized":"2023-11-27T20:54:59.610582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:24:36.921232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'4","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:05.779737+0000","last_change":"2023-11-27T20:54:26.230913+0000","last_active":"2023-11-27T20:55:05.779737+0000","last_peered":"2023-11-27T20:55:05.779737+0000","last_clean":"2023-11-27T20:55:05.779737+0000","last_became_active":"2023-11-27T20:54:26.230548+0000","last_became_peered":"2023-11-27T20:54:26.230548+0000","last_unstale":"2023-11-27T20:55:05.779737+0000","last_undegraded":"2023-11-27T20:55:05.779737+0000","last_fullsized":"2023-11-27T20:55:05.779737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:42:11.153092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:00.595104+0000","last_change":"2023-11-27T20:55:00.595104+0000","last_active":"2023-11-27T20:55:00.595104+0000","last_peered":"2023-11-27T20:55:00.595104+0000","last_clean":"2023-11-27T20:55:00.595104+0000","last_became_active":"2023-11-27T20:55:00.594705+0000","last_became_peered":"2023-11-27T20:55:00.594705+0000","last_unstale":"2023-11-27T20:55:00.595104+0000","last_undegraded":"2023-11-27T20:55:00.595104+0000","last_fullsized":"2023-11-27T20:55:00.595104+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:06.015093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.603091+0000","last_change":"2023-11-27T20:54:27.503689+0000","last_active":"2023-11-27T20:54:59.603091+0000","last_peered":"2023-11-27T20:54:59.603091+0000","last_clean":"2023-11-27T20:54:59.603091+0000","last_became_active":"2023-11-27T20:54:27.502941+0000","last_became_peered":"2023-11-27T20:54:27.502941+0000","last_unstale":"2023-11-27T20:54:59.603091+0000","last_undegraded":"2023-11-27T20:54:59.603091+0000","last_fullsized":"2023-11-27T20:54:59.603091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:59:41.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'3","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:05.783768+0000","last_change":"2023-11-27T20:54:26.214419+0000","last_active":"2023-11-27T20:55:05.783768+0000","last_peered":"2023-11-27T20:55:05.783768+0000","last_clean":"2023-11-27T20:55:05.783768+0000","last_became_active":"2023-11-27T20:54:26.214166+0000","last_became_peered":"2023-11-27T20:54:26.214166+0000","last_unstale":"2023-11-27T20:55:05.783768+0000","last_undegraded":"2023-11-27T20:55:05.783768+0000","last_fullsized":"2023-11-27T20:55:05.783768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:44:20.481769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610511+0000","last_change":"2023-11-27T20:54:31.832551+0000","last_active":"2023-11-27T20:54:59.610511+0000","last_peered":"2023-11-27T20:54:59.610511+0000","last_clean":"2023-11-27T20:54:59.610511+0000","last_became_active":"2023-11-27T20:54:31.832196+0000","last_became_peered":"2023-11-27T20:54:31.832196+0000","last_unstale":"2023-11-27T20:54:59.610511+0000","last_undegraded":"2023-11-27T20:54:59.610511+0000","last_fullsized":"2023-11-27T20:54:59.610511+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:26:46.712422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609820+0000","last_change":"2023-11-27T20:54:27.433404+0000","last_active":"2023-11-27T20:54:59.609820+0000","last_peered":"2023-11-27T20:54:59.609820+0000","last_clean":"2023-11-27T20:54:59.609820+0000","last_became_active":"2023-11-27T20:54:27.433161+0000","last_became_peered":"2023-11-27T20:54:27.433161+0000","last_unstale":"2023-11-27T20:54:59.609820+0000","last_undegraded":"2023-11-27T20:54:59.609820+0000","last_fullsized":"2023-11-27T20:54:59.609820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:09.298985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'3","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:00.585518+0000","last_change":"2023-11-27T20:54:26.227451+0000","last_active":"2023-11-27T20:55:00.585518+0000","last_peered":"2023-11-27T20:55:00.585518+0000","last_clean":"2023-11-27T20:55:00.585518+0000","last_became_active":"2023-11-27T20:54:26.227133+0000","last_became_peered":"2023-11-27T20:54:26.227133+0000","last_unstale":"2023-11-27T20:55:00.585518+0000","last_undegraded":"2023-11-27T20:55:00.585518+0000","last_fullsized":"2023-11-27T20:55:00.585518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:58.281608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607563+0000","last_change":"2023-11-27T20:54:11.452973+0000","last_active":"2023-11-27T20:54:59.607563+0000","last_peered":"2023-11-27T20:54:59.607563+0000","last_clean":"2023-11-27T20:54:59.607563+0000","last_became_active":"2023-11-27T20:54:11.452181+0000","last_became_peered":"2023-11-27T20:54:11.452181+0000","last_unstale":"2023-11-27T20:54:59.607563+0000","last_undegraded":"2023-11-27T20:54:59.607563+0000","last_fullsized":"2023-11-27T20:54:59.607563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:09.564478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:09.564478+0000","last_clean_scrub_stamp":"2023-11-27T20:54:09.564478+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:07.792065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610624+0000","last_change":"2023-11-27T20:54:31.818408+0000","last_active":"2023-11-27T20:54:59.610624+0000","last_peered":"2023-11-27T20:54:59.610624+0000","last_clean":"2023-11-27T20:54:59.610624+0000","last_became_active":"2023-11-27T20:54:31.818048+0000","last_became_peered":"2023-11-27T20:54:31.818048+0000","last_unstale":"2023-11-27T20:54:59.610624+0000","last_undegraded":"2023-11-27T20:54:59.610624+0000","last_fullsized":"2023-11-27T20:54:59.610624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:48:53.892148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610546+0000","last_change":"2023-11-27T20:54:27.493626+0000","last_active":"2023-11-27T20:54:59.610546+0000","last_peered":"2023-11-27T20:54:59.610546+0000","last_clean":"2023-11-27T20:54:59.610546+0000","last_became_active":"2023-11-27T20:54:27.493256+0000","last_became_peered":"2023-11-27T20:54:27.493256+0000","last_unstale":"2023-11-27T20:54:59.610546+0000","last_undegraded":"2023-11-27T20:54:59.610546+0000","last_fullsized":"2023-11-27T20:54:59.610546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:40:57.665118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'3","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:05.710162+0000","last_change":"2023-11-27T20:54:26.230079+0000","last_active":"2023-11-27T20:55:05.710162+0000","last_peered":"2023-11-27T20:55:05.710162+0000","last_clean":"2023-11-27T20:55:05.710162+0000","last_became_active":"2023-11-27T20:54:26.229796+0000","last_became_peered":"2023-11-27T20:54:26.229796+0000","last_unstale":"2023-11-27T20:55:05.710162+0000","last_undegraded":"2023-11-27T20:55:05.710162+0000","last_fullsized":"2023-11-27T20:55:05.710162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:55.616164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.605097+0000","last_change":"2023-11-27T20:54:31.825472+0000","last_active":"2023-11-27T20:54:59.605097+0000","last_peered":"2023-11-27T20:54:59.605097+0000","last_clean":"2023-11-27T20:54:59.605097+0000","last_became_active":"2023-11-27T20:54:31.825080+0000","last_became_peered":"2023-11-27T20:54:31.825080+0000","last_unstale":"2023-11-27T20:54:59.605097+0000","last_undegraded":"2023-11-27T20:54:59.605097+0000","last_fullsized":"2023-11-27T20:54:59.605097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:56:07.208945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:00.595764+0000","last_change":"2023-11-27T20:55:00.593751+0000","last_active":"2023-11-27T20:55:00.595764+0000","last_peered":"2023-11-27T20:55:00.595764+0000","last_clean":"2023-11-27T20:55:00.595764+0000","last_became_active":"2023-11-27T20:55:00.593249+0000","last_became_peered":"2023-11-27T20:55:00.593249+0000","last_unstale":"2023-11-27T20:55:00.595764+0000","last_undegraded":"2023-11-27T20:55:00.595764+0000","last_fullsized":"2023-11-27T20:55:00.595764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:10.486151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.611072+0000","last_change":"2023-11-27T20:54:26.226148+0000","last_active":"2023-11-27T20:54:59.611072+0000","last_peered":"2023-11-27T20:54:59.611072+0000","last_clean":"2023-11-27T20:54:59.611072+0000","last_became_active":"2023-11-27T20:54:26.225886+0000","last_became_peered":"2023-11-27T20:54:26.225886+0000","last_unstale":"2023-11-27T20:54:59.611072+0000","last_undegraded":"2023-11-27T20:54:59.611072+0000","last_fullsized":"2023-11-27T20:54:59.611072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:32:19.691350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610672+0000","last_change":"2023-11-27T20:54:31.828729+0000","last_active":"2023-11-27T20:54:59.610672+0000","last_peered":"2023-11-27T20:54:59.610672+0000","last_clean":"2023-11-27T20:54:59.610672+0000","last_became_active":"2023-11-27T20:54:31.828368+0000","last_became_peered":"2023-11-27T20:54:31.828368+0000","last_unstale":"2023-11-27T20:54:59.610672+0000","last_undegraded":"2023-11-27T20:54:59.610672+0000","last_fullsized":"2023-11-27T20:54:59.610672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:02.384459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.608484+0000","last_change":"2023-11-27T20:54:27.515800+0000","last_active":"2023-11-27T20:54:59.608484+0000","last_peered":"2023-11-27T20:54:59.608484+0000","last_clean":"2023-11-27T20:54:59.608484+0000","last_became_active":"2023-11-27T20:54:27.515416+0000","last_became_peered":"2023-11-27T20:54:27.515416+0000","last_unstale":"2023-11-27T20:54:59.608484+0000","last_undegraded":"2023-11-27T20:54:59.608484+0000","last_fullsized":"2023-11-27T20:54:59.608484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:03:00.166936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610003+0000","last_change":"2023-11-27T20:54:26.224880+0000","last_active":"2023-11-27T20:54:59.610003+0000","last_peered":"2023-11-27T20:54:59.610003+0000","last_clean":"2023-11-27T20:54:59.610003+0000","last_became_active":"2023-11-27T20:54:26.224604+0000","last_became_peered":"2023-11-27T20:54:26.224604+0000","last_unstale":"2023-11-27T20:54:59.610003+0000","last_undegraded":"2023-11-27T20:54:59.610003+0000","last_fullsized":"2023-11-27T20:54:59.610003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:15:45.927622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609459+0000","last_change":"2023-11-27T20:54:31.819648+0000","last_active":"2023-11-27T20:54:59.609459+0000","last_peered":"2023-11-27T20:54:59.609459+0000","last_clean":"2023-11-27T20:54:59.609459+0000","last_became_active":"2023-11-27T20:54:31.819294+0000","last_became_peered":"2023-11-27T20:54:31.819294+0000","last_unstale":"2023-11-27T20:54:59.609459+0000","last_undegraded":"2023-11-27T20:54:59.609459+0000","last_fullsized":"2023-11-27T20:54:59.609459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:15.043559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.606415+0000","last_change":"2023-11-27T20:54:27.512925+0000","last_active":"2023-11-27T20:54:59.606415+0000","last_peered":"2023-11-27T20:54:59.606415+0000","last_clean":"2023-11-27T20:54:59.606415+0000","last_became_active":"2023-11-27T20:54:27.512663+0000","last_became_peered":"2023-11-27T20:54:27.512663+0000","last_unstale":"2023-11-27T20:54:59.606415+0000","last_undegraded":"2023-11-27T20:54:59.606415+0000","last_fullsized":"2023-11-27T20:54:59.606415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:41.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.608545+0000","last_change":"2023-11-27T20:54:26.225344+0000","last_active":"2023-11-27T20:54:59.608545+0000","last_peered":"2023-11-27T20:54:59.608545+0000","last_clean":"2023-11-27T20:54:59.608545+0000","last_became_active":"2023-11-27T20:54:26.225056+0000","last_became_peered":"2023-11-27T20:54:26.225056+0000","last_unstale":"2023-11-27T20:54:59.608545+0000","last_undegraded":"2023-11-27T20:54:59.608545+0000","last_fullsized":"2023-11-27T20:54:59.608545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:39.965666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.606158+0000","last_change":"2023-11-27T20:54:31.827590+0000","last_active":"2023-11-27T20:54:59.606158+0000","last_peered":"2023-11-27T20:54:59.606158+0000","last_clean":"2023-11-27T20:54:59.606158+0000","last_became_active":"2023-11-27T20:54:31.827175+0000","last_became_peered":"2023-11-27T20:54:31.827175+0000","last_unstale":"2023-11-27T20:54:59.606158+0000","last_undegraded":"2023-11-27T20:54:59.606158+0000","last_fullsized":"2023-11-27T20:54:59.606158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:07:26.372924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609706+0000","last_change":"2023-11-27T20:54:27.498488+0000","last_active":"2023-11-27T20:54:59.609706+0000","last_peered":"2023-11-27T20:54:59.609706+0000","last_clean":"2023-11-27T20:54:59.609706+0000","last_became_active":"2023-11-27T20:54:27.498225+0000","last_became_peered":"2023-11-27T20:54:27.498225+0000","last_unstale":"2023-11-27T20:54:59.609706+0000","last_undegraded":"2023-11-27T20:54:59.609706+0000","last_fullsized":"2023-11-27T20:54:59.609706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:20:24.928142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'15","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:05.781453+0000","last_change":"2023-11-27T20:54:26.225580+0000","last_active":"2023-11-27T20:55:05.781453+0000","last_peered":"2023-11-27T20:55:05.781453+0000","last_clean":"2023-11-27T20:55:05.781453+0000","last_became_active":"2023-11-27T20:54:26.225333+0000","last_became_peered":"2023-11-27T20:54:26.225333+0000","last_unstale":"2023-11-27T20:55:05.781453+0000","last_undegraded":"2023-11-27T20:55:05.781453+0000","last_fullsized":"2023-11-27T20:55:05.781453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:46:01.797509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.611223+0000","last_change":"2023-11-27T20:54:31.836029+0000","last_active":"2023-11-27T20:54:59.611223+0000","last_peered":"2023-11-27T20:54:59.611223+0000","last_clean":"2023-11-27T20:54:59.611223+0000","last_became_active":"2023-11-27T20:54:31.835629+0000","last_became_peered":"2023-11-27T20:54:31.835629+0000","last_unstale":"2023-11-27T20:54:59.611223+0000","last_undegraded":"2023-11-27T20:54:59.611223+0000","last_fullsized":"2023-11-27T20:54:59.611223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:06.015093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607367+0000","last_change":"2023-11-27T20:54:27.511034+0000","last_active":"2023-11-27T20:54:59.607367+0000","last_peered":"2023-11-27T20:54:59.607367+0000","last_clean":"2023-11-27T20:54:59.607367+0000","last_became_active":"2023-11-27T20:54:27.510775+0000","last_became_peered":"2023-11-27T20:54:27.510775+0000","last_unstale":"2023-11-27T20:54:59.607367+0000","last_undegraded":"2023-11-27T20:54:59.607367+0000","last_fullsized":"2023-11-27T20:54:59.607367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:56.708375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.606897+0000","last_change":"2023-11-27T20:54:26.227007+0000","last_active":"2023-11-27T20:54:59.606897+0000","last_peered":"2023-11-27T20:54:59.606897+0000","last_clean":"2023-11-27T20:54:59.606897+0000","last_became_active":"2023-11-27T20:54:26.226745+0000","last_became_peered":"2023-11-27T20:54:26.226745+0000","last_unstale":"2023-11-27T20:54:59.606897+0000","last_undegraded":"2023-11-27T20:54:59.606897+0000","last_fullsized":"2023-11-27T20:54:59.606897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:41:46.312385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.611070+0000","last_change":"2023-11-27T20:54:31.831969+0000","last_active":"2023-11-27T20:54:59.611070+0000","last_peered":"2023-11-27T20:54:59.611070+0000","last_clean":"2023-11-27T20:54:59.611070+0000","last_became_active":"2023-11-27T20:54:31.831620+0000","last_became_peered":"2023-11-27T20:54:31.831620+0000","last_unstale":"2023-11-27T20:54:59.611070+0000","last_undegraded":"2023-11-27T20:54:59.611070+0000","last_fullsized":"2023-11-27T20:54:59.611070+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:57:38.465675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609895+0000","last_change":"2023-11-27T20:54:27.515785+0000","last_active":"2023-11-27T20:54:59.609895+0000","last_peered":"2023-11-27T20:54:59.609895+0000","last_clean":"2023-11-27T20:54:59.609895+0000","last_became_active":"2023-11-27T20:54:27.515524+0000","last_became_peered":"2023-11-27T20:54:27.515524+0000","last_unstale":"2023-11-27T20:54:59.609895+0000","last_undegraded":"2023-11-27T20:54:59.609895+0000","last_fullsized":"2023-11-27T20:54:59.609895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:40:33.267986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610197+0000","last_change":"2023-11-27T20:54:26.225975+0000","last_active":"2023-11-27T20:54:59.610197+0000","last_peered":"2023-11-27T20:54:59.610197+0000","last_clean":"2023-11-27T20:54:59.610197+0000","last_became_active":"2023-11-27T20:54:26.225691+0000","last_became_peered":"2023-11-27T20:54:26.225691+0000","last_unstale":"2023-11-27T20:54:59.610197+0000","last_undegraded":"2023-11-27T20:54:59.610197+0000","last_fullsized":"2023-11-27T20:54:59.610197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:25.427192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.603433+0000","last_change":"2023-11-27T20:54:31.827058+0000","last_active":"2023-11-27T20:54:59.603433+0000","last_peered":"2023-11-27T20:54:59.603433+0000","last_clean":"2023-11-27T20:54:59.603433+0000","last_became_active":"2023-11-27T20:54:31.826669+0000","last_became_peered":"2023-11-27T20:54:31.826669+0000","last_unstale":"2023-11-27T20:54:59.603433+0000","last_undegraded":"2023-11-27T20:54:59.603433+0000","last_fullsized":"2023-11-27T20:54:59.603433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:40.986177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.603162+0000","last_change":"2023-11-27T20:54:27.503066+0000","last_active":"2023-11-27T20:54:59.603162+0000","last_peered":"2023-11-27T20:54:59.603162+0000","last_clean":"2023-11-27T20:54:59.603162+0000","last_became_active":"2023-11-27T20:54:27.502677+0000","last_became_peered":"2023-11-27T20:54:27.502677+0000","last_unstale":"2023-11-27T20:54:59.603162+0000","last_undegraded":"2023-11-27T20:54:59.603162+0000","last_fullsized":"2023-11-27T20:54:59.603162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:41.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'6","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:05.787593+0000","last_change":"2023-11-27T20:54:26.228175+0000","last_active":"2023-11-27T20:55:05.787593+0000","last_peered":"2023-11-27T20:55:05.787593+0000","last_clean":"2023-11-27T20:55:05.787593+0000","last_became_active":"2023-11-27T20:54:26.227911+0000","last_became_peered":"2023-11-27T20:54:26.227911+0000","last_unstale":"2023-11-27T20:55:05.787593+0000","last_undegraded":"2023-11-27T20:55:05.787593+0000","last_fullsized":"2023-11-27T20:55:05.787593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:57.995466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610892+0000","last_change":"2023-11-27T20:54:31.828136+0000","last_active":"2023-11-27T20:54:59.610892+0000","last_peered":"2023-11-27T20:54:59.610892+0000","last_clean":"2023-11-27T20:54:59.610892+0000","last_became_active":"2023-11-27T20:54:31.827785+0000","last_became_peered":"2023-11-27T20:54:31.827785+0000","last_unstale":"2023-11-27T20:54:59.610892+0000","last_undegraded":"2023-11-27T20:54:59.610892+0000","last_fullsized":"2023-11-27T20:54:59.610892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:28:18.206490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607483+0000","last_change":"2023-11-27T20:54:27.514185+0000","last_active":"2023-11-27T20:54:59.607483+0000","last_peered":"2023-11-27T20:54:59.607483+0000","last_clean":"2023-11-27T20:54:59.607483+0000","last_became_active":"2023-11-27T20:54:27.513655+0000","last_became_peered":"2023-11-27T20:54:27.513655+0000","last_unstale":"2023-11-27T20:54:59.607483+0000","last_undegraded":"2023-11-27T20:54:59.607483+0000","last_fullsized":"2023-11-27T20:54:59.607483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:52.629755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'12","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.605715+0000","last_change":"2023-11-27T20:54:26.230827+0000","last_active":"2023-11-27T20:54:59.605715+0000","last_peered":"2023-11-27T20:54:59.605715+0000","last_clean":"2023-11-27T20:54:59.605715+0000","last_became_active":"2023-11-27T20:54:26.230570+0000","last_became_peered":"2023-11-27T20:54:26.230570+0000","last_unstale":"2023-11-27T20:54:59.605715+0000","last_undegraded":"2023-11-27T20:54:59.605715+0000","last_fullsized":"2023-11-27T20:54:59.605715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:42:04.480038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609727+0000","last_change":"2023-11-27T20:54:31.828482+0000","last_active":"2023-11-27T20:54:59.609727+0000","last_peered":"2023-11-27T20:54:59.609727+0000","last_clean":"2023-11-27T20:54:59.609727+0000","last_became_active":"2023-11-27T20:54:31.827872+0000","last_became_peered":"2023-11-27T20:54:31.827872+0000","last_unstale":"2023-11-27T20:54:59.609727+0000","last_undegraded":"2023-11-27T20:54:59.609727+0000","last_fullsized":"2023-11-27T20:54:59.609727+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:32:35.015914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610523+0000","last_change":"2023-11-27T20:54:27.493526+0000","last_active":"2023-11-27T20:54:59.610523+0000","last_peered":"2023-11-27T20:54:59.610523+0000","last_clean":"2023-11-27T20:54:59.610523+0000","last_became_active":"2023-11-27T20:54:27.493257+0000","last_became_peered":"2023-11-27T20:54:27.493257+0000","last_unstale":"2023-11-27T20:54:59.610523+0000","last_undegraded":"2023-11-27T20:54:59.610523+0000","last_fullsized":"2023-11-27T20:54:59.610523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:04.222900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607560+0000","last_change":"2023-11-27T20:54:26.231237+0000","last_active":"2023-11-27T20:54:59.607560+0000","last_peered":"2023-11-27T20:54:59.607560+0000","last_clean":"2023-11-27T20:54:59.607560+0000","last_became_active":"2023-11-27T20:54:26.230963+0000","last_became_peered":"2023-11-27T20:54:26.230963+0000","last_unstale":"2023-11-27T20:54:59.607560+0000","last_undegraded":"2023-11-27T20:54:59.607560+0000","last_fullsized":"2023-11-27T20:54:59.607560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:11:24.730507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.604887+0000","last_change":"2023-11-27T20:54:31.825391+0000","last_active":"2023-11-27T20:54:59.604887+0000","last_peered":"2023-11-27T20:54:59.604887+0000","last_clean":"2023-11-27T20:54:59.604887+0000","last_became_active":"2023-11-27T20:54:31.825038+0000","last_became_peered":"2023-11-27T20:54:31.825038+0000","last_unstale":"2023-11-27T20:54:59.604887+0000","last_undegraded":"2023-11-27T20:54:59.604887+0000","last_fullsized":"2023-11-27T20:54:59.604887+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:11:47.511718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.611154+0000","last_change":"2023-11-27T20:54:27.508226+0000","last_active":"2023-11-27T20:54:59.611154+0000","last_peered":"2023-11-27T20:54:59.611154+0000","last_clean":"2023-11-27T20:54:59.611154+0000","last_became_active":"2023-11-27T20:54:27.507805+0000","last_became_peered":"2023-11-27T20:54:27.507805+0000","last_unstale":"2023-11-27T20:54:59.611154+0000","last_undegraded":"2023-11-27T20:54:59.611154+0000","last_fullsized":"2023-11-27T20:54:59.611154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:43:42.137077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.608316+0000","last_change":"2023-11-27T20:54:26.226915+0000","last_active":"2023-11-27T20:54:59.608316+0000","last_peered":"2023-11-27T20:54:59.608316+0000","last_clean":"2023-11-27T20:54:59.608316+0000","last_became_active":"2023-11-27T20:54:26.226679+0000","last_became_peered":"2023-11-27T20:54:26.226679+0000","last_unstale":"2023-11-27T20:54:59.608316+0000","last_undegraded":"2023-11-27T20:54:59.608316+0000","last_fullsized":"2023-11-27T20:54:59.608316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:05:08.792958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.606773+0000","last_change":"2023-11-27T20:54:31.834934+0000","last_active":"2023-11-27T20:54:59.606773+0000","last_peered":"2023-11-27T20:54:59.606773+0000","last_clean":"2023-11-27T20:54:59.606773+0000","last_became_active":"2023-11-27T20:54:31.834569+0000","last_became_peered":"2023-11-27T20:54:31.834569+0000","last_unstale":"2023-11-27T20:54:59.606773+0000","last_undegraded":"2023-11-27T20:54:59.606773+0000","last_fullsized":"2023-11-27T20:54:59.606773+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:15:51.754021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.606349+0000","last_change":"2023-11-27T20:54:27.498841+0000","last_active":"2023-11-27T20:54:59.606349+0000","last_peered":"2023-11-27T20:54:59.606349+0000","last_clean":"2023-11-27T20:54:59.606349+0000","last_became_active":"2023-11-27T20:54:27.498535+0000","last_became_peered":"2023-11-27T20:54:27.498535+0000","last_unstale":"2023-11-27T20:54:59.606349+0000","last_undegraded":"2023-11-27T20:54:59.606349+0000","last_fullsized":"2023-11-27T20:54:59.606349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:21.736684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.608227+0000","last_change":"2023-11-27T20:54:26.228140+0000","last_active":"2023-11-27T20:54:59.608227+0000","last_peered":"2023-11-27T20:54:59.608227+0000","last_clean":"2023-11-27T20:54:59.608227+0000","last_became_active":"2023-11-27T20:54:26.227878+0000","last_became_peered":"2023-11-27T20:54:26.227878+0000","last_unstale":"2023-11-27T20:54:59.608227+0000","last_undegraded":"2023-11-27T20:54:59.608227+0000","last_fullsized":"2023-11-27T20:54:59.608227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:21:36.965668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609901+0000","last_change":"2023-11-27T20:54:31.825264+0000","last_active":"2023-11-27T20:54:59.609901+0000","last_peered":"2023-11-27T20:54:59.609901+0000","last_clean":"2023-11-27T20:54:59.609901+0000","last_became_active":"2023-11-27T20:54:31.824914+0000","last_became_peered":"2023-11-27T20:54:31.824914+0000","last_unstale":"2023-11-27T20:54:59.609901+0000","last_undegraded":"2023-11-27T20:54:59.609901+0000","last_fullsized":"2023-11-27T20:54:59.609901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:49:01.022403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609853+0000","last_change":"2023-11-27T20:54:31.828359+0000","last_active":"2023-11-27T20:54:59.609853+0000","last_peered":"2023-11-27T20:54:59.609853+0000","last_clean":"2023-11-27T20:54:59.609853+0000","last_became_active":"2023-11-27T20:54:31.827971+0000","last_became_peered":"2023-11-27T20:54:31.827971+0000","last_unstale":"2023-11-27T20:54:59.609853+0000","last_undegraded":"2023-11-27T20:54:59.609853+0000","last_fullsized":"2023-11-27T20:54:59.609853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:02.858386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609971+0000","last_change":"2023-11-27T20:54:27.434914+0000","last_active":"2023-11-27T20:54:59.609971+0000","last_peered":"2023-11-27T20:54:59.609971+0000","last_clean":"2023-11-27T20:54:59.609971+0000","last_became_active":"2023-11-27T20:54:27.434635+0000","last_became_peered":"2023-11-27T20:54:27.434635+0000","last_unstale":"2023-11-27T20:54:59.609971+0000","last_undegraded":"2023-11-27T20:54:59.609971+0000","last_fullsized":"2023-11-27T20:54:59.609971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:59.373818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609710+0000","last_change":"2023-11-27T20:54:26.224770+0000","last_active":"2023-11-27T20:54:59.609710+0000","last_peered":"2023-11-27T20:54:59.609710+0000","last_clean":"2023-11-27T20:54:59.609710+0000","last_became_active":"2023-11-27T20:54:26.224502+0000","last_became_peered":"2023-11-27T20:54:26.224502+0000","last_unstale":"2023-11-27T20:54:59.609710+0000","last_undegraded":"2023-11-27T20:54:59.609710+0000","last_fullsized":"2023-11-27T20:54:59.609710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:51:28.157451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609919+0000","last_change":"2023-11-27T20:54:31.827147+0000","last_active":"2023-11-27T20:54:59.609919+0000","last_peered":"2023-11-27T20:54:59.609919+0000","last_clean":"2023-11-27T20:54:59.609919+0000","last_became_active":"2023-11-27T20:54:31.826790+0000","last_became_peered":"2023-11-27T20:54:31.826790+0000","last_unstale":"2023-11-27T20:54:59.609919+0000","last_undegraded":"2023-11-27T20:54:59.609919+0000","last_fullsized":"2023-11-27T20:54:59.609919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:11:33.954256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610782+0000","last_change":"2023-11-27T20:54:27.507947+0000","last_active":"2023-11-27T20:54:59.610782+0000","last_peered":"2023-11-27T20:54:59.610782+0000","last_clean":"2023-11-27T20:54:59.610782+0000","last_became_active":"2023-11-27T20:54:27.507698+0000","last_became_peered":"2023-11-27T20:54:27.507698+0000","last_unstale":"2023-11-27T20:54:59.610782+0000","last_undegraded":"2023-11-27T20:54:59.610782+0000","last_fullsized":"2023-11-27T20:54:59.610782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:50.369518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'2","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:05.708459+0000","last_change":"2023-11-27T20:54:26.230417+0000","last_active":"2023-11-27T20:55:05.708459+0000","last_peered":"2023-11-27T20:55:05.708459+0000","last_clean":"2023-11-27T20:55:05.708459+0000","last_became_active":"2023-11-27T20:54:26.229725+0000","last_became_peered":"2023-11-27T20:54:26.229725+0000","last_unstale":"2023-11-27T20:55:05.708459+0000","last_undegraded":"2023-11-27T20:55:05.708459+0000","last_fullsized":"2023-11-27T20:55:05.708459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:01.075715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'3","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:05.786177+0000","last_change":"2023-11-27T20:54:26.221975+0000","last_active":"2023-11-27T20:55:05.786177+0000","last_peered":"2023-11-27T20:55:05.786177+0000","last_clean":"2023-11-27T20:55:05.786177+0000","last_became_active":"2023-11-27T20:54:26.221715+0000","last_became_peered":"2023-11-27T20:54:26.221715+0000","last_unstale":"2023-11-27T20:55:05.786177+0000","last_undegraded":"2023-11-27T20:55:05.786177+0000","last_fullsized":"2023-11-27T20:55:05.786177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:15.156440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609797+0000","last_change":"2023-11-27T20:54:27.517213+0000","last_active":"2023-11-27T20:54:59.609797+0000","last_peered":"2023-11-27T20:54:59.609797+0000","last_clean":"2023-11-27T20:54:59.609797+0000","last_became_active":"2023-11-27T20:54:27.516887+0000","last_became_peered":"2023-11-27T20:54:27.516887+0000","last_unstale":"2023-11-27T20:54:59.609797+0000","last_undegraded":"2023-11-27T20:54:59.609797+0000","last_fullsized":"2023-11-27T20:54:59.609797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:51:29.249661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610033+0000","last_change":"2023-11-27T20:54:31.827740+0000","last_active":"2023-11-27T20:54:59.610033+0000","last_peered":"2023-11-27T20:54:59.610033+0000","last_clean":"2023-11-27T20:54:59.610033+0000","last_became_active":"2023-11-27T20:54:31.827395+0000","last_became_peered":"2023-11-27T20:54:31.827395+0000","last_unstale":"2023-11-27T20:54:59.610033+0000","last_undegraded":"2023-11-27T20:54:59.610033+0000","last_fullsized":"2023-11-27T20:54:59.610033+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:20:29.485550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'5","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610823+0000","last_change":"2023-11-27T20:54:26.227971+0000","last_active":"2023-11-27T20:54:59.610823+0000","last_peered":"2023-11-27T20:54:59.610823+0000","last_clean":"2023-11-27T20:54:59.610823+0000","last_became_active":"2023-11-27T20:54:26.227713+0000","last_became_peered":"2023-11-27T20:54:26.227713+0000","last_unstale":"2023-11-27T20:54:59.610823+0000","last_undegraded":"2023-11-27T20:54:59.610823+0000","last_fullsized":"2023-11-27T20:54:59.610823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:39.965666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.606399+0000","last_change":"2023-11-27T20:54:27.506394+0000","last_active":"2023-11-27T20:54:59.606399+0000","last_peered":"2023-11-27T20:54:59.606399+0000","last_clean":"2023-11-27T20:54:59.606399+0000","last_became_active":"2023-11-27T20:54:27.506119+0000","last_became_peered":"2023-11-27T20:54:27.506119+0000","last_unstale":"2023-11-27T20:54:59.606399+0000","last_undegraded":"2023-11-27T20:54:59.606399+0000","last_fullsized":"2023-11-27T20:54:59.606399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:21.736684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.606972+0000","last_change":"2023-11-27T20:54:31.833185+0000","last_active":"2023-11-27T20:54:59.606972+0000","last_peered":"2023-11-27T20:54:59.606972+0000","last_clean":"2023-11-27T20:54:59.606972+0000","last_became_active":"2023-11-27T20:54:31.832813+0000","last_became_peered":"2023-11-27T20:54:31.832813+0000","last_unstale":"2023-11-27T20:54:59.606972+0000","last_undegraded":"2023-11-27T20:54:59.606972+0000","last_fullsized":"2023-11-27T20:54:59.606972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:13.856393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.605669+0000","last_change":"2023-11-27T20:54:27.500687+0000","last_active":"2023-11-27T20:54:59.605669+0000","last_peered":"2023-11-27T20:54:59.605669+0000","last_clean":"2023-11-27T20:54:59.605669+0000","last_became_active":"2023-11-27T20:54:27.500394+0000","last_became_peered":"2023-11-27T20:54:27.500394+0000","last_unstale":"2023-11-27T20:54:59.605669+0000","last_undegraded":"2023-11-27T20:54:59.605669+0000","last_fullsized":"2023-11-27T20:54:59.605669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:15:32.173306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607085+0000","last_change":"2023-11-27T20:54:27.515441+0000","last_active":"2023-11-27T20:54:59.607085+0000","last_peered":"2023-11-27T20:54:59.607085+0000","last_clean":"2023-11-27T20:54:59.607085+0000","last_became_active":"2023-11-27T20:54:27.515173+0000","last_became_peered":"2023-11-27T20:54:27.515173+0000","last_unstale":"2023-11-27T20:54:59.607085+0000","last_undegraded":"2023-11-27T20:54:59.607085+0000","last_fullsized":"2023-11-27T20:54:59.607085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:19:36.361734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609870+0000","last_change":"2023-11-27T20:54:27.506358+0000","last_active":"2023-11-27T20:54:59.609870+0000","last_peered":"2023-11-27T20:54:59.609870+0000","last_clean":"2023-11-27T20:54:59.609870+0000","last_became_active":"2023-11-27T20:54:27.506112+0000","last_became_peered":"2023-11-27T20:54:27.506112+0000","last_unstale":"2023-11-27T20:54:59.609870+0000","last_undegraded":"2023-11-27T20:54:59.609870+0000","last_fullsized":"2023-11-27T20:54:59.609870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:58.300979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610743+0000","last_change":"2023-11-27T20:54:27.510776+0000","last_active":"2023-11-27T20:54:59.610743+0000","last_peered":"2023-11-27T20:54:59.610743+0000","last_clean":"2023-11-27T20:54:59.610743+0000","last_became_active":"2023-11-27T20:54:27.510532+0000","last_became_peered":"2023-11-27T20:54:27.510532+0000","last_unstale":"2023-11-27T20:54:59.610743+0000","last_undegraded":"2023-11-27T20:54:59.610743+0000","last_fullsized":"2023-11-27T20:54:59.610743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:36.428770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.603513+0000","last_change":"2023-11-27T20:54:27.513775+0000","last_active":"2023-11-27T20:54:59.603513+0000","last_peered":"2023-11-27T20:54:59.603513+0000","last_clean":"2023-11-27T20:54:59.603513+0000","last_became_active":"2023-11-27T20:54:27.513517+0000","last_became_peered":"2023-11-27T20:54:27.513517+0000","last_unstale":"2023-11-27T20:54:59.603513+0000","last_undegraded":"2023-11-27T20:54:59.603513+0000","last_fullsized":"2023-11-27T20:54:59.603513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:07:21.815516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.603564+0000","last_change":"2023-11-27T20:54:27.511798+0000","last_active":"2023-11-27T20:54:59.603564+0000","last_peered":"2023-11-27T20:54:59.603564+0000","last_clean":"2023-11-27T20:54:59.603564+0000","last_became_active":"2023-11-27T20:54:27.511559+0000","last_became_peered":"2023-11-27T20:54:27.511559+0000","last_unstale":"2023-11-27T20:54:59.603564+0000","last_undegraded":"2023-11-27T20:54:59.603564+0000","last_fullsized":"2023-11-27T20:54:59.603564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:41.057877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.606280+0000","last_change":"2023-11-27T20:54:27.499585+0000","last_active":"2023-11-27T20:54:59.606280+0000","last_peered":"2023-11-27T20:54:59.606280+0000","last_clean":"2023-11-27T20:54:59.606280+0000","last_became_active":"2023-11-27T20:54:27.499323+0000","last_became_peered":"2023-11-27T20:54:27.499323+0000","last_unstale":"2023-11-27T20:54:59.606280+0000","last_undegraded":"2023-11-27T20:54:59.606280+0000","last_fullsized":"2023-11-27T20:54:59.606280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:59:41.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610994+0000","last_change":"2023-11-27T20:54:27.508846+0000","last_active":"2023-11-27T20:54:59.610994+0000","last_peered":"2023-11-27T20:54:59.610994+0000","last_clean":"2023-11-27T20:54:59.610994+0000","last_became_active":"2023-11-27T20:54:27.508615+0000","last_became_peered":"2023-11-27T20:54:27.508615+0000","last_unstale":"2023-11-27T20:54:59.610994+0000","last_undegraded":"2023-11-27T20:54:59.610994+0000","last_fullsized":"2023-11-27T20:54:59.610994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:53.751196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609632+0000","last_change":"2023-11-27T20:54:27.510920+0000","last_active":"2023-11-27T20:54:59.609632+0000","last_peered":"2023-11-27T20:54:59.609632+0000","last_clean":"2023-11-27T20:54:59.609632+0000","last_became_active":"2023-11-27T20:54:27.510647+0000","last_became_peered":"2023-11-27T20:54:27.510647+0000","last_unstale":"2023-11-27T20:54:59.609632+0000","last_undegraded":"2023-11-27T20:54:59.609632+0000","last_fullsized":"2023-11-27T20:54:59.609632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:32:30.458506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610169+0000","last_change":"2023-11-27T20:54:27.508596+0000","last_active":"2023-11-27T20:54:59.610169+0000","last_peered":"2023-11-27T20:54:59.610169+0000","last_clean":"2023-11-27T20:54:59.610169+0000","last_became_active":"2023-11-27T20:54:27.508360+0000","last_became_peered":"2023-11-27T20:54:27.508360+0000","last_unstale":"2023-11-27T20:54:59.610169+0000","last_undegraded":"2023-11-27T20:54:59.610169+0000","last_fullsized":"2023-11-27T20:54:59.610169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:58.794639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.606330+0000","last_change":"2023-11-27T20:54:27.513374+0000","last_active":"2023-11-27T20:54:59.606330+0000","last_peered":"2023-11-27T20:54:59.606330+0000","last_clean":"2023-11-27T20:54:59.606330+0000","last_became_active":"2023-11-27T20:54:27.513105+0000","last_became_peered":"2023-11-27T20:54:27.513105+0000","last_unstale":"2023-11-27T20:54:59.606330+0000","last_undegraded":"2023-11-27T20:54:59.606330+0000","last_fullsized":"2023-11-27T20:54:59.606330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:59:41.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609724+0000","last_change":"2023-11-27T20:54:27.433370+0000","last_active":"2023-11-27T20:54:59.609724+0000","last_peered":"2023-11-27T20:54:59.609724+0000","last_clean":"2023-11-27T20:54:59.609724+0000","last_became_active":"2023-11-27T20:54:27.433179+0000","last_became_peered":"2023-11-27T20:54:27.433179+0000","last_unstale":"2023-11-27T20:54:59.609724+0000","last_undegraded":"2023-11-27T20:54:59.609724+0000","last_fullsized":"2023-11-27T20:54:59.609724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:01.805918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607240+0000","last_change":"2023-11-27T20:54:27.515324+0000","last_active":"2023-11-27T20:54:59.607240+0000","last_peered":"2023-11-27T20:54:59.607240+0000","last_clean":"2023-11-27T20:54:59.607240+0000","last_became_active":"2023-11-27T20:54:27.515068+0000","last_became_peered":"2023-11-27T20:54:27.515068+0000","last_unstale":"2023-11-27T20:54:59.607240+0000","last_undegraded":"2023-11-27T20:54:59.607240+0000","last_fullsized":"2023-11-27T20:54:59.607240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:11:42.954310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610694+0000","last_change":"2023-11-27T20:54:27.498621+0000","last_active":"2023-11-27T20:54:59.610694+0000","last_peered":"2023-11-27T20:54:59.610694+0000","last_clean":"2023-11-27T20:54:59.610694+0000","last_became_active":"2023-11-27T20:54:27.498306+0000","last_became_peered":"2023-11-27T20:54:27.498306+0000","last_unstale":"2023-11-27T20:54:59.610694+0000","last_undegraded":"2023-11-27T20:54:59.610694+0000","last_fullsized":"2023-11-27T20:54:59.610694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:20:24.529896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607257+0000","last_change":"2023-11-27T20:54:27.513134+0000","last_active":"2023-11-27T20:54:59.607257+0000","last_peered":"2023-11-27T20:54:59.607257+0000","last_clean":"2023-11-27T20:54:59.607257+0000","last_became_active":"2023-11-27T20:54:27.512897+0000","last_became_peered":"2023-11-27T20:54:27.512897+0000","last_unstale":"2023-11-27T20:54:59.607257+0000","last_undegraded":"2023-11-27T20:54:59.607257+0000","last_fullsized":"2023-11-27T20:54:59.607257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:13:40.877792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610185+0000","last_change":"2023-11-27T20:54:27.515196+0000","last_active":"2023-11-27T20:54:59.610185+0000","last_peered":"2023-11-27T20:54:59.610185+0000","last_clean":"2023-11-27T20:54:59.610185+0000","last_became_active":"2023-11-27T20:54:27.514946+0000","last_became_peered":"2023-11-27T20:54:27.514946+0000","last_unstale":"2023-11-27T20:54:59.610185+0000","last_undegraded":"2023-11-27T20:54:59.610185+0000","last_fullsized":"2023-11-27T20:54:59.610185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:06:07.940123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.609907+0000","last_change":"2023-11-27T20:54:27.493565+0000","last_active":"2023-11-27T20:54:59.609907+0000","last_peered":"2023-11-27T20:54:59.609907+0000","last_clean":"2023-11-27T20:54:59.609907+0000","last_became_active":"2023-11-27T20:54:27.493297+0000","last_became_peered":"2023-11-27T20:54:27.493297+0000","last_unstale":"2023-11-27T20:54:59.609907+0000","last_undegraded":"2023-11-27T20:54:59.609907+0000","last_fullsized":"2023-11-27T20:54:59.609907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:28:51.839397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610095+0000","last_change":"2023-11-27T20:54:27.512910+0000","last_active":"2023-11-27T20:54:59.610095+0000","last_peered":"2023-11-27T20:54:59.610095+0000","last_clean":"2023-11-27T20:54:59.610095+0000","last_became_active":"2023-11-27T20:54:27.512662+0000","last_became_peered":"2023-11-27T20:54:27.512662+0000","last_unstale":"2023-11-27T20:54:59.610095+0000","last_undegraded":"2023-11-27T20:54:59.610095+0000","last_fullsized":"2023-11-27T20:54:59.610095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:52.629755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.603080+0000","last_change":"2023-11-27T20:54:27.512406+0000","last_active":"2023-11-27T20:54:59.603080+0000","last_peered":"2023-11-27T20:54:59.603080+0000","last_clean":"2023-11-27T20:54:59.603080+0000","last_became_active":"2023-11-27T20:54:27.512124+0000","last_became_peered":"2023-11-27T20:54:27.512124+0000","last_unstale":"2023-11-27T20:54:59.603080+0000","last_undegraded":"2023-11-27T20:54:59.603080+0000","last_fullsized":"2023-11-27T20:54:59.603080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:21.736684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.603234+0000","last_change":"2023-11-27T20:54:27.517262+0000","last_active":"2023-11-27T20:54:59.603234+0000","last_peered":"2023-11-27T20:54:59.603234+0000","last_clean":"2023-11-27T20:54:59.603234+0000","last_became_active":"2023-11-27T20:54:27.516907+0000","last_became_peered":"2023-11-27T20:54:27.516907+0000","last_unstale":"2023-11-27T20:54:59.603234+0000","last_undegraded":"2023-11-27T20:54:59.603234+0000","last_fullsized":"2023-11-27T20:54:59.603234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:05:09.885169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607166+0000","last_change":"2023-11-27T20:54:27.515432+0000","last_active":"2023-11-27T20:54:59.607166+0000","last_peered":"2023-11-27T20:54:59.607166+0000","last_clean":"2023-11-27T20:54:59.607166+0000","last_became_active":"2023-11-27T20:54:27.515182+0000","last_became_peered":"2023-11-27T20:54:27.515182+0000","last_unstale":"2023-11-27T20:54:59.607166+0000","last_undegraded":"2023-11-27T20:54:59.607166+0000","last_fullsized":"2023-11-27T20:54:59.607166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:36.428770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T20:55:00.589255+0000","last_change":"2023-11-27T20:55:00.588607+0000","last_active":"2023-11-27T20:55:00.589255+0000","last_peered":"2023-11-27T20:55:00.589255+0000","last_clean":"2023-11-27T20:55:00.589255+0000","last_became_active":"2023-11-27T20:55:00.588298+0000","last_became_peered":"2023-11-27T20:55:00.588298+0000","last_unstale":"2023-11-27T20:55:00.589255+0000","last_undegraded":"2023-11-27T20:55:00.589255+0000","last_fullsized":"2023-11-27T20:55:00.589255+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:32:30.458506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.608232+0000","last_change":"2023-11-27T20:54:27.512956+0000","last_active":"2023-11-27T20:54:59.608232+0000","last_peered":"2023-11-27T20:54:59.608232+0000","last_clean":"2023-11-27T20:54:59.608232+0000","last_became_active":"2023-11-27T20:54:27.512692+0000","last_became_peered":"2023-11-27T20:54:27.512692+0000","last_unstale":"2023-11-27T20:54:59.608232+0000","last_undegraded":"2023-11-27T20:54:59.608232+0000","last_fullsized":"2023-11-27T20:54:59.608232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:53.751196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.608133+0000","last_change":"2023-11-27T20:54:27.499043+0000","last_active":"2023-11-27T20:54:59.608133+0000","last_peered":"2023-11-27T20:54:59.608133+0000","last_clean":"2023-11-27T20:54:59.608133+0000","last_became_active":"2023-11-27T20:54:27.498790+0000","last_became_peered":"2023-11-27T20:54:27.498790+0000","last_unstale":"2023-11-27T20:54:59.608133+0000","last_undegraded":"2023-11-27T20:54:59.608133+0000","last_fullsized":"2023-11-27T20:54:59.608133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:41.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610491+0000","last_change":"2023-11-27T20:54:27.513089+0000","last_active":"2023-11-27T20:54:59.610491+0000","last_peered":"2023-11-27T20:54:59.610491+0000","last_clean":"2023-11-27T20:54:59.610491+0000","last_became_active":"2023-11-27T20:54:27.512777+0000","last_became_peered":"2023-11-27T20:54:27.512777+0000","last_unstale":"2023-11-27T20:54:59.610491+0000","last_undegraded":"2023-11-27T20:54:59.610491+0000","last_fullsized":"2023-11-27T20:54:59.610491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:32.362116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.606813+0000","last_change":"2023-11-27T20:54:27.512691+0000","last_active":"2023-11-27T20:54:59.606813+0000","last_peered":"2023-11-27T20:54:59.606813+0000","last_clean":"2023-11-27T20:54:59.606813+0000","last_became_active":"2023-11-27T20:54:27.512433+0000","last_became_peered":"2023-11-27T20:54:27.512433+0000","last_unstale":"2023-11-27T20:54:59.606813+0000","last_undegraded":"2023-11-27T20:54:59.606813+0000","last_fullsized":"2023-11-27T20:54:59.606813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:30.589702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.605221+0000","last_change":"2023-11-27T20:54:27.432322+0000","last_active":"2023-11-27T20:54:59.605221+0000","last_peered":"2023-11-27T20:54:59.605221+0000","last_clean":"2023-11-27T20:54:59.605221+0000","last_became_active":"2023-11-27T20:54:27.432152+0000","last_became_peered":"2023-11-27T20:54:27.432152+0000","last_unstale":"2023-11-27T20:54:59.605221+0000","last_undegraded":"2023-11-27T20:54:59.605221+0000","last_fullsized":"2023-11-27T20:54:59.605221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:02.167926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.607606+0000","last_change":"2023-11-27T20:54:27.516081+0000","last_active":"2023-11-27T20:54:59.607606+0000","last_peered":"2023-11-27T20:54:59.607606+0000","last_clean":"2023-11-27T20:54:59.607606+0000","last_became_active":"2023-11-27T20:54:27.515801+0000","last_became_peered":"2023-11-27T20:54:27.515801+0000","last_unstale":"2023-11-27T20:54:59.607606+0000","last_undegraded":"2023-11-27T20:54:59.607606+0000","last_fullsized":"2023-11-27T20:54:59.607606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:24:30.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.605533+0000","last_change":"2023-11-27T20:54:27.432375+0000","last_active":"2023-11-27T20:54:59.605533+0000","last_peered":"2023-11-27T20:54:59.605533+0000","last_clean":"2023-11-27T20:54:59.605533+0000","last_became_active":"2023-11-27T20:54:27.432160+0000","last_became_peered":"2023-11-27T20:54:27.432160+0000","last_unstale":"2023-11-27T20:54:59.605533+0000","last_undegraded":"2023-11-27T20:54:59.605533+0000","last_fullsized":"2023-11-27T20:54:59.605533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:36.652979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610944+0000","last_change":"2023-11-27T20:54:27.505374+0000","last_active":"2023-11-27T20:54:59.610944+0000","last_peered":"2023-11-27T20:54:59.610944+0000","last_clean":"2023-11-27T20:54:59.610944+0000","last_became_active":"2023-11-27T20:54:27.505122+0000","last_became_peered":"2023-11-27T20:54:27.505122+0000","last_unstale":"2023-11-27T20:54:59.610944+0000","last_undegraded":"2023-11-27T20:54:59.610944+0000","last_fullsized":"2023-11-27T20:54:59.610944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:30.589702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.610652+0000","last_change":"2023-11-27T20:54:27.505531+0000","last_active":"2023-11-27T20:54:59.610652+0000","last_peered":"2023-11-27T20:54:59.610652+0000","last_clean":"2023-11-27T20:54:59.610652+0000","last_became_active":"2023-11-27T20:54:27.505236+0000","last_became_peered":"2023-11-27T20:54:27.505236+0000","last_unstale":"2023-11-27T20:54:59.610652+0000","last_undegraded":"2023-11-27T20:54:59.610652+0000","last_fullsized":"2023-11-27T20:54:59.610652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:56:02.651538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-27T20:54:59.608460+0000","last_change":"2023-11-27T20:54:27.515185+0000","last_active":"2023-11-27T20:54:59.608460+0000","last_peered":"2023-11-27T20:54:59.608460+0000","last_clean":"2023-11-27T20:54:59.608460+0000","last_became_active":"2023-11-27T20:54:27.514846+0000","last_became_peered":"2023-11-27T20:54:27.514846+0000","last_unstale":"2023-11-27T20:54:59.608460+0000","last_undegraded":"2023-11-27T20:54:59.608460+0000","last_fullsized":"2023-11-27T20:54:59.608460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:43:42.137077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6864,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":13700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":120661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":905216,"data_stored":711121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":123881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]}]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":897024,"data_stored":710567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]}]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":120185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":120947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":3,"last update":"Mon Nov 27 20:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.40799999999999997}]},{"osd":4,"last update":"Mon Nov 27 20:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":125449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":121265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:55:10.425 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-27T20:55:10.425 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-27T20:55:10.425 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-27T20:55:10.426 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-27T20:55:10.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.557+0000 7f348c810640 1 Processor -- start 2023-11-27T20:55:10.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.557+0000 7f348c810640 1 -- start start 2023-11-27T20:55:10.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.558+0000 7f348c810640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f34880c9620 0x7f34880c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:10.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.558+0000 7f348c810640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34880cbda0 con 0x7f34880cda70 2023-11-27T20:55:10.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.558+0000 7f348c810640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34880cea60 con 0x7f34880cc420 2023-11-27T20:55:10.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.558+0000 7f348c810640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34880cc230 con 0x7f34880c9620 2023-11-27T20:55:10.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.559+0000 7f3485d9b640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f34880cc420 0x7f3488159610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:44508/0 (socket says 172.21.15.88:44508) 2023-11-27T20:55:10.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.559+0000 7f3485d9b640 1 -- 172.21.15.88:0/1595551732 learned_addr learned my addr 172.21.15.88:0/1595551732 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:55:10.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.560+0000 7f3486d9d640 1 --2- 172.21.15.88:0/1595551732 >> v2:172.21.15.88:3300/0 conn(0x7f34880c9620 0x7f34880c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:10.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.563+0000 7f348559a640 1 -- 172.21.15.88:0/1595551732 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124722772 0 0) 0x7f34880cea60 con 0x7f34880cc420 2023-11-27T20:55:10.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.563+0000 7f348559a640 1 -- 172.21.15.88:0/1595551732 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3470003520 con 0x7f34880cc420 2023-11-27T20:55:10.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.566+0000 7f3486d9d640 1 -- 172.21.15.88:0/1595551732 >> v1:172.21.15.167:6789/0 conn(0x7f34880cc420 legacy=0x7f3488159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:10.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.566+0000 7f3486d9d640 1 -- 172.21.15.88:0/1595551732 >> v1:172.21.15.88:6789/0 conn(0x7f34880cda70 legacy=0x7f34880ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:10.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.566+0000 7f3486d9d640 1 -- 172.21.15.88:0/1595551732 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34880cb4e0 con 0x7f34880c9620 2023-11-27T20:55:10.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.569+0000 7f3486d9d640 1 --2- 172.21.15.88:0/1595551732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34880c9620 0x7f34880c9a50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3480009d90 tx=0x7f348002bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8076593bb1e18d03 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:10.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.574+0000 7f348559a640 1 -- 172.21.15.88:0/1595551732 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348002cd80 con 0x7f34880c9620 2023-11-27T20:55:10.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.574+0000 7f348559a640 1 -- 172.21.15.88:0/1595551732 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3480034440 con 0x7f34880c9620 2023-11-27T20:55:10.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.574+0000 7f348559a640 1 -- 172.21.15.88:0/1595551732 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34800347d0 con 0x7f34880c9620 2023-11-27T20:55:10.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.575+0000 7f348c810640 1 -- 172.21.15.88:0/1595551732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34880c9620 msgr2=0x7f34880c9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:10.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.575+0000 7f348c810640 1 --2- 172.21.15.88:0/1595551732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34880c9620 0x7f34880c9a50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3480009d90 tx=0x7f348002bfd0 comp rx=0 tx=0).stop 2023-11-27T20:55:10.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.575+0000 7f348c810640 1 -- 172.21.15.88:0/1595551732 shutdown_connections 2023-11-27T20:55:10.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.575+0000 7f348c810640 1 --2- 172.21.15.88:0/1595551732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34880c9620 0x7f34880c9a50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:10.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.575+0000 7f348c810640 1 -- 172.21.15.88:0/1595551732 >> 172.21.15.88:0/1595551732 conn(0x7f34880b07b0 msgr2=0x7f34880b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:10.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.575+0000 7f348c810640 1 -- 172.21.15.88:0/1595551732 shutdown_connections 2023-11-27T20:55:10.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.575+0000 7f348c810640 1 -- 172.21.15.88:0/1595551732 wait complete. 2023-11-27T20:55:10.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.576+0000 7f348c810640 1 Processor -- start 2023-11-27T20:55:10.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.576+0000 7f348c810640 1 -- start start 2023-11-27T20:55:10.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.577+0000 7f348c810640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34880c9620 0x7f34880c29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:10.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.577+0000 7f348c810640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34880cc420 0x7f34880b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:10.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.577+0000 7f348c810640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34880cda70 0x7f34881f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:10.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.577+0000 7f348c810640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34881524a0 con 0x7f34880cda70 2023-11-27T20:55:10.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.577+0000 7f348c810640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34880c3ed0 con 0x7f34880c9620 2023-11-27T20:55:10.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.577+0000 7f348c810640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34881ef470 con 0x7f34880cc420 2023-11-27T20:55:10.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.578+0000 7f3486d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34880cda70 0x7f34881f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:10.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.578+0000 7f3485d9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34880cc420 0x7f34880b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:10.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.578+0000 7f348659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34880c9620 0x7f34880c29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:10.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.578+0000 7f3486d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34880cda70 0x7f34881f21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44746/0 (socket says 172.21.15.88:44746) 2023-11-27T20:55:10.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.578+0000 7f3486d9d640 1 -- 172.21.15.88:0/531429313 learned_addr learned my addr 172.21.15.88:0/531429313 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:10.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.581+0000 7f3486d9d640 1 -- 172.21.15.88:0/531429313 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34880cc420 msgr2=0x7f34880b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:10.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.581+0000 7f3486d9d640 1 --2- 172.21.15.88:0/531429313 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34880cc420 0x7f34880b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:10.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.581+0000 7f3486d9d640 1 -- 172.21.15.88:0/531429313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34880c9620 msgr2=0x7f34880c29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:10.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.581+0000 7f3486d9d640 1 --2- 172.21.15.88:0/531429313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34880c9620 0x7f34880c29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:10.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.582+0000 7f3486d9d640 1 -- 172.21.15.88:0/531429313 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3480009a70 con 0x7f34880cda70 2023-11-27T20:55:10.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.584+0000 7f3486d9d640 1 --2- 172.21.15.88:0/531429313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34880cda70 0x7f34881f21f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3480009eb0 tx=0x7f3480004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:10.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.588+0000 7f3476ffd640 1 -- 172.21.15.88:0/531429313 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348003e410 con 0x7f34880cda70 2023-11-27T20:55:10.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.588+0000 7f3476ffd640 1 -- 172.21.15.88:0/531429313 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348003e570 con 0x7f34880cda70 2023-11-27T20:55:10.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.588+0000 7f3476ffd640 1 -- 172.21.15.88:0/531429313 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348003e920 con 0x7f34880cda70 2023-11-27T20:55:10.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.588+0000 7f348c810640 1 -- 172.21.15.88:0/531429313 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3488152bd0 con 0x7f34880cda70 2023-11-27T20:55:10.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.588+0000 7f348c810640 1 -- 172.21.15.88:0/531429313 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34880c2f20 con 0x7f34880cda70 2023-11-27T20:55:10.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.589+0000 7f348c810640 1 -- 172.21.15.88:0/531429313 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34881ef620 con 0x7f34880cda70 2023-11-27T20:55:10.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.609+0000 7f3476ffd640 1 -- 172.21.15.88:0/531429313 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f348003b050 con 0x7f34880cda70 2023-11-27T20:55:10.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.609+0000 7f3476ffd640 1 --2- 172.21.15.88:0/531429313 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f346806b1f0 0x7f346806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:10.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.610+0000 7f348659c640 1 --2- 172.21.15.88:0/531429313 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f346806b1f0 0x7f346806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:10.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.610+0000 7f348659c640 1 --2- 172.21.15.88:0/531429313 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f346806b1f0 0x7f346806d6b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f34780016e0 tx=0x7f3478009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:10.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.853+0000 7f3476ffd640 1 -- 172.21.15.88:0/531429313 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f348007aa20 con 0x7f34880cda70 2023-11-27T20:55:10.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:10.853+0000 7f3476ffd640 1 -- 172.21.15.88:0/531429313 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3480076d60 con 0x7f34880cda70 2023-11-27T20:55:11.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.073+0000 7f348c810640 1 -- 172.21.15.88:0/531429313 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f34881ef5e0 con 0x7f34880cda70 2023-11-27T20:55:11.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.079+0000 7f3476ffd640 1 -- 172.21.15.88:0/531429313 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f3480039080 con 0x7f34880cda70 2023-11-27T20:55:11.081 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:55:11.081 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-27T20:55:11.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.081+0000 7f348c810640 1 -- 172.21.15.88:0/531429313 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f346806b1f0 msgr2=0x7f346806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:11.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.081+0000 7f348c810640 1 --2- 172.21.15.88:0/531429313 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f346806b1f0 0x7f346806d6b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f34780016e0 tx=0x7f3478009040 comp rx=0 tx=0).stop 2023-11-27T20:55:11.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.081+0000 7f348c810640 1 -- 172.21.15.88:0/531429313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34880cda70 msgr2=0x7f34881f21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:11.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.081+0000 7f348c810640 1 --2- 172.21.15.88:0/531429313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34880cda70 0x7f34881f21f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3480009eb0 tx=0x7f3480004a40 comp rx=0 tx=0).stop 2023-11-27T20:55:11.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.081+0000 7f348c810640 1 -- 172.21.15.88:0/531429313 shutdown_connections 2023-11-27T20:55:11.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.081+0000 7f348c810640 1 --2- 172.21.15.88:0/531429313 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f346806b1f0 0x7f346806d6b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:11.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.081+0000 7f348c810640 1 --2- 172.21.15.88:0/531429313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34880cda70 0x7f34881f21f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:11.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.081+0000 7f348c810640 1 --2- 172.21.15.88:0/531429313 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34880cc420 0x7f34880b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:11.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.081+0000 7f348c810640 1 --2- 172.21.15.88:0/531429313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34880c9620 0x7f34880c29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:11.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.081+0000 7f348c810640 1 -- 172.21.15.88:0/531429313 >> 172.21.15.88:0/531429313 conn(0x7f34880b07b0 msgr2=0x7f34880c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:11.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.081+0000 7f348c810640 1 -- 172.21.15.88:0/531429313 shutdown_connections 2023-11-27T20:55:11.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.081+0000 7f348c810640 1 -- 172.21.15.88:0/531429313 wait complete. 2023-11-27T20:55:11.094 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-27T20:55:11.094 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:55:11.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.194+0000 7fd60a7f5640 1 Processor -- start 2023-11-27T20:55:11.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.194+0000 7fd60a7f5640 1 -- start start 2023-11-27T20:55:11.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.195+0000 7fd60a7f5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd6040710c0 0x7fd604071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:11.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.195+0000 7fd60a7f5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6041577f0 con 0x7fd604157240 2023-11-27T20:55:11.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.195+0000 7fd60a7f5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd604157a90 con 0x7fd604151220 2023-11-27T20:55:11.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.195+0000 7fd60a7f5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd60406f470 con 0x7fd6040710c0 2023-11-27T20:55:11.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.195+0000 7fd6037fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd604157240 0x7fd6040c40d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46684/0 (socket says 172.21.15.88:46684) 2023-11-27T20:55:11.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.195+0000 7fd6037fe640 1 -- 172.21.15.88:0/3817674336 learned_addr learned my addr 172.21.15.88:0/3817674336 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:55:11.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.196+0000 7fd608d92640 1 --2- 172.21.15.88:0/3817674336 >> v2:172.21.15.167:3300/0 conn(0x7fd6040710c0 0x7fd604071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:11.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.198+0000 7fd602ffd640 1 -- 172.21.15.88:0/3817674336 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874610126 0 0) 0x7fd6041577f0 con 0x7fd604157240 2023-11-27T20:55:11.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.198+0000 7fd602ffd640 1 -- 172.21.15.88:0/3817674336 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5ec003520 con 0x7fd604157240 2023-11-27T20:55:11.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.199+0000 7fd608d92640 1 -- 172.21.15.88:0/3817674336 >> v1:172.21.15.167:6789/0 conn(0x7fd604151220 legacy=0x7fd60406ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:11.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.199+0000 7fd608d92640 1 -- 172.21.15.88:0/3817674336 >> v1:172.21.15.88:6789/0 conn(0x7fd604157240 legacy=0x7fd6040c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:11.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.199+0000 7fd608d92640 1 -- 172.21.15.88:0/3817674336 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd604157d30 con 0x7fd6040710c0 2023-11-27T20:55:11.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.203+0000 7fd608d92640 1 --2- 172.21.15.88:0/3817674336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6040710c0 0x7fd604071530 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd60406f5b0 tx=0x7fd5fc02bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e0b7a886f07a234 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:11.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.207+0000 7fd602ffd640 1 -- 172.21.15.88:0/3817674336 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc02cd80 con 0x7fd6040710c0 2023-11-27T20:55:11.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.207+0000 7fd602ffd640 1 -- 172.21.15.88:0/3817674336 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5fc034440 con 0x7fd6040710c0 2023-11-27T20:55:11.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.207+0000 7fd602ffd640 1 -- 172.21.15.88:0/3817674336 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc0347d0 con 0x7fd6040710c0 2023-11-27T20:55:11.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.208+0000 7fd60a7f5640 1 -- 172.21.15.88:0/3817674336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6040710c0 msgr2=0x7fd604071530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:11.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.208+0000 7fd60a7f5640 1 --2- 172.21.15.88:0/3817674336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6040710c0 0x7fd604071530 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd60406f5b0 tx=0x7fd5fc02bfd0 comp rx=0 tx=0).stop 2023-11-27T20:55:11.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.208+0000 7fd60a7f5640 1 -- 172.21.15.88:0/3817674336 shutdown_connections 2023-11-27T20:55:11.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.208+0000 7fd60a7f5640 1 --2- 172.21.15.88:0/3817674336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6040710c0 0x7fd604071530 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:11.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.208+0000 7fd60a7f5640 1 -- 172.21.15.88:0/3817674336 >> 172.21.15.88:0/3817674336 conn(0x7fd60406c5f0 msgr2=0x7fd60406c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:11.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.208+0000 7fd60a7f5640 1 -- 172.21.15.88:0/3817674336 shutdown_connections 2023-11-27T20:55:11.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.208+0000 7fd60a7f5640 1 -- 172.21.15.88:0/3817674336 wait complete. 2023-11-27T20:55:11.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.209+0000 7fd60a7f5640 1 Processor -- start 2023-11-27T20:55:11.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.209+0000 7fd60a7f5640 1 -- start start 2023-11-27T20:55:11.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.210+0000 7fd60a7f5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6040710c0 0x7fd6041ee170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:11.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.210+0000 7fd60a7f5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd604151220 0x7fd604146a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:11.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.210+0000 7fd60a7f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd604157240 0x7fd604152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:11.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.210+0000 7fd60a7f5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6040cb250 con 0x7fd604151220 2023-11-27T20:55:11.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.210+0000 7fd60a7f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6041eeb60 con 0x7fd604157240 2023-11-27T20:55:11.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.210+0000 7fd60a7f5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6041ee6b0 con 0x7fd6040710c0 2023-11-27T20:55:11.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.210+0000 7fd6037fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd604151220 0x7fd604146a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:11.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.210+0000 7fd608d92640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd604157240 0x7fd604152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:11.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.210+0000 7fd603fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6040710c0 0x7fd6041ee170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:11.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.210+0000 7fd608d92640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd604157240 0x7fd604152010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:58938/0 (socket says 172.21.15.88:58938) 2023-11-27T20:55:11.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.211+0000 7fd608d92640 1 -- 172.21.15.88:0/285478570 learned_addr learned my addr 172.21.15.88:0/285478570 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:11.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.214+0000 7fd6037fe640 1 -- 172.21.15.88:0/285478570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6040710c0 msgr2=0x7fd6041ee170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:11.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.214+0000 7fd6037fe640 1 --2- 172.21.15.88:0/285478570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6040710c0 0x7fd6041ee170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:11.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.214+0000 7fd6037fe640 1 -- 172.21.15.88:0/285478570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd604157240 msgr2=0x7fd604152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:11.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.214+0000 7fd6037fe640 1 --2- 172.21.15.88:0/285478570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd604157240 0x7fd604152010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:11.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.214+0000 7fd6037fe640 1 -- 172.21.15.88:0/285478570 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5fc009a70 con 0x7fd604151220 2023-11-27T20:55:11.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.217+0000 7fd6037fe640 1 --2- 172.21.15.88:0/285478570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd604151220 0x7fd604146a20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800c3c0 tx=0x7fd5f8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:11.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.220+0000 7fd600ff9640 1 -- 172.21.15.88:0/285478570 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8005ce0 con 0x7fd604151220 2023-11-27T20:55:11.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.220+0000 7fd600ff9640 1 -- 172.21.15.88:0/285478570 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f8005e40 con 0x7fd604151220 2023-11-27T20:55:11.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.220+0000 7fd600ff9640 1 -- 172.21.15.88:0/285478570 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f80072d0 con 0x7fd604151220 2023-11-27T20:55:11.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.220+0000 7fd60a7f5640 1 -- 172.21.15.88:0/285478570 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd604153db0 con 0x7fd604151220 2023-11-27T20:55:11.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.220+0000 7fd60a7f5640 1 -- 172.21.15.88:0/285478570 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6041518a0 con 0x7fd604151220 2023-11-27T20:55:11.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.221+0000 7fd60a7f5640 1 -- 172.21.15.88:0/285478570 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd604072020 con 0x7fd604151220 2023-11-27T20:55:11.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.240+0000 7fd600ff9640 1 -- 172.21.15.88:0/285478570 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd5f80074f0 con 0x7fd604151220 2023-11-27T20:55:11.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.240+0000 7fd600ff9640 1 --2- 172.21.15.88:0/285478570 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd5f006b210 0x7fd5f006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:11.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.240+0000 7fd603fff640 1 --2- 172.21.15.88:0/285478570 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd5f006b210 0x7fd5f006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:11.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.241+0000 7fd603fff640 1 --2- 172.21.15.88:0/285478570 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd5f006b210 0x7fd5f006d6d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4001780 tx=0x7fd5f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:11.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.471+0000 7fd600ff9640 1 -- 172.21.15.88:0/285478570 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd5f8013e70 con 0x7fd604151220 2023-11-27T20:55:11.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.472+0000 7fd600ff9640 1 -- 172.21.15.88:0/285478570 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd5f80540f0 con 0x7fd604151220 2023-11-27T20:55:11.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.642+0000 7fd60a7f5640 1 -- 172.21.15.88:0/285478570 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd604067470 con 0x7fd604151220 2023-11-27T20:55:11.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.680+0000 7fd600ff9640 1 -- 172.21.15.88:0/285478570 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18666 (secure 0 0 0) 0x7fd5f8057710 con 0x7fd604151220 2023-11-27T20:55:11.682 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:55:11.682 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":28,"fsid":"ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc","created":"2023-11-27T20:53:53.110827+0000","modified":"2023-11-27T20:55:00.550945+0000","last_up_change":"2023-11-27T20:54:08.219383+0000","last_in_change":"2023-11-27T20:53:59.022798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:54:09.277670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:54:24.503156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:54:25.744043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T20:54:29.704111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1207ca0f-bef1-44c6-b66b-58bf0e080ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6819","nonce":3952326022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6821","nonce":3952326022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6825","nonce":3952326022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6823","nonce":3952326022}]},"public_addr":"172.21.15.88:6819/3952326022","cluster_addr":"172.21.15.88:6821/3952326022","heartbeat_back_addr":"172.21.15.88:6825/3952326022","heartbeat_front_addr":"172.21.15.88:6823/3952326022","state":["exists","up"]},{"osd":1,"uuid":"8d1be479-4241-4335-9633-1394311fde76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6827","nonce":1788401966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6829","nonce":1788401966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6833","nonce":1788401966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6831","nonce":1788401966}]},"public_addr":"172.21.15.88:6827/1788401966","cluster_addr":"172.21.15.88:6829/1788401966","heartbeat_back_addr":"172.21.15.88:6833/1788401966","heartbeat_front_addr":"172.21.15.88:6831/1788401966","state":["exists","up"]},{"osd":2,"uuid":"7536b008-05dd-40eb-9d4a-bdac4b1c38c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6803","nonce":1166333913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6805","nonce":1166333913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6809","nonce":1166333913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6807","nonce":1166333913}]},"public_addr":"172.21.15.88:6803/1166333913","cluster_addr":"172.21.15.88:6805/1166333913","heartbeat_back_addr":"172.21.15.88:6809/1166333913","heartbeat_front_addr":"172.21.15.88:6807/1166333913","state":["exists","up"]},{"osd":3,"uuid":"47edd4d7-e99c-4ce3-851b-cc9c8e2d4480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6811","nonce":406887502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6813","nonce":406887502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6817","nonce":406887502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6815","nonce":406887502}]},"public_addr":"172.21.15.88:6811/406887502","cluster_addr":"172.21.15.88:6813/406887502","heartbeat_back_addr":"172.21.15.88:6817/406887502","heartbeat_front_addr":"172.21.15.88:6815/406887502","state":["exists","up"]},{"osd":4,"uuid":"0a81dd31-1a8b-41af-b933-d74aae63f3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6801","nonce":2551293703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6803","nonce":2551293703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6807","nonce":2551293703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6805","nonce":2551293703}]},"public_addr":"172.21.15.167:6801/2551293703","cluster_addr":"172.21.15.167:6803/2551293703","heartbeat_back_addr":"172.21.15.167:6807/2551293703","heartbeat_front_addr":"172.21.15.167:6805/2551293703","state":["exists","up"]},{"osd":5,"uuid":"1c462d0d-3361-48b3-a82a-86a920539e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6825","nonce":866085094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6827","nonce":866085094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6831","nonce":866085094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6829","nonce":866085094}]},"public_addr":"172.21.15.167:6825/866085094","cluster_addr":"172.21.15.167:6827/866085094","heartbeat_back_addr":"172.21.15.167:6831/866085094","heartbeat_front_addr":"172.21.15.167:6829/866085094","state":["exists","up"]},{"osd":6,"uuid":"d687c5ad-6c88-4a15-8120-0cdbc5610535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6809","nonce":2766725538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6811","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6813","nonce":2766725538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6819","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6821","nonce":2766725538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6815","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6817","nonce":2766725538}]},"public_addr":"172.21.15.167:6809/2766725538","cluster_addr":"172.21.15.167:6813/2766725538","heartbeat_back_addr":"172.21.15.167:6821/2766725538","heartbeat_front_addr":"172.21.15.167:6817/2766725538","state":["exists","up"]},{"osd":7,"uuid":"c9a50596-4981-4bd8-a8ef-d7679f8d9559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6812","nonce":2695037266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6816","nonce":2695037266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6823","nonce":2695037266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6820","nonce":2695037266}]},"public_addr":"172.21.15.167:6812/2695037266","cluster_addr":"172.21.15.167:6816/2695037266","heartbeat_back_addr":"172.21.15.167:6823/2695037266","heartbeat_front_addr":"172.21.15.167:6820/2695037266","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.522590+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.483170+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.492504+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.432204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.414964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.459803+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.437250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.460394+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.1d","mappings":[{"from":0,"to":1}]},{"pgid":"3.35","mappings":[{"from":0,"to":7}]},{"pgid":"4.4","mappings":[{"from":6,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":4}]},{"pgid":"4.e","mappings":[{"from":3,"to":5}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:55:11.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.682+0000 7fd60a7f5640 1 -- 172.21.15.88:0/285478570 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd5f006b210 msgr2=0x7fd5f006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:11.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.682+0000 7fd60a7f5640 1 --2- 172.21.15.88:0/285478570 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd5f006b210 0x7fd5f006d6d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4001780 tx=0x7fd5f4009040 comp rx=0 tx=0).stop 2023-11-27T20:55:11.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.682+0000 7fd60a7f5640 1 -- 172.21.15.88:0/285478570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd604151220 msgr2=0x7fd604146a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:11.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.682+0000 7fd60a7f5640 1 --2- 172.21.15.88:0/285478570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd604151220 0x7fd604146a20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800c3c0 tx=0x7fd5f8001e70 comp rx=0 tx=0).stop 2023-11-27T20:55:11.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.682+0000 7fd60a7f5640 1 -- 172.21.15.88:0/285478570 shutdown_connections 2023-11-27T20:55:11.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.682+0000 7fd60a7f5640 1 --2- 172.21.15.88:0/285478570 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd5f006b210 0x7fd5f006d6d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:11.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.682+0000 7fd60a7f5640 1 --2- 172.21.15.88:0/285478570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd604157240 0x7fd604152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:11.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.682+0000 7fd60a7f5640 1 --2- 172.21.15.88:0/285478570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd604151220 0x7fd604146a20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:11.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.682+0000 7fd60a7f5640 1 --2- 172.21.15.88:0/285478570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6040710c0 0x7fd6041ee170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:11.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.682+0000 7fd60a7f5640 1 -- 172.21.15.88:0/285478570 >> 172.21.15.88:0/285478570 conn(0x7fd60406c5f0 msgr2=0x7fd60414f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:11.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.682+0000 7fd60a7f5640 1 -- 172.21.15.88:0/285478570 shutdown_connections 2023-11-27T20:55:11.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.682+0000 7fd60a7f5640 1 -- 172.21.15.88:0/285478570 wait complete. 2023-11-27T20:55:11.694 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:54:09.277670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:54:24.503156+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:54:25.744043+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-27T20:54:29.704111+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-27T20:55:11.695 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:55:11.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.795+0000 7f4a183d0640 1 Processor -- start 2023-11-27T20:55:11.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.795+0000 7f4a183d0640 1 -- start start 2023-11-27T20:55:11.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.796+0000 7f4a183d0640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4a10153620 0x7f4a100723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:11.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.796+0000 7f4a183d0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4a100c8370 0x7f4a100c8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:11.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.796+0000 7f4a183d0640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1006fe60 con 0x7f4a1006f1d0 2023-11-27T20:55:11.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.796+0000 7f4a183d0640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a100c8d40 con 0x7f4a10153620 2023-11-27T20:55:11.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.796+0000 7f4a183d0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a100c2e00 con 0x7f4a100c8370 2023-11-27T20:55:11.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.797+0000 7f4a1616c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4a10153620 0x7f4a100723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:11.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.797+0000 7f4a1696d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4a100c8370 0x7f4a100c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:11.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.797+0000 7f4a1696d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4a100c8370 0x7f4a100c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:58946/0 (socket says 172.21.15.88:58946) 2023-11-27T20:55:11.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.797+0000 7f4a1696d640 1 -- 172.21.15.88:0/3329150337 learned_addr learned my addr 172.21.15.88:0/3329150337 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:11.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.800+0000 7f4a1696d640 1 -- 172.21.15.88:0/3329150337 >> v2:172.21.15.88:3300/0 conn(0x7f4a10153620 msgr2=0x7f4a100723f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:11.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.800+0000 7f4a1696d640 1 --2- 172.21.15.88:0/3329150337 >> v2:172.21.15.88:3300/0 conn(0x7f4a10153620 0x7f4a100723f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:11.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.800+0000 7f4a1696d640 1 -- 172.21.15.88:0/3329150337 >> v1:172.21.15.88:6789/0 conn(0x7f4a1006f1d0 legacy=0x7f4a10159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:11.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.800+0000 7f4a1696d640 1 -- 172.21.15.88:0/3329150337 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a101597d0 con 0x7f4a100c8370 2023-11-27T20:55:11.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.802+0000 7f4a1696d640 1 --2- 172.21.15.88:0/3329150337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a100c8370 0x7f4a100c8800 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4a10070670 tx=0x7f4a0802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acbbb9887e373954 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:11.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.805+0000 7f4a1516a640 1 -- 172.21.15.88:0/3329150337 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a08031870 con 0x7f4a100c8370 2023-11-27T20:55:11.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.806+0000 7f4a1516a640 1 -- 172.21.15.88:0/3329150337 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a080319d0 con 0x7f4a100c8370 2023-11-27T20:55:11.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.806+0000 7f4a1516a640 1 -- 172.21.15.88:0/3329150337 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a08031d60 con 0x7f4a100c8370 2023-11-27T20:55:11.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.806+0000 7f4a183d0640 1 -- 172.21.15.88:0/3329150337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a100c8370 msgr2=0x7f4a100c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:11.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.806+0000 7f4a183d0640 1 --2- 172.21.15.88:0/3329150337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a100c8370 0x7f4a100c8800 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4a10070670 tx=0x7f4a0802b910 comp rx=0 tx=0).stop 2023-11-27T20:55:11.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.806+0000 7f4a183d0640 1 -- 172.21.15.88:0/3329150337 shutdown_connections 2023-11-27T20:55:11.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.806+0000 7f4a183d0640 1 --2- 172.21.15.88:0/3329150337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a100c8370 0x7f4a100c8800 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:11.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.806+0000 7f4a183d0640 1 --2- 172.21.15.88:0/3329150337 >> v2:172.21.15.88:3300/0 conn(0x7f4a10153620 0x7f4a100723f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:11.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.806+0000 7f4a183d0640 1 -- 172.21.15.88:0/3329150337 >> 172.21.15.88:0/3329150337 conn(0x7f4a1006b5c0 msgr2=0x7f4a1006b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:11.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.806+0000 7f4a183d0640 1 -- 172.21.15.88:0/3329150337 shutdown_connections 2023-11-27T20:55:11.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.806+0000 7f4a183d0640 1 -- 172.21.15.88:0/3329150337 wait complete. 2023-11-27T20:55:11.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.808+0000 7f4a183d0640 1 Processor -- start 2023-11-27T20:55:11.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.808+0000 7f4a183d0640 1 -- start start 2023-11-27T20:55:11.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.808+0000 7f4a183d0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a1006f1d0 0x7f4a100cc400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:11.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.808+0000 7f4a183d0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a100c8370 0x7f4a101e6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:11.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.808+0000 7f4a183d0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a10153620 0x7f4a101ef6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:11.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.808+0000 7f4a183d0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a100cc940 con 0x7f4a1006f1d0 2023-11-27T20:55:11.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.808+0000 7f4a183d0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a10150730 con 0x7f4a100c8370 2023-11-27T20:55:11.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.808+0000 7f4a183d0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1014fe90 con 0x7f4a10153620 2023-11-27T20:55:11.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.809+0000 7f4a1616c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a1006f1d0 0x7f4a100cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:11.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.809+0000 7f4a1596b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a100c8370 0x7f4a101e6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:11.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.809+0000 7f4a1616c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a1006f1d0 0x7f4a100cc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44762/0 (socket says 172.21.15.88:44762) 2023-11-27T20:55:11.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.809+0000 7f4a1616c640 1 -- 172.21.15.88:0/3678488965 learned_addr learned my addr 172.21.15.88:0/3678488965 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:11.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.809+0000 7f4a1696d640 1 --2- 172.21.15.88:0/3678488965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a10153620 0x7f4a101ef6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:11.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.812+0000 7f4a1616c640 1 -- 172.21.15.88:0/3678488965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a10153620 msgr2=0x7f4a101ef6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:11.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.812+0000 7f4a1616c640 1 --2- 172.21.15.88:0/3678488965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a10153620 0x7f4a101ef6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:11.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.812+0000 7f4a1616c640 1 -- 172.21.15.88:0/3678488965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a100c8370 msgr2=0x7f4a101e6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:11.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.812+0000 7f4a1616c640 1 --2- 172.21.15.88:0/3678488965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a100c8370 0x7f4a101e6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:11.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.812+0000 7f4a1616c640 1 -- 172.21.15.88:0/3678488965 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a080094d0 con 0x7f4a1006f1d0 2023-11-27T20:55:11.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.815+0000 7f4a1616c640 1 --2- 172.21.15.88:0/3678488965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a1006f1d0 0x7f4a100cc400 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c00efc0 tx=0x7f4a0c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:11.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.818+0000 7f4a06ffd640 1 -- 172.21.15.88:0/3678488965 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c009b80 con 0x7f4a1006f1d0 2023-11-27T20:55:11.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.818+0000 7f4a06ffd640 1 -- 172.21.15.88:0/3678488965 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0c00f040 con 0x7f4a1006f1d0 2023-11-27T20:55:11.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.818+0000 7f4a06ffd640 1 -- 172.21.15.88:0/3678488965 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c0146a0 con 0x7f4a1006f1d0 2023-11-27T20:55:11.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.818+0000 7f4a183d0640 1 -- 172.21.15.88:0/3678488965 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a10150170 con 0x7f4a1006f1d0 2023-11-27T20:55:11.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.818+0000 7f4a183d0640 1 -- 172.21.15.88:0/3678488965 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a101ef190 con 0x7f4a1006f1d0 2023-11-27T20:55:11.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.819+0000 7f4a183d0640 1 -- 172.21.15.88:0/3678488965 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a10073dc0 con 0x7f4a1006f1d0 2023-11-27T20:55:11.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.838+0000 7f4a06ffd640 1 -- 172.21.15.88:0/3678488965 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4a0c014800 con 0x7f4a1006f1d0 2023-11-27T20:55:11.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.838+0000 7f4a06ffd640 1 --2- 172.21.15.88:0/3678488965 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f49f406b210 0x7f49f406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:11.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.838+0000 7f4a1596b640 1 --2- 172.21.15.88:0/3678488965 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f49f406b210 0x7f49f406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:11.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:11.839+0000 7f4a1596b640 1 --2- 172.21.15.88:0/3678488965 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f49f406b210 0x7f49f406d6d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4a100c88c0 tx=0x7f4a00009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:12.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.074+0000 7f4a06ffd640 1 -- 172.21.15.88:0/3678488965 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4a0c0596d0 con 0x7f4a1006f1d0 2023-11-27T20:55:12.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.074+0000 7f4a06ffd640 1 -- 172.21.15.88:0/3678488965 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4a0c055a10 con 0x7f4a1006f1d0 2023-11-27T20:55:12.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.250+0000 7f4a183d0640 1 -- 172.21.15.88:0/3678488965 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4a10071bb0 con 0x7f4a1006f1d0 2023-11-27T20:55:12.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.263+0000 7f4a06ffd640 1 -- 172.21.15.88:0/3678488965 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4a0c059030 con 0x7f4a1006f1d0 2023-11-27T20:55:12.265 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-27T20:55:12.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.265+0000 7f4a183d0640 1 -- 172.21.15.88:0/3678488965 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f49f406b210 msgr2=0x7f49f406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:12.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.265+0000 7f4a183d0640 1 --2- 172.21.15.88:0/3678488965 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f49f406b210 0x7f49f406d6d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4a100c88c0 tx=0x7f4a00009040 comp rx=0 tx=0).stop 2023-11-27T20:55:12.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.265+0000 7f4a183d0640 1 -- 172.21.15.88:0/3678488965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a1006f1d0 msgr2=0x7f4a100cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:12.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.265+0000 7f4a183d0640 1 --2- 172.21.15.88:0/3678488965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a1006f1d0 0x7f4a100cc400 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c00efc0 tx=0x7f4a0c00c490 comp rx=0 tx=0).stop 2023-11-27T20:55:12.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.265+0000 7f4a183d0640 1 -- 172.21.15.88:0/3678488965 shutdown_connections 2023-11-27T20:55:12.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.265+0000 7f4a183d0640 1 --2- 172.21.15.88:0/3678488965 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f49f406b210 0x7f49f406d6d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:12.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.265+0000 7f4a183d0640 1 --2- 172.21.15.88:0/3678488965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a10153620 0x7f4a101ef6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:12.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.265+0000 7f4a183d0640 1 --2- 172.21.15.88:0/3678488965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a100c8370 0x7f4a101e6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:12.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.265+0000 7f4a183d0640 1 --2- 172.21.15.88:0/3678488965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a1006f1d0 0x7f4a100cc400 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:12.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.265+0000 7f4a183d0640 1 -- 172.21.15.88:0/3678488965 >> 172.21.15.88:0/3678488965 conn(0x7f4a1006b5c0 msgr2=0x7f4a101e2870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:12.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.265+0000 7f4a183d0640 1 -- 172.21.15.88:0/3678488965 shutdown_connections 2023-11-27T20:55:12.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.265+0000 7f4a183d0640 1 -- 172.21.15.88:0/3678488965 wait complete. 2023-11-27T20:55:12.278 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:55:12.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.381+0000 7fb773e61640 1 Processor -- start 2023-11-27T20:55:12.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.381+0000 7fb773e61640 1 -- start start 2023-11-27T20:55:12.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.382+0000 7fb773e61640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb76c13d1a0 0x7fb76c15adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:12.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.382+0000 7fb773e61640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb76c15b330 0x7fb76c13fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:12.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.382+0000 7fb773e61640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb76c1403a0 0x7fb76c0c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:12.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.382+0000 7fb773e61640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb76c157140 con 0x7fb76c15b330 2023-11-27T20:55:12.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.382+0000 7fb773e61640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb76c06a770 con 0x7fb76c13d1a0 2023-11-27T20:55:12.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.382+0000 7fb773e61640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c0c8180 con 0x7fb76c1403a0 2023-11-27T20:55:12.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.383+0000 7fb7713fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb76c15b330 0x7fb76c13fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:12.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.383+0000 7fb771bfd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb76c13d1a0 0x7fb76c15adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:12.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.383+0000 7fb7713fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb76c15b330 0x7fb76c13fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44764/0 (socket says 172.21.15.88:44764) 2023-11-27T20:55:12.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.383+0000 7fb7713fc640 1 -- 172.21.15.88:0/103486152 learned_addr learned my addr 172.21.15.88:0/103486152 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:12.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.383+0000 7fb7723fe640 1 --2- 172.21.15.88:0/103486152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb76c1403a0 0x7fb76c0c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:12.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.385+0000 7fb7713fc640 1 -- 172.21.15.88:0/103486152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb76c1403a0 msgr2=0x7fb76c0c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:12.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.385+0000 7fb7713fc640 1 --2- 172.21.15.88:0/103486152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb76c1403a0 0x7fb76c0c4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:12.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.385+0000 7fb7713fc640 1 -- 172.21.15.88:0/103486152 >> v2:172.21.15.167:3300/0 conn(0x7fb76c13d1a0 msgr2=0x7fb76c15adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:12.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.385+0000 7fb7713fc640 1 --2- 172.21.15.88:0/103486152 >> v2:172.21.15.167:3300/0 conn(0x7fb76c13d1a0 0x7fb76c15adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:12.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.385+0000 7fb7713fc640 1 -- 172.21.15.88:0/103486152 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76c0c8460 con 0x7fb76c15b330 2023-11-27T20:55:12.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.387+0000 7fb7713fc640 1 --2- 172.21.15.88:0/103486152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb76c15b330 0x7fb76c13fe60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb76c071e40 tx=0x7fb75c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48a004f6e101f92 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:12.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.391+0000 7fb770bfb640 1 -- 172.21.15.88:0/103486152 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c030860 con 0x7fb76c15b330 2023-11-27T20:55:12.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.391+0000 7fb770bfb640 1 -- 172.21.15.88:0/103486152 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75c0309c0 con 0x7fb76c15b330 2023-11-27T20:55:12.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.391+0000 7fb770bfb640 1 -- 172.21.15.88:0/103486152 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c030d50 con 0x7fb76c15b330 2023-11-27T20:55:12.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.392+0000 7fb773e61640 1 -- 172.21.15.88:0/103486152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb76c15b330 msgr2=0x7fb76c13fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:12.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.392+0000 7fb773e61640 1 --2- 172.21.15.88:0/103486152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb76c15b330 0x7fb76c13fe60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb76c071e40 tx=0x7fb75c02b9a0 comp rx=0 tx=0).stop 2023-11-27T20:55:12.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.392+0000 7fb773e61640 1 -- 172.21.15.88:0/103486152 shutdown_connections 2023-11-27T20:55:12.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.392+0000 7fb773e61640 1 --2- 172.21.15.88:0/103486152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb76c1403a0 0x7fb76c0c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:12.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.392+0000 7fb773e61640 1 --2- 172.21.15.88:0/103486152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb76c15b330 0x7fb76c13fe60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:12.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.392+0000 7fb773e61640 1 --2- 172.21.15.88:0/103486152 >> v2:172.21.15.167:3300/0 conn(0x7fb76c13d1a0 0x7fb76c15adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:12.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.392+0000 7fb773e61640 1 -- 172.21.15.88:0/103486152 >> 172.21.15.88:0/103486152 conn(0x7fb76c0712f0 msgr2=0x7fb76c0716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:12.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.392+0000 7fb773e61640 1 -- 172.21.15.88:0/103486152 shutdown_connections 2023-11-27T20:55:12.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.392+0000 7fb773e61640 1 -- 172.21.15.88:0/103486152 wait complete. 2023-11-27T20:55:12.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.393+0000 7fb773e61640 1 Processor -- start 2023-11-27T20:55:12.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.393+0000 7fb773e61640 1 -- start start 2023-11-27T20:55:12.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.394+0000 7fb773e61640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb76c13d1a0 0x7fb76c0cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:12.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.394+0000 7fb773e61640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb76c1403a0 0x7fb76c1e0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:12.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.394+0000 7fb773e61640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb76c15b330 0x7fb76c1e1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:12.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.394+0000 7fb773e61640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c0c76a0 con 0x7fb76c1403a0 2023-11-27T20:55:12.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.394+0000 7fb773e61640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c13f720 con 0x7fb76c13d1a0 2023-11-27T20:55:12.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.394+0000 7fb773e61640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c1f3080 con 0x7fb76c15b330 2023-11-27T20:55:12.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.394+0000 7fb771bfd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb76c13d1a0 0x7fb76c0cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:12.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.394+0000 7fb7713fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb76c1403a0 0x7fb76c1e0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:12.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.394+0000 7fb7723fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb76c15b330 0x7fb76c1e1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:12.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.394+0000 7fb7713fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb76c1403a0 0x7fb76c1e0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44772/0 (socket says 172.21.15.88:44772) 2023-11-27T20:55:12.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.394+0000 7fb7713fc640 1 -- 172.21.15.88:0/3679656405 learned_addr learned my addr 172.21.15.88:0/3679656405 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:12.398 INFO:tasks.ceph.mds.c.smithi088.stderr:2023-11-27T20:55:12.396+0000 f5b2640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2023-11-27T20:55:12.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.398+0000 7fb7713fc640 1 -- 172.21.15.88:0/3679656405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb76c15b330 msgr2=0x7fb76c1e1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:12.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.398+0000 7fb7713fc640 1 --2- 172.21.15.88:0/3679656405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb76c15b330 0x7fb76c1e1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:12.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.398+0000 7fb7713fc640 1 -- 172.21.15.88:0/3679656405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb76c13d1a0 msgr2=0x7fb76c0cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:12.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.398+0000 7fb7713fc640 1 --2- 172.21.15.88:0/3679656405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb76c13d1a0 0x7fb76c0cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:12.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.398+0000 7fb7713fc640 1 -- 172.21.15.88:0/3679656405 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c0094d0 con 0x7fb76c1403a0 2023-11-27T20:55:12.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.400+0000 7fb7713fc640 1 --2- 172.21.15.88:0/3679656405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb76c1403a0 0x7fb76c1e0d10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb75c000c00 tx=0x7fb75c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:12.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.404+0000 7fb7627fc640 1 -- 172.21.15.88:0/3679656405 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c039c90 con 0x7fb76c1403a0 2023-11-27T20:55:12.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.404+0000 7fb7627fc640 1 -- 172.21.15.88:0/3679656405 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75c039df0 con 0x7fb76c1403a0 2023-11-27T20:55:12.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.404+0000 7fb773e61640 1 -- 172.21.15.88:0/3679656405 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb76c1f3360 con 0x7fb76c1403a0 2023-11-27T20:55:12.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.404+0000 7fb7627fc640 1 -- 172.21.15.88:0/3679656405 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c043640 con 0x7fb76c1403a0 2023-11-27T20:55:12.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.404+0000 7fb773e61640 1 -- 172.21.15.88:0/3679656405 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb76c1e3000 con 0x7fb76c1403a0 2023-11-27T20:55:12.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.405+0000 7fb773e61640 1 -- 172.21.15.88:0/3679656405 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb76c13f290 con 0x7fb76c1403a0 2023-11-27T20:55:12.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.422+0000 7fb7627fc640 1 -- 172.21.15.88:0/3679656405 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb75c0437a0 con 0x7fb76c1403a0 2023-11-27T20:55:12.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.423+0000 7fb7627fc640 1 --2- 172.21.15.88:0/3679656405 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb75006b210 0x7fb75006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:12.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.423+0000 7fb771bfd640 1 --2- 172.21.15.88:0/3679656405 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb75006b210 0x7fb75006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:12.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.423+0000 7fb771bfd640 1 --2- 172.21.15.88:0/3679656405 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb75006b210 0x7fb75006d6d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb768011200 tx=0x7fb76800d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:12.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.426+0000 7fb7627fc640 1 -- 172.21.15.88:0/3679656405 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb75c03e070 con 0x7fb76c1403a0 2023-11-27T20:55:12.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.673+0000 7fb7627fc640 1 -- 172.21.15.88:0/3679656405 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb75c077fe0 con 0x7fb76c1403a0 2023-11-27T20:55:12.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.844+0000 7fb773e61640 1 -- 172.21.15.88:0/3679656405 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb76c13f290 con 0x7fb76c1403a0 2023-11-27T20:55:12.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.849+0000 7fb7627fc640 1 -- 172.21.15.88:0/3679656405 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb76c13f290 con 0x7fb76c1403a0 2023-11-27T20:55:12.851 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-27T20:55:12.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.851+0000 7fb773e61640 1 -- 172.21.15.88:0/3679656405 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb75006b210 msgr2=0x7fb75006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:12.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.851+0000 7fb773e61640 1 --2- 172.21.15.88:0/3679656405 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb75006b210 0x7fb75006d6d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb768011200 tx=0x7fb76800d040 comp rx=0 tx=0).stop 2023-11-27T20:55:12.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.851+0000 7fb773e61640 1 -- 172.21.15.88:0/3679656405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb76c1403a0 msgr2=0x7fb76c1e0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:12.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.851+0000 7fb773e61640 1 --2- 172.21.15.88:0/3679656405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb76c1403a0 0x7fb76c1e0d10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb75c000c00 tx=0x7fb75c004730 comp rx=0 tx=0).stop 2023-11-27T20:55:12.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.851+0000 7fb773e61640 1 -- 172.21.15.88:0/3679656405 shutdown_connections 2023-11-27T20:55:12.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.851+0000 7fb773e61640 1 --2- 172.21.15.88:0/3679656405 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb75006b210 0x7fb75006d6d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:12.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.851+0000 7fb773e61640 1 --2- 172.21.15.88:0/3679656405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb76c15b330 0x7fb76c1e1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:12.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.851+0000 7fb773e61640 1 --2- 172.21.15.88:0/3679656405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb76c1403a0 0x7fb76c1e0d10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:12.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.851+0000 7fb773e61640 1 --2- 172.21.15.88:0/3679656405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb76c13d1a0 0x7fb76c0cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:12.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.851+0000 7fb773e61640 1 -- 172.21.15.88:0/3679656405 >> 172.21.15.88:0/3679656405 conn(0x7fb76c0712f0 msgr2=0x7fb76c13a030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:12.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.851+0000 7fb773e61640 1 -- 172.21.15.88:0/3679656405 shutdown_connections 2023-11-27T20:55:12.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.851+0000 7fb773e61640 1 -- 172.21.15.88:0/3679656405 wait complete. 2023-11-27T20:55:12.864 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:55:12.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.978+0000 7fb413fec640 1 Processor -- start 2023-11-27T20:55:12.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.978+0000 7fb413fec640 1 -- start start 2023-11-27T20:55:12.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.979+0000 7fb413fec640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb40c151680 0x7fb40c1571d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:12.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.979+0000 7fb413fec640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb40c06f3f0 0x7fb40c0c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:12.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.979+0000 7fb413fec640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb40c06f810 0x7fb40c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:12.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.979+0000 7fb413fec640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb40c157880 con 0x7fb40c151680 2023-11-27T20:55:12.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.979+0000 7fb413fec640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb40c157b60 con 0x7fb40c06f3f0 2023-11-27T20:55:12.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.979+0000 7fb413fec640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb40c157e40 con 0x7fb40c06f810 2023-11-27T20:55:12.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.980+0000 7fb411d88640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb40c151680 0x7fb40c1571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:12.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.980+0000 7fb411587640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb40c06f3f0 0x7fb40c0c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:12.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.980+0000 7fb411d88640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb40c151680 0x7fb40c1571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44774/0 (socket says 172.21.15.88:44774) 2023-11-27T20:55:12.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.980+0000 7fb411d88640 1 -- 172.21.15.88:0/73394069 learned_addr learned my addr 172.21.15.88:0/73394069 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:12.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.980+0000 7fb412589640 1 --2- 172.21.15.88:0/73394069 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb40c06f810 0x7fb40c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:12.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.982+0000 7fb411d88640 1 -- 172.21.15.88:0/73394069 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb40c06f810 msgr2=0x7fb40c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:12.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.982+0000 7fb411d88640 1 --2- 172.21.15.88:0/73394069 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb40c06f810 0x7fb40c0ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:12.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.982+0000 7fb411d88640 1 -- 172.21.15.88:0/73394069 >> v2:172.21.15.167:3300/0 conn(0x7fb40c06f3f0 msgr2=0x7fb40c0c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:12.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.982+0000 7fb411d88640 1 --2- 172.21.15.88:0/73394069 >> v2:172.21.15.167:3300/0 conn(0x7fb40c06f3f0 0x7fb40c0c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:12.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.982+0000 7fb411d88640 1 -- 172.21.15.88:0/73394069 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40c158120 con 0x7fb40c151680 2023-11-27T20:55:12.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.984+0000 7fb411d88640 1 --2- 172.21.15.88:0/73394069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb40c151680 0x7fb40c1571d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb40c0c7850 tx=0x7fb40802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fb01a52a678c36 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:12.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.988+0000 7fb410d86640 1 -- 172.21.15.88:0/73394069 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40802cb00 con 0x7fb40c151680 2023-11-27T20:55:12.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.988+0000 7fb410d86640 1 -- 172.21.15.88:0/73394069 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40802cc60 con 0x7fb40c151680 2023-11-27T20:55:12.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.988+0000 7fb410d86640 1 -- 172.21.15.88:0/73394069 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4080343f0 con 0x7fb40c151680 2023-11-27T20:55:12.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.988+0000 7fb413fec640 1 -- 172.21.15.88:0/73394069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb40c151680 msgr2=0x7fb40c1571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:12.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.988+0000 7fb413fec640 1 --2- 172.21.15.88:0/73394069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb40c151680 0x7fb40c1571d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb40c0c7850 tx=0x7fb40802bf60 comp rx=0 tx=0).stop 2023-11-27T20:55:12.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.988+0000 7fb413fec640 1 -- 172.21.15.88:0/73394069 shutdown_connections 2023-11-27T20:55:12.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.988+0000 7fb413fec640 1 --2- 172.21.15.88:0/73394069 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb40c06f810 0x7fb40c0ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:12.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.988+0000 7fb413fec640 1 --2- 172.21.15.88:0/73394069 >> v2:172.21.15.167:3300/0 conn(0x7fb40c06f3f0 0x7fb40c0c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:12.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.988+0000 7fb413fec640 1 --2- 172.21.15.88:0/73394069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb40c151680 0x7fb40c1571d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:12.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.988+0000 7fb413fec640 1 -- 172.21.15.88:0/73394069 >> 172.21.15.88:0/73394069 conn(0x7fb40c0707f0 msgr2=0x7fb40c070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:12.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.989+0000 7fb413fec640 1 -- 172.21.15.88:0/73394069 shutdown_connections 2023-11-27T20:55:12.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.989+0000 7fb413fec640 1 -- 172.21.15.88:0/73394069 wait complete. 2023-11-27T20:55:12.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.990+0000 7fb413fec640 1 Processor -- start 2023-11-27T20:55:12.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.990+0000 7fb413fec640 1 -- start start 2023-11-27T20:55:12.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.991+0000 7fb413fec640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb40c06f3f0 0x7fb40c1ed530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:12.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.991+0000 7fb413fec640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb40c06f810 0x7fb40c158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:12.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.991+0000 7fb413fec640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb40c151680 0x7fb40c0cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:12.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.991+0000 7fb413fec640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40c1ed110 con 0x7fb40c06f810 2023-11-27T20:55:12.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.991+0000 7fb413fec640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40c157320 con 0x7fb40c151680 2023-11-27T20:55:12.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.991+0000 7fb413fec640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb40c159ff0 con 0x7fb40c06f3f0 2023-11-27T20:55:12.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.991+0000 7fb411587640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb40c06f810 0x7fb40c158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:12.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.991+0000 7fb411587640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb40c06f810 0x7fb40c158390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44790/0 (socket says 172.21.15.88:44790) 2023-11-27T20:55:12.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.991+0000 7fb411587640 1 -- 172.21.15.88:0/4133534091 learned_addr learned my addr 172.21.15.88:0/4133534091 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:12.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.991+0000 7fb412589640 1 --2- 172.21.15.88:0/4133534091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb40c151680 0x7fb40c0cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:12.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.991+0000 7fb411d88640 1 --2- 172.21.15.88:0/4133534091 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb40c06f3f0 0x7fb40c1ed530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:12.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.995+0000 7fb411587640 1 -- 172.21.15.88:0/4133534091 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb40c06f3f0 msgr2=0x7fb40c1ed530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:12.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.995+0000 7fb411587640 1 --2- 172.21.15.88:0/4133534091 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb40c06f3f0 0x7fb40c1ed530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:12.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.995+0000 7fb411587640 1 -- 172.21.15.88:0/4133534091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb40c151680 msgr2=0x7fb40c0cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:12.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.995+0000 7fb411587640 1 --2- 172.21.15.88:0/4133534091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb40c151680 0x7fb40c0cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:12.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.995+0000 7fb411587640 1 -- 172.21.15.88:0/4133534091 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb408009b30 con 0x7fb40c06f810 2023-11-27T20:55:12.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:12.997+0000 7fb411587640 1 --2- 172.21.15.88:0/4133534091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb40c06f810 0x7fb40c158390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00e870 tx=0x7fb3fc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:13.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.000+0000 7fb4027fc640 1 -- 172.21.15.88:0/4133534091 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc0094f0 con 0x7fb40c06f810 2023-11-27T20:55:13.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.000+0000 7fb4027fc640 1 -- 172.21.15.88:0/4133534091 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3fc00c940 con 0x7fb40c06f810 2023-11-27T20:55:13.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.000+0000 7fb413fec640 1 -- 172.21.15.88:0/4133534091 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb40c15a2d0 con 0x7fb40c06f810 2023-11-27T20:55:13.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.000+0000 7fb4027fc640 1 -- 172.21.15.88:0/4133534091 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc00ccf0 con 0x7fb40c06f810 2023-11-27T20:55:13.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.000+0000 7fb413fec640 1 -- 172.21.15.88:0/4133534091 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40c1eca50 con 0x7fb40c06f810 2023-11-27T20:55:13.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.001+0000 7fb413fec640 1 -- 172.21.15.88:0/4133534091 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb40c1ed250 con 0x7fb40c06f810 2023-11-27T20:55:13.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.018+0000 7fb4027fc640 1 -- 172.21.15.88:0/4133534091 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb3fc013470 con 0x7fb40c06f810 2023-11-27T20:55:13.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.019+0000 7fb4027fc640 1 --2- 172.21.15.88:0/4133534091 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb3f006b210 0x7fb3f006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:13.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.019+0000 7fb411d88640 1 --2- 172.21.15.88:0/4133534091 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb3f006b210 0x7fb3f006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:13.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.019+0000 7fb411d88640 1 --2- 172.21.15.88:0/4133534091 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb3f006b210 0x7fb3f006d6d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb408035000 tx=0x7fb408030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:13.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.021+0000 7fb4027fc640 1 -- 172.21.15.88:0/4133534091 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb3fc058b30 con 0x7fb40c06f810 2023-11-27T20:55:13.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.257+0000 7fb4027fc640 1 -- 172.21.15.88:0/4133534091 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb3fc054e70 con 0x7fb40c06f810 2023-11-27T20:55:13.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.427+0000 7fb413fec640 1 -- 172.21.15.88:0/4133534091 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb40c1ed250 con 0x7fb40c06f810 2023-11-27T20:55:13.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.432+0000 7fb4027fc640 1 -- 172.21.15.88:0/4133534091 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb40c1ed250 con 0x7fb40c06f810 2023-11-27T20:55:13.433 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-11-27T20:55:13.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.434+0000 7fb413fec640 1 -- 172.21.15.88:0/4133534091 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb3f006b210 msgr2=0x7fb3f006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:13.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.434+0000 7fb413fec640 1 --2- 172.21.15.88:0/4133534091 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb3f006b210 0x7fb3f006d6d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb408035000 tx=0x7fb408030000 comp rx=0 tx=0).stop 2023-11-27T20:55:13.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.434+0000 7fb413fec640 1 -- 172.21.15.88:0/4133534091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb40c06f810 msgr2=0x7fb40c158390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:13.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.434+0000 7fb413fec640 1 --2- 172.21.15.88:0/4133534091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb40c06f810 0x7fb40c158390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00e870 tx=0x7fb3fc00ed30 comp rx=0 tx=0).stop 2023-11-27T20:55:13.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.434+0000 7fb413fec640 1 -- 172.21.15.88:0/4133534091 shutdown_connections 2023-11-27T20:55:13.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.434+0000 7fb413fec640 1 --2- 172.21.15.88:0/4133534091 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb3f006b210 0x7fb3f006d6d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:13.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.434+0000 7fb413fec640 1 --2- 172.21.15.88:0/4133534091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb40c151680 0x7fb40c0cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:13.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.434+0000 7fb413fec640 1 --2- 172.21.15.88:0/4133534091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb40c06f810 0x7fb40c158390 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:13.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.434+0000 7fb413fec640 1 --2- 172.21.15.88:0/4133534091 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb40c06f3f0 0x7fb40c1ed530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:13.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.434+0000 7fb413fec640 1 -- 172.21.15.88:0/4133534091 >> 172.21.15.88:0/4133534091 conn(0x7fb40c0707f0 msgr2=0x7fb40c0b1390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:13.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.434+0000 7fb413fec640 1 -- 172.21.15.88:0/4133534091 shutdown_connections 2023-11-27T20:55:13.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.434+0000 7fb413fec640 1 -- 172.21.15.88:0/4133534091 wait complete. 2023-11-27T20:55:13.447 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-27T20:55:13.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.547+0000 7f57ef79e640 1 Processor -- start 2023-11-27T20:55:13.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.548+0000 7f57ef79e640 1 -- start start 2023-11-27T20:55:13.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.548+0000 7f57ef79e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57e8151680 0x7f57e81571d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:13.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.548+0000 7f57ef79e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f57e806f3f0 0x7f57e80c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:13.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.548+0000 7f57ef79e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f57e806f810 0x7f57e80ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:13.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.548+0000 7f57ef79e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e8157880 con 0x7f57e806f810 2023-11-27T20:55:13.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.548+0000 7f57ef79e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e8157b60 con 0x7f57e806f3f0 2023-11-27T20:55:13.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.548+0000 7f57ef79e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e8157e40 con 0x7f57e8151680 2023-11-27T20:55:13.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.549+0000 7f57edd3b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f57e806f810 0x7f57e80ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:13.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.549+0000 7f57ed53a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57e8151680 0x7f57e81571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:13.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.549+0000 7f57ed53a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57e8151680 0x7f57e81571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:35166/0 (socket says 172.21.15.88:35166) 2023-11-27T20:55:13.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.549+0000 7f57ed53a640 1 -- 172.21.15.88:0/2544099666 learned_addr learned my addr 172.21.15.88:0/2544099666 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:13.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.550+0000 7f57ecd39640 1 --2- 172.21.15.88:0/2544099666 >> v2:172.21.15.167:3300/0 conn(0x7f57e806f3f0 0x7f57e80c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:13.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.551+0000 7f57ed53a640 1 -- 172.21.15.88:0/2544099666 >> v2:172.21.15.167:3300/0 conn(0x7f57e806f3f0 msgr2=0x7f57e80c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:13.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.551+0000 7f57ed53a640 1 --2- 172.21.15.88:0/2544099666 >> v2:172.21.15.167:3300/0 conn(0x7f57e806f3f0 0x7f57e80c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:13.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.551+0000 7f57ed53a640 1 -- 172.21.15.88:0/2544099666 >> v2:172.21.15.88:3300/0 conn(0x7f57e806f810 msgr2=0x7f57e80ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:13.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.551+0000 7f57ed53a640 1 --2- 172.21.15.88:0/2544099666 >> v2:172.21.15.88:3300/0 conn(0x7f57e806f810 0x7f57e80ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:13.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.551+0000 7f57ed53a640 1 -- 172.21.15.88:0/2544099666 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e8158120 con 0x7f57e8151680 2023-11-27T20:55:13.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.553+0000 7f57ed53a640 1 --2- 172.21.15.88:0/2544099666 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57e8151680 0x7f57e81571d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f57e80cd730 tx=0x7f57e402b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f269412deee40c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:13.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.557+0000 7f57dffff640 1 -- 172.21.15.88:0/2544099666 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e4030860 con 0x7f57e8151680 2023-11-27T20:55:13.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.557+0000 7f57dffff640 1 -- 172.21.15.88:0/2544099666 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e40309c0 con 0x7f57e8151680 2023-11-27T20:55:13.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.557+0000 7f57dffff640 1 -- 172.21.15.88:0/2544099666 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e4030d50 con 0x7f57e8151680 2023-11-27T20:55:13.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.558+0000 7f57ef79e640 1 -- 172.21.15.88:0/2544099666 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57e8151680 msgr2=0x7f57e81571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:13.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.558+0000 7f57ef79e640 1 --2- 172.21.15.88:0/2544099666 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57e8151680 0x7f57e81571d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f57e80cd730 tx=0x7f57e402b9a0 comp rx=0 tx=0).stop 2023-11-27T20:55:13.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.558+0000 7f57ef79e640 1 -- 172.21.15.88:0/2544099666 shutdown_connections 2023-11-27T20:55:13.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.558+0000 7f57ef79e640 1 --2- 172.21.15.88:0/2544099666 >> v2:172.21.15.88:3300/0 conn(0x7f57e806f810 0x7f57e80ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:13.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.558+0000 7f57ef79e640 1 --2- 172.21.15.88:0/2544099666 >> v2:172.21.15.167:3300/0 conn(0x7f57e806f3f0 0x7f57e80c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:13.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.558+0000 7f57ef79e640 1 --2- 172.21.15.88:0/2544099666 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57e8151680 0x7f57e81571d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:13.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.558+0000 7f57ef79e640 1 -- 172.21.15.88:0/2544099666 >> 172.21.15.88:0/2544099666 conn(0x7f57e80707f0 msgr2=0x7f57e8070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:13.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.558+0000 7f57ef79e640 1 -- 172.21.15.88:0/2544099666 shutdown_connections 2023-11-27T20:55:13.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.558+0000 7f57ef79e640 1 -- 172.21.15.88:0/2544099666 wait complete. 2023-11-27T20:55:13.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.559+0000 7f57ef79e640 1 Processor -- start 2023-11-27T20:55:13.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.559+0000 7f57ef79e640 1 -- start start 2023-11-27T20:55:13.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.560+0000 7f57ef79e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57e806f3f0 0x7f57e814b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:13.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.560+0000 7f57ef79e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57e806f810 0x7f57e81edda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:13.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.560+0000 7f57ef79e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57e8151680 0x7f57e81ee2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:13.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.560+0000 7f57ef79e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e80ca930 con 0x7f57e806f810 2023-11-27T20:55:13.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.560+0000 7f57ef79e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e80b2b70 con 0x7f57e8151680 2023-11-27T20:55:13.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.560+0000 7f57ef79e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e80cab40 con 0x7f57e806f3f0 2023-11-27T20:55:13.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.560+0000 7f57ecd39640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57e806f810 0x7f57e81edda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:13.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.560+0000 7f57edd3b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57e8151680 0x7f57e81ee2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:13.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.560+0000 7f57ed53a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57e806f3f0 0x7f57e814b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:13.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.560+0000 7f57ecd39640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57e806f810 0x7f57e81edda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44802/0 (socket says 172.21.15.88:44802) 2023-11-27T20:55:13.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.560+0000 7f57ecd39640 1 -- 172.21.15.88:0/1641823967 learned_addr learned my addr 172.21.15.88:0/1641823967 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:13.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.564+0000 7f57ecd39640 1 -- 172.21.15.88:0/1641823967 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57e806f3f0 msgr2=0x7f57e814b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:13.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.564+0000 7f57ecd39640 1 --2- 172.21.15.88:0/1641823967 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57e806f3f0 0x7f57e814b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:13.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.564+0000 7f57ecd39640 1 -- 172.21.15.88:0/1641823967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57e8151680 msgr2=0x7f57e81ee2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:13.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.564+0000 7f57ecd39640 1 --2- 172.21.15.88:0/1641823967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57e8151680 0x7f57e81ee2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:13.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.564+0000 7f57ecd39640 1 -- 172.21.15.88:0/1641823967 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e40094d0 con 0x7f57e806f810 2023-11-27T20:55:13.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.566+0000 7f57ecd39640 1 --2- 172.21.15.88:0/1641823967 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57e806f810 0x7f57e81edda0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f57d800e9e0 tx=0x7f57d800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:13.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.569+0000 7f57ddffb640 1 -- 172.21.15.88:0/1641823967 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8009670 con 0x7f57e806f810 2023-11-27T20:55:13.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.569+0000 7f57ddffb640 1 -- 172.21.15.88:0/1641823967 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d800c9d0 con 0x7f57e806f810 2023-11-27T20:55:13.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.569+0000 7f57ddffb640 1 -- 172.21.15.88:0/1641823967 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d800cd80 con 0x7f57e806f810 2023-11-27T20:55:13.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.569+0000 7f57ef79e640 1 -- 172.21.15.88:0/1641823967 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e80cae20 con 0x7f57e806f810 2023-11-27T20:55:13.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.570+0000 7f57ef79e640 1 -- 172.21.15.88:0/1641823967 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e80cb3e0 con 0x7f57e806f810 2023-11-27T20:55:13.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.571+0000 7f57ef79e640 1 -- 172.21.15.88:0/1641823967 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57e8073dc0 con 0x7f57e806f810 2023-11-27T20:55:13.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.589+0000 7f57ddffb640 1 -- 172.21.15.88:0/1641823967 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f57d8013470 con 0x7f57e806f810 2023-11-27T20:55:13.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.589+0000 7f57ddffb640 1 --2- 172.21.15.88:0/1641823967 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f57cc06b210 0x7f57cc06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:13.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.589+0000 7f57ed53a640 1 --2- 172.21.15.88:0/1641823967 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f57cc06b210 0x7f57cc06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:13.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.590+0000 7f57ed53a640 1 --2- 172.21.15.88:0/1641823967 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f57cc06b210 0x7f57cc06d6d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f57e4036000 tx=0x7f57e4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:13.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.591+0000 7f57ddffb640 1 -- 172.21.15.88:0/1641823967 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f57d8058e10 con 0x7f57e806f810 2023-11-27T20:55:13.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.821+0000 7f57ddffb640 1 -- 172.21.15.88:0/1641823967 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f57d8055150 con 0x7f57e806f810 2023-11-27T20:55:13.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.992+0000 7f57ef79e640 1 -- 172.21.15.88:0/1641823967 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f57e80c8400 con 0x7f57e806f810 2023-11-27T20:55:13.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:13.997+0000 7f57ddffb640 1 -- 172.21.15.88:0/1641823967 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f57d8021020 con 0x7f57e806f810 2023-11-27T20:55:13.999 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-27T20:55:14.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.000+0000 7f57ef79e640 1 -- 172.21.15.88:0/1641823967 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f57cc06b210 msgr2=0x7f57cc06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:14.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.000+0000 7f57ef79e640 1 --2- 172.21.15.88:0/1641823967 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f57cc06b210 0x7f57cc06d6d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f57e4036000 tx=0x7f57e4008030 comp rx=0 tx=0).stop 2023-11-27T20:55:14.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.000+0000 7f57ef79e640 1 -- 172.21.15.88:0/1641823967 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57e806f810 msgr2=0x7f57e81edda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:14.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.000+0000 7f57ef79e640 1 --2- 172.21.15.88:0/1641823967 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57e806f810 0x7f57e81edda0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f57d800e9e0 tx=0x7f57d800eea0 comp rx=0 tx=0).stop 2023-11-27T20:55:14.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.000+0000 7f57ef79e640 1 -- 172.21.15.88:0/1641823967 shutdown_connections 2023-11-27T20:55:14.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.000+0000 7f57ef79e640 1 --2- 172.21.15.88:0/1641823967 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f57cc06b210 0x7f57cc06d6d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:14.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.000+0000 7f57ef79e640 1 --2- 172.21.15.88:0/1641823967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57e8151680 0x7f57e81ee2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:14.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.000+0000 7f57ef79e640 1 --2- 172.21.15.88:0/1641823967 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57e806f810 0x7f57e81edda0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:14.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.000+0000 7f57ef79e640 1 --2- 172.21.15.88:0/1641823967 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57e806f3f0 0x7f57e814b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:14.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.000+0000 7f57ef79e640 1 -- 172.21.15.88:0/1641823967 >> 172.21.15.88:0/1641823967 conn(0x7f57e80707f0 msgr2=0x7f57e8070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:14.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.000+0000 7f57ef79e640 1 -- 172.21.15.88:0/1641823967 shutdown_connections 2023-11-27T20:55:14.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.000+0000 7f57ef79e640 1 -- 172.21.15.88:0/1641823967 wait complete. 2023-11-27T20:55:14.012 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:55:14.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.111+0000 7f9f52c56640 1 Processor -- start 2023-11-27T20:55:14.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.111+0000 7f9f52c56640 1 -- start start 2023-11-27T20:55:14.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.111+0000 7f9f52c56640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9f4c0cc420 0x7f9f4c159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:14.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.111+0000 7f9f52c56640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f4c159b50 0x7f9f4c0c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:14.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.111+0000 7f9f52c56640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f4c0cbda0 con 0x7f9f4c0cda70 2023-11-27T20:55:14.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.111+0000 7f9f52c56640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f4c0cc230 con 0x7f9f4c0cc420 2023-11-27T20:55:14.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.111+0000 7f9f52c56640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c0cea60 con 0x7f9f4c159b50 2023-11-27T20:55:14.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.112+0000 7f9f4bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9f4c0cc420 0x7f9f4c159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:14.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.112+0000 7f9f511f3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f4c159b50 0x7f9f4c0c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:14.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.112+0000 7f9f509f2640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9f4c0cda70 0x7f9f4c0ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46694/0 (socket says 172.21.15.88:46694) 2023-11-27T20:55:14.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.112+0000 7f9f509f2640 1 -- 172.21.15.88:0/245487326 learned_addr learned my addr 172.21.15.88:0/245487326 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:55:14.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.114+0000 7f9f4bfff640 1 -- 172.21.15.88:0/245487326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f4c159b50 msgr2=0x7f9f4c0c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:14.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.114+0000 7f9f4bfff640 1 --2- 172.21.15.88:0/245487326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f4c159b50 0x7f9f4c0c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:14.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.115+0000 7f9f4bfff640 1 -- 172.21.15.88:0/245487326 >> v1:172.21.15.88:6789/0 conn(0x7f9f4c0cda70 legacy=0x7f9f4c0ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:14.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.115+0000 7f9f4bfff640 1 -- 172.21.15.88:0/245487326 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4c0cb4e0 con 0x7f9f4c0cc420 2023-11-27T20:55:14.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.117+0000 7f9f4bfff640 1 --2- 172.21.15.88:0/245487326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f4c0cc420 0x7f9f4c159610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9f340097a0 tx=0x7f9f3402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=331d25cf30c69290 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:14.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.120+0000 7f9f4b7fe640 1 -- 172.21.15.88:0/245487326 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f34030610 con 0x7f9f4c0cc420 2023-11-27T20:55:14.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.120+0000 7f9f4b7fe640 1 -- 172.21.15.88:0/245487326 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f34030770 con 0x7f9f4c0cc420 2023-11-27T20:55:14.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.120+0000 7f9f4b7fe640 1 -- 172.21.15.88:0/245487326 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f34030b00 con 0x7f9f4c0cc420 2023-11-27T20:55:14.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.121+0000 7f9f52c56640 1 -- 172.21.15.88:0/245487326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f4c0cc420 msgr2=0x7f9f4c159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:14.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.121+0000 7f9f52c56640 1 --2- 172.21.15.88:0/245487326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f4c0cc420 0x7f9f4c159610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9f340097a0 tx=0x7f9f3402b960 comp rx=0 tx=0).stop 2023-11-27T20:55:14.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.121+0000 7f9f52c56640 1 -- 172.21.15.88:0/245487326 shutdown_connections 2023-11-27T20:55:14.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.121+0000 7f9f52c56640 1 --2- 172.21.15.88:0/245487326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f4c159b50 0x7f9f4c0c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:14.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.121+0000 7f9f52c56640 1 --2- 172.21.15.88:0/245487326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f4c0cc420 0x7f9f4c159610 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:14.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.121+0000 7f9f52c56640 1 -- 172.21.15.88:0/245487326 >> 172.21.15.88:0/245487326 conn(0x7f9f4c0b07b0 msgr2=0x7f9f4c0b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:14.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.121+0000 7f9f52c56640 1 -- 172.21.15.88:0/245487326 shutdown_connections 2023-11-27T20:55:14.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.121+0000 7f9f52c56640 1 -- 172.21.15.88:0/245487326 wait complete. 2023-11-27T20:55:14.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.122+0000 7f9f52c56640 1 Processor -- start 2023-11-27T20:55:14.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.122+0000 7f9f52c56640 1 -- start start 2023-11-27T20:55:14.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.123+0000 7f9f52c56640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f4c0cc420 0x7f9f4c158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:14.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.123+0000 7f9f52c56640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f4c0cda70 0x7f9f4c0b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:14.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.123+0000 7f9f52c56640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f4c159b50 0x7f9f4c150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:14.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.123+0000 7f9f52c56640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c0b1840 con 0x7f9f4c0cda70 2023-11-27T20:55:14.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.123+0000 7f9f52c56640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c0b1b20 con 0x7f9f4c159b50 2023-11-27T20:55:14.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.123+0000 7f9f52c56640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c0c27d0 con 0x7f9f4c0cc420 2023-11-27T20:55:14.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.124+0000 7f9f4bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f4c0cda70 0x7f9f4c0b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:14.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.124+0000 7f9f511f3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f4c159b50 0x7f9f4c150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:14.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.124+0000 7f9f509f2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f4c0cc420 0x7f9f4c158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:14.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.124+0000 7f9f4bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f4c0cda70 0x7f9f4c0b1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44812/0 (socket says 172.21.15.88:44812) 2023-11-27T20:55:14.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.124+0000 7f9f4bfff640 1 -- 172.21.15.88:0/3319615689 learned_addr learned my addr 172.21.15.88:0/3319615689 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:14.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.127+0000 7f9f511f3640 1 -- 172.21.15.88:0/3319615689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f4c0cc420 msgr2=0x7f9f4c158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:14.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.127+0000 7f9f511f3640 1 --2- 172.21.15.88:0/3319615689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f4c0cc420 0x7f9f4c158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:14.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.127+0000 7f9f511f3640 1 -- 172.21.15.88:0/3319615689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f4c0cda70 msgr2=0x7f9f4c0b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:14.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.127+0000 7f9f511f3640 1 --2- 172.21.15.88:0/3319615689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f4c0cda70 0x7f9f4c0b1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:14.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.127+0000 7f9f511f3640 1 -- 172.21.15.88:0/3319615689 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f34009400 con 0x7f9f4c159b50 2023-11-27T20:55:14.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.130+0000 7f9f511f3640 1 --2- 172.21.15.88:0/3319615689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f4c159b50 0x7f9f4c150180 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c00e5c0 tx=0x7f9f3c00ea80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:14.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.133+0000 7f9f497fa640 1 -- 172.21.15.88:0/3319615689 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c013680 con 0x7f9f4c159b50 2023-11-27T20:55:14.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.133+0000 7f9f497fa640 1 -- 172.21.15.88:0/3319615689 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3c013800 con 0x7f9f4c159b50 2023-11-27T20:55:14.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.133+0000 7f9f497fa640 1 -- 172.21.15.88:0/3319615689 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c013bb0 con 0x7f9f4c159b50 2023-11-27T20:55:14.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.133+0000 7f9f52c56640 1 -- 172.21.15.88:0/3319615689 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f4c1f0080 con 0x7f9f4c159b50 2023-11-27T20:55:14.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.134+0000 7f9f52c56640 1 -- 172.21.15.88:0/3319615689 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4c0b3a40 con 0x7f9f4c159b50 2023-11-27T20:55:14.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.135+0000 7f9f52c56640 1 -- 172.21.15.88:0/3319615689 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f4c0b1c90 con 0x7f9f4c159b50 2023-11-27T20:55:14.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.154+0000 7f9f497fa640 1 -- 172.21.15.88:0/3319615689 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9f3c013d10 con 0x7f9f4c159b50 2023-11-27T20:55:14.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.154+0000 7f9f497fa640 1 --2- 172.21.15.88:0/3319615689 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f9f2c06b210 0x7f9f2c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:14.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.154+0000 7f9f509f2640 1 --2- 172.21.15.88:0/3319615689 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f9f2c06b210 0x7f9f2c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:14.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.154+0000 7f9f509f2640 1 --2- 172.21.15.88:0/3319615689 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f9f2c06b210 0x7f9f2c06d6d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9f440012e0 tx=0x7f9f44001a30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:14.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.388+0000 7f9f497fa640 1 -- 172.21.15.88:0/3319615689 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9f3c0583c0 con 0x7f9f4c159b50 2023-11-27T20:55:14.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.400+0000 7f9f497fa640 1 -- 172.21.15.88:0/3319615689 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9f3c054700 con 0x7f9f4c159b50 2023-11-27T20:55:14.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.603+0000 7f9f52c56640 1 -- 172.21.15.88:0/3319615689 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f4c067470 con 0x7f9f4c159b50 2023-11-27T20:55:14.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.616+0000 7f9f497fa640 1 -- 172.21.15.88:0/3319615689 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+6568 (secure 0 0 0) 0x7f9f3c017070 con 0x7f9f4c159b50 2023-11-27T20:55:14.617 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:55:14.617 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/298325117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":298325117},{"type":"v1","addr":"172.21.15.88:6837","nonce":298325117}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:54:26.940968+0000","modified":"2023-11-27T20:55:11.136300+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34205,"mds_1":34199,"mds_2":34190,"mds_3":34187,"mds_4":4258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4258":{"gid":4258,"name":"f","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.167:6837/1596074914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1596074914},{"type":"v1","addr":"172.21.15.167:6837","nonce":1596074914}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34187":{"gid":34187,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":15,"addr":"172.21.15.88:6835/256796309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":256796309},{"type":"v1","addr":"172.21.15.88:6835","nonce":256796309}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34190":{"gid":34190,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":14,"addr":"172.21.15.167:6833/1245449675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1245449675},{"type":"v1","addr":"172.21.15.167:6833","nonce":1245449675}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34199":{"gid":34199,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":14,"addr":"172.21.15.167:6835/327644613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":327644613},{"type":"v1","addr":"172.21.15.167:6835","nonce":327644613}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34205":{"gid":34205,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.88:6839/2120059880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":2120059880},{"type":"v1","addr":"172.21.15.88:6839","nonce":2120059880}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T20:55:14.618 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 19 2023-11-27T20:55:14.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.618+0000 7f9f52c56640 1 -- 172.21.15.88:0/3319615689 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f9f2c06b210 msgr2=0x7f9f2c06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:14.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.618+0000 7f9f52c56640 1 --2- 172.21.15.88:0/3319615689 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f9f2c06b210 0x7f9f2c06d6d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9f440012e0 tx=0x7f9f44001a30 comp rx=0 tx=0).stop 2023-11-27T20:55:14.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.618+0000 7f9f52c56640 1 -- 172.21.15.88:0/3319615689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f4c159b50 msgr2=0x7f9f4c150180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:14.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.618+0000 7f9f52c56640 1 --2- 172.21.15.88:0/3319615689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f4c159b50 0x7f9f4c150180 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c00e5c0 tx=0x7f9f3c00ea80 comp rx=0 tx=0).stop 2023-11-27T20:55:14.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.618+0000 7f9f52c56640 1 -- 172.21.15.88:0/3319615689 shutdown_connections 2023-11-27T20:55:14.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.618+0000 7f9f52c56640 1 --2- 172.21.15.88:0/3319615689 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f9f2c06b210 0x7f9f2c06d6d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:14.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.618+0000 7f9f52c56640 1 --2- 172.21.15.88:0/3319615689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f4c159b50 0x7f9f4c150180 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:14.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.618+0000 7f9f52c56640 1 --2- 172.21.15.88:0/3319615689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f4c0cda70 0x7f9f4c0b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:14.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.618+0000 7f9f52c56640 1 --2- 172.21.15.88:0/3319615689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f4c0cc420 0x7f9f4c158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:14.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.618+0000 7f9f52c56640 1 -- 172.21.15.88:0/3319615689 >> 172.21.15.88:0/3319615689 conn(0x7f9f4c0b07b0 msgr2=0x7f9f4c0c6be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:14.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.618+0000 7f9f52c56640 1 -- 172.21.15.88:0/3319615689 shutdown_connections 2023-11-27T20:55:14.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.618+0000 7f9f52c56640 1 -- 172.21.15.88:0/3319615689 wait complete. 2023-11-27T20:55:14.630 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:55:14.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.729+0000 7fda30a32640 1 Processor -- start 2023-11-27T20:55:14.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.729+0000 7fda30a32640 1 -- start start 2023-11-27T20:55:14.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.730+0000 7fda30a32640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fda2c153900 0x7fda2c0ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:14.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.730+0000 7fda30a32640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda2c0cd230 con 0x7fda2c0cc3f0 2023-11-27T20:55:14.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.730+0000 7fda30a32640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda2c0cd510 con 0x7fda2c15a2b0 2023-11-27T20:55:14.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.730+0000 7fda30a32640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2c0cd7f0 con 0x7fda2c153900 2023-11-27T20:55:14.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.730+0000 7fda29d9b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fda2c0cc3f0 0x7fda2c159ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46700/0 (socket says 172.21.15.88:46700) 2023-11-27T20:55:14.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.730+0000 7fda29d9b640 1 -- 172.21.15.88:0/1562715461 learned_addr learned my addr 172.21.15.88:0/1562715461 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:55:14.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.731+0000 7fda2a59c640 1 --2- 172.21.15.88:0/1562715461 >> v2:172.21.15.167:3300/0 conn(0x7fda2c153900 0x7fda2c0ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:14.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.733+0000 7fda2959a640 1 -- 172.21.15.88:0/1562715461 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3216194686 0 0) 0x7fda2c0cd230 con 0x7fda2c0cc3f0 2023-11-27T20:55:14.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.733+0000 7fda2959a640 1 -- 172.21.15.88:0/1562715461 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda18003520 con 0x7fda2c0cc3f0 2023-11-27T20:55:14.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.735+0000 7fda2a59c640 1 -- 172.21.15.88:0/1562715461 >> v1:172.21.15.167:6789/0 conn(0x7fda2c15a2b0 legacy=0x7fda2c0cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:14.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.735+0000 7fda2a59c640 1 -- 172.21.15.88:0/1562715461 >> v1:172.21.15.88:6789/0 conn(0x7fda2c0cc3f0 legacy=0x7fda2c159ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:14.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.735+0000 7fda2a59c640 1 -- 172.21.15.88:0/1562715461 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2c0cdad0 con 0x7fda2c153900 2023-11-27T20:55:14.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.739+0000 7fda2a59c640 1 --2- 172.21.15.88:0/1562715461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda2c153900 0x7fda2c0ce0b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fda240097a0 tx=0x7fda2402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=807162352609d19d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:14.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.743+0000 7fda2959a640 1 -- 172.21.15.88:0/1562715461 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24030610 con 0x7fda2c153900 2023-11-27T20:55:14.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.743+0000 7fda2959a640 1 -- 172.21.15.88:0/1562715461 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda24030770 con 0x7fda2c153900 2023-11-27T20:55:14.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.743+0000 7fda2959a640 1 -- 172.21.15.88:0/1562715461 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24030b00 con 0x7fda2c153900 2023-11-27T20:55:14.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.743+0000 7fda30a32640 1 -- 172.21.15.88:0/1562715461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda2c153900 msgr2=0x7fda2c0ce0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:14.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.743+0000 7fda30a32640 1 --2- 172.21.15.88:0/1562715461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda2c153900 0x7fda2c0ce0b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fda240097a0 tx=0x7fda2402b960 comp rx=0 tx=0).stop 2023-11-27T20:55:14.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.743+0000 7fda30a32640 1 -- 172.21.15.88:0/1562715461 shutdown_connections 2023-11-27T20:55:14.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.743+0000 7fda30a32640 1 --2- 172.21.15.88:0/1562715461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda2c153900 0x7fda2c0ce0b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:14.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.743+0000 7fda30a32640 1 -- 172.21.15.88:0/1562715461 >> 172.21.15.88:0/1562715461 conn(0x7fda2c0b07d0 msgr2=0x7fda2c0b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:14.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.744+0000 7fda30a32640 1 -- 172.21.15.88:0/1562715461 shutdown_connections 2023-11-27T20:55:14.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.744+0000 7fda30a32640 1 -- 172.21.15.88:0/1562715461 wait complete. 2023-11-27T20:55:14.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.745+0000 7fda30a32640 1 Processor -- start 2023-11-27T20:55:14.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.745+0000 7fda30a32640 1 -- start start 2023-11-27T20:55:14.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.745+0000 7fda30a32640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda2c0cc3f0 0x7fda2c0b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:14.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.745+0000 7fda30a32640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda2c153900 0x7fda2c1efc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:14.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.746+0000 7fda30a32640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda2c15a2b0 0x7fda2c14cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:14.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.746+0000 7fda30a32640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c0b1e20 con 0x7fda2c153900 2023-11-27T20:55:14.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.746+0000 7fda30a32640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c1f01c0 con 0x7fda2c0cc3f0 2023-11-27T20:55:14.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.746+0000 7fda30a32640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c14c8b0 con 0x7fda2c15a2b0 2023-11-27T20:55:14.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.746+0000 7fda29d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda2c153900 0x7fda2c1efc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:14.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.746+0000 7fda2a59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda2c0cc3f0 0x7fda2c0b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:14.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.746+0000 7fda2ad9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda2c15a2b0 0x7fda2c14cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:14.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.746+0000 7fda2a59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda2c0cc3f0 0x7fda2c0b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:59050/0 (socket says 172.21.15.88:59050) 2023-11-27T20:55:14.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.746+0000 7fda2a59c640 1 -- 172.21.15.88:0/2354514682 learned_addr learned my addr 172.21.15.88:0/2354514682 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:14.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.750+0000 7fda2a59c640 1 -- 172.21.15.88:0/2354514682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda2c15a2b0 msgr2=0x7fda2c14cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:14.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.750+0000 7fda2a59c640 1 --2- 172.21.15.88:0/2354514682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda2c15a2b0 0x7fda2c14cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:14.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.750+0000 7fda2a59c640 1 -- 172.21.15.88:0/2354514682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda2c153900 msgr2=0x7fda2c1efc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:14.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.750+0000 7fda2a59c640 1 --2- 172.21.15.88:0/2354514682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda2c153900 0x7fda2c1efc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:14.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.750+0000 7fda2a59c640 1 -- 172.21.15.88:0/2354514682 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda24009400 con 0x7fda2c0cc3f0 2023-11-27T20:55:14.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.752+0000 7fda2a59c640 1 --2- 172.21.15.88:0/2354514682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda2c0cc3f0 0x7fda2c0b18e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fda2402bf70 tx=0x7fda24004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:14.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.755+0000 7fda22ffd640 1 -- 172.21.15.88:0/2354514682 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2403e040 con 0x7fda2c0cc3f0 2023-11-27T20:55:14.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.756+0000 7fda22ffd640 1 -- 172.21.15.88:0/2354514682 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda24039a40 con 0x7fda2c0cc3f0 2023-11-27T20:55:14.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.756+0000 7fda30a32640 1 -- 172.21.15.88:0/2354514682 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda2c0b2000 con 0x7fda2c0cc3f0 2023-11-27T20:55:14.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.756+0000 7fda22ffd640 1 -- 172.21.15.88:0/2354514682 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24039df0 con 0x7fda2c0cc3f0 2023-11-27T20:55:14.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.756+0000 7fda30a32640 1 -- 172.21.15.88:0/2354514682 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda2c14c260 con 0x7fda2c0cc3f0 2023-11-27T20:55:14.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.757+0000 7fda30a32640 1 -- 172.21.15.88:0/2354514682 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda2c073dc0 con 0x7fda2c0cc3f0 2023-11-27T20:55:14.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.775+0000 7fda22ffd640 1 -- 172.21.15.88:0/2354514682 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fda2404d3b0 con 0x7fda2c0cc3f0 2023-11-27T20:55:14.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.776+0000 7fda22ffd640 1 --2- 172.21.15.88:0/2354514682 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fda0c06b1c0 0x7fda0c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:14.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.776+0000 7fda29d9b640 1 --2- 172.21.15.88:0/2354514682 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fda0c06b1c0 0x7fda0c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:14.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.776+0000 7fda29d9b640 1 --2- 172.21.15.88:0/2354514682 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fda0c06b1c0 0x7fda0c06d680 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0aee10 tx=0x7fda14007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:14.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:14.779+0000 7fda22ffd640 1 -- 172.21.15.88:0/2354514682 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fda2407adc0 con 0x7fda2c0cc3f0 2023-11-27T20:55:15.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.021+0000 7fda22ffd640 1 -- 172.21.15.88:0/2354514682 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fda24077100 con 0x7fda2c0cc3f0 2023-11-27T20:55:15.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.191+0000 7fda30a32640 1 -- 172.21.15.88:0/2354514682 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda2c0c9d30 con 0x7fda2c0cc3f0 2023-11-27T20:55:15.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.234+0000 7fda22ffd640 1 -- 172.21.15.88:0/2354514682 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18666 (secure 0 0 0) 0x7fda2407a720 con 0x7fda2c0cc3f0 2023-11-27T20:55:15.236 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:55:15.236 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":28,"fsid":"ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc","created":"2023-11-27T20:53:53.110827+0000","modified":"2023-11-27T20:55:00.550945+0000","last_up_change":"2023-11-27T20:54:08.219383+0000","last_in_change":"2023-11-27T20:53:59.022798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:54:09.277670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:54:24.503156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:54:25.744043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T20:54:29.704111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1207ca0f-bef1-44c6-b66b-58bf0e080ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6819","nonce":3952326022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6821","nonce":3952326022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6825","nonce":3952326022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6823","nonce":3952326022}]},"public_addr":"172.21.15.88:6819/3952326022","cluster_addr":"172.21.15.88:6821/3952326022","heartbeat_back_addr":"172.21.15.88:6825/3952326022","heartbeat_front_addr":"172.21.15.88:6823/3952326022","state":["exists","up"]},{"osd":1,"uuid":"8d1be479-4241-4335-9633-1394311fde76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6827","nonce":1788401966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6829","nonce":1788401966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6833","nonce":1788401966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6831","nonce":1788401966}]},"public_addr":"172.21.15.88:6827/1788401966","cluster_addr":"172.21.15.88:6829/1788401966","heartbeat_back_addr":"172.21.15.88:6833/1788401966","heartbeat_front_addr":"172.21.15.88:6831/1788401966","state":["exists","up"]},{"osd":2,"uuid":"7536b008-05dd-40eb-9d4a-bdac4b1c38c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6803","nonce":1166333913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6805","nonce":1166333913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6809","nonce":1166333913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6807","nonce":1166333913}]},"public_addr":"172.21.15.88:6803/1166333913","cluster_addr":"172.21.15.88:6805/1166333913","heartbeat_back_addr":"172.21.15.88:6809/1166333913","heartbeat_front_addr":"172.21.15.88:6807/1166333913","state":["exists","up"]},{"osd":3,"uuid":"47edd4d7-e99c-4ce3-851b-cc9c8e2d4480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6811","nonce":406887502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6813","nonce":406887502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6817","nonce":406887502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6815","nonce":406887502}]},"public_addr":"172.21.15.88:6811/406887502","cluster_addr":"172.21.15.88:6813/406887502","heartbeat_back_addr":"172.21.15.88:6817/406887502","heartbeat_front_addr":"172.21.15.88:6815/406887502","state":["exists","up"]},{"osd":4,"uuid":"0a81dd31-1a8b-41af-b933-d74aae63f3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6801","nonce":2551293703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6803","nonce":2551293703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6807","nonce":2551293703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6805","nonce":2551293703}]},"public_addr":"172.21.15.167:6801/2551293703","cluster_addr":"172.21.15.167:6803/2551293703","heartbeat_back_addr":"172.21.15.167:6807/2551293703","heartbeat_front_addr":"172.21.15.167:6805/2551293703","state":["exists","up"]},{"osd":5,"uuid":"1c462d0d-3361-48b3-a82a-86a920539e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6825","nonce":866085094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6827","nonce":866085094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6831","nonce":866085094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6829","nonce":866085094}]},"public_addr":"172.21.15.167:6825/866085094","cluster_addr":"172.21.15.167:6827/866085094","heartbeat_back_addr":"172.21.15.167:6831/866085094","heartbeat_front_addr":"172.21.15.167:6829/866085094","state":["exists","up"]},{"osd":6,"uuid":"d687c5ad-6c88-4a15-8120-0cdbc5610535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6809","nonce":2766725538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6811","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6813","nonce":2766725538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6819","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6821","nonce":2766725538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6815","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6817","nonce":2766725538}]},"public_addr":"172.21.15.167:6809/2766725538","cluster_addr":"172.21.15.167:6813/2766725538","heartbeat_back_addr":"172.21.15.167:6821/2766725538","heartbeat_front_addr":"172.21.15.167:6817/2766725538","state":["exists","up"]},{"osd":7,"uuid":"c9a50596-4981-4bd8-a8ef-d7679f8d9559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6812","nonce":2695037266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6816","nonce":2695037266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6823","nonce":2695037266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6820","nonce":2695037266}]},"public_addr":"172.21.15.167:6812/2695037266","cluster_addr":"172.21.15.167:6816/2695037266","heartbeat_back_addr":"172.21.15.167:6823/2695037266","heartbeat_front_addr":"172.21.15.167:6820/2695037266","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.522590+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.483170+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.492504+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.432204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.414964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.459803+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.437250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.460394+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.1d","mappings":[{"from":0,"to":1}]},{"pgid":"3.35","mappings":[{"from":0,"to":7}]},{"pgid":"4.4","mappings":[{"from":6,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":4}]},{"pgid":"4.e","mappings":[{"from":3,"to":5}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:55:15.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.236+0000 7fda30a32640 1 -- 172.21.15.88:0/2354514682 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fda0c06b1c0 msgr2=0x7fda0c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:15.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.236+0000 7fda30a32640 1 --2- 172.21.15.88:0/2354514682 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fda0c06b1c0 0x7fda0c06d680 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0aee10 tx=0x7fda14007d30 comp rx=0 tx=0).stop 2023-11-27T20:55:15.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.236+0000 7fda30a32640 1 -- 172.21.15.88:0/2354514682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda2c0cc3f0 msgr2=0x7fda2c0b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:15.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.236+0000 7fda30a32640 1 --2- 172.21.15.88:0/2354514682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda2c0cc3f0 0x7fda2c0b18e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fda2402bf70 tx=0x7fda24004730 comp rx=0 tx=0).stop 2023-11-27T20:55:15.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.236+0000 7fda30a32640 1 -- 172.21.15.88:0/2354514682 shutdown_connections 2023-11-27T20:55:15.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.236+0000 7fda30a32640 1 --2- 172.21.15.88:0/2354514682 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fda0c06b1c0 0x7fda0c06d680 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:15.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.236+0000 7fda30a32640 1 --2- 172.21.15.88:0/2354514682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda2c15a2b0 0x7fda2c14cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:15.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.236+0000 7fda30a32640 1 --2- 172.21.15.88:0/2354514682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda2c153900 0x7fda2c1efc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:15.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.236+0000 7fda30a32640 1 --2- 172.21.15.88:0/2354514682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda2c0cc3f0 0x7fda2c0b18e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:15.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.236+0000 7fda30a32640 1 -- 172.21.15.88:0/2354514682 >> 172.21.15.88:0/2354514682 conn(0x7fda2c0b07d0 msgr2=0x7fda2c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:15.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.236+0000 7fda30a32640 1 -- 172.21.15.88:0/2354514682 shutdown_connections 2023-11-27T20:55:15.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.236+0000 7fda30a32640 1 -- 172.21.15.88:0/2354514682 wait complete. 2023-11-27T20:55:15.248 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:54:09.277670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:54:24.503156+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:54:25.744043+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-27T20:54:29.704111+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-27T20:55:15.249 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:55:15.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.349+0000 7f94cf5e5640 1 Processor -- start 2023-11-27T20:55:15.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.349+0000 7f94cf5e5640 1 -- start start 2023-11-27T20:55:15.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.350+0000 7f94cf5e5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f94c80cb520 0x7f94c8159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:15.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.350+0000 7f94cf5e5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94c80cb900 0x7f94c815cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:15.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.350+0000 7f94cf5e5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c8153ca0 con 0x7f94c8153140 2023-11-27T20:55:15.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.350+0000 7f94cf5e5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c80c6e40 con 0x7f94c80cb520 2023-11-27T20:55:15.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.350+0000 7f94cf5e5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c815d430 con 0x7f94c80cb900 2023-11-27T20:55:15.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.351+0000 7f94cd381640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f94c80cb520 0x7f94c8159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:15.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.351+0000 7f94ccb80640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94c80cb900 0x7f94c815cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:15.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.351+0000 7f94cdb82640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f94c8153140 0x7f94c8153590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:44548/0 (socket says 172.21.15.88:44548) 2023-11-27T20:55:15.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.351+0000 7f94cdb82640 1 -- 172.21.15.88:0/603701070 learned_addr learned my addr 172.21.15.88:0/603701070 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:55:15.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.353+0000 7f94ccb80640 1 -- 172.21.15.88:0/603701070 >> v2:172.21.15.167:3300/0 conn(0x7f94c80cb520 msgr2=0x7f94c8159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:15.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.353+0000 7f94ccb80640 1 --2- 172.21.15.88:0/603701070 >> v2:172.21.15.167:3300/0 conn(0x7f94c80cb520 0x7f94c8159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:15.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.353+0000 7f94ccb80640 1 -- 172.21.15.88:0/603701070 >> v1:172.21.15.167:6789/0 conn(0x7f94c8153140 legacy=0x7f94c8153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:15.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.353+0000 7f94ccb80640 1 -- 172.21.15.88:0/603701070 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c815d710 con 0x7f94c80cb900 2023-11-27T20:55:15.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.355+0000 7f94ccb80640 1 --2- 172.21.15.88:0/603701070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94c80cb900 0x7f94c815cc10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f94b80097a0 tx=0x7f94b802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cc4cbeea53eafa9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:15.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.358+0000 7f94bffff640 1 -- 172.21.15.88:0/603701070 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b802e070 con 0x7f94c80cb900 2023-11-27T20:55:15.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.359+0000 7f94bffff640 1 -- 172.21.15.88:0/603701070 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b80315a0 con 0x7f94c80cb900 2023-11-27T20:55:15.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.359+0000 7f94bffff640 1 -- 172.21.15.88:0/603701070 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b8031930 con 0x7f94c80cb900 2023-11-27T20:55:15.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.360+0000 7f94cf5e5640 1 -- 172.21.15.88:0/603701070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94c80cb900 msgr2=0x7f94c815cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:15.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.360+0000 7f94cf5e5640 1 --2- 172.21.15.88:0/603701070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94c80cb900 0x7f94c815cc10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f94b80097a0 tx=0x7f94b802b840 comp rx=0 tx=0).stop 2023-11-27T20:55:15.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.360+0000 7f94cf5e5640 1 -- 172.21.15.88:0/603701070 shutdown_connections 2023-11-27T20:55:15.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.360+0000 7f94cf5e5640 1 --2- 172.21.15.88:0/603701070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94c80cb900 0x7f94c815cc10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:15.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.360+0000 7f94cf5e5640 1 --2- 172.21.15.88:0/603701070 >> v2:172.21.15.167:3300/0 conn(0x7f94c80cb520 0x7f94c8159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:15.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.360+0000 7f94cf5e5640 1 -- 172.21.15.88:0/603701070 >> 172.21.15.88:0/603701070 conn(0x7f94c806d170 msgr2=0x7f94c806d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:15.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.360+0000 7f94cf5e5640 1 -- 172.21.15.88:0/603701070 shutdown_connections 2023-11-27T20:55:15.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.360+0000 7f94cf5e5640 1 -- 172.21.15.88:0/603701070 wait complete. 2023-11-27T20:55:15.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.361+0000 7f94cf5e5640 1 Processor -- start 2023-11-27T20:55:15.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.361+0000 7f94cf5e5640 1 -- start start 2023-11-27T20:55:15.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.362+0000 7f94cf5e5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94c80cb520 0x7f94c81ee740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:15.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.362+0000 7f94cf5e5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94c80cb900 0x7f94c8151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:15.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.362+0000 7f94cf5e5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94c8153140 0x7f94c81f2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:15.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.362+0000 7f94cf5e5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c8152550 con 0x7f94c8153140 2023-11-27T20:55:15.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.362+0000 7f94cf5e5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c8152830 con 0x7f94c80cb520 2023-11-27T20:55:15.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.362+0000 7f94cf5e5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c8152b10 con 0x7f94c80cb900 2023-11-27T20:55:15.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.363+0000 7f94ccb80640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94c80cb900 0x7f94c8151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:15.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.363+0000 7f94cdb82640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94c8153140 0x7f94c81f2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:15.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.363+0000 7f94ccb80640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94c80cb900 0x7f94c8151ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:35222/0 (socket says 172.21.15.88:35222) 2023-11-27T20:55:15.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.363+0000 7f94ccb80640 1 -- 172.21.15.88:0/3997048895 learned_addr learned my addr 172.21.15.88:0/3997048895 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:15.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.363+0000 7f94cd381640 1 --2- 172.21.15.88:0/3997048895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94c80cb520 0x7f94c81ee740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:15.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.366+0000 7f94ccb80640 1 -- 172.21.15.88:0/3997048895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94c80cb520 msgr2=0x7f94c81ee740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:15.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.366+0000 7f94ccb80640 1 --2- 172.21.15.88:0/3997048895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94c80cb520 0x7f94c81ee740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:15.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.366+0000 7f94ccb80640 1 -- 172.21.15.88:0/3997048895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94c8153140 msgr2=0x7f94c81f2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:15.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.366+0000 7f94ccb80640 1 --2- 172.21.15.88:0/3997048895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94c8153140 0x7f94c81f2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:15.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.366+0000 7f94ccb80640 1 -- 172.21.15.88:0/3997048895 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b8009400 con 0x7f94c80cb900 2023-11-27T20:55:15.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.369+0000 7f94ccb80640 1 --2- 172.21.15.88:0/3997048895 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94c80cb900 0x7f94c8151ea0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f94b8034040 tx=0x7f94b80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:15.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.372+0000 7f94bdffb640 1 -- 172.21.15.88:0/3997048895 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b8032840 con 0x7f94c80cb900 2023-11-27T20:55:15.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.372+0000 7f94bdffb640 1 -- 172.21.15.88:0/3997048895 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b80329c0 con 0x7f94c80cb900 2023-11-27T20:55:15.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.372+0000 7f94bdffb640 1 -- 172.21.15.88:0/3997048895 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b8032d70 con 0x7f94c80cb900 2023-11-27T20:55:15.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.372+0000 7f94cf5e5640 1 -- 172.21.15.88:0/3997048895 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c81f1d30 con 0x7f94c80cb900 2023-11-27T20:55:15.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.373+0000 7f94cf5e5640 1 -- 172.21.15.88:0/3997048895 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c81f22f0 con 0x7f94c80cb900 2023-11-27T20:55:15.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.373+0000 7f94cf5e5640 1 -- 172.21.15.88:0/3997048895 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c8067470 con 0x7f94c80cb900 2023-11-27T20:55:15.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.627+0000 7f94bdffb640 1 -- 172.21.15.88:0/3997048895 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f94b804e430 con 0x7f94c80cb900 2023-11-27T20:55:15.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.627+0000 7f94bdffb640 1 --2- 172.21.15.88:0/3997048895 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f94ac06b210 0x7f94ac06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:15.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.627+0000 7f94cd381640 1 --2- 172.21.15.88:0/3997048895 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f94ac06b210 0x7f94ac06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:15.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.627+0000 7f94cd381640 1 --2- 172.21.15.88:0/3997048895 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f94ac06b210 0x7f94ac06d6d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f94c4009b40 tx=0x7f94c4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:15.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.629+0000 7f94bdffb640 1 -- 172.21.15.88:0/3997048895 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f94b807a830 con 0x7f94c80cb900 2023-11-27T20:55:15.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.640+0000 7f94bdffb640 1 -- 172.21.15.88:0/3997048895 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f94b8076b70 con 0x7f94c80cb900 2023-11-27T20:55:15.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.848+0000 7f94cf5e5640 1 -- 172.21.15.88:0/3997048895 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f94c81504c0 con 0x7f94c80cb900 2023-11-27T20:55:15.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.868+0000 7f94bdffb640 1 -- 172.21.15.88:0/3997048895 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f94b807a190 con 0x7f94c80cb900 2023-11-27T20:55:15.870 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-27T20:55:15.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.870+0000 7f94cf5e5640 1 -- 172.21.15.88:0/3997048895 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f94ac06b210 msgr2=0x7f94ac06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:15.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.870+0000 7f94cf5e5640 1 --2- 172.21.15.88:0/3997048895 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f94ac06b210 0x7f94ac06d6d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f94c4009b40 tx=0x7f94c4009190 comp rx=0 tx=0).stop 2023-11-27T20:55:15.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.871+0000 7f94cf5e5640 1 -- 172.21.15.88:0/3997048895 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94c80cb900 msgr2=0x7f94c8151ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:15.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.871+0000 7f94cf5e5640 1 --2- 172.21.15.88:0/3997048895 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94c80cb900 0x7f94c8151ea0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f94b8034040 tx=0x7f94b80046c0 comp rx=0 tx=0).stop 2023-11-27T20:55:15.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.871+0000 7f94cf5e5640 1 -- 172.21.15.88:0/3997048895 shutdown_connections 2023-11-27T20:55:15.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.871+0000 7f94cf5e5640 1 --2- 172.21.15.88:0/3997048895 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f94ac06b210 0x7f94ac06d6d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:15.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.871+0000 7f94cf5e5640 1 --2- 172.21.15.88:0/3997048895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94c8153140 0x7f94c81f2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:15.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.871+0000 7f94cf5e5640 1 --2- 172.21.15.88:0/3997048895 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94c80cb900 0x7f94c8151ea0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:15.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.871+0000 7f94cf5e5640 1 --2- 172.21.15.88:0/3997048895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94c80cb520 0x7f94c81ee740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:15.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.871+0000 7f94cf5e5640 1 -- 172.21.15.88:0/3997048895 >> 172.21.15.88:0/3997048895 conn(0x7f94c806d170 msgr2=0x7f94c806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:15.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.871+0000 7f94cf5e5640 1 -- 172.21.15.88:0/3997048895 shutdown_connections 2023-11-27T20:55:15.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.871+0000 7f94cf5e5640 1 -- 172.21.15.88:0/3997048895 wait complete. 2023-11-27T20:55:15.883 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:55:15.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.992+0000 7ff695924640 1 Processor -- start 2023-11-27T20:55:15.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.992+0000 7ff695924640 1 -- start start 2023-11-27T20:55:15.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.993+0000 7ff695924640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6900cda70 0x7ff6900ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:15.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.993+0000 7ff695924640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff6900c9620 0x7ff6900c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:15.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.993+0000 7ff695924640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6900cbda0 con 0x7ff6900cc420 2023-11-27T20:55:15.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.993+0000 7ff695924640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6900cc230 con 0x7ff6900c9620 2023-11-27T20:55:15.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.993+0000 7ff695924640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6900cb4e0 con 0x7ff6900cda70 2023-11-27T20:55:15.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.993+0000 7ff68f7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff6900c9620 0x7ff6900c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:15.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.993+0000 7ff687fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7ff6900cc420 0x7ff690159610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:44562/0 (socket says 172.21.15.88:44562) 2023-11-27T20:55:15.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.993+0000 7ff687fff640 1 -- 172.21.15.88:0/247803992 learned_addr learned my addr 172.21.15.88:0/247803992 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:55:15.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.993+0000 7ff68effd640 1 --2- 172.21.15.88:0/247803992 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6900cda70 0x7ff6900ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:15.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.996+0000 7ff68e7fc640 1 -- 172.21.15.88:0/247803992 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407961483 0 0) 0x7ff6900cbda0 con 0x7ff6900cc420 2023-11-27T20:55:15.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.996+0000 7ff68f7fe640 1 -- 172.21.15.88:0/247803992 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6900cda70 msgr2=0x7ff6900ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:15.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.996+0000 7ff68f7fe640 1 --2- 172.21.15.88:0/247803992 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6900cda70 0x7ff6900ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:15.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.996+0000 7ff68f7fe640 1 -- 172.21.15.88:0/247803992 >> v1:172.21.15.167:6789/0 conn(0x7ff6900cc420 legacy=0x7ff690159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:15.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.996+0000 7ff68f7fe640 1 -- 172.21.15.88:0/247803992 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6900cce00 con 0x7ff6900c9620 2023-11-27T20:55:15.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:15.998+0000 7ff68f7fe640 1 --2- 172.21.15.88:0/247803992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6900c9620 0x7ff6900c9a90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff688009d90 tx=0x7ff68802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419155b952e1bc54 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:16.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.002+0000 7ff68e7fc640 1 -- 172.21.15.88:0/247803992 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68802cce0 con 0x7ff6900c9620 2023-11-27T20:55:16.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.002+0000 7ff68e7fc640 1 -- 172.21.15.88:0/247803992 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68802ce40 con 0x7ff6900c9620 2023-11-27T20:55:16.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.002+0000 7ff68e7fc640 1 -- 172.21.15.88:0/247803992 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff688034660 con 0x7ff6900c9620 2023-11-27T20:55:16.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.002+0000 7ff695924640 1 -- 172.21.15.88:0/247803992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6900c9620 msgr2=0x7ff6900c9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:16.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.002+0000 7ff695924640 1 --2- 172.21.15.88:0/247803992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6900c9620 0x7ff6900c9a90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff688009d90 tx=0x7ff68802bf30 comp rx=0 tx=0).stop 2023-11-27T20:55:16.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.002+0000 7ff695924640 1 -- 172.21.15.88:0/247803992 shutdown_connections 2023-11-27T20:55:16.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.002+0000 7ff695924640 1 --2- 172.21.15.88:0/247803992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6900c9620 0x7ff6900c9a90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:16.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.002+0000 7ff695924640 1 --2- 172.21.15.88:0/247803992 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6900cda70 0x7ff6900ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:16.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.002+0000 7ff695924640 1 -- 172.21.15.88:0/247803992 >> 172.21.15.88:0/247803992 conn(0x7ff6900b07b0 msgr2=0x7ff6900b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:16.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.003+0000 7ff695924640 1 -- 172.21.15.88:0/247803992 shutdown_connections 2023-11-27T20:55:16.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.003+0000 7ff695924640 1 -- 172.21.15.88:0/247803992 wait complete. 2023-11-27T20:55:16.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.004+0000 7ff695924640 1 Processor -- start 2023-11-27T20:55:16.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.004+0000 7ff695924640 1 -- start start 2023-11-27T20:55:16.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.004+0000 7ff695924640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6900c9620 0x7ff6900b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:16.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.004+0000 7ff695924640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6900cc420 0x7ff6900b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:16.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.004+0000 7ff695924640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6900cda70 0x7ff6900b3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:16.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.004+0000 7ff695924640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6900b1de0 con 0x7ff6900cc420 2023-11-27T20:55:16.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.004+0000 7ff695924640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6900b1840 con 0x7ff6900cda70 2023-11-27T20:55:16.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.004+0000 7ff695924640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6901f3310 con 0x7ff6900c9620 2023-11-27T20:55:16.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.005+0000 7ff687fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6900cc420 0x7ff6900b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:16.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.005+0000 7ff68effd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6900c9620 0x7ff6900b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:16.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.005+0000 7ff68f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6900cda70 0x7ff6900b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:16.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.005+0000 7ff687fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6900cc420 0x7ff6900b2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44848/0 (socket says 172.21.15.88:44848) 2023-11-27T20:55:16.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.005+0000 7ff687fff640 1 -- 172.21.15.88:0/1418031163 learned_addr learned my addr 172.21.15.88:0/1418031163 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:16.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.009+0000 7ff68effd640 1 -- 172.21.15.88:0/1418031163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6900cda70 msgr2=0x7ff6900b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:16.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.009+0000 7ff68effd640 1 --2- 172.21.15.88:0/1418031163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6900cda70 0x7ff6900b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:16.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.009+0000 7ff68effd640 1 -- 172.21.15.88:0/1418031163 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6900cc420 msgr2=0x7ff6900b2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:16.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.009+0000 7ff68effd640 1 --2- 172.21.15.88:0/1418031163 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6900cc420 0x7ff6900b2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:16.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.009+0000 7ff68effd640 1 -- 172.21.15.88:0/1418031163 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff688009a70 con 0x7ff6900c9620 2023-11-27T20:55:16.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.009+0000 7ff687fff640 1 --2- 172.21.15.88:0/1418031163 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6900cc420 0x7ff6900b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:55:16.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.011+0000 7ff68effd640 1 --2- 172.21.15.88:0/1418031163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6900c9620 0x7ff6900b1fb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff68000e870 tx=0x7ff68000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:16.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.014+0000 7ff68cff9640 1 -- 172.21.15.88:0/1418031163 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68000ee60 con 0x7ff6900c9620 2023-11-27T20:55:16.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.015+0000 7ff68cff9640 1 -- 172.21.15.88:0/1418031163 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68000c940 con 0x7ff6900c9620 2023-11-27T20:55:16.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.015+0000 7ff695924640 1 -- 172.21.15.88:0/1418031163 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6900b1b00 con 0x7ff6900c9620 2023-11-27T20:55:16.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.015+0000 7ff68cff9640 1 -- 172.21.15.88:0/1418031163 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68000ccd0 con 0x7ff6900c9620 2023-11-27T20:55:16.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.015+0000 7ff695924640 1 -- 172.21.15.88:0/1418031163 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6901541e0 con 0x7ff6900c9620 2023-11-27T20:55:16.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.016+0000 7ff695924640 1 -- 172.21.15.88:0/1418031163 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6900c7260 con 0x7ff6900c9620 2023-11-27T20:55:16.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.035+0000 7ff68cff9640 1 -- 172.21.15.88:0/1418031163 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff680013470 con 0x7ff6900c9620 2023-11-27T20:55:16.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.035+0000 7ff68cff9640 1 --2- 172.21.15.88:0/1418031163 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff67006b210 0x7ff67006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:16.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.035+0000 7ff687fff640 1 --2- 172.21.15.88:0/1418031163 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff67006b210 0x7ff67006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:16.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.035+0000 7ff687fff640 1 --2- 172.21.15.88:0/1418031163 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff67006b210 0x7ff67006d6d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff690157230 tx=0x7ff678007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:16.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.037+0000 7ff68cff9640 1 -- 172.21.15.88:0/1418031163 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff68000ce30 con 0x7ff6900c9620 2023-11-27T20:55:16.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.276+0000 7ff68cff9640 1 -- 172.21.15.88:0/1418031163 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff680054f10 con 0x7ff6900c9620 2023-11-27T20:55:16.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.442+0000 7ff695924640 1 -- 172.21.15.88:0/1418031163 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff690154550 con 0x7ff6900c9620 2023-11-27T20:55:16.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.449+0000 7ff68cff9640 1 -- 172.21.15.88:0/1418031163 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff680021020 con 0x7ff6900c9620 2023-11-27T20:55:16.450 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-27T20:55:16.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.450+0000 7ff695924640 1 -- 172.21.15.88:0/1418031163 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff67006b210 msgr2=0x7ff67006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:16.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.450+0000 7ff695924640 1 --2- 172.21.15.88:0/1418031163 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff67006b210 0x7ff67006d6d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff690157230 tx=0x7ff678007de0 comp rx=0 tx=0).stop 2023-11-27T20:55:16.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.450+0000 7ff695924640 1 -- 172.21.15.88:0/1418031163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6900c9620 msgr2=0x7ff6900b1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:16.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.450+0000 7ff695924640 1 --2- 172.21.15.88:0/1418031163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6900c9620 0x7ff6900b1fb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff68000e870 tx=0x7ff68000ed30 comp rx=0 tx=0).stop 2023-11-27T20:55:16.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.450+0000 7ff695924640 1 -- 172.21.15.88:0/1418031163 shutdown_connections 2023-11-27T20:55:16.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.450+0000 7ff695924640 1 --2- 172.21.15.88:0/1418031163 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7ff67006b210 0x7ff67006d6d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:16.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.450+0000 7ff695924640 1 --2- 172.21.15.88:0/1418031163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6900cda70 0x7ff6900b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:16.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.450+0000 7ff695924640 1 --2- 172.21.15.88:0/1418031163 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6900cc420 0x7ff6900b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:16.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.450+0000 7ff695924640 1 --2- 172.21.15.88:0/1418031163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6900c9620 0x7ff6900b1fb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:16.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.450+0000 7ff695924640 1 -- 172.21.15.88:0/1418031163 >> 172.21.15.88:0/1418031163 conn(0x7ff6900b07b0 msgr2=0x7ff6900c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:16.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.450+0000 7ff695924640 1 -- 172.21.15.88:0/1418031163 shutdown_connections 2023-11-27T20:55:16.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.451+0000 7ff695924640 1 -- 172.21.15.88:0/1418031163 wait complete. 2023-11-27T20:55:16.463 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:55:16.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.564+0000 7f77cfd9e640 1 Processor -- start 2023-11-27T20:55:16.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.564+0000 7f77cfd9e640 1 -- start start 2023-11-27T20:55:16.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.565+0000 7f77cfd9e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77c80c46c0 0x7f77c80c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:16.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.565+0000 7f77cfd9e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f77c80c4aa0 0x7f77c814fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:16.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.565+0000 7f77cfd9e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c80c76f0 con 0x7f77c8150290 2023-11-27T20:55:16.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.565+0000 7f77cfd9e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c80c2bc0 con 0x7f77c80c4aa0 2023-11-27T20:55:16.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.565+0000 7f77cfd9e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c80c6dc0 con 0x7f77c80c46c0 2023-11-27T20:55:16.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.566+0000 7f77cd339640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f77c80c4aa0 0x7f77c814fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:16.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.566+0000 7f77ce33b640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f77c8150290 0x7f77c80c1ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:44572/0 (socket says 172.21.15.88:44572) 2023-11-27T20:55:16.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.566+0000 7f77ce33b640 1 -- 172.21.15.88:0/3178848068 learned_addr learned my addr 172.21.15.88:0/3178848068 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:55:16.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.566+0000 7f77cdb3a640 1 --2- 172.21.15.88:0/3178848068 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77c80c46c0 0x7f77c80c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:16.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.568+0000 7f77cd339640 1 -- 172.21.15.88:0/3178848068 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77c80c46c0 msgr2=0x7f77c80c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:16.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.568+0000 7f77cd339640 1 --2- 172.21.15.88:0/3178848068 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77c80c46c0 0x7f77c80c53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:16.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.568+0000 7f77cd339640 1 -- 172.21.15.88:0/3178848068 >> v1:172.21.15.167:6789/0 conn(0x7f77c8150290 legacy=0x7f77c80c1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:16.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.568+0000 7f77cd339640 1 -- 172.21.15.88:0/3178848068 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c80c70a0 con 0x7f77c80c4aa0 2023-11-27T20:55:16.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.570+0000 7f77cd339640 1 --2- 172.21.15.88:0/3178848068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77c80c4aa0 0x7f77c814fd50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f77b80097a0 tx=0x7f77b802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1123a09633343a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:16.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.574+0000 7f77ccb38640 1 -- 172.21.15.88:0/3178848068 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b8031830 con 0x7f77c80c4aa0 2023-11-27T20:55:16.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.574+0000 7f77ccb38640 1 -- 172.21.15.88:0/3178848068 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b8031990 con 0x7f77c80c4aa0 2023-11-27T20:55:16.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.574+0000 7f77ccb38640 1 -- 172.21.15.88:0/3178848068 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b8031d20 con 0x7f77c80c4aa0 2023-11-27T20:55:16.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.575+0000 7f77cfd9e640 1 -- 172.21.15.88:0/3178848068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77c80c4aa0 msgr2=0x7f77c814fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:16.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.575+0000 7f77cfd9e640 1 --2- 172.21.15.88:0/3178848068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77c80c4aa0 0x7f77c814fd50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f77b80097a0 tx=0x7f77b802b8d0 comp rx=0 tx=0).stop 2023-11-27T20:55:16.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.575+0000 7f77cfd9e640 1 -- 172.21.15.88:0/3178848068 shutdown_connections 2023-11-27T20:55:16.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.575+0000 7f77cfd9e640 1 --2- 172.21.15.88:0/3178848068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77c80c4aa0 0x7f77c814fd50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:16.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.575+0000 7f77cfd9e640 1 --2- 172.21.15.88:0/3178848068 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77c80c46c0 0x7f77c80c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:16.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.575+0000 7f77cfd9e640 1 -- 172.21.15.88:0/3178848068 >> 172.21.15.88:0/3178848068 conn(0x7f77c806c5f0 msgr2=0x7f77c806c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:16.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.575+0000 7f77cfd9e640 1 -- 172.21.15.88:0/3178848068 shutdown_connections 2023-11-27T20:55:16.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.575+0000 7f77cfd9e640 1 -- 172.21.15.88:0/3178848068 wait complete. 2023-11-27T20:55:16.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.576+0000 7f77cfd9e640 1 Processor -- start 2023-11-27T20:55:16.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.576+0000 7f77cfd9e640 1 -- start start 2023-11-27T20:55:16.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.577+0000 7f77cfd9e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77c80c46c0 0x7f77c81636e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:16.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.577+0000 7f77cfd9e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77c80c4aa0 0x7f77c81f2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:16.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.577+0000 7f77cfd9e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77c8150290 0x7f77c8145e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:16.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.577+0000 7f77cfd9e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c81efe80 con 0x7f77c80c46c0 2023-11-27T20:55:16.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.577+0000 7f77cfd9e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c81eee90 con 0x7f77c80c4aa0 2023-11-27T20:55:16.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.577+0000 7f77cfd9e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c81f3350 con 0x7f77c8150290 2023-11-27T20:55:16.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.577+0000 7f77cdb3a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77c80c46c0 0x7f77c81636e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:16.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.577+0000 7f77cd339640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77c80c4aa0 0x7f77c81f2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:16.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.577+0000 7f77ce33b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77c8150290 0x7f77c8145e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:16.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.578+0000 7f77cdb3a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77c80c46c0 0x7f77c81636e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44870/0 (socket says 172.21.15.88:44870) 2023-11-27T20:55:16.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.578+0000 7f77cdb3a640 1 -- 172.21.15.88:0/2783394498 learned_addr learned my addr 172.21.15.88:0/2783394498 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:16.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.581+0000 7f77cdb3a640 1 -- 172.21.15.88:0/2783394498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77c8150290 msgr2=0x7f77c8145e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:16.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.581+0000 7f77cdb3a640 1 --2- 172.21.15.88:0/2783394498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77c8150290 0x7f77c8145e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:16.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.581+0000 7f77cdb3a640 1 -- 172.21.15.88:0/2783394498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77c80c4aa0 msgr2=0x7f77c81f2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:16.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.581+0000 7f77cdb3a640 1 --2- 172.21.15.88:0/2783394498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77c80c4aa0 0x7f77c81f2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:16.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.581+0000 7f77cdb3a640 1 -- 172.21.15.88:0/2783394498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b8009400 con 0x7f77c80c46c0 2023-11-27T20:55:16.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.583+0000 7f77cdb3a640 1 --2- 172.21.15.88:0/2783394498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77c80c46c0 0x7f77c81636e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f77c400efc0 tx=0x7f77c400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:16.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.587+0000 7f77be7fc640 1 -- 172.21.15.88:0/2783394498 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c4014480 con 0x7f77c80c46c0 2023-11-27T20:55:16.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.587+0000 7f77be7fc640 1 -- 172.21.15.88:0/2783394498 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c400f040 con 0x7f77c80c46c0 2023-11-27T20:55:16.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.587+0000 7f77be7fc640 1 -- 172.21.15.88:0/2783394498 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c4014800 con 0x7f77c80c46c0 2023-11-27T20:55:16.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.587+0000 7f77cfd9e640 1 -- 172.21.15.88:0/2783394498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c81ef080 con 0x7f77c80c46c0 2023-11-27T20:55:16.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.587+0000 7f77cfd9e640 1 -- 172.21.15.88:0/2783394498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c81ef5e0 con 0x7f77c80c46c0 2023-11-27T20:55:16.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.588+0000 7f77cfd9e640 1 -- 172.21.15.88:0/2783394498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c8067470 con 0x7f77c80c46c0 2023-11-27T20:55:16.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.830+0000 7f77be7fc640 1 -- 172.21.15.88:0/2783394498 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f77c4014960 con 0x7f77c80c46c0 2023-11-27T20:55:16.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.831+0000 7f77be7fc640 1 --2- 172.21.15.88:0/2783394498 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f77ac06b1f0 0x7f77ac06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:16.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.831+0000 7f77cd339640 1 --2- 172.21.15.88:0/2783394498 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f77ac06b1f0 0x7f77ac06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:16.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.831+0000 7f77cd339640 1 --2- 172.21.15.88:0/2783394498 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f77ac06b1f0 0x7f77ac06d6b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f77b8036000 tx=0x7f77b803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:16.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.844+0000 7f77be7fc640 1 -- 172.21.15.88:0/2783394498 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f77c40596f0 con 0x7f77c80c46c0 2023-11-27T20:55:16.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:16.844+0000 7f77be7fc640 1 -- 172.21.15.88:0/2783394498 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f77c4055a30 con 0x7f77c80c46c0 2023-11-27T20:55:17.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.018+0000 7f77cfd9e640 1 -- 172.21.15.88:0/2783394498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f77c814a470 con 0x7f77c80c46c0 2023-11-27T20:55:17.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.023+0000 7f77be7fc640 1 -- 172.21.15.88:0/2783394498 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f77c4059050 con 0x7f77c80c46c0 2023-11-27T20:55:17.025 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-11-27T20:55:17.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.025+0000 7f77cfd9e640 1 -- 172.21.15.88:0/2783394498 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f77ac06b1f0 msgr2=0x7f77ac06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:17.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.025+0000 7f77cfd9e640 1 --2- 172.21.15.88:0/2783394498 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f77ac06b1f0 0x7f77ac06d6b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f77b8036000 tx=0x7f77b803c040 comp rx=0 tx=0).stop 2023-11-27T20:55:17.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.025+0000 7f77cfd9e640 1 -- 172.21.15.88:0/2783394498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77c80c46c0 msgr2=0x7f77c81636e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:17.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.025+0000 7f77cfd9e640 1 --2- 172.21.15.88:0/2783394498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77c80c46c0 0x7f77c81636e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f77c400efc0 tx=0x7f77c400c490 comp rx=0 tx=0).stop 2023-11-27T20:55:17.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.025+0000 7f77cfd9e640 1 -- 172.21.15.88:0/2783394498 shutdown_connections 2023-11-27T20:55:17.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.025+0000 7f77cfd9e640 1 --2- 172.21.15.88:0/2783394498 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f77ac06b1f0 0x7f77ac06d6b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:17.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.025+0000 7f77cfd9e640 1 --2- 172.21.15.88:0/2783394498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77c8150290 0x7f77c8145e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:17.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.025+0000 7f77cfd9e640 1 --2- 172.21.15.88:0/2783394498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77c80c4aa0 0x7f77c81f2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:17.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.025+0000 7f77cfd9e640 1 --2- 172.21.15.88:0/2783394498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77c80c46c0 0x7f77c81636e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:17.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.025+0000 7f77cfd9e640 1 -- 172.21.15.88:0/2783394498 >> 172.21.15.88:0/2783394498 conn(0x7f77c806c5f0 msgr2=0x7f77c814e750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:17.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.025+0000 7f77cfd9e640 1 -- 172.21.15.88:0/2783394498 shutdown_connections 2023-11-27T20:55:17.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.025+0000 7f77cfd9e640 1 -- 172.21.15.88:0/2783394498 wait complete. 2023-11-27T20:55:17.037 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-27T20:55:17.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.142+0000 7f2d9f297640 1 Processor -- start 2023-11-27T20:55:17.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.143+0000 7f2d9f297640 1 -- start start 2023-11-27T20:55:17.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.143+0000 7f2d9f297640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2d980c91d0 0x7f2d9806eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:17.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.143+0000 7f2d9f297640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d9815a0c0 0x7f2d980ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:17.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.143+0000 7f2d9f297640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d9806f090 con 0x7f2d98153730 2023-11-27T20:55:17.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.143+0000 7f2d9f297640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d980c38f0 con 0x7f2d980c91d0 2023-11-27T20:55:17.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.143+0000 7f2d9f297640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d981593d0 con 0x7f2d9815a0c0 2023-11-27T20:55:17.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.144+0000 7f2d9d033640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f2d98153730 0x7f2d980c2b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:44588/0 (socket says 172.21.15.88:44588) 2023-11-27T20:55:17.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.144+0000 7f2d9d033640 1 -- 172.21.15.88:0/3304206769 learned_addr learned my addr 172.21.15.88:0/3304206769 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:55:17.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.144+0000 7f2d9d834640 1 --2- 172.21.15.88:0/3304206769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d9815a0c0 0x7f2d980ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:17.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.146+0000 7f2d8bfff640 1 -- 172.21.15.88:0/3304206769 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3815111519 0 0) 0x7f2d9806f090 con 0x7f2d98153730 2023-11-27T20:55:17.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.146+0000 7f2d8bfff640 1 -- 172.21.15.88:0/3304206769 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d84003520 con 0x7f2d98153730 2023-11-27T20:55:17.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.147+0000 7f2d9d834640 1 -- 172.21.15.88:0/3304206769 >> v2:172.21.15.88:3300/0 conn(0x7f2d980c91d0 msgr2=0x7f2d9806eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:17.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.147+0000 7f2d9d834640 1 --2- 172.21.15.88:0/3304206769 >> v2:172.21.15.88:3300/0 conn(0x7f2d980c91d0 0x7f2d9806eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:17.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.147+0000 7f2d9d834640 1 -- 172.21.15.88:0/3304206769 >> v1:172.21.15.167:6789/0 conn(0x7f2d98153730 legacy=0x7f2d980c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:17.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.147+0000 7f2d9d834640 1 -- 172.21.15.88:0/3304206769 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d98153b10 con 0x7f2d9815a0c0 2023-11-27T20:55:17.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.149+0000 7f2d9d834640 1 --2- 172.21.15.88:0/3304206769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d9815a0c0 0x7f2d980ccac0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2d90009d90 tx=0x7f2d9002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e4f79be6e460d4f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:17.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.152+0000 7f2d8bfff640 1 -- 172.21.15.88:0/3304206769 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9002cce0 con 0x7f2d9815a0c0 2023-11-27T20:55:17.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.152+0000 7f2d8bfff640 1 -- 172.21.15.88:0/3304206769 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9002ce40 con 0x7f2d9815a0c0 2023-11-27T20:55:17.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.152+0000 7f2d8bfff640 1 -- 172.21.15.88:0/3304206769 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d90034660 con 0x7f2d9815a0c0 2023-11-27T20:55:17.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.153+0000 7f2d9f297640 1 -- 172.21.15.88:0/3304206769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d9815a0c0 msgr2=0x7f2d980ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:17.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.153+0000 7f2d9f297640 1 --2- 172.21.15.88:0/3304206769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d9815a0c0 0x7f2d980ccac0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2d90009d90 tx=0x7f2d9002bf30 comp rx=0 tx=0).stop 2023-11-27T20:55:17.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.153+0000 7f2d9f297640 1 -- 172.21.15.88:0/3304206769 shutdown_connections 2023-11-27T20:55:17.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.153+0000 7f2d9f297640 1 --2- 172.21.15.88:0/3304206769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d9815a0c0 0x7f2d980ccac0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:17.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.153+0000 7f2d9f297640 1 --2- 172.21.15.88:0/3304206769 >> v2:172.21.15.88:3300/0 conn(0x7f2d980c91d0 0x7f2d9806eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:17.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.153+0000 7f2d9f297640 1 -- 172.21.15.88:0/3304206769 >> 172.21.15.88:0/3304206769 conn(0x7f2d980707f0 msgr2=0x7f2d98070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:17.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.153+0000 7f2d9f297640 1 -- 172.21.15.88:0/3304206769 shutdown_connections 2023-11-27T20:55:17.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.153+0000 7f2d9f297640 1 -- 172.21.15.88:0/3304206769 wait complete. 2023-11-27T20:55:17.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.154+0000 7f2d9f297640 1 Processor -- start 2023-11-27T20:55:17.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.154+0000 7f2d9f297640 1 -- start start 2023-11-27T20:55:17.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.155+0000 7f2d9f297640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d980c91d0 0x7f2d981f25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:17.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.155+0000 7f2d9f297640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d98153730 0x7f2d980c5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:17.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.155+0000 7f2d9f297640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d9815a0c0 0x7f2d980c5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:17.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.155+0000 7f2d9f297640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d980c6cf0 con 0x7f2d98153730 2023-11-27T20:55:17.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.155+0000 7f2d9f297640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d980c4cb0 con 0x7f2d980c91d0 2023-11-27T20:55:17.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.155+0000 7f2d9f297640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d98150820 con 0x7f2d9815a0c0 2023-11-27T20:55:17.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.155+0000 7f2d9d834640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d9815a0c0 0x7f2d980c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:17.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.156+0000 7f2d9d834640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d9815a0c0 0x7f2d980c5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:35284/0 (socket says 172.21.15.88:35284) 2023-11-27T20:55:17.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.156+0000 7f2d9d834640 1 -- 172.21.15.88:0/4198706125 learned_addr learned my addr 172.21.15.88:0/4198706125 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:17.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.156+0000 7f2d9d033640 1 --2- 172.21.15.88:0/4198706125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d980c91d0 0x7f2d981f25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:17.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.156+0000 7f2d9c832640 1 --2- 172.21.15.88:0/4198706125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d98153730 0x7f2d980c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:17.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.159+0000 7f2d9d834640 1 -- 172.21.15.88:0/4198706125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d980c91d0 msgr2=0x7f2d981f25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:17.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.159+0000 7f2d9d834640 1 --2- 172.21.15.88:0/4198706125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d980c91d0 0x7f2d981f25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:17.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.159+0000 7f2d9d834640 1 -- 172.21.15.88:0/4198706125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d98153730 msgr2=0x7f2d980c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:17.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.159+0000 7f2d9d834640 1 --2- 172.21.15.88:0/4198706125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d98153730 0x7f2d980c5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:17.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.159+0000 7f2d9d834640 1 -- 172.21.15.88:0/4198706125 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d90009a70 con 0x7f2d9815a0c0 2023-11-27T20:55:17.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.161+0000 7f2d9d834640 1 --2- 172.21.15.88:0/4198706125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d9815a0c0 0x7f2d980c5680 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2d90037040 tx=0x7f2d90004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:17.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.165+0000 7f2d89ffb640 1 -- 172.21.15.88:0/4198706125 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9003d600 con 0x7f2d9815a0c0 2023-11-27T20:55:17.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.165+0000 7f2d89ffb640 1 -- 172.21.15.88:0/4198706125 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9003d760 con 0x7f2d9815a0c0 2023-11-27T20:55:17.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.165+0000 7f2d9f297640 1 -- 172.21.15.88:0/4198706125 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d98150ac0 con 0x7f2d9815a0c0 2023-11-27T20:55:17.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.165+0000 7f2d89ffb640 1 -- 172.21.15.88:0/4198706125 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9003db10 con 0x7f2d9815a0c0 2023-11-27T20:55:17.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.165+0000 7f2d9f297640 1 -- 172.21.15.88:0/4198706125 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d981f3180 con 0x7f2d9815a0c0 2023-11-27T20:55:17.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.166+0000 7f2d9f297640 1 -- 172.21.15.88:0/4198706125 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d980c4e20 con 0x7f2d9815a0c0 2023-11-27T20:55:17.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.412+0000 7f2d89ffb640 1 -- 172.21.15.88:0/4198706125 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2d9003b040 con 0x7f2d9815a0c0 2023-11-27T20:55:17.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.413+0000 7f2d89ffb640 1 --2- 172.21.15.88:0/4198706125 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f2d7c06b240 0x7f2d7c06d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:17.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.413+0000 7f2d9d033640 1 --2- 172.21.15.88:0/4198706125 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f2d7c06b240 0x7f2d7c06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:17.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.413+0000 7f2d9d033640 1 --2- 172.21.15.88:0/4198706125 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f2d7c06b240 0x7f2d7c06d700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0011e0 tx=0x7f2d8c007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:17.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.416+0000 7f2d89ffb640 1 -- 172.21.15.88:0/4198706125 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2d9007a7b0 con 0x7f2d9815a0c0 2023-11-27T20:55:17.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.425+0000 7f2d89ffb640 1 -- 172.21.15.88:0/4198706125 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2d90076af0 con 0x7f2d9815a0c0 2023-11-27T20:55:17.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.592+0000 7f2d9f297640 1 -- 172.21.15.88:0/4198706125 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2d98073dc0 con 0x7f2d9815a0c0 2023-11-27T20:55:17.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.598+0000 7f2d89ffb640 1 -- 172.21.15.88:0/4198706125 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2d900390a0 con 0x7f2d9815a0c0 2023-11-27T20:55:17.599 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-27T20:55:17.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.599+0000 7f2d9f297640 1 -- 172.21.15.88:0/4198706125 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f2d7c06b240 msgr2=0x7f2d7c06d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:17.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.599+0000 7f2d9f297640 1 --2- 172.21.15.88:0/4198706125 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f2d7c06b240 0x7f2d7c06d700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0011e0 tx=0x7f2d8c007d30 comp rx=0 tx=0).stop 2023-11-27T20:55:17.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.599+0000 7f2d9f297640 1 -- 172.21.15.88:0/4198706125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d9815a0c0 msgr2=0x7f2d980c5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:17.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.599+0000 7f2d9f297640 1 --2- 172.21.15.88:0/4198706125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d9815a0c0 0x7f2d980c5680 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2d90037040 tx=0x7f2d90004a40 comp rx=0 tx=0).stop 2023-11-27T20:55:17.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.599+0000 7f2d9f297640 1 -- 172.21.15.88:0/4198706125 shutdown_connections 2023-11-27T20:55:17.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.599+0000 7f2d9f297640 1 --2- 172.21.15.88:0/4198706125 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f2d7c06b240 0x7f2d7c06d700 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:17.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.599+0000 7f2d9f297640 1 --2- 172.21.15.88:0/4198706125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d9815a0c0 0x7f2d980c5680 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:17.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.599+0000 7f2d9f297640 1 --2- 172.21.15.88:0/4198706125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d98153730 0x7f2d980c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:17.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.599+0000 7f2d9f297640 1 --2- 172.21.15.88:0/4198706125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d980c91d0 0x7f2d981f25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:17.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.599+0000 7f2d9f297640 1 -- 172.21.15.88:0/4198706125 >> 172.21.15.88:0/4198706125 conn(0x7f2d980707f0 msgr2=0x7f2d981e5800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:17.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.599+0000 7f2d9f297640 1 -- 172.21.15.88:0/4198706125 shutdown_connections 2023-11-27T20:55:17.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.599+0000 7f2d9f297640 1 -- 172.21.15.88:0/4198706125 wait complete. 2023-11-27T20:55:17.614 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:55:17.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.713+0000 7f539789b640 1 Processor -- start 2023-11-27T20:55:17.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.714+0000 7f539789b640 1 -- start start 2023-11-27T20:55:17.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.714+0000 7f539789b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5390150530 0x7f53900c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:17.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.714+0000 7f539789b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f53900c7180 0x7f53900c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:17.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.714+0000 7f539789b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5390150910 con 0x7f53900c4a10 2023-11-27T20:55:17.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.714+0000 7f539789b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53900c1ec0 con 0x7f53900c7180 2023-11-27T20:55:17.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.714+0000 7f539789b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539015a4e0 con 0x7f5390150530 2023-11-27T20:55:17.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.715+0000 7f5395637640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5390150530 0x7f53900c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:17.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.715+0000 7f5395e38640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f53900c4a10 0x7f53901596e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:44604/0 (socket says 172.21.15.88:44604) 2023-11-27T20:55:17.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.715+0000 7f5395e38640 1 -- 172.21.15.88:0/2113076156 learned_addr learned my addr 172.21.15.88:0/2113076156 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:55:17.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.716+0000 7f5394e36640 1 --2- 172.21.15.88:0/2113076156 >> v2:172.21.15.167:3300/0 conn(0x7f53900c7180 0x7f53900c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:17.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.718+0000 7f5395637640 1 -- 172.21.15.88:0/2113076156 >> v2:172.21.15.167:3300/0 conn(0x7f53900c7180 msgr2=0x7f53900c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:17.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.718+0000 7f5395637640 1 --2- 172.21.15.88:0/2113076156 >> v2:172.21.15.167:3300/0 conn(0x7f53900c7180 0x7f53900c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:17.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.718+0000 7f5395637640 1 -- 172.21.15.88:0/2113076156 >> v1:172.21.15.167:6789/0 conn(0x7f53900c4a10 legacy=0x7f53901596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:17.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.718+0000 7f5395637640 1 -- 172.21.15.88:0/2113076156 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53900c2110 con 0x7f5390150530 2023-11-27T20:55:17.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.721+0000 7f5395637640 1 --2- 172.21.15.88:0/2113076156 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5390150530 0x7f53900c6c40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f53880097a0 tx=0x7f538802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32d763ac6a44ccd0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:17.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.725+0000 7f5387fff640 1 -- 172.21.15.88:0/2113076156 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5388030610 con 0x7f5390150530 2023-11-27T20:55:17.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.725+0000 7f5387fff640 1 -- 172.21.15.88:0/2113076156 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5388030770 con 0x7f5390150530 2023-11-27T20:55:17.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.725+0000 7f5387fff640 1 -- 172.21.15.88:0/2113076156 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5388030b00 con 0x7f5390150530 2023-11-27T20:55:17.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.725+0000 7f539789b640 1 -- 172.21.15.88:0/2113076156 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5390150530 msgr2=0x7f53900c6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:17.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.725+0000 7f539789b640 1 --2- 172.21.15.88:0/2113076156 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5390150530 0x7f53900c6c40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f53880097a0 tx=0x7f538802b960 comp rx=0 tx=0).stop 2023-11-27T20:55:17.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.725+0000 7f539789b640 1 -- 172.21.15.88:0/2113076156 shutdown_connections 2023-11-27T20:55:17.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.725+0000 7f539789b640 1 --2- 172.21.15.88:0/2113076156 >> v2:172.21.15.167:3300/0 conn(0x7f53900c7180 0x7f53900c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:17.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.725+0000 7f539789b640 1 --2- 172.21.15.88:0/2113076156 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5390150530 0x7f53900c6c40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:17.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.726+0000 7f539789b640 1 -- 172.21.15.88:0/2113076156 >> 172.21.15.88:0/2113076156 conn(0x7f539006c5f0 msgr2=0x7f539006c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:17.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.726+0000 7f539789b640 1 -- 172.21.15.88:0/2113076156 shutdown_connections 2023-11-27T20:55:17.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.726+0000 7f539789b640 1 -- 172.21.15.88:0/2113076156 wait complete. 2023-11-27T20:55:17.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.727+0000 7f539789b640 1 Processor -- start 2023-11-27T20:55:17.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.727+0000 7f539789b640 1 -- start start 2023-11-27T20:55:17.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.727+0000 7f539789b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53900c4a10 0x7f539014d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:17.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.727+0000 7f539789b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53900c7180 0x7f53900c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:17.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.727+0000 7f539789b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5390150530 0x7f53900c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:17.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.727+0000 7f539789b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53900cb7a0 con 0x7f53900c4a10 2023-11-27T20:55:17.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.727+0000 7f539789b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53900ca1d0 con 0x7f53900c7180 2023-11-27T20:55:17.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.727+0000 7f539789b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539014c200 con 0x7f5390150530 2023-11-27T20:55:17.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.728+0000 7f5394e36640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53900c7180 0x7f53900c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:17.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.728+0000 7f5395e38640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5390150530 0x7f53900c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:17.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.728+0000 7f5395637640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53900c4a10 0x7f539014d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:17.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.728+0000 7f5394e36640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53900c7180 0x7f53900c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:59130/0 (socket says 172.21.15.88:59130) 2023-11-27T20:55:17.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.728+0000 7f5394e36640 1 -- 172.21.15.88:0/211629759 learned_addr learned my addr 172.21.15.88:0/211629759 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:17.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.732+0000 7f5395637640 1 -- 172.21.15.88:0/211629759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5390150530 msgr2=0x7f53900c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:17.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.732+0000 7f5395637640 1 --2- 172.21.15.88:0/211629759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5390150530 0x7f53900c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:17.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.732+0000 7f5395637640 1 -- 172.21.15.88:0/211629759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53900c7180 msgr2=0x7f53900c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:17.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.732+0000 7f5395637640 1 --2- 172.21.15.88:0/211629759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53900c7180 0x7f53900c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:17.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.732+0000 7f5395637640 1 -- 172.21.15.88:0/211629759 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5388009400 con 0x7f53900c4a10 2023-11-27T20:55:17.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.734+0000 7f5395637640 1 --2- 172.21.15.88:0/211629759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53900c4a10 0x7f539014d5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f539015a620 tx=0x7f53880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:17.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.737+0000 7f5385ffb640 1 -- 172.21.15.88:0/211629759 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538803e070 con 0x7f53900c4a10 2023-11-27T20:55:17.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.737+0000 7f5385ffb640 1 -- 172.21.15.88:0/211629759 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5388030e30 con 0x7f53900c4a10 2023-11-27T20:55:17.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.737+0000 7f5385ffb640 1 -- 172.21.15.88:0/211629759 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5388039c70 con 0x7f53900c4a10 2023-11-27T20:55:17.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.737+0000 7f539789b640 1 -- 172.21.15.88:0/211629759 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53901effa0 con 0x7f53900c4a10 2023-11-27T20:55:17.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.737+0000 7f539789b640 1 -- 172.21.15.88:0/211629759 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53900cb3c0 con 0x7f53900c4a10 2023-11-27T20:55:17.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.738+0000 7f539789b640 1 -- 172.21.15.88:0/211629759 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53900cb8e0 con 0x7f53900c4a10 2023-11-27T20:55:17.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.981+0000 7f5385ffb640 1 -- 172.21.15.88:0/211629759 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f53880423f0 con 0x7f53900c4a10 2023-11-27T20:55:17.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.981+0000 7f5385ffb640 1 --2- 172.21.15.88:0/211629759 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f537406b240 0x7f537406d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:17.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.981+0000 7f5394e36640 1 --2- 172.21.15.88:0/211629759 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f537406b240 0x7f537406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:17.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.981+0000 7f5394e36640 1 --2- 172.21.15.88:0/211629759 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f537406b240 0x7f537406d700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5390155580 tx=0x7f5380009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:17.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.995+0000 7f5385ffb640 1 -- 172.21.15.88:0/211629759 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f538807a6c0 con 0x7f53900c4a10 2023-11-27T20:55:17.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:17.996+0000 7f5385ffb640 1 -- 172.21.15.88:0/211629759 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5388076a00 con 0x7f53900c4a10 2023-11-27T20:55:18.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.210+0000 7f539789b640 1 -- 172.21.15.88:0/211629759 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53900cb8e0 con 0x7f53900c4a10 2023-11-27T20:55:18.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.223+0000 7f5385ffb640 1 -- 172.21.15.88:0/211629759 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+6568 (secure 0 0 0) 0x7f53900cb8e0 con 0x7f53900c4a10 2023-11-27T20:55:18.225 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:55:18.225 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/298325117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":298325117},{"type":"v1","addr":"172.21.15.88:6837","nonce":298325117}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:54:26.940968+0000","modified":"2023-11-27T20:55:11.136300+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34205,"mds_1":34199,"mds_2":34190,"mds_3":34187,"mds_4":4258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4258":{"gid":4258,"name":"f","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.167:6837/1596074914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1596074914},{"type":"v1","addr":"172.21.15.167:6837","nonce":1596074914}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34187":{"gid":34187,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":15,"addr":"172.21.15.88:6835/256796309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":256796309},{"type":"v1","addr":"172.21.15.88:6835","nonce":256796309}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34190":{"gid":34190,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":14,"addr":"172.21.15.167:6833/1245449675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1245449675},{"type":"v1","addr":"172.21.15.167:6833","nonce":1245449675}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34199":{"gid":34199,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":14,"addr":"172.21.15.167:6835/327644613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":327644613},{"type":"v1","addr":"172.21.15.167:6835","nonce":327644613}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34205":{"gid":34205,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.88:6839/2120059880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":2120059880},{"type":"v1","addr":"172.21.15.88:6839","nonce":2120059880}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T20:55:18.225 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 19 2023-11-27T20:55:18.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.225+0000 7f539789b640 1 -- 172.21.15.88:0/211629759 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f537406b240 msgr2=0x7f537406d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:18.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.225+0000 7f539789b640 1 --2- 172.21.15.88:0/211629759 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f537406b240 0x7f537406d700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5390155580 tx=0x7f5380009190 comp rx=0 tx=0).stop 2023-11-27T20:55:18.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.225+0000 7f539789b640 1 -- 172.21.15.88:0/211629759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53900c4a10 msgr2=0x7f539014d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:18.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.225+0000 7f539789b640 1 --2- 172.21.15.88:0/211629759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53900c4a10 0x7f539014d5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f539015a620 tx=0x7f53880046c0 comp rx=0 tx=0).stop 2023-11-27T20:55:18.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.225+0000 7f539789b640 1 -- 172.21.15.88:0/211629759 shutdown_connections 2023-11-27T20:55:18.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.225+0000 7f539789b640 1 --2- 172.21.15.88:0/211629759 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f537406b240 0x7f537406d700 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:18.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.225+0000 7f539789b640 1 --2- 172.21.15.88:0/211629759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5390150530 0x7f53900c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:18.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.225+0000 7f539789b640 1 --2- 172.21.15.88:0/211629759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53900c7180 0x7f53900c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:18.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.225+0000 7f539789b640 1 --2- 172.21.15.88:0/211629759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53900c4a10 0x7f539014d5a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:18.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.225+0000 7f539789b640 1 -- 172.21.15.88:0/211629759 >> 172.21.15.88:0/211629759 conn(0x7f539006c5f0 msgr2=0x7f5390159780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:18.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.225+0000 7f539789b640 1 -- 172.21.15.88:0/211629759 shutdown_connections 2023-11-27T20:55:18.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.225+0000 7f539789b640 1 -- 172.21.15.88:0/211629759 wait complete. 2023-11-27T20:55:18.237 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:55:18.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.335+0000 7fb8df690640 1 Processor -- start 2023-11-27T20:55:18.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.335+0000 7fb8df690640 1 -- start start 2023-11-27T20:55:18.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.336+0000 7fb8df690640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8d80cb900 0x7fb8d8159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:18.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.336+0000 7fb8df690640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8d80c8270 0x7fb8d80c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:18.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.336+0000 7fb8df690640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d80c8c00 con 0x7fb8d80cb520 2023-11-27T20:55:18.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.336+0000 7fb8df690640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8d80c6e40 con 0x7fb8d80c8270 2023-11-27T20:55:18.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.336+0000 7fb8df690640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d815d430 con 0x7fb8d80cb900 2023-11-27T20:55:18.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.336+0000 7fb8ddc2d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8d80c8270 0x7fb8d80c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:18.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.336+0000 7fb8dcc2b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8d80cb900 0x7fb8d8159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:18.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.337+0000 7fb8dcc2b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8d80cb900 0x7fb8d8159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:35308/0 (socket says 172.21.15.88:35308) 2023-11-27T20:55:18.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.337+0000 7fb8dcc2b640 1 -- 172.21.15.88:0/1086739134 learned_addr learned my addr 172.21.15.88:0/1086739134 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:18.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.339+0000 7fb8dcc2b640 1 -- 172.21.15.88:0/1086739134 >> v2:172.21.15.88:3300/0 conn(0x7fb8d80c8270 msgr2=0x7fb8d80c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:18.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.339+0000 7fb8dcc2b640 1 --2- 172.21.15.88:0/1086739134 >> v2:172.21.15.88:3300/0 conn(0x7fb8d80c8270 0x7fb8d80c86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:18.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.339+0000 7fb8dcc2b640 1 -- 172.21.15.88:0/1086739134 >> v1:172.21.15.88:6789/0 conn(0x7fb8d80cb520 legacy=0x7fb8d815cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:18.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.339+0000 7fb8dcc2b640 1 -- 172.21.15.88:0/1086739134 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d815d710 con 0x7fb8d80cb900 2023-11-27T20:55:18.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.341+0000 7fb8dcc2b640 1 --2- 172.21.15.88:0/1086739134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8d80cb900 0x7fb8d8159620 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8009870 tx=0x7fb8c802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cadbacf70d05c4f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:18.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.344+0000 7fb8cffff640 1 -- 172.21.15.88:0/1086739134 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8031640 con 0x7fb8d80cb900 2023-11-27T20:55:18.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.344+0000 7fb8cffff640 1 -- 172.21.15.88:0/1086739134 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c80317a0 con 0x7fb8d80cb900 2023-11-27T20:55:18.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.344+0000 7fb8cffff640 1 -- 172.21.15.88:0/1086739134 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8031b30 con 0x7fb8d80cb900 2023-11-27T20:55:18.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.345+0000 7fb8df690640 1 -- 172.21.15.88:0/1086739134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8d80cb900 msgr2=0x7fb8d8159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:18.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.345+0000 7fb8df690640 1 --2- 172.21.15.88:0/1086739134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8d80cb900 0x7fb8d8159620 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8009870 tx=0x7fb8c802b8f0 comp rx=0 tx=0).stop 2023-11-27T20:55:18.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.345+0000 7fb8df690640 1 -- 172.21.15.88:0/1086739134 shutdown_connections 2023-11-27T20:55:18.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.345+0000 7fb8df690640 1 --2- 172.21.15.88:0/1086739134 >> v2:172.21.15.88:3300/0 conn(0x7fb8d80c8270 0x7fb8d80c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:18.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.345+0000 7fb8df690640 1 --2- 172.21.15.88:0/1086739134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8d80cb900 0x7fb8d8159620 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:18.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.345+0000 7fb8df690640 1 -- 172.21.15.88:0/1086739134 >> 172.21.15.88:0/1086739134 conn(0x7fb8d806d170 msgr2=0x7fb8d806d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:18.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.345+0000 7fb8df690640 1 -- 172.21.15.88:0/1086739134 shutdown_connections 2023-11-27T20:55:18.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.345+0000 7fb8df690640 1 -- 172.21.15.88:0/1086739134 wait complete. 2023-11-27T20:55:18.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.346+0000 7fb8df690640 1 Processor -- start 2023-11-27T20:55:18.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.346+0000 7fb8df690640 1 -- start start 2023-11-27T20:55:18.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.347+0000 7fb8df690640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8d80c8270 0x7fb8d8151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:18.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.347+0000 7fb8df690640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8d80cb520 0x7fb8d814ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:18.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.347+0000 7fb8df690640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8d80cb900 0x7fb8d814bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:18.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.347+0000 7fb8df690640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d81efb40 con 0x7fb8d80c8270 2023-11-27T20:55:18.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.347+0000 7fb8df690640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d81598f0 con 0x7fb8d80cb520 2023-11-27T20:55:18.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.347+0000 7fb8df690640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d81505e0 con 0x7fb8d80cb900 2023-11-27T20:55:18.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.347+0000 7fb8dd42c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8d80c8270 0x7fb8d8151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:18.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.348+0000 7fb8dcc2b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8d80cb520 0x7fb8d814ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:18.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.348+0000 7fb8dd42c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8d80c8270 0x7fb8d8151680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44914/0 (socket says 172.21.15.88:44914) 2023-11-27T20:55:18.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.348+0000 7fb8dd42c640 1 -- 172.21.15.88:0/3624036472 learned_addr learned my addr 172.21.15.88:0/3624036472 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:18.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.348+0000 7fb8ddc2d640 1 --2- 172.21.15.88:0/3624036472 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8d80cb900 0x7fb8d814bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:18.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.351+0000 7fb8dd42c640 1 -- 172.21.15.88:0/3624036472 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8d80cb900 msgr2=0x7fb8d814bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:18.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.351+0000 7fb8dd42c640 1 --2- 172.21.15.88:0/3624036472 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8d80cb900 0x7fb8d814bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:18.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.351+0000 7fb8dd42c640 1 -- 172.21.15.88:0/3624036472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8d80cb520 msgr2=0x7fb8d814ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:18.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.351+0000 7fb8dd42c640 1 --2- 172.21.15.88:0/3624036472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8d80cb520 0x7fb8d814ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:18.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.351+0000 7fb8dd42c640 1 -- 172.21.15.88:0/3624036472 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c80094d0 con 0x7fb8d80c8270 2023-11-27T20:55:18.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.353+0000 7fb8dd42c640 1 --2- 172.21.15.88:0/3624036472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8d80c8270 0x7fb8d8151680 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000c4d0 tx=0x7fb8d000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:18.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.356+0000 7fb8cdffb640 1 -- 172.21.15.88:0/3624036472 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d00052d0 con 0x7fb8d80c8270 2023-11-27T20:55:18.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.356+0000 7fb8cdffb640 1 -- 172.21.15.88:0/3624036472 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d0005430 con 0x7fb8d80c8270 2023-11-27T20:55:18.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.356+0000 7fb8cdffb640 1 -- 172.21.15.88:0/3624036472 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0012850 con 0x7fb8d80c8270 2023-11-27T20:55:18.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.356+0000 7fb8df690640 1 -- 172.21.15.88:0/3624036472 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d81508c0 con 0x7fb8d80c8270 2023-11-27T20:55:18.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.356+0000 7fb8df690640 1 -- 172.21.15.88:0/3624036472 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d8150e80 con 0x7fb8d80c8270 2023-11-27T20:55:18.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.357+0000 7fb8df690640 1 -- 172.21.15.88:0/3624036472 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d8151bc0 con 0x7fb8d80c8270 2023-11-27T20:55:18.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.597+0000 7fb8cdffb640 1 -- 172.21.15.88:0/3624036472 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb8d00129b0 con 0x7fb8d80c8270 2023-11-27T20:55:18.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.597+0000 7fb8cdffb640 1 --2- 172.21.15.88:0/3624036472 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb8bc06b210 0x7fb8bc06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:18.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.598+0000 7fb8dcc2b640 1 --2- 172.21.15.88:0/3624036472 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb8bc06b210 0x7fb8bc06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:18.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.598+0000 7fb8dcc2b640 1 --2- 172.21.15.88:0/3624036472 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb8bc06b210 0x7fb8bc06d6d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8036000 tx=0x7fb8c803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:18.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.611+0000 7fb8cdffb640 1 -- 172.21.15.88:0/3624036472 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb8d0058930 con 0x7fb8d80c8270 2023-11-27T20:55:18.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.611+0000 7fb8cdffb640 1 -- 172.21.15.88:0/3624036472 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb8d0054c70 con 0x7fb8d80c8270 2023-11-27T20:55:18.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.782+0000 7fb8df690640 1 -- 172.21.15.88:0/3624036472 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8d8067470 con 0x7fb8d80c8270 2023-11-27T20:55:18.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.819+0000 7fb8cdffb640 1 -- 172.21.15.88:0/3624036472 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18666 (secure 0 0 0) 0x7fb8d0058290 con 0x7fb8d80c8270 2023-11-27T20:55:18.821 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:55:18.821 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":28,"fsid":"ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc","created":"2023-11-27T20:53:53.110827+0000","modified":"2023-11-27T20:55:00.550945+0000","last_up_change":"2023-11-27T20:54:08.219383+0000","last_in_change":"2023-11-27T20:53:59.022798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:54:09.277670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:54:24.503156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:54:25.744043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T20:54:29.704111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1207ca0f-bef1-44c6-b66b-58bf0e080ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6819","nonce":3952326022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6821","nonce":3952326022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6825","nonce":3952326022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6823","nonce":3952326022}]},"public_addr":"172.21.15.88:6819/3952326022","cluster_addr":"172.21.15.88:6821/3952326022","heartbeat_back_addr":"172.21.15.88:6825/3952326022","heartbeat_front_addr":"172.21.15.88:6823/3952326022","state":["exists","up"]},{"osd":1,"uuid":"8d1be479-4241-4335-9633-1394311fde76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6827","nonce":1788401966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6829","nonce":1788401966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6833","nonce":1788401966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6831","nonce":1788401966}]},"public_addr":"172.21.15.88:6827/1788401966","cluster_addr":"172.21.15.88:6829/1788401966","heartbeat_back_addr":"172.21.15.88:6833/1788401966","heartbeat_front_addr":"172.21.15.88:6831/1788401966","state":["exists","up"]},{"osd":2,"uuid":"7536b008-05dd-40eb-9d4a-bdac4b1c38c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6803","nonce":1166333913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6805","nonce":1166333913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6809","nonce":1166333913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6807","nonce":1166333913}]},"public_addr":"172.21.15.88:6803/1166333913","cluster_addr":"172.21.15.88:6805/1166333913","heartbeat_back_addr":"172.21.15.88:6809/1166333913","heartbeat_front_addr":"172.21.15.88:6807/1166333913","state":["exists","up"]},{"osd":3,"uuid":"47edd4d7-e99c-4ce3-851b-cc9c8e2d4480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6811","nonce":406887502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6813","nonce":406887502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6817","nonce":406887502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6815","nonce":406887502}]},"public_addr":"172.21.15.88:6811/406887502","cluster_addr":"172.21.15.88:6813/406887502","heartbeat_back_addr":"172.21.15.88:6817/406887502","heartbeat_front_addr":"172.21.15.88:6815/406887502","state":["exists","up"]},{"osd":4,"uuid":"0a81dd31-1a8b-41af-b933-d74aae63f3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6801","nonce":2551293703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6803","nonce":2551293703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6807","nonce":2551293703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6805","nonce":2551293703}]},"public_addr":"172.21.15.167:6801/2551293703","cluster_addr":"172.21.15.167:6803/2551293703","heartbeat_back_addr":"172.21.15.167:6807/2551293703","heartbeat_front_addr":"172.21.15.167:6805/2551293703","state":["exists","up"]},{"osd":5,"uuid":"1c462d0d-3361-48b3-a82a-86a920539e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6825","nonce":866085094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6827","nonce":866085094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6831","nonce":866085094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6829","nonce":866085094}]},"public_addr":"172.21.15.167:6825/866085094","cluster_addr":"172.21.15.167:6827/866085094","heartbeat_back_addr":"172.21.15.167:6831/866085094","heartbeat_front_addr":"172.21.15.167:6829/866085094","state":["exists","up"]},{"osd":6,"uuid":"d687c5ad-6c88-4a15-8120-0cdbc5610535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6809","nonce":2766725538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6811","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6813","nonce":2766725538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6819","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6821","nonce":2766725538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6815","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6817","nonce":2766725538}]},"public_addr":"172.21.15.167:6809/2766725538","cluster_addr":"172.21.15.167:6813/2766725538","heartbeat_back_addr":"172.21.15.167:6821/2766725538","heartbeat_front_addr":"172.21.15.167:6817/2766725538","state":["exists","up"]},{"osd":7,"uuid":"c9a50596-4981-4bd8-a8ef-d7679f8d9559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6812","nonce":2695037266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6816","nonce":2695037266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6823","nonce":2695037266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6820","nonce":2695037266}]},"public_addr":"172.21.15.167:6812/2695037266","cluster_addr":"172.21.15.167:6816/2695037266","heartbeat_back_addr":"172.21.15.167:6823/2695037266","heartbeat_front_addr":"172.21.15.167:6820/2695037266","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.522590+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.483170+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.492504+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.432204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.414964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.459803+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.437250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.460394+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.1d","mappings":[{"from":0,"to":1}]},{"pgid":"3.35","mappings":[{"from":0,"to":7}]},{"pgid":"4.4","mappings":[{"from":6,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":4}]},{"pgid":"4.e","mappings":[{"from":3,"to":5}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:55:18.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.821+0000 7fb8df690640 1 -- 172.21.15.88:0/3624036472 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb8bc06b210 msgr2=0x7fb8bc06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:18.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.821+0000 7fb8df690640 1 --2- 172.21.15.88:0/3624036472 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb8bc06b210 0x7fb8bc06d6d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8036000 tx=0x7fb8c803c040 comp rx=0 tx=0).stop 2023-11-27T20:55:18.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.821+0000 7fb8df690640 1 -- 172.21.15.88:0/3624036472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8d80c8270 msgr2=0x7fb8d8151680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:18.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.821+0000 7fb8df690640 1 --2- 172.21.15.88:0/3624036472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8d80c8270 0x7fb8d8151680 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000c4d0 tx=0x7fb8d000c990 comp rx=0 tx=0).stop 2023-11-27T20:55:18.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.821+0000 7fb8df690640 1 -- 172.21.15.88:0/3624036472 shutdown_connections 2023-11-27T20:55:18.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.821+0000 7fb8df690640 1 --2- 172.21.15.88:0/3624036472 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb8bc06b210 0x7fb8bc06d6d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:18.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.821+0000 7fb8df690640 1 --2- 172.21.15.88:0/3624036472 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8d80cb900 0x7fb8d814bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:18.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.821+0000 7fb8df690640 1 --2- 172.21.15.88:0/3624036472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8d80cb520 0x7fb8d814ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:18.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.821+0000 7fb8df690640 1 --2- 172.21.15.88:0/3624036472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8d80c8270 0x7fb8d8151680 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:18.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.821+0000 7fb8df690640 1 -- 172.21.15.88:0/3624036472 >> 172.21.15.88:0/3624036472 conn(0x7fb8d806d170 msgr2=0x7fb8d80c5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:18.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.821+0000 7fb8df690640 1 -- 172.21.15.88:0/3624036472 shutdown_connections 2023-11-27T20:55:18.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.821+0000 7fb8df690640 1 -- 172.21.15.88:0/3624036472 wait complete. 2023-11-27T20:55:18.834 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:55:18.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.934+0000 7f3214b73640 1 Processor -- start 2023-11-27T20:55:18.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.934+0000 7f3214b73640 1 -- start start 2023-11-27T20:55:18.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.935+0000 7f3214b73640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f321014ffa0 0x7f32100c1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:18.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.935+0000 7f3214b73640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3210150380 0x7f321006fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:18.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.935+0000 7f3214b73640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32101570d0 con 0x7f321006ffc0 2023-11-27T20:55:18.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.935+0000 7f3214b73640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3210156270 con 0x7f3210150380 2023-11-27T20:55:18.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.935+0000 7f3214b73640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3210156550 con 0x7f321014ffa0 2023-11-27T20:55:18.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.936+0000 7f320e59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f321014ffa0 0x7f32100c1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:18.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.936+0000 7f320e59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f321014ffa0 0x7f32100c1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:59142/0 (socket says 172.21.15.88:59142) 2023-11-27T20:55:18.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.936+0000 7f320e59c640 1 -- 172.21.15.88:0/2238098331 learned_addr learned my addr 172.21.15.88:0/2238098331 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:18.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.939+0000 7f320e59c640 1 -- 172.21.15.88:0/2238098331 >> v2:172.21.15.88:3300/0 conn(0x7f3210150380 msgr2=0x7f321006fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:18.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.939+0000 7f320e59c640 1 --2- 172.21.15.88:0/2238098331 >> v2:172.21.15.88:3300/0 conn(0x7f3210150380 0x7f321006fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:18.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.939+0000 7f320e59c640 1 -- 172.21.15.88:0/2238098331 >> v1:172.21.15.88:6789/0 conn(0x7f321006ffc0 legacy=0x7f32100c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:18.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.939+0000 7f320e59c640 1 -- 172.21.15.88:0/2238098331 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3210156830 con 0x7f321014ffa0 2023-11-27T20:55:18.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.941+0000 7f320e59c640 1 --2- 172.21.15.88:0/2238098331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f321014ffa0 0x7f32100c1900 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f32100c91c0 tx=0x7f320002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67db855bdab411b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:18.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.944+0000 7f320d59a640 1 -- 172.21.15.88:0/2238098331 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3200030860 con 0x7f321014ffa0 2023-11-27T20:55:18.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.944+0000 7f320d59a640 1 -- 172.21.15.88:0/2238098331 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32000309c0 con 0x7f321014ffa0 2023-11-27T20:55:18.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.944+0000 7f320d59a640 1 -- 172.21.15.88:0/2238098331 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3200030d50 con 0x7f321014ffa0 2023-11-27T20:55:18.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.945+0000 7f3214b73640 1 -- 172.21.15.88:0/2238098331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f321014ffa0 msgr2=0x7f32100c1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:18.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.945+0000 7f3214b73640 1 --2- 172.21.15.88:0/2238098331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f321014ffa0 0x7f32100c1900 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f32100c91c0 tx=0x7f320002b9a0 comp rx=0 tx=0).stop 2023-11-27T20:55:18.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.945+0000 7f3214b73640 1 -- 172.21.15.88:0/2238098331 shutdown_connections 2023-11-27T20:55:18.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.945+0000 7f3214b73640 1 --2- 172.21.15.88:0/2238098331 >> v2:172.21.15.88:3300/0 conn(0x7f3210150380 0x7f321006fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:18.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.945+0000 7f3214b73640 1 --2- 172.21.15.88:0/2238098331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f321014ffa0 0x7f32100c1900 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:18.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.945+0000 7f3214b73640 1 -- 172.21.15.88:0/2238098331 >> 172.21.15.88:0/2238098331 conn(0x7f321006b5c0 msgr2=0x7f321006b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:18.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.945+0000 7f3214b73640 1 -- 172.21.15.88:0/2238098331 shutdown_connections 2023-11-27T20:55:18.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.945+0000 7f3214b73640 1 -- 172.21.15.88:0/2238098331 wait complete. 2023-11-27T20:55:18.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.947+0000 7f3214b73640 1 Processor -- start 2023-11-27T20:55:18.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.947+0000 7f3214b73640 1 -- start start 2023-11-27T20:55:18.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.948+0000 7f3214b73640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f321006ffc0 0x7f3210144880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:18.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.948+0000 7f3214b73640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f321014ffa0 0x7f3210144dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:18.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.948+0000 7f3214b73640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3210150380 0x7f321006a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:18.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.948+0000 7f3214b73640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32101f0b00 con 0x7f321006ffc0 2023-11-27T20:55:18.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.948+0000 7f3214b73640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32100c47a0 con 0x7f3210150380 2023-11-27T20:55:18.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.948+0000 7f3214b73640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32101eff50 con 0x7f321014ffa0 2023-11-27T20:55:18.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.949+0000 7f320ed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3210150380 0x7f321006a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:18.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.949+0000 7f320dd9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f321014ffa0 0x7f3210144dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:18.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.949+0000 7f320ed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3210150380 0x7f321006a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:59156/0 (socket says 172.21.15.88:59156) 2023-11-27T20:55:18.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.949+0000 7f320ed9d640 1 -- 172.21.15.88:0/2122165855 learned_addr learned my addr 172.21.15.88:0/2122165855 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:18.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.953+0000 7f320dd9b640 1 -- 172.21.15.88:0/2122165855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3210150380 msgr2=0x7f321006a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:18.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.953+0000 7f320dd9b640 1 --2- 172.21.15.88:0/2122165855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3210150380 0x7f321006a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:18.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.953+0000 7f320dd9b640 1 -- 172.21.15.88:0/2122165855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f321006ffc0 msgr2=0x7f3210144880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:18.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.953+0000 7f320dd9b640 1 --2- 172.21.15.88:0/2122165855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f321006ffc0 0x7f3210144880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:18.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.953+0000 7f320dd9b640 1 -- 172.21.15.88:0/2122165855 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32000094d0 con 0x7f321014ffa0 2023-11-27T20:55:18.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.953+0000 7f320ed9d640 1 --2- 172.21.15.88:0/2122165855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3210150380 0x7f321006a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:55:18.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.957+0000 7f320dd9b640 1 --2- 172.21.15.88:0/2122165855 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f321014ffa0 0x7f3210144dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f320400b3c0 tx=0x7f320400b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:18.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.961+0000 7f31feffd640 1 -- 172.21.15.88:0/2122165855 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3204011830 con 0x7f321014ffa0 2023-11-27T20:55:18.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.961+0000 7f31feffd640 1 -- 172.21.15.88:0/2122165855 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32040119b0 con 0x7f321014ffa0 2023-11-27T20:55:18.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.961+0000 7f31feffd640 1 -- 172.21.15.88:0/2122165855 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3204011d60 con 0x7f321014ffa0 2023-11-27T20:55:18.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.961+0000 7f3214b73640 1 -- 172.21.15.88:0/2122165855 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32100c4060 con 0x7f321014ffa0 2023-11-27T20:55:18.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.961+0000 7f3214b73640 1 -- 172.21.15.88:0/2122165855 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32101f0160 con 0x7f321014ffa0 2023-11-27T20:55:18.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:18.962+0000 7f3214b73640 1 -- 172.21.15.88:0/2122165855 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3210153d80 con 0x7f321014ffa0 2023-11-27T20:55:19.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:19.214+0000 7f31feffd640 1 -- 172.21.15.88:0/2122165855 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f320401b460 con 0x7f321014ffa0 2023-11-27T20:55:19.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:19.214+0000 7f31feffd640 1 --2- 172.21.15.88:0/2122165855 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f31f006b210 0x7f31f006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:19.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:19.215+0000 7f320e59c640 1 --2- 172.21.15.88:0/2122165855 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f31f006b210 0x7f31f006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:19.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:19.215+0000 7f320e59c640 1 --2- 172.21.15.88:0/2122165855 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f31f006b210 0x7f31f006d6d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3200036000 tx=0x7f320003b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:19.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:19.220+0000 7f31feffd640 1 -- 172.21.15.88:0/2122165855 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3204059350 con 0x7f321014ffa0 2023-11-27T20:55:19.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:19.230+0000 7f31feffd640 1 -- 172.21.15.88:0/2122165855 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3204054f90 con 0x7f321014ffa0 2023-11-27T20:55:19.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:19.442+0000 7f3214b73640 1 -- 172.21.15.88:0/2122165855 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32101f0c40 con 0x7f321014ffa0 2023-11-27T20:55:19.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:19.471+0000 7f31feffd640 1 -- 172.21.15.88:0/2122165855 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+6568 (secure 0 0 0) 0x7f32101f0c40 con 0x7f321014ffa0 2023-11-27T20:55:19.473 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T20:55:19.473 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/298325117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":298325117},{"type":"v1","addr":"172.21.15.88:6837","nonce":298325117}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:54:26.940968+0000","modified":"2023-11-27T20:55:11.136300+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34205,"mds_1":34199,"mds_2":34190,"mds_3":34187,"mds_4":4258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4258":{"gid":4258,"name":"f","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.167:6837/1596074914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1596074914},{"type":"v1","addr":"172.21.15.167:6837","nonce":1596074914}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34187":{"gid":34187,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":15,"addr":"172.21.15.88:6835/256796309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":256796309},{"type":"v1","addr":"172.21.15.88:6835","nonce":256796309}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34190":{"gid":34190,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":14,"addr":"172.21.15.167:6833/1245449675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1245449675},{"type":"v1","addr":"172.21.15.167:6833","nonce":1245449675}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34199":{"gid":34199,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":14,"addr":"172.21.15.167:6835/327644613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":327644613},{"type":"v1","addr":"172.21.15.167:6835","nonce":327644613}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34205":{"gid":34205,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.88:6839/2120059880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":2120059880},{"type":"v1","addr":"172.21.15.88:6839","nonce":2120059880}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T20:55:19.473 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 19 2023-11-27T20:55:19.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:19.473+0000 7f3214b73640 1 -- 172.21.15.88:0/2122165855 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f31f006b210 msgr2=0x7f31f006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:19.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:19.473+0000 7f3214b73640 1 --2- 172.21.15.88:0/2122165855 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f31f006b210 0x7f31f006d6d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3200036000 tx=0x7f320003b040 comp rx=0 tx=0).stop 2023-11-27T20:55:19.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:19.473+0000 7f3214b73640 1 -- 172.21.15.88:0/2122165855 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f321014ffa0 msgr2=0x7f3210144dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:19.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:19.473+0000 7f3214b73640 1 --2- 172.21.15.88:0/2122165855 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f321014ffa0 0x7f3210144dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f320400b3c0 tx=0x7f320400b880 comp rx=0 tx=0).stop 2023-11-27T20:55:19.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:19.473+0000 7f3214b73640 1 -- 172.21.15.88:0/2122165855 shutdown_connections 2023-11-27T20:55:19.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:19.473+0000 7f3214b73640 1 --2- 172.21.15.88:0/2122165855 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f31f006b210 0x7f31f006d6d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:19.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:19.473+0000 7f3214b73640 1 --2- 172.21.15.88:0/2122165855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3210150380 0x7f321006a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:19.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:19.473+0000 7f3214b73640 1 --2- 172.21.15.88:0/2122165855 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f321014ffa0 0x7f3210144dc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:19.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:19.473+0000 7f3214b73640 1 --2- 172.21.15.88:0/2122165855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f321006ffc0 0x7f3210144880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:19.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:19.473+0000 7f3214b73640 1 -- 172.21.15.88:0/2122165855 >> 172.21.15.88:0/2122165855 conn(0x7f321006b5c0 msgr2=0x7f321006f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:19.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:19.473+0000 7f3214b73640 1 -- 172.21.15.88:0/2122165855 shutdown_connections 2023-11-27T20:55:19.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:19.473+0000 7f3214b73640 1 -- 172.21.15.88:0/2122165855 wait complete. 2023-11-27T20:55:20.089 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-27T20:54:26.940968+0000', 'modified': '2023-11-27T20:55:11.136300+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 34205, 'mds_1': 34199, 'mds_2': 34190, 'mds_3': 34187, 'mds_4': 4258}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4258': {'gid': 4258, 'name': 'f', 'rank': 4, 'incarnation': 18, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.167:6837/1596074914', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6836', 'nonce': 1596074914}, {'type': 'v1', 'addr': '172.21.15.167:6837', 'nonce': 1596074914}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_34187': {'gid': 34187, 'name': 'e', 'rank': 3, 'incarnation': 16, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.88:6835/256796309', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6834', 'nonce': 256796309}, {'type': 'v1', 'addr': '172.21.15.88:6835', 'nonce': 256796309}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_34190': {'gid': 34190, 'name': 'd', 'rank': 2, 'incarnation': 14, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.167:6833/1245449675', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6832', 'nonce': 1245449675}, {'type': 'v1', 'addr': '172.21.15.167:6833', 'nonce': 1245449675}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_34199': {'gid': 34199, 'name': 'b', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.167:6835/327644613', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6834', 'nonce': 327644613}, {'type': 'v1', 'addr': '172.21.15.167:6835', 'nonce': 327644613}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_34205': {'gid': 34205, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.88:6839/2120059880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6838', 'nonce': 2120059880}, {'type': 'v1', 'addr': '172.21.15.88:6839', 'nonce': 2120059880}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-27T20:55:20.089 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-11-27T20:55:20.089 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-11-27T20:55:20.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.188+0000 7f285355a640 1 Processor -- start 2023-11-27T20:55:20.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.188+0000 7f285355a640 1 -- start start 2023-11-27T20:55:20.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.189+0000 7f285355a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f284c0c8ee0 0x7f284c06e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.189+0000 7f285355a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f284c06ed80 0x7f284c06ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.189+0000 7f285355a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284c0c7640 con 0x7f284c1538d0 2023-11-27T20:55:20.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.189+0000 7f285355a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284c06d130 con 0x7f284c06ed80 2023-11-27T20:55:20.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.189+0000 7f285355a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284c06b5c0 con 0x7f284c0c8ee0 2023-11-27T20:55:20.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.190+0000 7f2850af5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f284c0c8ee0 0x7f284c06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.190+0000 7f28512f6640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f284c1538d0 0x7f284c15a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:44606/0 (socket says 172.21.15.88:44606) 2023-11-27T20:55:20.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.190+0000 7f28512f6640 1 -- 172.21.15.88:0/2540399709 learned_addr learned my addr 172.21.15.88:0/2540399709 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:55:20.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.190+0000 7f2851af7640 1 --2- 172.21.15.88:0/2540399709 >> v2:172.21.15.167:3300/0 conn(0x7f284c06ed80 0x7f284c06ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.193+0000 7f2850af5640 1 -- 172.21.15.88:0/2540399709 >> v2:172.21.15.167:3300/0 conn(0x7f284c06ed80 msgr2=0x7f284c06ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:20.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.193+0000 7f2850af5640 1 --2- 172.21.15.88:0/2540399709 >> v2:172.21.15.167:3300/0 conn(0x7f284c06ed80 0x7f284c06ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.193+0000 7f2850af5640 1 -- 172.21.15.88:0/2540399709 >> v1:172.21.15.167:6789/0 conn(0x7f284c1538d0 legacy=0x7f284c15a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:20.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.193+0000 7f2850af5640 1 -- 172.21.15.88:0/2540399709 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c0cd750 con 0x7f284c0c8ee0 2023-11-27T20:55:20.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.195+0000 7f2850af5640 1 --2- 172.21.15.88:0/2540399709 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f284c0c8ee0 0x7f284c06e840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f283c0097a0 tx=0x7f283c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef53b37d830ee267 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:20.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.197+0000 7f2843fff640 1 -- 172.21.15.88:0/2540399709 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c02e070 con 0x7f284c0c8ee0 2023-11-27T20:55:20.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.198+0000 7f2843fff640 1 -- 172.21.15.88:0/2540399709 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283c0315a0 con 0x7f284c0c8ee0 2023-11-27T20:55:20.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.199+0000 7f2843fff640 1 -- 172.21.15.88:0/2540399709 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c031930 con 0x7f284c0c8ee0 2023-11-27T20:55:20.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.199+0000 7f285355a640 1 -- 172.21.15.88:0/2540399709 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f284c0c8ee0 msgr2=0x7f284c06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:20.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.199+0000 7f285355a640 1 --2- 172.21.15.88:0/2540399709 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f284c0c8ee0 0x7f284c06e840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f283c0097a0 tx=0x7f283c02b840 comp rx=0 tx=0).stop 2023-11-27T20:55:20.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.199+0000 7f285355a640 1 -- 172.21.15.88:0/2540399709 shutdown_connections 2023-11-27T20:55:20.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.199+0000 7f285355a640 1 --2- 172.21.15.88:0/2540399709 >> v2:172.21.15.167:3300/0 conn(0x7f284c06ed80 0x7f284c06ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.199+0000 7f285355a640 1 --2- 172.21.15.88:0/2540399709 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f284c0c8ee0 0x7f284c06e840 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.199+0000 7f285355a640 1 -- 172.21.15.88:0/2540399709 >> 172.21.15.88:0/2540399709 conn(0x7f284c060f20 msgr2=0x7f284c061300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:20.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.199+0000 7f285355a640 1 -- 172.21.15.88:0/2540399709 shutdown_connections 2023-11-27T20:55:20.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.199+0000 7f285355a640 1 -- 172.21.15.88:0/2540399709 wait complete. 2023-11-27T20:55:20.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.200+0000 7f285355a640 1 Processor -- start 2023-11-27T20:55:20.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.200+0000 7f285355a640 1 -- start start 2023-11-27T20:55:20.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.201+0000 7f285355a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f284c06ed80 0x7f284c14f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.201+0000 7f285355a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f284c0c8ee0 0x7f284c0c4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.201+0000 7f285355a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f284c1538d0 0x7f284c1ef100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.201+0000 7f285355a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c0c61d0 con 0x7f284c06ed80 2023-11-27T20:55:20.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.201+0000 7f285355a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c0c64b0 con 0x7f284c0c8ee0 2023-11-27T20:55:20.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.201+0000 7f285355a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284c0c6790 con 0x7f284c1538d0 2023-11-27T20:55:20.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.202+0000 7f28512f6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f284c06ed80 0x7f284c14f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.202+0000 7f2850af5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f284c0c8ee0 0x7f284c0c4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.202+0000 7f2851af7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f284c1538d0 0x7f284c1ef100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.202+0000 7f2850af5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f284c0c8ee0 0x7f284c0c4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:59166/0 (socket says 172.21.15.88:59166) 2023-11-27T20:55:20.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.202+0000 7f2850af5640 1 -- 172.21.15.88:0/2864477750 learned_addr learned my addr 172.21.15.88:0/2864477750 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:20.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.205+0000 7f2850af5640 1 -- 172.21.15.88:0/2864477750 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f284c1538d0 msgr2=0x7f284c1ef100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:20.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.205+0000 7f2850af5640 1 --2- 172.21.15.88:0/2864477750 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f284c1538d0 0x7f284c1ef100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.205+0000 7f2850af5640 1 -- 172.21.15.88:0/2864477750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f284c06ed80 msgr2=0x7f284c14f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:20.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.205+0000 7f2850af5640 1 --2- 172.21.15.88:0/2864477750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f284c06ed80 0x7f284c14f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.205+0000 7f2850af5640 1 -- 172.21.15.88:0/2864477750 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283c009400 con 0x7f284c0c8ee0 2023-11-27T20:55:20.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.208+0000 7f2850af5640 1 --2- 172.21.15.88:0/2864477750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f284c0c8ee0 0x7f284c0c4040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f283c000c00 tx=0x7f283c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:20.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.211+0000 7f2841ffb640 1 -- 172.21.15.88:0/2864477750 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c032630 con 0x7f284c0c8ee0 2023-11-27T20:55:20.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.211+0000 7f2841ffb640 1 -- 172.21.15.88:0/2864477750 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283c0327b0 con 0x7f284c0c8ee0 2023-11-27T20:55:20.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.211+0000 7f2841ffb640 1 -- 172.21.15.88:0/2864477750 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c032b60 con 0x7f284c0c8ee0 2023-11-27T20:55:20.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.211+0000 7f285355a640 1 -- 172.21.15.88:0/2864477750 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f284c0c6a70 con 0x7f284c0c8ee0 2023-11-27T20:55:20.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.212+0000 7f285355a640 1 -- 172.21.15.88:0/2864477750 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284c0c5870 con 0x7f284c0c8ee0 2023-11-27T20:55:20.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.214+0000 7f28561c8740 1 Processor -- start 2023-11-27T20:55:20.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.214+0000 7f28561c8740 1 -- start start 2023-11-27T20:55:20.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.215+0000 7f28561c8740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562c484b5650 0x562c484b5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.215+0000 7f28561c8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c484ff4d0 0x562c484b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.215+0000 7f28561c8740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562c484b40b0 0x562c484f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.215+0000 7f28561c8740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c48470980 con 0x562c484b40b0 2023-11-27T20:55:20.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.215+0000 7f28561c8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c48422b90 con 0x562c484ff4d0 2023-11-27T20:55:20.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.215+0000 7f28561c8740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562c48420280 con 0x562c484b5650 2023-11-27T20:55:20.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.216+0000 7f2850af5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562c484b40b0 0x562c484f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.216+0000 7f2851af7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562c484b5650 0x562c484b5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.216+0000 7f2850af5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562c484b40b0 0x562c484f4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44946/0 (socket says 172.21.15.88:44946) 2023-11-27T20:55:20.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.216+0000 7f2850af5640 1 -- 172.21.15.88:0/3068379125 learned_addr learned my addr 172.21.15.88:0/3068379125 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:20.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.218+0000 7f2850af5640 1 -- 172.21.15.88:0/3068379125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562c484b5650 msgr2=0x562c484b5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:20.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.218+0000 7f2850af5640 1 --2- 172.21.15.88:0/3068379125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562c484b5650 0x562c484b5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.218+0000 7f2850af5640 1 -- 172.21.15.88:0/3068379125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c484ff4d0 msgr2=0x562c484b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:20.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.218+0000 7f2850af5640 1 --2- 172.21.15.88:0/3068379125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c484ff4d0 0x562c484b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.218+0000 7f2850af5640 1 -- 172.21.15.88:0/3068379125 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c483e1500 con 0x562c484b40b0 2023-11-27T20:55:20.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.220+0000 7f2850af5640 1 --2- 172.21.15.88:0/3068379125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562c484b40b0 0x562c484f4eb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f283c02be50 tx=0x7f283c03e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac8f626740f3488 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:20.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.223+0000 7f282effd640 1 -- 172.21.15.88:0/3068379125 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c052040 con 0x562c484b40b0 2023-11-27T20:55:20.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.223+0000 7f282effd640 1 -- 172.21.15.88:0/3068379125 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283c04de10 con 0x562c484b40b0 2023-11-27T20:55:20.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.223+0000 7f282effd640 1 -- 172.21.15.88:0/3068379125 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c0576c0 con 0x562c484b40b0 2023-11-27T20:55:20.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.224+0000 7f28561c8740 1 -- 172.21.15.88:0/3068379125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562c484b40b0 msgr2=0x562c484f4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:20.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.224+0000 7f28561c8740 1 --2- 172.21.15.88:0/3068379125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562c484b40b0 0x562c484f4eb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f283c02be50 tx=0x7f283c03e000 comp rx=0 tx=0).stop 2023-11-27T20:55:20.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.224+0000 7f28561c8740 1 -- 172.21.15.88:0/3068379125 shutdown_connections 2023-11-27T20:55:20.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.224+0000 7f28561c8740 1 --2- 172.21.15.88:0/3068379125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562c484b40b0 0x562c484f4eb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.224+0000 7f28561c8740 1 --2- 172.21.15.88:0/3068379125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c484ff4d0 0x562c484b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.224+0000 7f28561c8740 1 --2- 172.21.15.88:0/3068379125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562c484b5650 0x562c484b5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.224+0000 7f28561c8740 1 -- 172.21.15.88:0/3068379125 >> 172.21.15.88:0/3068379125 conn(0x562c484b1dc0 msgr2=0x562c484b4700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:20.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.224+0000 7f28561c8740 1 -- 172.21.15.88:0/3068379125 shutdown_connections 2023-11-27T20:55:20.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.224+0000 7f28561c8740 1 -- 172.21.15.88:0/3068379125 wait complete. 2023-11-27T20:55:20.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.225+0000 7f28561c8740 1 -- start start 2023-11-27T20:55:20.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.225+0000 7f28561c8740 1 Processor -- start 2023-11-27T20:55:20.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.226+0000 7f28561c8740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562c484b5650 0x562c484d6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.226+0000 7f28561c8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c484ff4d0 0x562c484f82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.226+0000 7f28561c8740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562c484dde60 0x562c484f63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.226+0000 7f28561c8740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c4841bb70 con 0x562c484dde60 2023-11-27T20:55:20.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.226+0000 7f28561c8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c483d5e00 con 0x562c484ff4d0 2023-11-27T20:55:20.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.226+0000 7f28561c8740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562c483d5aa0 con 0x562c484b5650 2023-11-27T20:55:20.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.226+0000 7f28561c8740 10 client.0 _ll_register_callbacks cb 0x562c4812dac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T20:55:20.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.226+0000 7f2850af5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562c484dde60 0x562c484f63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.227+0000 7f2851af7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562c484b5650 0x562c484d6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.227+0000 7f2850af5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562c484dde60 0x562c484f63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44954/0 (socket says 172.21.15.88:44954) 2023-11-27T20:55:20.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.227+0000 7f2850af5640 1 -- 172.21.15.88:0/60256902 learned_addr learned my addr 172.21.15.88:0/60256902 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:20.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.230+0000 7f2850af5640 1 -- 172.21.15.88:0/60256902 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562c484b5650 msgr2=0x562c484d6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:20.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.230+0000 7f2850af5640 1 --2- 172.21.15.88:0/60256902 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562c484b5650 0x562c484d6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.230+0000 7f2850af5640 1 -- 172.21.15.88:0/60256902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c484ff4d0 msgr2=0x562c484f82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:20.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.230+0000 7f2850af5640 1 --2- 172.21.15.88:0/60256902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c484ff4d0 0x562c484f82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.230+0000 7f2850af5640 1 -- 172.21.15.88:0/60256902 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284c0c5870 con 0x562c484dde60 2023-11-27T20:55:20.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.232+0000 7f2850af5640 1 --2- 172.21.15.88:0/60256902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562c484dde60 0x562c484f63a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x562c484b3e40 tx=0x7f283c031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ff79459eeafe47 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:20.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.232+0000 7f2827fff640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-11-27T20:55:20.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.233+0000 7f2841ffb640 1 -- 172.21.15.88:0/2864477750 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f283c0579a0 con 0x7f284c0c8ee0 2023-11-27T20:55:20.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.233+0000 7f2841ffb640 1 --2- 172.21.15.88:0/2864477750 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f283006b180 0x7f283006d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.233+0000 7f2851af7640 1 --2- 172.21.15.88:0/2864477750 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f283006b180 0x7f283006d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.234+0000 7f2851af7640 1 --2- 172.21.15.88:0/2864477750 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f283006b180 0x7f283006d640 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f284c1efee0 tx=0x7f2844009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:20.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.236+0000 7f2827fff640 1 -- 172.21.15.88:0/60256902 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c052070 con 0x562c484dde60 2023-11-27T20:55:20.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.236+0000 7f2841ffb640 1 -- 172.21.15.88:0/2864477750 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f283c07d4f0 con 0x7f284c0c8ee0 2023-11-27T20:55:20.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.236+0000 7f2827fff640 1 -- 172.21.15.88:0/60256902 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f283c046e60 con 0x562c484dde60 2023-11-27T20:55:20.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.236+0000 7f28561c8740 1 -- 172.21.15.88:0/60256902 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562c48414b50 con 0x562c484dde60 2023-11-27T20:55:20.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.237+0000 7f2827fff640 1 -- 172.21.15.88:0/60256902 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f283c062ed0 con 0x562c484dde60 2023-11-27T20:55:20.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.237+0000 7f28561c8740 10 client.4656 fetch_fsmap learned FSMap version 19 2023-11-27T20:55:20.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.237+0000 7f28561c8740 1 -- 172.21.15.88:0/60256902 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x562c4841a1f0 con 0x562c484dde60 2023-11-27T20:55:20.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.241+0000 7f2827fff640 1 -- 172.21.15.88:0/60256902 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562c48414b50 con 0x562c484dde60 2023-11-27T20:55:20.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.241+0000 7f2827fff640 1 -- 172.21.15.88:0/60256902 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 19) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f283c07d750 con 0x562c484dde60 2023-11-27T20:55:20.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.241+0000 7f28561c8740 10 client.4656 fetch_fsmap finished waiting for FSMap version 19 2023-11-27T20:55:20.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.241+0000 7f28561c8740 10 client.4656 resolve_mds: resolved name 'f' to daemon mds.f 2023-11-27T20:55:20.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.241+0000 7f28561c8740 20 client.4656 populate_metadata read hostname 'smithi088' 2023-11-27T20:55:20.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.241+0000 7f28561c8740 1 --2- 172.21.15.88:0/60256902 >> [v2:172.21.15.167:6836/1596074914,v1:172.21.15.167:6837/1596074914] conn(0x562c484d57d0 0x562c484d9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.241+0000 7f28561c8740 4 client.4656 mds_command: new command op to 4258 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-27T20:55:20.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.241+0000 7f28561c8740 1 -- 172.21.15.88:0/60256902 --> [v2:172.21.15.167:6836/1596074914,v1:172.21.15.167:6837/1596074914] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562c48414870 con 0x562c484d57d0 2023-11-27T20:55:20.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.242+0000 7f28512f6640 1 --2- 172.21.15.88:0/60256902 >> [v2:172.21.15.167:6836/1596074914,v1:172.21.15.167:6837/1596074914] conn(0x562c484d57d0 0x562c484d9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.282+0000 7f28512f6640 1 --2- 172.21.15.88:0/60256902 >> [v2:172.21.15.167:6836/1596074914,v1:172.21.15.167:6837/1596074914] conn(0x562c484d57d0 0x562c484d9ab0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8d4274f45711489e server_cookie=5ae892f4ca6f3dab in_seq=0 out_seq=0 2023-11-27T20:55:20.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.282+0000 7f2827fff640 10 client.4656 ms_handle_connect on v2:172.21.15.167:6836/1596074914 2023-11-27T20:55:20.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.383+0000 7f2827fff640 1 -- 172.21.15.88:0/60256902 <== mds.4 v2:172.21.15.167:6836/1596074914 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562c48414870 con 0x562c484d57d0 2023-11-27T20:55:20.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.383+0000 7f2827fff640 10 client.4656 handle_command_reply: tid=0 2023-11-27T20:55:20.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.383+0000 7f28561c8740 1 client.4656 shutdown 2023-11-27T20:55:20.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.383+0000 7f28561c8740 1 -- 172.21.15.88:0/60256902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562c484dde60 msgr2=0x562c484f63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:20.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.383+0000 7f28561c8740 1 --2- 172.21.15.88:0/60256902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562c484dde60 0x562c484f63a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x562c484b3e40 tx=0x7f283c031000 comp rx=0 tx=0).stop 2023-11-27T20:55:20.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.383+0000 7f28561c8740 1 -- 172.21.15.88:0/60256902 shutdown_connections 2023-11-27T20:55:20.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.383+0000 7f28561c8740 1 --2- 172.21.15.88:0/60256902 >> [v2:172.21.15.167:6836/1596074914,v1:172.21.15.167:6837/1596074914] conn(0x562c484d57d0 0x562c484d9ab0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.383+0000 7f28561c8740 1 --2- 172.21.15.88:0/60256902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562c484dde60 0x562c484f63a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.383+0000 7f28561c8740 1 --2- 172.21.15.88:0/60256902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c484ff4d0 0x562c484f82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.383+0000 7f2827fff640 0 client.4656 ms_handle_reset on v2:172.21.15.167:6836/1596074914 2023-11-27T20:55:20.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.383+0000 7f28561c8740 1 --2- 172.21.15.88:0/60256902 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562c484b5650 0x562c484d6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.383+0000 7f28561c8740 1 -- 172.21.15.88:0/60256902 >> 172.21.15.88:0/60256902 conn(0x562c484b40b0 msgr2=0x562c484dea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:20.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.383+0000 7f28561c8740 1 -- 172.21.15.88:0/60256902 shutdown_connections 2023-11-27T20:55:20.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.383+0000 7f28561c8740 1 -- 172.21.15.88:0/60256902 wait complete. 2023-11-27T20:55:20.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.383+0000 7f28561c8740 20 client.4656 trim_cache size 0 max 16384 2023-11-27T20:55:20.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.400+0000 7f28561c8740 1 Processor -- start 2023-11-27T20:55:20.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.400+0000 7f28561c8740 1 -- start start 2023-11-27T20:55:20.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.401+0000 7f28561c8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c484b5650 0x562c484d44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.401+0000 7f28561c8740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562c484d57d0 0x562c484f61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.401+0000 7f28561c8740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562c484dde60 0x562c484f89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.401+0000 7f28561c8740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c4839b270 con 0x562c484dde60 2023-11-27T20:55:20.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.401+0000 7f28561c8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c484b6780 con 0x562c484b5650 2023-11-27T20:55:20.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.401+0000 7f28561c8740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562c484de390 con 0x562c484d57d0 2023-11-27T20:55:20.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.402+0000 7f28512f6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c484b5650 0x562c484d44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.402+0000 7f2850af5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562c484d57d0 0x562c484f61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.402+0000 7f28512f6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c484b5650 0x562c484d44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:59200/0 (socket says 172.21.15.88:59200) 2023-11-27T20:55:20.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.402+0000 7f28512f6640 1 -- 172.21.15.88:0/2730976499 learned_addr learned my addr 172.21.15.88:0/2730976499 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:20.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.404+0000 7f28512f6640 1 -- 172.21.15.88:0/2730976499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562c484d57d0 msgr2=0x562c484f61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:20.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.404+0000 7f28512f6640 1 --2- 172.21.15.88:0/2730976499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562c484d57d0 0x562c484f61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.404+0000 7f28512f6640 1 -- 172.21.15.88:0/2730976499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562c484dde60 msgr2=0x562c484f89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:20.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.404+0000 7f28512f6640 1 --2- 172.21.15.88:0/2730976499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562c484dde60 0x562c484f89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.404+0000 7f28512f6640 1 -- 172.21.15.88:0/2730976499 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c483b7d00 con 0x562c484b5650 2023-11-27T20:55:20.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.410+0000 7f28512f6640 1 --2- 172.21.15.88:0/2730976499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c484b5650 0x562c484d44f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2848001d10 tx=0x7f2848001990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3044abe497d0525c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:20.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.457+0000 7f282f7fe640 1 -- 172.21.15.88:0/2730976499 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2848016910 con 0x562c484b5650 2023-11-27T20:55:20.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.457+0000 7f282f7fe640 1 -- 172.21.15.88:0/2730976499 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2848001f50 con 0x562c484b5650 2023-11-27T20:55:20.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.457+0000 7f282f7fe640 1 -- 172.21.15.88:0/2730976499 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2848007860 con 0x562c484b5650 2023-11-27T20:55:20.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.457+0000 7f28561c8740 1 -- 172.21.15.88:0/2730976499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c484b5650 msgr2=0x562c484d44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:20.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.457+0000 7f28561c8740 1 --2- 172.21.15.88:0/2730976499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c484b5650 0x562c484d44f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2848001d10 tx=0x7f2848001990 comp rx=0 tx=0).stop 2023-11-27T20:55:20.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.458+0000 7f28561c8740 1 -- 172.21.15.88:0/2730976499 shutdown_connections 2023-11-27T20:55:20.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.458+0000 7f28561c8740 1 --2- 172.21.15.88:0/2730976499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562c484dde60 0x562c484f89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.458+0000 7f28561c8740 1 --2- 172.21.15.88:0/2730976499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562c484d57d0 0x562c484f61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.458+0000 7f28561c8740 1 --2- 172.21.15.88:0/2730976499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c484b5650 0x562c484d44f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.458+0000 7f28561c8740 1 -- 172.21.15.88:0/2730976499 >> 172.21.15.88:0/2730976499 conn(0x562c484b40b0 msgr2=0x562c484c7380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:20.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.458+0000 7f28561c8740 1 -- 172.21.15.88:0/2730976499 shutdown_connections 2023-11-27T20:55:20.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.458+0000 7f28561c8740 1 -- 172.21.15.88:0/2730976499 wait complete. 2023-11-27T20:55:20.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.458+0000 7f28561c8740 1 -- start start 2023-11-27T20:55:20.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.458+0000 7f28561c8740 1 Processor -- start 2023-11-27T20:55:20.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.459+0000 7f28561c8740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562c484b5650 0x562c4855adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.459+0000 7f28561c8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c484d57d0 0x562c48560ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.459+0000 7f28561c8740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562c484dde60 0x562c484f89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.459+0000 7f28561c8740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c48561310 con 0x562c484dde60 2023-11-27T20:55:20.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.459+0000 7f28561c8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c484fea50 con 0x562c484d57d0 2023-11-27T20:55:20.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.459+0000 7f28561c8740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562c48564b80 con 0x562c484b5650 2023-11-27T20:55:20.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.459+0000 7f28561c8740 10 client.0 _ll_register_callbacks cb 0x7f2848001830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T20:55:20.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.460+0000 7f2850af5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c484d57d0 0x562c48560ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.461+0000 7f2850af5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c484d57d0 0x562c48560ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:59216/0 (socket says 172.21.15.88:59216) 2023-11-27T20:55:20.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.461+0000 7f2850af5640 1 -- 172.21.15.88:0/2506420242 learned_addr learned my addr 172.21.15.88:0/2506420242 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:20.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.461+0000 7f28512f6640 1 --2- 172.21.15.88:0/2506420242 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562c484b5650 0x562c4855adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.462+0000 7f2851af7640 1 --2- 172.21.15.88:0/2506420242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562c484dde60 0x562c484f89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.464+0000 7f2850af5640 1 -- 172.21.15.88:0/2506420242 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562c484b5650 msgr2=0x562c4855adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:20.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.464+0000 7f2850af5640 1 --2- 172.21.15.88:0/2506420242 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562c484b5650 0x562c4855adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.464+0000 7f2850af5640 1 -- 172.21.15.88:0/2506420242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562c484dde60 msgr2=0x562c484f89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:20.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.464+0000 7f2850af5640 1 --2- 172.21.15.88:0/2506420242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562c484dde60 0x562c484f89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.464+0000 7f2850af5640 1 -- 172.21.15.88:0/2506420242 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284c0c7640 con 0x562c484d57d0 2023-11-27T20:55:20.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.467+0000 7f2850af5640 1 --2- 172.21.15.88:0/2506420242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c484d57d0 0x562c48560ae0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f283c07d1a0 tx=0x7f283c0ace50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c12b560303a3470 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:20.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.467+0000 7f2827fff640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-11-27T20:55:20.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.470+0000 7f2827fff640 1 -- 172.21.15.88:0/2506420242 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c052040 con 0x562c484d57d0 2023-11-27T20:55:20.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.470+0000 7f2827fff640 1 -- 172.21.15.88:0/2506420242 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f283c032cc0 con 0x562c484d57d0 2023-11-27T20:55:20.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.470+0000 7f28561c8740 1 -- 172.21.15.88:0/2506420242 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f283c04de10 con 0x562c484d57d0 2023-11-27T20:55:20.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.472+0000 7f2827fff640 1 -- 172.21.15.88:0/2506420242 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f283c07d2c0 con 0x562c484d57d0 2023-11-27T20:55:20.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.472+0000 7f28561c8740 10 client.4726 fetch_fsmap learned FSMap version 19 2023-11-27T20:55:20.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.472+0000 7f28561c8740 1 -- 172.21.15.88:0/2506420242 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x562c483dd4f0 con 0x562c484d57d0 2023-11-27T20:55:20.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.476+0000 7f2827fff640 1 -- 172.21.15.88:0/2506420242 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283c04de10 con 0x562c484d57d0 2023-11-27T20:55:20.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.476+0000 7f2827fff640 1 -- 172.21.15.88:0/2506420242 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f283c0811a0 con 0x562c484d57d0 2023-11-27T20:55:20.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.476+0000 7f28561c8740 10 client.4726 fetch_fsmap finished waiting for FSMap version 19 2023-11-27T20:55:20.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.477+0000 7f28561c8740 10 client.4726 resolve_mds: resolved name 'f' to daemon mds.f 2023-11-27T20:55:20.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.477+0000 7f28561c8740 20 client.4726 populate_metadata read hostname 'smithi088' 2023-11-27T20:55:20.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.477+0000 7f28561c8740 1 --2- 172.21.15.88:0/2506420242 >> [v2:172.21.15.167:6836/1596074914,v1:172.21.15.167:6837/1596074914] conn(0x562c484ff4d0 0x562c484f2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.477+0000 7f28561c8740 4 client.4726 mds_command: new command op to 4258 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-27T20:55:20.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.477+0000 7f28561c8740 1 -- 172.21.15.88:0/2506420242 --> [v2:172.21.15.167:6836/1596074914,v1:172.21.15.167:6837/1596074914] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562c4811c6c0 con 0x562c484ff4d0 2023-11-27T20:55:20.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.478+0000 7f28512f6640 1 --2- 172.21.15.88:0/2506420242 >> [v2:172.21.15.167:6836/1596074914,v1:172.21.15.167:6837/1596074914] conn(0x562c484ff4d0 0x562c484f2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.480+0000 7f28512f6640 1 --2- 172.21.15.88:0/2506420242 >> [v2:172.21.15.167:6836/1596074914,v1:172.21.15.167:6837/1596074914] conn(0x562c484ff4d0 0x562c484f2530 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5bfa559bb02cf80a server_cookie=852468d91e2fadd7 in_seq=0 out_seq=0 2023-11-27T20:55:20.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.480+0000 7f2827fff640 10 client.4726 ms_handle_connect on v2:172.21.15.167:6836/1596074914 2023-11-27T20:55:20.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.498+0000 7f2827fff640 1 -- 172.21.15.88:0/2506420242 <== mds.4 v2:172.21.15.167:6836/1596074914 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x562c4811c6c0 con 0x562c484ff4d0 2023-11-27T20:55:20.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.498+0000 7f2827fff640 10 client.4726 handle_command_reply: tid=0 2023-11-27T20:55:20.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.498+0000 7f28561c8740 1 client.4726 shutdown 2023-11-27T20:55:20.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.498+0000 7f28561c8740 1 -- 172.21.15.88:0/2506420242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c484d57d0 msgr2=0x562c48560ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:20.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.498+0000 7f28561c8740 1 --2- 172.21.15.88:0/2506420242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c484d57d0 0x562c48560ae0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f283c07d1a0 tx=0x7f283c0ace50 comp rx=0 tx=0).stop 2023-11-27T20:55:20.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.498+0000 7f28561c8740 1 -- 172.21.15.88:0/2506420242 shutdown_connections 2023-11-27T20:55:20.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.498+0000 7f28561c8740 1 --2- 172.21.15.88:0/2506420242 >> [v2:172.21.15.167:6836/1596074914,v1:172.21.15.167:6837/1596074914] conn(0x562c484ff4d0 0x562c484f2530 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.498+0000 7f28561c8740 1 --2- 172.21.15.88:0/2506420242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562c484dde60 0x562c484f89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.498+0000 7f2827fff640 0 client.4726 ms_handle_reset on v2:172.21.15.167:6836/1596074914 2023-11-27T20:55:20.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.498+0000 7f28561c8740 1 --2- 172.21.15.88:0/2506420242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562c484d57d0 0x562c48560ae0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.498+0000 7f28561c8740 1 --2- 172.21.15.88:0/2506420242 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562c484b5650 0x562c4855adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.498+0000 7f28561c8740 1 -- 172.21.15.88:0/2506420242 >> 172.21.15.88:0/2506420242 conn(0x562c484b40b0 msgr2=0x562c484de720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:20.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.499+0000 7f28561c8740 1 -- 172.21.15.88:0/2506420242 shutdown_connections 2023-11-27T20:55:20.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.499+0000 7f28561c8740 1 -- 172.21.15.88:0/2506420242 wait complete. 2023-11-27T20:55:20.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.499+0000 7f28561c8740 20 client.4726 trim_cache size 0 max 16384 2023-11-27T20:55:20.502 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-27T20:55:20.502 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_fsid": "ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc", 2023-11-27T20:55:20.502 INFO:teuthology.orchestra.run.smithi088.stdout: "whoami": 4, 2023-11-27T20:55:20.502 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4258, 2023-11-27T20:55:20.502 INFO:teuthology.orchestra.run.smithi088.stdout: "want_state": "up:active", 2023-11-27T20:55:20.502 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "up:active", 2023-11-27T20:55:20.503 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs", 2023-11-27T20:55:20.503 INFO:teuthology.orchestra.run.smithi088.stdout: "rank_uptime": 10.465709035, 2023-11-27T20:55:20.503 INFO:teuthology.orchestra.run.smithi088.stdout: "mdsmap_epoch": 19, 2023-11-27T20:55:20.503 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch": 28, 2023-11-27T20:55:20.503 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch_barrier": 28, 2023-11-27T20:55:20.503 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 65.200982608000004 2023-11-27T20:55:20.503 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-27T20:55:20.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.499+0000 7f285355a640 1 -- 172.21.15.88:0/2864477750 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f283006b180 msgr2=0x7f283006d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:20.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.499+0000 7f285355a640 1 --2- 172.21.15.88:0/2864477750 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f283006b180 0x7f283006d640 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f284c1efee0 tx=0x7f2844009190 comp rx=0 tx=0).stop 2023-11-27T20:55:20.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.499+0000 7f285355a640 1 -- 172.21.15.88:0/2864477750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f284c0c8ee0 msgr2=0x7f284c0c4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:20.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.499+0000 7f285355a640 1 --2- 172.21.15.88:0/2864477750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f284c0c8ee0 0x7f284c0c4040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f283c000c00 tx=0x7f283c0046c0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.499+0000 7f285355a640 1 -- 172.21.15.88:0/2864477750 shutdown_connections 2023-11-27T20:55:20.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.499+0000 7f285355a640 1 --2- 172.21.15.88:0/2864477750 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f283006b180 0x7f283006d640 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.499+0000 7f285355a640 1 --2- 172.21.15.88:0/2864477750 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f284c1538d0 0x7f284c1ef100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.499+0000 7f285355a640 1 --2- 172.21.15.88:0/2864477750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f284c0c8ee0 0x7f284c0c4040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.499+0000 7f285355a640 1 --2- 172.21.15.88:0/2864477750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f284c06ed80 0x7f284c14f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.499+0000 7f285355a640 1 -- 172.21.15.88:0/2864477750 >> 172.21.15.88:0/2864477750 conn(0x7f284c060f20 msgr2=0x7f284c0c94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:20.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.499+0000 7f285355a640 1 -- 172.21.15.88:0/2864477750 shutdown_connections 2023-11-27T20:55:20.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.499+0000 7f285355a640 1 -- 172.21.15.88:0/2864477750 wait complete. 2023-11-27T20:55:20.511 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-11-27T20:55:20.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.610+0000 7f17588e5640 1 Processor -- start 2023-11-27T20:55:20.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.610+0000 7f17588e5640 1 -- start start 2023-11-27T20:55:20.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.611+0000 7f17588e5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f17540710c0 0x7f1754071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.611+0000 7f17588e5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17541577f0 con 0x7f1754157240 2023-11-27T20:55:20.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.611+0000 7f17588e5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1754157a90 con 0x7f1754151220 2023-11-27T20:55:20.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.611+0000 7f17588e5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f175406f470 con 0x7f17540710c0 2023-11-27T20:55:20.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.612+0000 7f1752d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f17540710c0 0x7f1754071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.612+0000 7f175259c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f1754151220 0x7f175406ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:48062/0 (socket says 172.21.15.88:48062) 2023-11-27T20:55:20.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.612+0000 7f175259c640 1 -- 172.21.15.88:0/614862976 learned_addr learned my addr 172.21.15.88:0/614862976 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:55:20.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.614+0000 7f175159a640 1 -- 172.21.15.88:0/614862976 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385261976 0 0) 0x7f1754157a90 con 0x7f1754151220 2023-11-27T20:55:20.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.614+0000 7f175159a640 1 -- 172.21.15.88:0/614862976 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f173c003520 con 0x7f1754151220 2023-11-27T20:55:20.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.615+0000 7f1752d9d640 1 -- 172.21.15.88:0/614862976 >> v1:172.21.15.167:6789/0 conn(0x7f1754151220 legacy=0x7f175406ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:20.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.615+0000 7f1752d9d640 1 -- 172.21.15.88:0/614862976 >> v1:172.21.15.88:6789/0 conn(0x7f1754157240 legacy=0x7f17540c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:20.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.615+0000 7f1752d9d640 1 -- 172.21.15.88:0/614862976 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1754157d30 con 0x7f17540710c0 2023-11-27T20:55:20.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.618+0000 7f1752d9d640 1 --2- 172.21.15.88:0/614862976 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17540710c0 0x7f1754071530 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f175406f5b0 tx=0x7f174c02b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644c032ee39b6610 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:20.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.623+0000 7f175159a640 1 -- 172.21.15.88:0/614862976 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c030890 con 0x7f17540710c0 2023-11-27T20:55:20.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.623+0000 7f175159a640 1 -- 172.21.15.88:0/614862976 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c0309f0 con 0x7f17540710c0 2023-11-27T20:55:20.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.623+0000 7f175159a640 1 -- 172.21.15.88:0/614862976 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c030d80 con 0x7f17540710c0 2023-11-27T20:55:20.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.623+0000 7f17588e5640 1 -- 172.21.15.88:0/614862976 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17540710c0 msgr2=0x7f1754071530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:20.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.623+0000 7f17588e5640 1 --2- 172.21.15.88:0/614862976 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17540710c0 0x7f1754071530 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f175406f5b0 tx=0x7f174c02b9d0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.623+0000 7f17588e5640 1 -- 172.21.15.88:0/614862976 shutdown_connections 2023-11-27T20:55:20.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.623+0000 7f17588e5640 1 --2- 172.21.15.88:0/614862976 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17540710c0 0x7f1754071530 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.623+0000 7f17588e5640 1 -- 172.21.15.88:0/614862976 >> 172.21.15.88:0/614862976 conn(0x7f175406c5f0 msgr2=0x7f175406c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:20.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.623+0000 7f17588e5640 1 -- 172.21.15.88:0/614862976 shutdown_connections 2023-11-27T20:55:20.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.624+0000 7f17588e5640 1 -- 172.21.15.88:0/614862976 wait complete. 2023-11-27T20:55:20.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.625+0000 7f17588e5640 1 Processor -- start 2023-11-27T20:55:20.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.625+0000 7f17588e5640 1 -- start start 2023-11-27T20:55:20.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.626+0000 7f17588e5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17540710c0 0x7f1754146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.626+0000 7f17588e5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1754151220 0x7f17540c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.626+0000 7f17588e5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1754157240 0x7f17540c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.626+0000 7f17588e5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17540caaa0 con 0x7f17540710c0 2023-11-27T20:55:20.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.626+0000 7f17588e5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1754147320 con 0x7f1754151220 2023-11-27T20:55:20.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.626+0000 7f17588e5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17541ed1b0 con 0x7f1754157240 2023-11-27T20:55:20.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.626+0000 7f175259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17540710c0 0x7f1754146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.627+0000 7f175259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17540710c0 0x7f1754146700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36100/0 (socket says 172.21.15.88:36100) 2023-11-27T20:55:20.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.627+0000 7f175259c640 1 -- 172.21.15.88:0/2857595641 learned_addr learned my addr 172.21.15.88:0/2857595641 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:20.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.627+0000 7f1751d9b640 1 --2- 172.21.15.88:0/2857595641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1754151220 0x7f17540c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.627+0000 7f1752d9d640 1 --2- 172.21.15.88:0/2857595641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1754157240 0x7f17540c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.630+0000 7f175259c640 1 -- 172.21.15.88:0/2857595641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1754157240 msgr2=0x7f17540c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:20.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.630+0000 7f175259c640 1 --2- 172.21.15.88:0/2857595641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1754157240 0x7f17540c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.630+0000 7f175259c640 1 -- 172.21.15.88:0/2857595641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1754151220 msgr2=0x7f17540c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:20.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.630+0000 7f175259c640 1 --2- 172.21.15.88:0/2857595641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1754151220 0x7f17540c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.630+0000 7f175259c640 1 -- 172.21.15.88:0/2857595641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174c009400 con 0x7f17540710c0 2023-11-27T20:55:20.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.632+0000 7f175259c640 1 --2- 172.21.15.88:0/2857595641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17540710c0 0x7f1754146700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f174400cbf0 tx=0x7f174400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:20.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.636+0000 7f1742ffd640 1 -- 172.21.15.88:0/2857595641 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174400ad50 con 0x7f17540710c0 2023-11-27T20:55:20.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.636+0000 7f1742ffd640 1 -- 172.21.15.88:0/2857595641 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1744012400 con 0x7f17540710c0 2023-11-27T20:55:20.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.636+0000 7f1742ffd640 1 -- 172.21.15.88:0/2857595641 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1744012790 con 0x7f17540710c0 2023-11-27T20:55:20.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.636+0000 7f17588e5640 1 -- 172.21.15.88:0/2857595641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17541ed490 con 0x7f17540710c0 2023-11-27T20:55:20.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.636+0000 7f17588e5640 1 -- 172.21.15.88:0/2857595641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17541eda50 con 0x7f17540710c0 2023-11-27T20:55:20.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.638+0000 7f175b474740 1 Processor -- start 2023-11-27T20:55:20.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.638+0000 7f175b474740 1 -- start start 2023-11-27T20:55:20.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.639+0000 7f175b474740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee3e0de5e0 0x55ee3e0e0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.639+0000 7f175b474740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ee3e0de9c0 0x55ee3e0e3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.639+0000 7f175b474740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ee3e0dee20 0x55ee3e0e39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.639+0000 7f175b474740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee3e09e980 con 0x55ee3e0de9c0 2023-11-27T20:55:20.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.639+0000 7f175b474740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee3e050b90 con 0x55ee3e0de5e0 2023-11-27T20:55:20.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.639+0000 7f175b474740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ee3e04e280 con 0x55ee3e0dee20 2023-11-27T20:55:20.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.640+0000 7f1752d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee3e0de5e0 0x55ee3e0e0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.640+0000 7f1751d9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ee3e0dee20 0x55ee3e0e39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.640+0000 7f1752d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee3e0de5e0 0x55ee3e0e0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:39596/0 (socket says 172.21.15.88:39596) 2023-11-27T20:55:20.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.640+0000 7f1752d9d640 1 -- 172.21.15.88:0/3310093289 learned_addr learned my addr 172.21.15.88:0/3310093289 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:20.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.642+0000 7f1752d9d640 1 -- 172.21.15.88:0/3310093289 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ee3e0dee20 msgr2=0x55ee3e0e39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:20.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.642+0000 7f1752d9d640 1 --2- 172.21.15.88:0/3310093289 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ee3e0dee20 0x55ee3e0e39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.642+0000 7f1752d9d640 1 -- 172.21.15.88:0/3310093289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ee3e0de9c0 msgr2=0x55ee3e0e3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:20.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.642+0000 7f1752d9d640 1 --2- 172.21.15.88:0/3310093289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ee3e0de9c0 0x55ee3e0e3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.642+0000 7f1752d9d640 1 -- 172.21.15.88:0/3310093289 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee3e00f500 con 0x55ee3e0de5e0 2023-11-27T20:55:20.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.644+0000 7f1752d9d640 1 --2- 172.21.15.88:0/3310093289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee3e0de5e0 0x55ee3e0e0e40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f174c02bfe0 tx=0x7f174c030000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=361f744d3d9c01b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:20.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.648+0000 7f1733fff640 1 -- 172.21.15.88:0/3310093289 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c03e040 con 0x55ee3e0de5e0 2023-11-27T20:55:20.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.648+0000 7f1733fff640 1 -- 172.21.15.88:0/3310093289 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c030d60 con 0x55ee3e0de5e0 2023-11-27T20:55:20.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.648+0000 7f1733fff640 1 -- 172.21.15.88:0/3310093289 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c039690 con 0x55ee3e0de5e0 2023-11-27T20:55:20.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.648+0000 7f175b474740 1 -- 172.21.15.88:0/3310093289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee3e0de5e0 msgr2=0x55ee3e0e0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:20.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.648+0000 7f175b474740 1 --2- 172.21.15.88:0/3310093289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee3e0de5e0 0x55ee3e0e0e40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f174c02bfe0 tx=0x7f174c030000 comp rx=0 tx=0).stop 2023-11-27T20:55:20.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.648+0000 7f175b474740 1 -- 172.21.15.88:0/3310093289 shutdown_connections 2023-11-27T20:55:20.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.648+0000 7f175b474740 1 --2- 172.21.15.88:0/3310093289 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ee3e0dee20 0x55ee3e0e39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.648+0000 7f175b474740 1 --2- 172.21.15.88:0/3310093289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ee3e0de9c0 0x55ee3e0e3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.648+0000 7f175b474740 1 --2- 172.21.15.88:0/3310093289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee3e0de5e0 0x55ee3e0e0e40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.648+0000 7f175b474740 1 -- 172.21.15.88:0/3310093289 >> 172.21.15.88:0/3310093289 conn(0x55ee3e0dfdc0 msgr2=0x55ee3e0e2700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:20.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.649+0000 7f175b474740 1 -- 172.21.15.88:0/3310093289 shutdown_connections 2023-11-27T20:55:20.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.649+0000 7f175b474740 1 -- 172.21.15.88:0/3310093289 wait complete. 2023-11-27T20:55:20.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.649+0000 7f175b474740 1 -- start start 2023-11-27T20:55:20.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.649+0000 7f175b474740 1 Processor -- start 2023-11-27T20:55:20.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.650+0000 7f175b474740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ee3e0de9c0 0x55ee3e126090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.650+0000 7f175b474740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ee3e0dee20 0x55ee3e12bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.650+0000 7f175b474740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee3e12c260 0x55ee3e13c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.650+0000 7f175b474740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee3e049b70 con 0x55ee3e0de9c0 2023-11-27T20:55:20.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.650+0000 7f175b474740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee3e003e00 con 0x55ee3e12c260 2023-11-27T20:55:20.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.650+0000 7f175b474740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ee3e003aa0 con 0x55ee3e0dee20 2023-11-27T20:55:20.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.650+0000 7f175b474740 10 client.0 _ll_register_callbacks cb 0x55ee3dd5bac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T20:55:20.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.651+0000 7f1751d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee3e12c260 0x55ee3e13c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.651+0000 7f175259c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ee3e0dee20 0x55ee3e12bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.651+0000 7f1751d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee3e12c260 0x55ee3e13c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:39608/0 (socket says 172.21.15.88:39608) 2023-11-27T20:55:20.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.651+0000 7f1751d9b640 1 -- 172.21.15.88:0/1781163084 learned_addr learned my addr 172.21.15.88:0/1781163084 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:20.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.654+0000 7f1751d9b640 1 -- 172.21.15.88:0/1781163084 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ee3e0dee20 msgr2=0x55ee3e12bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:20.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.654+0000 7f1751d9b640 1 --2- 172.21.15.88:0/1781163084 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ee3e0dee20 0x55ee3e12bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.654+0000 7f1751d9b640 1 -- 172.21.15.88:0/1781163084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ee3e0de9c0 msgr2=0x55ee3e126090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:20.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.654+0000 7f1751d9b640 1 --2- 172.21.15.88:0/1781163084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ee3e0de9c0 0x55ee3e126090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.654+0000 7f1751d9b640 1 -- 172.21.15.88:0/1781163084 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1754157d30 con 0x55ee3e12c260 2023-11-27T20:55:20.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.655+0000 7f1742ffd640 1 -- 172.21.15.88:0/2857595641 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f17440139e0 con 0x7f17540710c0 2023-11-27T20:55:20.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.655+0000 7f1742ffd640 1 --2- 172.21.15.88:0/2857595641 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f173406b1b0 0x7f173406d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.655+0000 7f1752d9d640 1 --2- 172.21.15.88:0/2857595641 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f173406b1b0 0x7f173406d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.656+0000 7f1752d9d640 1 --2- 172.21.15.88:0/2857595641 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f173406b1b0 0x7f173406d670 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f174c006ce0 tx=0x7f174c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:20.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.656+0000 7f1751d9b640 1 --2- 172.21.15.88:0/1781163084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee3e12c260 0x55ee3e13c450 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f17540c0ce0 tx=0x7f1748012690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5080b509220d15d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:20.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.656+0000 7f17317fa640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-11-27T20:55:20.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.659+0000 7f1742ffd640 1 -- 172.21.15.88:0/2857595641 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1744058950 con 0x7f17540710c0 2023-11-27T20:55:20.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.661+0000 7f17317fa640 1 -- 172.21.15.88:0/1781163084 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17480052e0 con 0x55ee3e12c260 2023-11-27T20:55:20.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.661+0000 7f17317fa640 1 -- 172.21.15.88:0/1781163084 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1748005440 con 0x55ee3e12c260 2023-11-27T20:55:20.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.661+0000 7f175b474740 1 -- 172.21.15.88:0/1781163084 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee3e042b50 con 0x55ee3e12c260 2023-11-27T20:55:20.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.662+0000 7f17317fa640 1 -- 172.21.15.88:0/1781163084 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17480035f0 con 0x55ee3e12c260 2023-11-27T20:55:20.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.662+0000 7f175b474740 10 client.4738 fetch_fsmap learned FSMap version 19 2023-11-27T20:55:20.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.662+0000 7f175b474740 1 -- 172.21.15.88:0/1781163084 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55ee3e0481f0 con 0x55ee3e12c260 2023-11-27T20:55:20.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.667+0000 7f17317fa640 1 -- 172.21.15.88:0/1781163084 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ee3e042b50 con 0x55ee3e12c260 2023-11-27T20:55:20.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.667+0000 7f17317fa640 1 -- 172.21.15.88:0/1781163084 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f1748003750 con 0x55ee3e12c260 2023-11-27T20:55:20.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.667+0000 7f175b474740 10 client.4738 fetch_fsmap finished waiting for FSMap version 19 2023-11-27T20:55:20.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.667+0000 7f175b474740 10 client.4738 resolve_mds: resolved name 'e' to daemon mds.e 2023-11-27T20:55:20.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.667+0000 7f175b474740 20 client.4738 populate_metadata read hostname 'smithi088' 2023-11-27T20:55:20.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.667+0000 7f175b474740 1 --2- 172.21.15.88:0/1781163084 >> [v2:172.21.15.88:6834/256796309,v1:172.21.15.88:6835/256796309] conn(0x55ee3e1391c0 0x55ee3e1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.667+0000 7f175b474740 4 client.4738 mds_command: new command op to 34187 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-27T20:55:20.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.667+0000 7f175b474740 1 -- 172.21.15.88:0/1781163084 --> [v2:172.21.15.88:6834/256796309,v1:172.21.15.88:6835/256796309] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee3e042870 con 0x55ee3e1391c0 2023-11-27T20:55:20.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.667+0000 7f175259c640 1 --2- 172.21.15.88:0/1781163084 >> [v2:172.21.15.88:6834/256796309,v1:172.21.15.88:6835/256796309] conn(0x55ee3e1391c0 0x55ee3e1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.712+0000 7f175259c640 1 --2- 172.21.15.88:0/1781163084 >> [v2:172.21.15.88:6834/256796309,v1:172.21.15.88:6835/256796309] conn(0x55ee3e1391c0 0x55ee3e1395a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=49f7ae8f1fecf4ce server_cookie=be1a17b0cdad3c5a in_seq=0 out_seq=0 2023-11-27T20:55:20.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.712+0000 7f17317fa640 10 client.4738 ms_handle_connect on v2:172.21.15.88:6834/256796309 2023-11-27T20:55:20.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.821+0000 7f17317fa640 1 -- 172.21.15.88:0/1781163084 <== mds.3 v2:172.21.15.88:6834/256796309 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ee3e042870 con 0x55ee3e1391c0 2023-11-27T20:55:20.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.821+0000 7f17317fa640 10 client.4738 handle_command_reply: tid=0 2023-11-27T20:55:20.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.821+0000 7f175b474740 1 client.4738 shutdown 2023-11-27T20:55:20.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.822+0000 7f175b474740 1 -- 172.21.15.88:0/1781163084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee3e12c260 msgr2=0x55ee3e13c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:20.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.822+0000 7f175b474740 1 --2- 172.21.15.88:0/1781163084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee3e12c260 0x55ee3e13c450 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f17540c0ce0 tx=0x7f1748012690 comp rx=0 tx=0).stop 2023-11-27T20:55:20.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.822+0000 7f175b474740 1 -- 172.21.15.88:0/1781163084 shutdown_connections 2023-11-27T20:55:20.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.822+0000 7f175b474740 1 --2- 172.21.15.88:0/1781163084 >> [v2:172.21.15.88:6834/256796309,v1:172.21.15.88:6835/256796309] conn(0x55ee3e1391c0 0x55ee3e1395a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.822+0000 7f175b474740 1 --2- 172.21.15.88:0/1781163084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee3e12c260 0x55ee3e13c450 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.822+0000 7f175b474740 1 --2- 172.21.15.88:0/1781163084 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ee3e0dee20 0x55ee3e12bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.822+0000 7f17317fa640 0 client.4738 ms_handle_reset on v2:172.21.15.88:6834/256796309 2023-11-27T20:55:20.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.822+0000 7f175b474740 1 --2- 172.21.15.88:0/1781163084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ee3e0de9c0 0x55ee3e126090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.822+0000 7f175b474740 1 -- 172.21.15.88:0/1781163084 >> 172.21.15.88:0/1781163084 conn(0x55ee3e0de5e0 msgr2=0x55ee3e0e33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:20.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.822+0000 7f175b474740 1 -- 172.21.15.88:0/1781163084 shutdown_connections 2023-11-27T20:55:20.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.822+0000 7f175b474740 1 -- 172.21.15.88:0/1781163084 wait complete. 2023-11-27T20:55:20.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.822+0000 7f175b474740 20 client.4738 trim_cache size 0 max 16384 2023-11-27T20:55:20.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.838+0000 7f175b474740 1 Processor -- start 2023-11-27T20:55:20.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.838+0000 7f175b474740 1 -- start start 2023-11-27T20:55:20.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.839+0000 7f175b474740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee3e0de9c0 0x55ee3e123fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.839+0000 7f175b474740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ee3e0dee20 0x55ee3e124500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.839+0000 7f175b474740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ee3e12c260 0x55ee3e0e3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.839+0000 7f175b474740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee3dfc9270 con 0x55ee3e12c260 2023-11-27T20:55:20.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.839+0000 7f175b474740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee3e10cbb0 con 0x55ee3e0de9c0 2023-11-27T20:55:20.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.839+0000 7f175b474740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ee3e12cbe0 con 0x55ee3e0dee20 2023-11-27T20:55:20.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.839+0000 7f1752d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ee3e12c260 0x55ee3e0e3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.840+0000 7f175259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee3e0de9c0 0x55ee3e123fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.840+0000 7f1751d9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ee3e0dee20 0x55ee3e124500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.840+0000 7f1752d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ee3e12c260 0x55ee3e0e3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36134/0 (socket says 172.21.15.88:36134) 2023-11-27T20:55:20.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.840+0000 7f1752d9d640 1 -- 172.21.15.88:0/1408879179 learned_addr learned my addr 172.21.15.88:0/1408879179 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:20.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.842+0000 7f1752d9d640 1 -- 172.21.15.88:0/1408879179 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ee3e0dee20 msgr2=0x55ee3e124500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:20.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.842+0000 7f1752d9d640 1 --2- 172.21.15.88:0/1408879179 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ee3e0dee20 0x55ee3e124500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.842+0000 7f1752d9d640 1 -- 172.21.15.88:0/1408879179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee3e0de9c0 msgr2=0x55ee3e123fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:20.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.842+0000 7f1752d9d640 1 --2- 172.21.15.88:0/1408879179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee3e0de9c0 0x55ee3e123fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.842+0000 7f1752d9d640 1 -- 172.21.15.88:0/1408879179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee3dfe5d00 con 0x55ee3e12c260 2023-11-27T20:55:20.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.844+0000 7f1752d9d640 1 --2- 172.21.15.88:0/1408879179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ee3e12c260 0x55ee3e0e3160 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55ee3e013a20 tx=0x7f174c03b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a7cdd6f4d94eb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:20.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.848+0000 7f1740ff9640 1 -- 172.21.15.88:0/1408879179 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c03e040 con 0x55ee3e12c260 2023-11-27T20:55:20.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.848+0000 7f1740ff9640 1 -- 172.21.15.88:0/1408879179 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c0038d0 con 0x55ee3e12c260 2023-11-27T20:55:20.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.848+0000 7f1740ff9640 1 -- 172.21.15.88:0/1408879179 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c003c60 con 0x55ee3e12c260 2023-11-27T20:55:20.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.848+0000 7f175b474740 1 -- 172.21.15.88:0/1408879179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ee3e12c260 msgr2=0x55ee3e0e3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:20.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.848+0000 7f175b474740 1 --2- 172.21.15.88:0/1408879179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ee3e12c260 0x55ee3e0e3160 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55ee3e013a20 tx=0x7f174c03b040 comp rx=0 tx=0).stop 2023-11-27T20:55:20.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.848+0000 7f175b474740 1 -- 172.21.15.88:0/1408879179 shutdown_connections 2023-11-27T20:55:20.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.848+0000 7f175b474740 1 --2- 172.21.15.88:0/1408879179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ee3e12c260 0x55ee3e0e3160 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.848+0000 7f175b474740 1 --2- 172.21.15.88:0/1408879179 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ee3e0dee20 0x55ee3e124500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.848+0000 7f175b474740 1 --2- 172.21.15.88:0/1408879179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee3e0de9c0 0x55ee3e123fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.848+0000 7f175b474740 1 -- 172.21.15.88:0/1408879179 >> 172.21.15.88:0/1408879179 conn(0x55ee3e0de5e0 msgr2=0x55ee3e123270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:20.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.848+0000 7f175b474740 1 -- 172.21.15.88:0/1408879179 shutdown_connections 2023-11-27T20:55:20.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.848+0000 7f175b474740 1 -- 172.21.15.88:0/1408879179 wait complete. 2023-11-27T20:55:20.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.849+0000 7f175b474740 1 -- start start 2023-11-27T20:55:20.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.849+0000 7f175b474740 1 Processor -- start 2023-11-27T20:55:20.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.850+0000 7f175b474740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee3e0de9c0 0x55ee3e0dd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.850+0000 7f175b474740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ee3e0dee20 0x55ee3e0dcd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.850+0000 7f175b474740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ee3e12c260 0x55ee3e124360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.850+0000 7f175b474740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee3e1248a0 con 0x55ee3e12c260 2023-11-27T20:55:20.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.850+0000 7f175b474740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee3e1970e0 con 0x55ee3e0de9c0 2023-11-27T20:55:20.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.850+0000 7f175b474740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ee3e131e30 con 0x55ee3e0dee20 2023-11-27T20:55:20.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.850+0000 7f175b474740 10 client.0 _ll_register_callbacks cb 0x55ee3e0e25d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T20:55:20.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.850+0000 7f1752d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ee3e12c260 0x55ee3e124360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.851+0000 7f175259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee3e0de9c0 0x55ee3e0dd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.851+0000 7f1751d9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ee3e0dee20 0x55ee3e0dcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.851+0000 7f1752d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ee3e12c260 0x55ee3e124360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36144/0 (socket says 172.21.15.88:36144) 2023-11-27T20:55:20.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.851+0000 7f1752d9d640 1 -- 172.21.15.88:0/2681025793 learned_addr learned my addr 172.21.15.88:0/2681025793 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:20.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.854+0000 7f1752d9d640 1 -- 172.21.15.88:0/2681025793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ee3e0dee20 msgr2=0x55ee3e0dcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:20.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.854+0000 7f1752d9d640 1 --2- 172.21.15.88:0/2681025793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ee3e0dee20 0x55ee3e0dcd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.854+0000 7f1752d9d640 1 -- 172.21.15.88:0/2681025793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee3e0de9c0 msgr2=0x55ee3e0dd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:20.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.854+0000 7f1752d9d640 1 --2- 172.21.15.88:0/2681025793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee3e0de9c0 0x55ee3e0dd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.854+0000 7f1752d9d640 1 -- 172.21.15.88:0/2681025793 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ee3e00f500 con 0x55ee3e12c260 2023-11-27T20:55:20.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.856+0000 7f1752d9d640 1 --2- 172.21.15.88:0/2681025793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ee3e12c260 0x55ee3e124360 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f174c030bb0 tx=0x7f174c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfbddbe034689454 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:20.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.856+0000 7f17317fa640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-11-27T20:55:20.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.859+0000 7f17317fa640 1 -- 172.21.15.88:0/2681025793 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c03e040 con 0x55ee3e12c260 2023-11-27T20:55:20.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.860+0000 7f17317fa640 1 -- 172.21.15.88:0/2681025793 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f174c054070 con 0x55ee3e12c260 2023-11-27T20:55:20.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.860+0000 7f175b474740 1 -- 172.21.15.88:0/2681025793 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee3e10ce80 con 0x55ee3e12c260 2023-11-27T20:55:20.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.861+0000 7f17317fa640 1 -- 172.21.15.88:0/2681025793 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f174c005ba0 con 0x55ee3e12c260 2023-11-27T20:55:20.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.861+0000 7f175b474740 10 client.4674 fetch_fsmap learned FSMap version 19 2023-11-27T20:55:20.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.861+0000 7f175b474740 1 -- 172.21.15.88:0/2681025793 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55ee3e00b4f0 con 0x55ee3e12c260 2023-11-27T20:55:20.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.865+0000 7f17317fa640 1 -- 172.21.15.88:0/2681025793 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ee3e10ce80 con 0x55ee3e12c260 2023-11-27T20:55:20.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.865+0000 7f17317fa640 1 -- 172.21.15.88:0/2681025793 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 19) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f174c041030 con 0x55ee3e12c260 2023-11-27T20:55:20.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.865+0000 7f175b474740 10 client.4674 fetch_fsmap finished waiting for FSMap version 19 2023-11-27T20:55:20.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.865+0000 7f175b474740 10 client.4674 resolve_mds: resolved name 'e' to daemon mds.e 2023-11-27T20:55:20.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.865+0000 7f175b474740 20 client.4674 populate_metadata read hostname 'smithi088' 2023-11-27T20:55:20.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.865+0000 7f175b474740 1 --2- 172.21.15.88:0/2681025793 >> [v2:172.21.15.88:6834/256796309,v1:172.21.15.88:6835/256796309] conn(0x55ee3e122b40 0x55ee3e122f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:20.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.865+0000 7f175b474740 4 client.4674 mds_command: new command op to 34187 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-27T20:55:20.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.865+0000 7f175b474740 1 -- 172.21.15.88:0/2681025793 --> [v2:172.21.15.88:6834/256796309,v1:172.21.15.88:6835/256796309] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f174c030d60 con 0x55ee3e122b40 2023-11-27T20:55:20.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.866+0000 7f175259c640 1 --2- 172.21.15.88:0/2681025793 >> [v2:172.21.15.88:6834/256796309,v1:172.21.15.88:6835/256796309] conn(0x55ee3e122b40 0x55ee3e122f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:20.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.869+0000 7f175259c640 1 --2- 172.21.15.88:0/2681025793 >> [v2:172.21.15.88:6834/256796309,v1:172.21.15.88:6835/256796309] conn(0x55ee3e122b40 0x55ee3e122f20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f0c13fba7b7ca480 server_cookie=8e13103452cfe9f4 in_seq=0 out_seq=0 2023-11-27T20:55:20.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.869+0000 7f17317fa640 10 client.4674 ms_handle_connect on v2:172.21.15.88:6834/256796309 2023-11-27T20:55:20.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.886+0000 7f17317fa640 1 -- 172.21.15.88:0/2681025793 <== mds.3 v2:172.21.15.88:6834/256796309 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x7f174c030d60 con 0x55ee3e122b40 2023-11-27T20:55:20.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.886+0000 7f17317fa640 10 client.4674 handle_command_reply: tid=0 2023-11-27T20:55:20.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.886+0000 7f175b474740 1 client.4674 shutdown 2023-11-27T20:55:20.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.887+0000 7f175b474740 1 -- 172.21.15.88:0/2681025793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ee3e12c260 msgr2=0x55ee3e124360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:20.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.887+0000 7f175b474740 1 --2- 172.21.15.88:0/2681025793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ee3e12c260 0x55ee3e124360 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f174c030bb0 tx=0x7f174c004730 comp rx=0 tx=0).stop 2023-11-27T20:55:20.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.887+0000 7f175b474740 1 -- 172.21.15.88:0/2681025793 shutdown_connections 2023-11-27T20:55:20.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.887+0000 7f175b474740 1 --2- 172.21.15.88:0/2681025793 >> [v2:172.21.15.88:6834/256796309,v1:172.21.15.88:6835/256796309] conn(0x55ee3e122b40 0x55ee3e122f20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.887+0000 7f175b474740 1 --2- 172.21.15.88:0/2681025793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ee3e12c260 0x55ee3e124360 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.887+0000 7f175b474740 1 --2- 172.21.15.88:0/2681025793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ee3e0dee20 0x55ee3e0dcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.887+0000 7f17317fa640 0 client.4674 ms_handle_reset on v2:172.21.15.88:6834/256796309 2023-11-27T20:55:20.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.887+0000 7f175b474740 1 --2- 172.21.15.88:0/2681025793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee3e0de9c0 0x55ee3e0dd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.887+0000 7f175b474740 1 -- 172.21.15.88:0/2681025793 >> 172.21.15.88:0/2681025793 conn(0x55ee3e0de5e0 msgr2=0x55ee3e0e3690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:20.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.887+0000 7f175b474740 1 -- 172.21.15.88:0/2681025793 shutdown_connections 2023-11-27T20:55:20.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.887+0000 7f175b474740 1 -- 172.21.15.88:0/2681025793 wait complete. 2023-11-27T20:55:20.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.887+0000 7f175b474740 20 client.4674 trim_cache size 0 max 16384 2023-11-27T20:55:20.890 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-27T20:55:20.890 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_fsid": "ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc", 2023-11-27T20:55:20.890 INFO:teuthology.orchestra.run.smithi088.stdout: "whoami": 3, 2023-11-27T20:55:20.890 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 34187, 2023-11-27T20:55:20.890 INFO:teuthology.orchestra.run.smithi088.stdout: "want_state": "up:active", 2023-11-27T20:55:20.890 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "up:active", 2023-11-27T20:55:20.890 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs", 2023-11-27T20:55:20.890 INFO:teuthology.orchestra.run.smithi088.stdout: "rank_uptime": 13.309250462, 2023-11-27T20:55:20.891 INFO:teuthology.orchestra.run.smithi088.stdout: "mdsmap_epoch": 19, 2023-11-27T20:55:20.891 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch": 28, 2023-11-27T20:55:20.891 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch_barrier": 28, 2023-11-27T20:55:20.891 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 65.740818399999995 2023-11-27T20:55:20.891 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-27T20:55:20.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.888+0000 7f17588e5640 1 -- 172.21.15.88:0/2857595641 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f173406b1b0 msgr2=0x7f173406d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:20.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.888+0000 7f17588e5640 1 --2- 172.21.15.88:0/2857595641 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f173406b1b0 0x7f173406d670 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f174c006ce0 tx=0x7f174c009190 comp rx=0 tx=0).stop 2023-11-27T20:55:20.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.888+0000 7f17588e5640 1 -- 172.21.15.88:0/2857595641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17540710c0 msgr2=0x7f1754146700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:20.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.888+0000 7f17588e5640 1 --2- 172.21.15.88:0/2857595641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17540710c0 0x7f1754146700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f174400cbf0 tx=0x7f174400a430 comp rx=0 tx=0).stop 2023-11-27T20:55:20.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.888+0000 7f17588e5640 1 -- 172.21.15.88:0/2857595641 shutdown_connections 2023-11-27T20:55:20.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.888+0000 7f17588e5640 1 --2- 172.21.15.88:0/2857595641 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f173406b1b0 0x7f173406d670 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.888+0000 7f17588e5640 1 --2- 172.21.15.88:0/2857595641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1754157240 0x7f17540c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.888+0000 7f17588e5640 1 --2- 172.21.15.88:0/2857595641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1754151220 0x7f17540c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.888+0000 7f17588e5640 1 --2- 172.21.15.88:0/2857595641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17540710c0 0x7f1754146700 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:20.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.888+0000 7f17588e5640 1 -- 172.21.15.88:0/2857595641 >> 172.21.15.88:0/2857595641 conn(0x7f175406c5f0 msgr2=0x7f1754073530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:20.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.888+0000 7f17588e5640 1 -- 172.21.15.88:0/2857595641 shutdown_connections 2023-11-27T20:55:20.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:20.888+0000 7f17588e5640 1 -- 172.21.15.88:0/2857595641 wait complete. 2023-11-27T20:55:20.900 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-27T20:55:21.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.000+0000 7f8660ac2640 1 Processor -- start 2023-11-27T20:55:21.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.000+0000 7f8660ac2640 1 -- start start 2023-11-27T20:55:21.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.001+0000 7f8660ac2640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f865c14ffa0 0x7f865c0c1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.001+0000 7f8660ac2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f865c0c6570 0x7f865c0c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.001+0000 7f8660ac2640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f865c0c6f60 con 0x7f865c150380 2023-11-27T20:55:21.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.001+0000 7f8660ac2640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f865c1570d0 con 0x7f865c14ffa0 2023-11-27T20:55:21.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.001+0000 7f8660ac2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865c156270 con 0x7f865c0c6570 2023-11-27T20:55:21.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.002+0000 7f8659d9b640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f865c150380 0x7f865c06fa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:48070/0 (socket says 172.21.15.88:48070) 2023-11-27T20:55:21.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.002+0000 7f8659d9b640 1 -- 172.21.15.88:0/2143494952 learned_addr learned my addr 172.21.15.88:0/2143494952 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:55:21.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.002+0000 7f865ad9d640 1 --2- 172.21.15.88:0/2143494952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f865c0c6570 0x7f865c0c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.004+0000 7f865959a640 1 -- 172.21.15.88:0/2143494952 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449528698 0 0) 0x7f865c0c6f60 con 0x7f865c150380 2023-11-27T20:55:21.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.004+0000 7f865959a640 1 -- 172.21.15.88:0/2143494952 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8644005730 con 0x7f865c150380 2023-11-27T20:55:21.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.004+0000 7f865ad9d640 1 -- 172.21.15.88:0/2143494952 >> v2:172.21.15.88:3300/0 conn(0x7f865c14ffa0 msgr2=0x7f865c0c1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.004+0000 7f865ad9d640 1 --2- 172.21.15.88:0/2143494952 >> v2:172.21.15.88:3300/0 conn(0x7f865c14ffa0 0x7f865c0c1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.004+0000 7f865ad9d640 1 -- 172.21.15.88:0/2143494952 >> v1:172.21.15.167:6789/0 conn(0x7f865c150380 legacy=0x7f865c06fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.004+0000 7f865ad9d640 1 -- 172.21.15.88:0/2143494952 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865c156550 con 0x7f865c0c6570 2023-11-27T20:55:21.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.006+0000 7f865ad9d640 1 --2- 172.21.15.88:0/2143494952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f865c0c6570 0x7f865c0c6a20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f864c009d90 tx=0x7f864c02bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfec58ca8bc4afcd server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:21.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.010+0000 7f865959a640 1 -- 172.21.15.88:0/2143494952 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c02cce0 con 0x7f865c0c6570 2023-11-27T20:55:21.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.010+0000 7f865959a640 1 -- 172.21.15.88:0/2143494952 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c02ce40 con 0x7f865c0c6570 2023-11-27T20:55:21.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.010+0000 7f865959a640 1 -- 172.21.15.88:0/2143494952 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c034660 con 0x7f865c0c6570 2023-11-27T20:55:21.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.011+0000 7f8660ac2640 1 -- 172.21.15.88:0/2143494952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f865c0c6570 msgr2=0x7f865c0c6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.011+0000 7f8660ac2640 1 --2- 172.21.15.88:0/2143494952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f865c0c6570 0x7f865c0c6a20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f864c009d90 tx=0x7f864c02bf30 comp rx=0 tx=0).stop 2023-11-27T20:55:21.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.011+0000 7f8660ac2640 1 -- 172.21.15.88:0/2143494952 shutdown_connections 2023-11-27T20:55:21.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.011+0000 7f8660ac2640 1 --2- 172.21.15.88:0/2143494952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f865c0c6570 0x7f865c0c6a20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.011+0000 7f8660ac2640 1 --2- 172.21.15.88:0/2143494952 >> v2:172.21.15.88:3300/0 conn(0x7f865c14ffa0 0x7f865c0c1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.011+0000 7f8660ac2640 1 -- 172.21.15.88:0/2143494952 >> 172.21.15.88:0/2143494952 conn(0x7f865c06b5c0 msgr2=0x7f865c06b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:21.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.011+0000 7f8660ac2640 1 -- 172.21.15.88:0/2143494952 shutdown_connections 2023-11-27T20:55:21.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.011+0000 7f8660ac2640 1 -- 172.21.15.88:0/2143494952 wait complete. 2023-11-27T20:55:21.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.012+0000 7f8660ac2640 1 Processor -- start 2023-11-27T20:55:21.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.012+0000 7f8660ac2640 1 -- start start 2023-11-27T20:55:21.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.013+0000 7f8660ac2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f865c0c6570 0x7f865c0c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.013+0000 7f8660ac2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f865c14ffa0 0x7f865c158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.013+0000 7f8660ac2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f865c150380 0x7f865c14d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.013+0000 7f8660ac2640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c1eb4e0 con 0x7f865c150380 2023-11-27T20:55:21.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.013+0000 7f8660ac2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c152c10 con 0x7f865c0c6570 2023-11-27T20:55:21.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.013+0000 7f8660ac2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865c0c4ed0 con 0x7f865c14ffa0 2023-11-27T20:55:21.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.013+0000 7f865a59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f865c0c6570 0x7f865c0c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.013+0000 7f8659d9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f865c14ffa0 0x7f865c158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.014+0000 7f865a59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f865c0c6570 0x7f865c0c4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:39636/0 (socket says 172.21.15.88:39636) 2023-11-27T20:55:21.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.014+0000 7f865a59c640 1 -- 172.21.15.88:0/2782613424 learned_addr learned my addr 172.21.15.88:0/2782613424 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:21.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.017+0000 7f865a59c640 1 -- 172.21.15.88:0/2782613424 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f865c14ffa0 msgr2=0x7f865c158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.017+0000 7f865a59c640 1 --2- 172.21.15.88:0/2782613424 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f865c14ffa0 0x7f865c158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.017+0000 7f865a59c640 1 -- 172.21.15.88:0/2782613424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f865c150380 msgr2=0x7f865c14d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.017+0000 7f865a59c640 1 --2- 172.21.15.88:0/2782613424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f865c150380 0x7f865c14d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.017+0000 7f865a59c640 1 -- 172.21.15.88:0/2782613424 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c009a70 con 0x7f865c0c6570 2023-11-27T20:55:21.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.020+0000 7f865a59c640 1 --2- 172.21.15.88:0/2782613424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f865c0c6570 0x7f865c0c4570 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f865400b4a0 tx=0x7f865400b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:21.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.023+0000 7f864affd640 1 -- 172.21.15.88:0/2782613424 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8654011830 con 0x7f865c0c6570 2023-11-27T20:55:21.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.023+0000 7f864affd640 1 -- 172.21.15.88:0/2782613424 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8654011990 con 0x7f865c0c6570 2023-11-27T20:55:21.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.023+0000 7f8660ac2640 1 -- 172.21.15.88:0/2782613424 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f865c15a530 con 0x7f865c0c6570 2023-11-27T20:55:21.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.023+0000 7f864affd640 1 -- 172.21.15.88:0/2782613424 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8654011d40 con 0x7f865c0c6570 2023-11-27T20:55:21.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.023+0000 7f8660ac2640 1 -- 172.21.15.88:0/2782613424 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f865c1eda50 con 0x7f865c0c6570 2023-11-27T20:55:21.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.026+0000 7f8663653740 1 Processor -- start 2023-11-27T20:55:21.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.026+0000 7f8663653740 1 -- start start 2023-11-27T20:55:21.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.027+0000 7f8663653740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55572a6e7650 0x55572a6e7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.027+0000 7f8663653740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55572a7314d0 0x55572a6e7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.027+0000 7f8663653740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55572a6e60b0 0x55572a726eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.027+0000 7f8663653740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55572a6a2980 con 0x55572a7314d0 2023-11-27T20:55:21.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.027+0000 7f8663653740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55572a654b90 con 0x55572a6e7650 2023-11-27T20:55:21.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.027+0000 7f8663653740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55572a652280 con 0x55572a6e60b0 2023-11-27T20:55:21.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.028+0000 7f8659d9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55572a6e60b0 0x55572a726eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.028+0000 7f8659d9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55572a6e60b0 0x55572a726eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:54148/0 (socket says 172.21.15.88:54148) 2023-11-27T20:55:21.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.028+0000 7f8659d9b640 1 -- 172.21.15.88:0/1689181987 learned_addr learned my addr 172.21.15.88:0/1689181987 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:21.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.030+0000 7f8659d9b640 1 -- 172.21.15.88:0/1689181987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55572a6e7650 msgr2=0x55572a6e7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.030+0000 7f8659d9b640 1 --2- 172.21.15.88:0/1689181987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55572a6e7650 0x55572a6e7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.030+0000 7f8659d9b640 1 -- 172.21.15.88:0/1689181987 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55572a7314d0 msgr2=0x55572a6e7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.030+0000 7f8659d9b640 1 --2- 172.21.15.88:0/1689181987 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55572a7314d0 0x55572a6e7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.030+0000 7f8659d9b640 1 -- 172.21.15.88:0/1689181987 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55572a613500 con 0x55572a6e60b0 2023-11-27T20:55:21.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.033+0000 7f8659d9b640 1 --2- 172.21.15.88:0/1689181987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55572a6e60b0 0x55572a726eb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f86500016e0 tx=0x7f8650000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6c7e446bf9b6c44 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:21.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.037+0000 7f863bfff640 1 -- 172.21.15.88:0/1689181987 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8650001d80 con 0x55572a6e60b0 2023-11-27T20:55:21.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.037+0000 7f863bfff640 1 -- 172.21.15.88:0/1689181987 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8650005ac0 con 0x55572a6e60b0 2023-11-27T20:55:21.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.037+0000 7f863bfff640 1 -- 172.21.15.88:0/1689181987 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8650005e70 con 0x55572a6e60b0 2023-11-27T20:55:21.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.038+0000 7f8663653740 1 -- 172.21.15.88:0/1689181987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55572a6e60b0 msgr2=0x55572a726eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.038+0000 7f8663653740 1 --2- 172.21.15.88:0/1689181987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55572a6e60b0 0x55572a726eb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f86500016e0 tx=0x7f8650000bc0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.038+0000 7f8663653740 1 -- 172.21.15.88:0/1689181987 shutdown_connections 2023-11-27T20:55:21.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.038+0000 7f8663653740 1 --2- 172.21.15.88:0/1689181987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55572a6e60b0 0x55572a726eb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.038+0000 7f8663653740 1 --2- 172.21.15.88:0/1689181987 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55572a7314d0 0x55572a6e7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.038+0000 7f8663653740 1 --2- 172.21.15.88:0/1689181987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55572a6e7650 0x55572a6e7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.038+0000 7f8663653740 1 -- 172.21.15.88:0/1689181987 >> 172.21.15.88:0/1689181987 conn(0x55572a6e3dc0 msgr2=0x55572a6e6700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:21.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.038+0000 7f8663653740 1 -- 172.21.15.88:0/1689181987 shutdown_connections 2023-11-27T20:55:21.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.038+0000 7f8663653740 1 -- 172.21.15.88:0/1689181987 wait complete. 2023-11-27T20:55:21.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.039+0000 7f8663653740 1 -- start start 2023-11-27T20:55:21.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.039+0000 7f8663653740 1 Processor -- start 2023-11-27T20:55:21.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.040+0000 7f8663653740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55572a6e7650 0x55572a73a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.040+0000 7f8663653740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55572a7314d0 0x55572a72ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.040+0000 7f8663653740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55572a722c10 0x55572a70cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.040+0000 7f8663653740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55572a64db70 con 0x55572a7314d0 2023-11-27T20:55:21.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.040+0000 7f8663653740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55572a607e00 con 0x55572a722c10 2023-11-27T20:55:21.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.040+0000 7f8663653740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55572a607aa0 con 0x55572a6e7650 2023-11-27T20:55:21.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.040+0000 7f8663653740 10 client.0 _ll_register_callbacks cb 0x55572a35fac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T20:55:21.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.041+0000 7f865ad9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55572a6e7650 0x55572a73a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.042+0000 7f865a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55572a7314d0 0x55572a72ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.042+0000 7f865ad9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55572a6e7650 0x55572a73a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:54160/0 (socket says 172.21.15.88:54160) 2023-11-27T20:55:21.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.042+0000 7f865ad9d640 1 -- 172.21.15.88:0/2623200432 learned_addr learned my addr 172.21.15.88:0/2623200432 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:21.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.044+0000 7f864affd640 1 -- 172.21.15.88:0/2782613424 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f865401b520 con 0x7f865c0c6570 2023-11-27T20:55:21.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.045+0000 7f864affd640 1 --2- 172.21.15.88:0/2782613424 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f863c06b1b0 0x7f863c06d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.045+0000 7f865ad9d640 1 --2- 172.21.15.88:0/2782613424 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f863c06b1b0 0x7f863c06d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.045+0000 7f865a59c640 1 -- 172.21.15.88:0/2623200432 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55572a6e7650 msgr2=0x55572a73a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.045+0000 7f865a59c640 1 --2- 172.21.15.88:0/2623200432 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55572a6e7650 0x55572a73a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.045+0000 7f865a59c640 1 -- 172.21.15.88:0/2623200432 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55572a722c10 msgr2=0x55572a70cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.045+0000 7f865a59c640 1 --2- 172.21.15.88:0/2623200432 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55572a722c10 0x55572a70cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.045+0000 7f865a59c640 1 -- 172.21.15.88:0/2623200432 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8644005730 con 0x55572a7314d0 2023-11-27T20:55:21.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.045+0000 7f865ad9d640 1 --2- 172.21.15.88:0/2782613424 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f863c06b1b0 0x7f863c06d670 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f864c02bf70 tx=0x7f864c004a40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:21.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.047+0000 7f864affd640 1 -- 172.21.15.88:0/2782613424 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f865405f680 con 0x7f865c0c6570 2023-11-27T20:55:21.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.047+0000 7f865a59c640 1 --2- 172.21.15.88:0/2623200432 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55572a7314d0 0x55572a72ccd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f865408eb70 tx=0x7f86540047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41625f7a3d80a14 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:21.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.047+0000 7f86397fa640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-11-27T20:55:21.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.050+0000 7f86397fa640 1 -- 172.21.15.88:0/2623200432 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865405e8e0 con 0x55572a7314d0 2023-11-27T20:55:21.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.050+0000 7f86397fa640 1 -- 172.21.15.88:0/2623200432 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f865405ef80 con 0x55572a7314d0 2023-11-27T20:55:21.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.050+0000 7f8663653740 1 -- 172.21.15.88:0/2623200432 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55572a646b50 con 0x55572a7314d0 2023-11-27T20:55:21.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.052+0000 7f86397fa640 1 -- 172.21.15.88:0/2623200432 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f865405d160 con 0x55572a7314d0 2023-11-27T20:55:21.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.052+0000 7f8663653740 10 client.4677 fetch_fsmap learned FSMap version 19 2023-11-27T20:55:21.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.052+0000 7f8663653740 1 -- 172.21.15.88:0/2623200432 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55572a64c1f0 con 0x55572a7314d0 2023-11-27T20:55:21.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.056+0000 7f86397fa640 1 -- 172.21.15.88:0/2623200432 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55572a646b50 con 0x55572a7314d0 2023-11-27T20:55:21.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.056+0000 7f86397fa640 1 -- 172.21.15.88:0/2623200432 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 19) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f8654061070 con 0x55572a7314d0 2023-11-27T20:55:21.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.056+0000 7f8663653740 10 client.4677 fetch_fsmap finished waiting for FSMap version 19 2023-11-27T20:55:21.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.056+0000 7f8663653740 10 client.4677 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-27T20:55:21.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.056+0000 7f8663653740 20 client.4677 populate_metadata read hostname 'smithi088' 2023-11-27T20:55:21.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.056+0000 7f8663653740 1 --2- 172.21.15.88:0/2623200432 >> [v2:172.21.15.167:6832/1245449675,v1:172.21.15.167:6833/1245449675] conn(0x55572a73c2a0 0x55572a73c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.056+0000 7f8663653740 4 client.4677 mds_command: new command op to 34190 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-27T20:55:21.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.056+0000 7f8663653740 1 -- 172.21.15.88:0/2623200432 --> [v2:172.21.15.167:6832/1245449675,v1:172.21.15.167:6833/1245449675] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55572a646870 con 0x55572a73c2a0 2023-11-27T20:55:21.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.057+0000 7f8659d9b640 1 --2- 172.21.15.88:0/2623200432 >> [v2:172.21.15.167:6832/1245449675,v1:172.21.15.167:6833/1245449675] conn(0x55572a73c2a0 0x55572a73c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.097+0000 7f8659d9b640 1 --2- 172.21.15.88:0/2623200432 >> [v2:172.21.15.167:6832/1245449675,v1:172.21.15.167:6833/1245449675] conn(0x55572a73c2a0 0x55572a73c680 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=64fee76c221cd90f server_cookie=512620baf7c680e4 in_seq=0 out_seq=0 2023-11-27T20:55:21.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.097+0000 7f86397fa640 10 client.4677 ms_handle_connect on v2:172.21.15.167:6832/1245449675 2023-11-27T20:55:21.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.201+0000 7f86397fa640 1 -- 172.21.15.88:0/2623200432 <== mds.2 v2:172.21.15.167:6832/1245449675 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55572a646870 con 0x55572a73c2a0 2023-11-27T20:55:21.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.201+0000 7f86397fa640 10 client.4677 handle_command_reply: tid=0 2023-11-27T20:55:21.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.201+0000 7f8663653740 1 client.4677 shutdown 2023-11-27T20:55:21.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.201+0000 7f8663653740 1 -- 172.21.15.88:0/2623200432 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55572a7314d0 msgr2=0x55572a72ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.201+0000 7f8663653740 1 --2- 172.21.15.88:0/2623200432 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55572a7314d0 0x55572a72ccd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f865408eb70 tx=0x7f86540047d0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.201+0000 7f8663653740 1 -- 172.21.15.88:0/2623200432 shutdown_connections 2023-11-27T20:55:21.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.201+0000 7f8663653740 1 --2- 172.21.15.88:0/2623200432 >> [v2:172.21.15.167:6832/1245449675,v1:172.21.15.167:6833/1245449675] conn(0x55572a73c2a0 0x55572a73c680 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.201+0000 7f8663653740 1 --2- 172.21.15.88:0/2623200432 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55572a722c10 0x55572a70cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.201+0000 7f8663653740 1 --2- 172.21.15.88:0/2623200432 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55572a7314d0 0x55572a72ccd0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.201+0000 7f8663653740 1 --2- 172.21.15.88:0/2623200432 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55572a6e7650 0x55572a73a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.201+0000 7f86397fa640 0 client.4677 ms_handle_reset on v2:172.21.15.167:6832/1245449675 2023-11-27T20:55:21.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.201+0000 7f8663653740 1 -- 172.21.15.88:0/2623200432 >> 172.21.15.88:0/2623200432 conn(0x55572a6e60b0 msgr2=0x55572a728840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:21.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.201+0000 7f8663653740 1 -- 172.21.15.88:0/2623200432 shutdown_connections 2023-11-27T20:55:21.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.201+0000 7f8663653740 1 -- 172.21.15.88:0/2623200432 wait complete. 2023-11-27T20:55:21.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.201+0000 7f8663653740 20 client.4677 trim_cache size 0 max 16384 2023-11-27T20:55:21.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.217+0000 7f8663653740 1 Processor -- start 2023-11-27T20:55:21.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.217+0000 7f8663653740 1 -- start start 2023-11-27T20:55:21.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.217+0000 7f8663653740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55572a6e7650 0x55572a73a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.217+0000 7f8663653740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55572a722c10 0x55572a70feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.217+0000 7f8663653740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55572a7314d0 0x55572a7426b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.217+0000 7f8663653740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55572a5cd270 con 0x55572a722c10 2023-11-27T20:55:21.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.217+0000 7f8663653740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55572a711400 con 0x55572a6e7650 2023-11-27T20:55:21.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.217+0000 7f8663653740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55572a6e2d30 con 0x55572a7314d0 2023-11-27T20:55:21.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.218+0000 7f8659d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55572a722c10 0x55572a70feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.218+0000 7f865ad9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55572a7314d0 0x55572a7426b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.218+0000 7f8659d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55572a722c10 0x55572a70feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36200/0 (socket says 172.21.15.88:36200) 2023-11-27T20:55:21.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.218+0000 7f8659d9b640 1 -- 172.21.15.88:0/53764060 learned_addr learned my addr 172.21.15.88:0/53764060 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:21.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.218+0000 7f865a59c640 1 --2- 172.21.15.88:0/53764060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55572a6e7650 0x55572a73a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.220+0000 7f8659d9b640 1 -- 172.21.15.88:0/53764060 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55572a7314d0 msgr2=0x55572a7426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.220+0000 7f8659d9b640 1 --2- 172.21.15.88:0/53764060 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55572a7314d0 0x55572a7426b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.220+0000 7f8659d9b640 1 -- 172.21.15.88:0/53764060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55572a6e7650 msgr2=0x55572a73a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.220+0000 7f8659d9b640 1 --2- 172.21.15.88:0/53764060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55572a6e7650 0x55572a73a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.220+0000 7f8659d9b640 1 -- 172.21.15.88:0/53764060 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55572a5e9d00 con 0x55572a722c10 2023-11-27T20:55:21.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.222+0000 7f8659d9b640 1 --2- 172.21.15.88:0/53764060 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55572a722c10 0x55572a70feb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8650015040 tx=0x7f8650012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ed1282b502816c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:21.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.226+0000 7f8648ff9640 1 -- 172.21.15.88:0/53764060 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8650024d70 con 0x55572a722c10 2023-11-27T20:55:21.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.226+0000 7f8648ff9640 1 -- 172.21.15.88:0/53764060 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8650023070 con 0x55572a722c10 2023-11-27T20:55:21.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.226+0000 7f8648ff9640 1 -- 172.21.15.88:0/53764060 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8650007510 con 0x55572a722c10 2023-11-27T20:55:21.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.226+0000 7f8663653740 1 -- 172.21.15.88:0/53764060 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55572a722c10 msgr2=0x55572a70feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.226+0000 7f8663653740 1 --2- 172.21.15.88:0/53764060 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55572a722c10 0x55572a70feb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8650015040 tx=0x7f8650012000 comp rx=0 tx=0).stop 2023-11-27T20:55:21.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.227+0000 7f8663653740 1 -- 172.21.15.88:0/53764060 shutdown_connections 2023-11-27T20:55:21.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.227+0000 7f8663653740 1 --2- 172.21.15.88:0/53764060 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55572a7314d0 0x55572a7426b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.227+0000 7f8663653740 1 --2- 172.21.15.88:0/53764060 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55572a722c10 0x55572a70feb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.227+0000 7f8663653740 1 --2- 172.21.15.88:0/53764060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55572a6e7650 0x55572a73a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.227+0000 7f8663653740 1 -- 172.21.15.88:0/53764060 >> 172.21.15.88:0/53764060 conn(0x55572a6e60b0 msgr2=0x55572a6dd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:21.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.227+0000 7f8663653740 1 -- 172.21.15.88:0/53764060 shutdown_connections 2023-11-27T20:55:21.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.227+0000 7f8663653740 1 -- 172.21.15.88:0/53764060 wait complete. 2023-11-27T20:55:21.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.227+0000 7f8663653740 1 -- start start 2023-11-27T20:55:21.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.227+0000 7f8663653740 1 Processor -- start 2023-11-27T20:55:21.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.228+0000 7f8663653740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55572a6e7650 0x55572a7499c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.228+0000 7f8663653740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55572a722c10 0x55572a6e6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.228+0000 7f8663653740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55572a7314d0 0x55572a7304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.228+0000 7f8663653740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55572a723c10 con 0x55572a7314d0 2023-11-27T20:55:21.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.228+0000 7f8663653740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55572a749f00 con 0x55572a6e7650 2023-11-27T20:55:21.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.228+0000 7f8663653740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55572a6e5550 con 0x55572a722c10 2023-11-27T20:55:21.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.228+0000 7f8663653740 10 client.0 _ll_register_callbacks cb 0x7f86500012d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T20:55:21.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.229+0000 7f865ad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55572a7314d0 0x55572a7304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.229+0000 7f8659d9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55572a722c10 0x55572a6e6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.229+0000 7f865a59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55572a6e7650 0x55572a7499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.229+0000 7f865ad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55572a7314d0 0x55572a7304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36206/0 (socket says 172.21.15.88:36206) 2023-11-27T20:55:21.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.229+0000 7f865ad9d640 1 -- 172.21.15.88:0/2264362442 learned_addr learned my addr 172.21.15.88:0/2264362442 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:21.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.232+0000 7f865ad9d640 1 -- 172.21.15.88:0/2264362442 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55572a722c10 msgr2=0x55572a6e6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.232+0000 7f865ad9d640 1 --2- 172.21.15.88:0/2264362442 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55572a722c10 0x55572a6e6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.232+0000 7f865ad9d640 1 -- 172.21.15.88:0/2264362442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55572a6e7650 msgr2=0x55572a7499c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.232+0000 7f865ad9d640 1 --2- 172.21.15.88:0/2264362442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55572a6e7650 0x55572a7499c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.232+0000 7f865ad9d640 1 -- 172.21.15.88:0/2264362442 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55572a613500 con 0x55572a7314d0 2023-11-27T20:55:21.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.234+0000 7f865ad9d640 1 --2- 172.21.15.88:0/2264362442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55572a7314d0 0x55572a7304d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f864c02c540 tx=0x7f864c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddcbcba1661ff52e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:21.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.234+0000 7f86397fa640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-11-27T20:55:21.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.240+0000 7f86397fa640 1 -- 172.21.15.88:0/2264362442 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c048070 con 0x55572a7314d0 2023-11-27T20:55:21.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.240+0000 7f86397fa640 1 -- 172.21.15.88:0/2264362442 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f864c04f660 con 0x55572a7314d0 2023-11-27T20:55:21.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.240+0000 7f8663653740 1 -- 172.21.15.88:0/2264362442 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8650005ac0 con 0x55572a7314d0 2023-11-27T20:55:21.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.241+0000 7f86397fa640 1 -- 172.21.15.88:0/2264362442 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f864c04f820 con 0x55572a7314d0 2023-11-27T20:55:21.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.241+0000 7f8663653740 10 client.4683 fetch_fsmap learned FSMap version 19 2023-11-27T20:55:21.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.241+0000 7f8663653740 1 -- 172.21.15.88:0/2264362442 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55572a60f4f0 con 0x55572a7314d0 2023-11-27T20:55:21.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.245+0000 7f86397fa640 1 -- 172.21.15.88:0/2264362442 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8650005ac0 con 0x55572a7314d0 2023-11-27T20:55:21.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.245+0000 7f86397fa640 1 -- 172.21.15.88:0/2264362442 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 19) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f864c04f980 con 0x55572a7314d0 2023-11-27T20:55:21.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.245+0000 7f8663653740 10 client.4683 fetch_fsmap finished waiting for FSMap version 19 2023-11-27T20:55:21.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.245+0000 7f8663653740 10 client.4683 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-27T20:55:21.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.245+0000 7f8663653740 20 client.4683 populate_metadata read hostname 'smithi088' 2023-11-27T20:55:21.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.245+0000 7f8663653740 1 --2- 172.21.15.88:0/2264362442 >> [v2:172.21.15.167:6832/1245449675,v1:172.21.15.167:6833/1245449675] conn(0x55572a793390 0x55572a793770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.245+0000 7f8663653740 4 client.4683 mds_command: new command op to 34190 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-27T20:55:21.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.245+0000 7f8663653740 1 -- 172.21.15.88:0/2264362442 --> [v2:172.21.15.167:6832/1245449675,v1:172.21.15.167:6833/1245449675] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55572a34e6c0 con 0x55572a793390 2023-11-27T20:55:21.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.246+0000 7f865a59c640 1 --2- 172.21.15.88:0/2264362442 >> [v2:172.21.15.167:6832/1245449675,v1:172.21.15.167:6833/1245449675] conn(0x55572a793390 0x55572a793770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.249+0000 7f865a59c640 1 --2- 172.21.15.88:0/2264362442 >> [v2:172.21.15.167:6832/1245449675,v1:172.21.15.167:6833/1245449675] conn(0x55572a793390 0x55572a793770 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=44849e752b6cf9b3 server_cookie=2bbcc6d9be537788 in_seq=0 out_seq=0 2023-11-27T20:55:21.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.249+0000 7f86397fa640 10 client.4683 ms_handle_connect on v2:172.21.15.167:6832/1245449675 2023-11-27T20:55:21.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.267+0000 7f86397fa640 1 -- 172.21.15.88:0/2264362442 <== mds.2 v2:172.21.15.167:6832/1245449675 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55572a34e6c0 con 0x55572a793390 2023-11-27T20:55:21.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.267+0000 7f86397fa640 10 client.4683 handle_command_reply: tid=0 2023-11-27T20:55:21.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.267+0000 7f8663653740 1 client.4683 shutdown 2023-11-27T20:55:21.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.267+0000 7f8663653740 1 -- 172.21.15.88:0/2264362442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55572a7314d0 msgr2=0x55572a7304d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.267+0000 7f8663653740 1 --2- 172.21.15.88:0/2264362442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55572a7314d0 0x55572a7304d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f864c02c540 tx=0x7f864c004ab0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.267+0000 7f8663653740 1 -- 172.21.15.88:0/2264362442 shutdown_connections 2023-11-27T20:55:21.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.267+0000 7f8663653740 1 --2- 172.21.15.88:0/2264362442 >> [v2:172.21.15.167:6832/1245449675,v1:172.21.15.167:6833/1245449675] conn(0x55572a793390 0x55572a793770 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.267+0000 7f8663653740 1 --2- 172.21.15.88:0/2264362442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55572a7314d0 0x55572a7304d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.267+0000 7f86397fa640 0 client.4683 ms_handle_reset on v2:172.21.15.167:6832/1245449675 2023-11-27T20:55:21.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.267+0000 7f8663653740 1 --2- 172.21.15.88:0/2264362442 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55572a722c10 0x55572a6e6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.267+0000 7f8663653740 1 --2- 172.21.15.88:0/2264362442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55572a6e7650 0x55572a7499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.267+0000 7f8663653740 1 -- 172.21.15.88:0/2264362442 >> 172.21.15.88:0/2264362442 conn(0x55572a6e60b0 msgr2=0x55572a7108d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:21.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.267+0000 7f8663653740 1 -- 172.21.15.88:0/2264362442 shutdown_connections 2023-11-27T20:55:21.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.267+0000 7f8663653740 1 -- 172.21.15.88:0/2264362442 wait complete. 2023-11-27T20:55:21.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.267+0000 7f8663653740 20 client.4683 trim_cache size 0 max 16384 2023-11-27T20:55:21.270 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-27T20:55:21.270 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_fsid": "ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc", 2023-11-27T20:55:21.271 INFO:teuthology.orchestra.run.smithi088.stdout: "whoami": 2, 2023-11-27T20:55:21.271 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 34190, 2023-11-27T20:55:21.271 INFO:teuthology.orchestra.run.smithi088.stdout: "want_state": "up:active", 2023-11-27T20:55:21.271 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "up:active", 2023-11-27T20:55:21.271 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs", 2023-11-27T20:55:21.271 INFO:teuthology.orchestra.run.smithi088.stdout: "rank_uptime": 16.489218358999999, 2023-11-27T20:55:21.271 INFO:teuthology.orchestra.run.smithi088.stdout: "mdsmap_epoch": 19, 2023-11-27T20:55:21.271 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch": 28, 2023-11-27T20:55:21.271 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch_barrier": 28, 2023-11-27T20:55:21.271 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 66.115651870999997 2023-11-27T20:55:21.271 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-27T20:55:21.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.268+0000 7f8660ac2640 1 -- 172.21.15.88:0/2782613424 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f863c06b1b0 msgr2=0x7f863c06d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.268+0000 7f8660ac2640 1 --2- 172.21.15.88:0/2782613424 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f863c06b1b0 0x7f863c06d670 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f864c02bf70 tx=0x7f864c004a40 comp rx=0 tx=0).stop 2023-11-27T20:55:21.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.268+0000 7f8660ac2640 1 -- 172.21.15.88:0/2782613424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f865c0c6570 msgr2=0x7f865c0c4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.268+0000 7f8660ac2640 1 --2- 172.21.15.88:0/2782613424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f865c0c6570 0x7f865c0c4570 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f865400b4a0 tx=0x7f865400b960 comp rx=0 tx=0).stop 2023-11-27T20:55:21.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.268+0000 7f8660ac2640 1 -- 172.21.15.88:0/2782613424 shutdown_connections 2023-11-27T20:55:21.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.268+0000 7f8660ac2640 1 --2- 172.21.15.88:0/2782613424 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f863c06b1b0 0x7f863c06d670 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.268+0000 7f8660ac2640 1 --2- 172.21.15.88:0/2782613424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f865c150380 0x7f865c14d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.268+0000 7f8660ac2640 1 --2- 172.21.15.88:0/2782613424 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f865c14ffa0 0x7f865c158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.268+0000 7f8660ac2640 1 --2- 172.21.15.88:0/2782613424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f865c0c6570 0x7f865c0c4570 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.268+0000 7f8660ac2640 1 -- 172.21.15.88:0/2782613424 >> 172.21.15.88:0/2782613424 conn(0x7f865c06b5c0 msgr2=0x7f865c159a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:21.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.268+0000 7f8660ac2640 1 -- 172.21.15.88:0/2782613424 shutdown_connections 2023-11-27T20:55:21.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.268+0000 7f8660ac2640 1 -- 172.21.15.88:0/2782613424 wait complete. 2023-11-27T20:55:21.280 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-27T20:55:21.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.379+0000 7f8cd9d25640 1 Processor -- start 2023-11-27T20:55:21.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.379+0000 7f8cd9d25640 1 -- start start 2023-11-27T20:55:21.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.379+0000 7f8cd9d25640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cd40c44d0 0x7f8cd40c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.379+0000 7f8cd9d25640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8cd41596e0 0x7f8cd4159b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.379+0000 7f8cd9d25640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd4150910 con 0x7f8cd4150530 2023-11-27T20:55:21.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.379+0000 7f8cd9d25640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd40c1ec0 con 0x7f8cd41596e0 2023-11-27T20:55:21.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.379+0000 7f8cd9d25640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd415a4e0 con 0x7f8cd40c44d0 2023-11-27T20:55:21.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.380+0000 7f8cd37fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8cd4150530 0x7f8cd40c6c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39356/0 (socket says 172.21.15.88:39356) 2023-11-27T20:55:21.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.380+0000 7f8cd37fe640 1 -- 172.21.15.88:0/3458120777 learned_addr learned my addr 172.21.15.88:0/3458120777 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:55:21.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.380+0000 7f8cd3fff640 1 --2- 172.21.15.88:0/3458120777 >> v2:172.21.15.167:3300/0 conn(0x7f8cd41596e0 0x7f8cd4159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.380+0000 7f8cd2ffd640 1 --2- 172.21.15.88:0/3458120777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cd40c44d0 0x7f8cd40c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.383+0000 7f8cd27fc640 1 -- 172.21.15.88:0/3458120777 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 356308762 0 0) 0x7f8cd4150910 con 0x7f8cd4150530 2023-11-27T20:55:21.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.383+0000 7f8cd27fc640 1 -- 172.21.15.88:0/3458120777 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cbc003520 con 0x7f8cd4150530 2023-11-27T20:55:21.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.383+0000 7f8cd2ffd640 1 -- 172.21.15.88:0/3458120777 >> v2:172.21.15.167:3300/0 conn(0x7f8cd41596e0 msgr2=0x7f8cd4159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.383+0000 7f8cd2ffd640 1 --2- 172.21.15.88:0/3458120777 >> v2:172.21.15.167:3300/0 conn(0x7f8cd41596e0 0x7f8cd4159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.383+0000 7f8cd2ffd640 1 -- 172.21.15.88:0/3458120777 >> v1:172.21.15.88:6789/0 conn(0x7f8cd4150530 legacy=0x7f8cd40c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.383+0000 7f8cd2ffd640 1 -- 172.21.15.88:0/3458120777 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd40c2110 con 0x7f8cd40c44d0 2023-11-27T20:55:21.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.385+0000 7f8cd2ffd640 1 --2- 172.21.15.88:0/3458120777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cd40c44d0 0x7f8cd40c4910 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8cc80097a0 tx=0x7f8cc802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28951e260988d5e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:21.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.389+0000 7f8cd27fc640 1 -- 172.21.15.88:0/3458120777 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8030610 con 0x7f8cd40c44d0 2023-11-27T20:55:21.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.389+0000 7f8cd27fc640 1 -- 172.21.15.88:0/3458120777 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc8030770 con 0x7f8cd40c44d0 2023-11-27T20:55:21.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.389+0000 7f8cd27fc640 1 -- 172.21.15.88:0/3458120777 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8030b00 con 0x7f8cd40c44d0 2023-11-27T20:55:21.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.390+0000 7f8cd9d25640 1 -- 172.21.15.88:0/3458120777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cd40c44d0 msgr2=0x7f8cd40c4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.390+0000 7f8cd9d25640 1 --2- 172.21.15.88:0/3458120777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cd40c44d0 0x7f8cd40c4910 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8cc80097a0 tx=0x7f8cc802b960 comp rx=0 tx=0).stop 2023-11-27T20:55:21.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.390+0000 7f8cd9d25640 1 -- 172.21.15.88:0/3458120777 shutdown_connections 2023-11-27T20:55:21.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.390+0000 7f8cd9d25640 1 --2- 172.21.15.88:0/3458120777 >> v2:172.21.15.167:3300/0 conn(0x7f8cd41596e0 0x7f8cd4159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.390+0000 7f8cd9d25640 1 --2- 172.21.15.88:0/3458120777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cd40c44d0 0x7f8cd40c4910 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.390+0000 7f8cd9d25640 1 -- 172.21.15.88:0/3458120777 >> 172.21.15.88:0/3458120777 conn(0x7f8cd406c5f0 msgr2=0x7f8cd406c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:21.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.390+0000 7f8cd9d25640 1 -- 172.21.15.88:0/3458120777 shutdown_connections 2023-11-27T20:55:21.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.390+0000 7f8cd9d25640 1 -- 172.21.15.88:0/3458120777 wait complete. 2023-11-27T20:55:21.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.391+0000 7f8cd9d25640 1 Processor -- start 2023-11-27T20:55:21.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.391+0000 7f8cd9d25640 1 -- start start 2023-11-27T20:55:21.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.392+0000 7f8cd9d25640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cd40c44d0 0x7f8cd41ee710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.392+0000 7f8cd9d25640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cd4150530 0x7f8cd4155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.392+0000 7f8cd9d25640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cd41596e0 0x7f8cd4154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.392+0000 7f8cd9d25640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd414ada0 con 0x7f8cd40c44d0 2023-11-27T20:55:21.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.392+0000 7f8cd9d25640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd414a870 con 0x7f8cd4150530 2023-11-27T20:55:21.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.392+0000 7f8cd9d25640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd41ee280 con 0x7f8cd41596e0 2023-11-27T20:55:21.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.392+0000 7f8cd37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cd40c44d0 0x7f8cd41ee710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.392+0000 7f8cd3fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cd41596e0 0x7f8cd4154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.392+0000 7f8cd2ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cd4150530 0x7f8cd4155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.393+0000 7f8cd37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cd40c44d0 0x7f8cd41ee710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36220/0 (socket says 172.21.15.88:36220) 2023-11-27T20:55:21.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.393+0000 7f8cd37fe640 1 -- 172.21.15.88:0/2447002821 learned_addr learned my addr 172.21.15.88:0/2447002821 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:21.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.396+0000 7f8cd37fe640 1 -- 172.21.15.88:0/2447002821 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cd41596e0 msgr2=0x7f8cd4154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.396+0000 7f8cd37fe640 1 --2- 172.21.15.88:0/2447002821 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cd41596e0 0x7f8cd4154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.396+0000 7f8cd37fe640 1 -- 172.21.15.88:0/2447002821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cd4150530 msgr2=0x7f8cd4155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.396+0000 7f8cd37fe640 1 --2- 172.21.15.88:0/2447002821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cd4150530 0x7f8cd4155b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.396+0000 7f8cd37fe640 1 -- 172.21.15.88:0/2447002821 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc8009400 con 0x7f8cd40c44d0 2023-11-27T20:55:21.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.396+0000 7f8cd2ffd640 1 --2- 172.21.15.88:0/2447002821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cd4150530 0x7f8cd4155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:55:21.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.398+0000 7f8cd37fe640 1 --2- 172.21.15.88:0/2447002821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cd40c44d0 0x7f8cd41ee710 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400c460 tx=0x7f8cc400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:21.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.402+0000 7f8cbbfff640 1 -- 172.21.15.88:0/2447002821 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4005ce0 con 0x7f8cd40c44d0 2023-11-27T20:55:21.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.402+0000 7f8cbbfff640 1 -- 172.21.15.88:0/2447002821 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc4005e40 con 0x7f8cd40c44d0 2023-11-27T20:55:21.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.402+0000 7f8cd9d25640 1 -- 172.21.15.88:0/2447002821 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd414aac0 con 0x7f8cd40c44d0 2023-11-27T20:55:21.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.402+0000 7f8cbbfff640 1 -- 172.21.15.88:0/2447002821 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc40072f0 con 0x7f8cd40c44d0 2023-11-27T20:55:21.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.402+0000 7f8cd9d25640 1 -- 172.21.15.88:0/2447002821 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd414a500 con 0x7f8cd40c44d0 2023-11-27T20:55:21.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.404+0000 7f8cdc992740 1 Processor -- start 2023-11-27T20:55:21.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.404+0000 7f8cdc992740 1 -- start start 2023-11-27T20:55:21.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.405+0000 7f8cdc992740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df89141650 0x55df89141a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.405+0000 7f8cdc992740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df8918b4d0 0x55df89141f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.405+0000 7f8cdc992740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55df891400b0 0x55df89180eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.405+0000 7f8cdc992740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df890fc980 con 0x55df891400b0 2023-11-27T20:55:21.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.405+0000 7f8cdc992740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df890aeb90 con 0x55df8918b4d0 2023-11-27T20:55:21.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.405+0000 7f8cdc992740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df890ac280 con 0x55df89141650 2023-11-27T20:55:21.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.406+0000 7f8cd37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df8918b4d0 0x55df89141f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.406+0000 7f8cd3fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df89141650 0x55df89141a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.406+0000 7f8cd37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df8918b4d0 0x55df89141f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:39664/0 (socket says 172.21.15.88:39664) 2023-11-27T20:55:21.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.406+0000 7f8cd37fe640 1 -- 172.21.15.88:0/4286563277 learned_addr learned my addr 172.21.15.88:0/4286563277 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:21.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.408+0000 7f8cd37fe640 1 -- 172.21.15.88:0/4286563277 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df89141650 msgr2=0x55df89141a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.408+0000 7f8cd37fe640 1 --2- 172.21.15.88:0/4286563277 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df89141650 0x55df89141a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.408+0000 7f8cd37fe640 1 -- 172.21.15.88:0/4286563277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55df891400b0 msgr2=0x55df89180eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.408+0000 7f8cd37fe640 1 --2- 172.21.15.88:0/4286563277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55df891400b0 0x55df89180eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.408+0000 7f8cd37fe640 1 -- 172.21.15.88:0/4286563277 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df8906d500 con 0x55df8918b4d0 2023-11-27T20:55:21.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.410+0000 7f8cd37fe640 1 --2- 172.21.15.88:0/4286563277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df8918b4d0 0x55df89141f70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4005880 tx=0x7f8cc400f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=488e4ee24b81c459 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:21.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.413+0000 7f8cb97fa640 1 -- 172.21.15.88:0/4286563277 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4027660 con 0x55df8918b4d0 2023-11-27T20:55:21.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.413+0000 7f8cb97fa640 1 -- 172.21.15.88:0/4286563277 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc40277c0 con 0x55df8918b4d0 2023-11-27T20:55:21.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.413+0000 7f8cb97fa640 1 -- 172.21.15.88:0/4286563277 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4027b70 con 0x55df8918b4d0 2023-11-27T20:55:21.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.414+0000 7f8cdc992740 1 -- 172.21.15.88:0/4286563277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df8918b4d0 msgr2=0x55df89141f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.414+0000 7f8cdc992740 1 --2- 172.21.15.88:0/4286563277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df8918b4d0 0x55df89141f70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4005880 tx=0x7f8cc400f000 comp rx=0 tx=0).stop 2023-11-27T20:55:21.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.414+0000 7f8cdc992740 1 -- 172.21.15.88:0/4286563277 shutdown_connections 2023-11-27T20:55:21.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.414+0000 7f8cdc992740 1 --2- 172.21.15.88:0/4286563277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55df891400b0 0x55df89180eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.414+0000 7f8cdc992740 1 --2- 172.21.15.88:0/4286563277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df8918b4d0 0x55df89141f70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.414+0000 7f8cdc992740 1 --2- 172.21.15.88:0/4286563277 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df89141650 0x55df89141a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.414+0000 7f8cdc992740 1 -- 172.21.15.88:0/4286563277 >> 172.21.15.88:0/4286563277 conn(0x55df8913ddc0 msgr2=0x55df89140700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:21.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.414+0000 7f8cdc992740 1 -- 172.21.15.88:0/4286563277 shutdown_connections 2023-11-27T20:55:21.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.414+0000 7f8cdc992740 1 -- 172.21.15.88:0/4286563277 wait complete. 2023-11-27T20:55:21.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.415+0000 7f8cdc992740 1 -- start start 2023-11-27T20:55:21.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.415+0000 7f8cdc992740 1 Processor -- start 2023-11-27T20:55:21.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.416+0000 7f8cdc992740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55df89141650 0x55df89196500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.416+0000 7f8cdc992740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df8918b4d0 0x55df89160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.416+0000 7f8cdc992740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df89184f50 0x55df8915de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.416+0000 7f8cdc992740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df890a7b70 con 0x55df89141650 2023-11-27T20:55:21.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.416+0000 7f8cdc992740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df89061e00 con 0x55df89184f50 2023-11-27T20:55:21.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.416+0000 7f8cdc992740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df89061aa0 con 0x55df8918b4d0 2023-11-27T20:55:21.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.416+0000 7f8cdc992740 10 client.0 _ll_register_callbacks cb 0x55df88db9ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T20:55:21.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.416+0000 7f8cd2ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df89184f50 0x55df8915de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.416+0000 7f8cd37fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df8918b4d0 0x55df89160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.416+0000 7f8cd2ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df89184f50 0x55df8915de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:39668/0 (socket says 172.21.15.88:39668) 2023-11-27T20:55:21.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.416+0000 7f8cd2ffd640 1 -- 172.21.15.88:0/4256612999 learned_addr learned my addr 172.21.15.88:0/4256612999 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:21.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.419+0000 7f8cd2ffd640 1 -- 172.21.15.88:0/4256612999 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df8918b4d0 msgr2=0x55df89160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.419+0000 7f8cd2ffd640 1 --2- 172.21.15.88:0/4256612999 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df8918b4d0 0x55df89160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.419+0000 7f8cd2ffd640 1 -- 172.21.15.88:0/4256612999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55df89141650 msgr2=0x55df89196500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.419+0000 7f8cd2ffd640 1 --2- 172.21.15.88:0/4256612999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55df89141650 0x55df89196500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.419+0000 7f8cd2ffd640 1 -- 172.21.15.88:0/4256612999 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd414a500 con 0x55df89184f50 2023-11-27T20:55:21.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.421+0000 7f8cd2ffd640 1 --2- 172.21.15.88:0/4256612999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df89184f50 0x55df8915de30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8009890 tx=0x7f8cc80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4265783f1e14242 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:21.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.421+0000 7f8cb27fc640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-11-27T20:55:21.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.422+0000 7f8cbbfff640 1 -- 172.21.15.88:0/2447002821 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8cc4027460 con 0x7f8cd40c44d0 2023-11-27T20:55:21.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.422+0000 7f8cbbfff640 1 --2- 172.21.15.88:0/2447002821 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f8cc006b130 0x7f8cc006d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.422+0000 7f8cd3fff640 1 --2- 172.21.15.88:0/2447002821 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f8cc006b130 0x7f8cc006d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.422+0000 7f8cd3fff640 1 --2- 172.21.15.88:0/2447002821 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f8cc006b130 0x7f8cc006d5f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0145b0 tx=0x7f8ccc009750 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:21.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.425+0000 7f8cb27fc640 1 -- 172.21.15.88:0/4256612999 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc803e040 con 0x55df89184f50 2023-11-27T20:55:21.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.425+0000 7f8cb27fc640 1 -- 172.21.15.88:0/4256612999 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8cc8039c00 con 0x55df89184f50 2023-11-27T20:55:21.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.425+0000 7f8cdc992740 1 -- 172.21.15.88:0/4256612999 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55df890a0b50 con 0x55df89184f50 2023-11-27T20:55:21.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.426+0000 7f8cb27fc640 1 -- 172.21.15.88:0/4256612999 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8cc8039dc0 con 0x55df89184f50 2023-11-27T20:55:21.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.426+0000 7f8cdc992740 10 client.4768 fetch_fsmap learned FSMap version 19 2023-11-27T20:55:21.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.426+0000 7f8cdc992740 1 -- 172.21.15.88:0/4256612999 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55df890a61f0 con 0x55df89184f50 2023-11-27T20:55:21.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.426+0000 7f8cbbfff640 1 -- 172.21.15.88:0/2447002821 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8cc405ad20 con 0x7f8cd40c44d0 2023-11-27T20:55:21.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.430+0000 7f8cb27fc640 1 -- 172.21.15.88:0/4256612999 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55df890a0b50 con 0x55df89184f50 2023-11-27T20:55:21.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.430+0000 7f8cb27fc640 1 -- 172.21.15.88:0/4256612999 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f8cc8041030 con 0x55df89184f50 2023-11-27T20:55:21.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.430+0000 7f8cdc992740 10 client.4768 fetch_fsmap finished waiting for FSMap version 19 2023-11-27T20:55:21.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.430+0000 7f8cdc992740 10 client.4768 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-27T20:55:21.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.430+0000 7f8cdc992740 20 client.4768 populate_metadata read hostname 'smithi088' 2023-11-27T20:55:21.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.430+0000 7f8cdc992740 1 --2- 172.21.15.88:0/4256612999 >> [v2:172.21.15.167:6834/327644613,v1:172.21.15.167:6835/327644613] conn(0x55df8915be50 0x55df8915c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.430+0000 7f8cdc992740 4 client.4768 mds_command: new command op to 34199 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-27T20:55:21.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.430+0000 7f8cdc992740 1 -- 172.21.15.88:0/4256612999 --> [v2:172.21.15.167:6834/327644613,v1:172.21.15.167:6835/327644613] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55df890a0870 con 0x55df8915be50 2023-11-27T20:55:21.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.431+0000 7f8cd37fe640 1 --2- 172.21.15.88:0/4256612999 >> [v2:172.21.15.167:6834/327644613,v1:172.21.15.167:6835/327644613] conn(0x55df8915be50 0x55df8915c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.471+0000 7f8cd37fe640 1 --2- 172.21.15.88:0/4256612999 >> [v2:172.21.15.167:6834/327644613,v1:172.21.15.167:6835/327644613] conn(0x55df8915be50 0x55df8915c230 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b796ce0bbd0a7cfa server_cookie=569f957ab3a08602 in_seq=0 out_seq=0 2023-11-27T20:55:21.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.471+0000 7f8cb27fc640 10 client.4768 ms_handle_connect on v2:172.21.15.167:6834/327644613 2023-11-27T20:55:21.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.574+0000 7f8cb27fc640 1 -- 172.21.15.88:0/4256612999 <== mds.1 v2:172.21.15.167:6834/327644613 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55df890a0870 con 0x55df8915be50 2023-11-27T20:55:21.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.574+0000 7f8cb27fc640 10 client.4768 handle_command_reply: tid=0 2023-11-27T20:55:21.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.574+0000 7f8cdc992740 1 client.4768 shutdown 2023-11-27T20:55:21.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.574+0000 7f8cdc992740 1 -- 172.21.15.88:0/4256612999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df89184f50 msgr2=0x55df8915de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.574+0000 7f8cdc992740 1 --2- 172.21.15.88:0/4256612999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df89184f50 0x55df8915de30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8009890 tx=0x7f8cc80046c0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.574+0000 7f8cdc992740 1 -- 172.21.15.88:0/4256612999 shutdown_connections 2023-11-27T20:55:21.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.574+0000 7f8cdc992740 1 --2- 172.21.15.88:0/4256612999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df89184f50 0x55df8915de30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.574+0000 7f8cdc992740 1 --2- 172.21.15.88:0/4256612999 >> [v2:172.21.15.167:6834/327644613,v1:172.21.15.167:6835/327644613] conn(0x55df8915be50 0x55df8915c230 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.574+0000 7f8cdc992740 1 --2- 172.21.15.88:0/4256612999 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df8918b4d0 0x55df89160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.574+0000 7f8cdc992740 1 --2- 172.21.15.88:0/4256612999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55df89141650 0x55df89196500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.574+0000 7f8cb27fc640 0 client.4768 ms_handle_reset on v2:172.21.15.167:6834/327644613 2023-11-27T20:55:21.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.574+0000 7f8cdc992740 1 -- 172.21.15.88:0/4256612999 >> 172.21.15.88:0/4256612999 conn(0x55df891400b0 msgr2=0x55df89141a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:21.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.574+0000 7f8cdc992740 1 -- 172.21.15.88:0/4256612999 shutdown_connections 2023-11-27T20:55:21.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.574+0000 7f8cdc992740 1 -- 172.21.15.88:0/4256612999 wait complete. 2023-11-27T20:55:21.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.574+0000 7f8cdc992740 20 client.4768 trim_cache size 0 max 16384 2023-11-27T20:55:21.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.589+0000 7f8cdc992740 1 Processor -- start 2023-11-27T20:55:21.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.589+0000 7f8cdc992740 1 -- start start 2023-11-27T20:55:21.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.590+0000 7f8cdc992740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55df89141650 0x55df8915b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.590+0000 7f8cdc992740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df89184f50 0x55df891825d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.590+0000 7f8cdc992740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df8918b4d0 0x55df89182b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.590+0000 7f8cdc992740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df8917bb70 con 0x55df89141650 2023-11-27T20:55:21.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.590+0000 7f8cdc992740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df89027270 con 0x55df89184f50 2023-11-27T20:55:21.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.590+0000 7f8cdc992740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df8915ba70 con 0x55df8918b4d0 2023-11-27T20:55:21.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.590+0000 7f8cd37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55df89141650 0x55df8915b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.591+0000 7f8cd3fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df8918b4d0 0x55df89182b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.591+0000 7f8cd2ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df89184f50 0x55df891825d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.591+0000 7f8cd37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55df89141650 0x55df8915b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36242/0 (socket says 172.21.15.88:36242) 2023-11-27T20:55:21.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.591+0000 7f8cd37fe640 1 -- 172.21.15.88:0/3273020784 learned_addr learned my addr 172.21.15.88:0/3273020784 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:21.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.593+0000 7f8cd37fe640 1 -- 172.21.15.88:0/3273020784 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df8918b4d0 msgr2=0x55df89182b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.593+0000 7f8cd37fe640 1 --2- 172.21.15.88:0/3273020784 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df8918b4d0 0x55df89182b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.593+0000 7f8cd37fe640 1 -- 172.21.15.88:0/3273020784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df89184f50 msgr2=0x55df891825d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.593+0000 7f8cd37fe640 1 --2- 172.21.15.88:0/3273020784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df89184f50 0x55df891825d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.593+0000 7f8cd37fe640 1 -- 172.21.15.88:0/3273020784 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df89182420 con 0x55df89141650 2023-11-27T20:55:21.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.594+0000 7f8cd37fe640 1 --2- 172.21.15.88:0/3273020784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55df89141650 0x55df8915b530 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8cc408a540 tx=0x7f8cc408a4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95dd6e6ca185d621 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:21.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.598+0000 7f8cb9ffb640 1 -- 172.21.15.88:0/3273020784 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4062f70 con 0x55df89141650 2023-11-27T20:55:21.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.598+0000 7f8cb9ffb640 1 -- 172.21.15.88:0/3273020784 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc40590c0 con 0x55df89141650 2023-11-27T20:55:21.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.598+0000 7f8cb9ffb640 1 -- 172.21.15.88:0/3273020784 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc405af80 con 0x55df89141650 2023-11-27T20:55:21.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.599+0000 7f8cdc992740 1 -- 172.21.15.88:0/3273020784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55df89141650 msgr2=0x55df8915b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.599+0000 7f8cdc992740 1 --2- 172.21.15.88:0/3273020784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55df89141650 0x55df8915b530 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8cc408a540 tx=0x7f8cc408a4a0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.599+0000 7f8cdc992740 1 -- 172.21.15.88:0/3273020784 shutdown_connections 2023-11-27T20:55:21.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.599+0000 7f8cdc992740 1 --2- 172.21.15.88:0/3273020784 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df8918b4d0 0x55df89182b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.599+0000 7f8cdc992740 1 --2- 172.21.15.88:0/3273020784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df89184f50 0x55df891825d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.599+0000 7f8cdc992740 1 --2- 172.21.15.88:0/3273020784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55df89141650 0x55df8915b530 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.599+0000 7f8cdc992740 1 -- 172.21.15.88:0/3273020784 >> 172.21.15.88:0/3273020784 conn(0x55df891400b0 msgr2=0x55df8913eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:21.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.599+0000 7f8cdc992740 1 -- 172.21.15.88:0/3273020784 shutdown_connections 2023-11-27T20:55:21.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.599+0000 7f8cdc992740 1 -- 172.21.15.88:0/3273020784 wait complete. 2023-11-27T20:55:21.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.600+0000 7f8cdc992740 1 -- start start 2023-11-27T20:55:21.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.600+0000 7f8cdc992740 1 Processor -- start 2023-11-27T20:55:21.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.601+0000 7f8cdc992740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df89141650 0x55df891829d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.601+0000 7f8cdc992740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df89184f50 0x55df891eedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.601+0000 7f8cdc992740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55df8918b4d0 0x55df891ef310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.601+0000 7f8cdc992740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df8915c990 con 0x55df8918b4d0 2023-11-27T20:55:21.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.601+0000 7f8cdc992740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df89182f10 con 0x55df89141650 2023-11-27T20:55:21.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.601+0000 7f8cdc992740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df89197190 con 0x55df89184f50 2023-11-27T20:55:21.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.601+0000 7f8cdc992740 10 client.0 _ll_register_callbacks cb 0x7f8cc4015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T20:55:21.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.601+0000 7f8cd3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55df8918b4d0 0x55df891ef310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.601+0000 7f8cd37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df89141650 0x55df891829d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.601+0000 7f8cd2ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df89184f50 0x55df891eedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.601+0000 7f8cd37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df89141650 0x55df891829d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:39690/0 (socket says 172.21.15.88:39690) 2023-11-27T20:55:21.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.601+0000 7f8cd37fe640 1 -- 172.21.15.88:0/49261066 learned_addr learned my addr 172.21.15.88:0/49261066 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:21.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.604+0000 7f8cd37fe640 1 -- 172.21.15.88:0/49261066 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df89184f50 msgr2=0x55df891eedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.604+0000 7f8cd37fe640 1 --2- 172.21.15.88:0/49261066 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df89184f50 0x55df891eedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.604+0000 7f8cd37fe640 1 -- 172.21.15.88:0/49261066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55df8918b4d0 msgr2=0x55df891ef310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.604+0000 7f8cd37fe640 1 --2- 172.21.15.88:0/49261066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55df8918b4d0 0x55df891ef310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.604+0000 7f8cd37fe640 1 -- 172.21.15.88:0/49261066 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df8906d500 con 0x55df89141650 2023-11-27T20:55:21.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.607+0000 7f8cd37fe640 1 --2- 172.21.15.88:0/49261066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df89141650 0x55df891829d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8cc405aee0 tx=0x7f8cc4009040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c7a1e2e38bfea66 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:21.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.607+0000 7f8cb27fc640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-11-27T20:55:21.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.610+0000 7f8cb27fc640 1 -- 172.21.15.88:0/49261066 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4062f70 con 0x55df89141650 2023-11-27T20:55:21.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.610+0000 7f8cb27fc640 1 -- 172.21.15.88:0/49261066 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8cc405a210 con 0x55df89141650 2023-11-27T20:55:21.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.610+0000 7f8cdc992740 1 -- 172.21.15.88:0/49261066 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8cc40277c0 con 0x55df89141650 2023-11-27T20:55:21.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.612+0000 7f8cb27fc640 1 -- 172.21.15.88:0/49261066 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8cc405a3d0 con 0x55df89141650 2023-11-27T20:55:21.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.612+0000 7f8cdc992740 10 client.4774 fetch_fsmap learned FSMap version 19 2023-11-27T20:55:21.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.612+0000 7f8cdc992740 1 -- 172.21.15.88:0/49261066 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55df89043d00 con 0x55df89141650 2023-11-27T20:55:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.616+0000 7f8cb27fc640 1 -- 172.21.15.88:0/49261066 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc40277c0 con 0x55df89141650 2023-11-27T20:55:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.616+0000 7f8cb27fc640 1 -- 172.21.15.88:0/49261066 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f8cc4066070 con 0x55df89141650 2023-11-27T20:55:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.616+0000 7f8cdc992740 10 client.4774 fetch_fsmap finished waiting for FSMap version 19 2023-11-27T20:55:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.616+0000 7f8cdc992740 10 client.4774 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-27T20:55:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.616+0000 7f8cdc992740 20 client.4774 populate_metadata read hostname 'smithi088' 2023-11-27T20:55:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.616+0000 7f8cdc992740 1 --2- 172.21.15.88:0/49261066 >> [v2:172.21.15.167:6834/327644613,v1:172.21.15.167:6835/327644613] conn(0x55df891f84e0 0x55df891f88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.616+0000 7f8cdc992740 4 client.4774 mds_command: new command op to 34199 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-27T20:55:21.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.616+0000 7f8cdc992740 1 -- 172.21.15.88:0/49261066 --> [v2:172.21.15.167:6834/327644613,v1:172.21.15.167:6835/327644613] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55df88da86c0 con 0x55df891f84e0 2023-11-27T20:55:21.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.616+0000 7f8cd2ffd640 1 --2- 172.21.15.88:0/49261066 >> [v2:172.21.15.167:6834/327644613,v1:172.21.15.167:6835/327644613] conn(0x55df891f84e0 0x55df891f88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.619+0000 7f8cb27fc640 10 client.4774 ms_handle_connect on v2:172.21.15.167:6834/327644613 2023-11-27T20:55:21.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.619+0000 7f8cd2ffd640 1 --2- 172.21.15.88:0/49261066 >> [v2:172.21.15.167:6834/327644613,v1:172.21.15.167:6835/327644613] conn(0x55df891f84e0 0x55df891f88c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dcb32dcdfc3f1a6b server_cookie=2384b0332a85af79 in_seq=0 out_seq=0 2023-11-27T20:55:21.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.636+0000 7f8cb27fc640 1 -- 172.21.15.88:0/49261066 <== mds.1 v2:172.21.15.167:6834/327644613 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55df88da86c0 con 0x55df891f84e0 2023-11-27T20:55:21.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.636+0000 7f8cb27fc640 10 client.4774 handle_command_reply: tid=0 2023-11-27T20:55:21.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.636+0000 7f8cdc992740 1 client.4774 shutdown 2023-11-27T20:55:21.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.636+0000 7f8cdc992740 1 -- 172.21.15.88:0/49261066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df89141650 msgr2=0x55df891829d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.636+0000 7f8cdc992740 1 --2- 172.21.15.88:0/49261066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df89141650 0x55df891829d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8cc405aee0 tx=0x7f8cc4009040 comp rx=0 tx=0).stop 2023-11-27T20:55:21.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.636+0000 7f8cdc992740 1 -- 172.21.15.88:0/49261066 shutdown_connections 2023-11-27T20:55:21.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.636+0000 7f8cdc992740 1 --2- 172.21.15.88:0/49261066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55df8918b4d0 0x55df891ef310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.636+0000 7f8cdc992740 1 --2- 172.21.15.88:0/49261066 >> [v2:172.21.15.167:6834/327644613,v1:172.21.15.167:6835/327644613] conn(0x55df891f84e0 0x55df891f88c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.636+0000 7f8cdc992740 1 --2- 172.21.15.88:0/49261066 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df89184f50 0x55df891eedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.636+0000 7f8cdc992740 1 --2- 172.21.15.88:0/49261066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df89141650 0x55df891829d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.636+0000 7f8cb27fc640 0 client.4774 ms_handle_reset on v2:172.21.15.167:6834/327644613 2023-11-27T20:55:21.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.636+0000 7f8cdc992740 1 -- 172.21.15.88:0/49261066 >> 172.21.15.88:0/49261066 conn(0x55df891400b0 msgr2=0x55df89163d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:21.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.637+0000 7f8cdc992740 1 -- 172.21.15.88:0/49261066 shutdown_connections 2023-11-27T20:55:21.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.637+0000 7f8cdc992740 1 -- 172.21.15.88:0/49261066 wait complete. 2023-11-27T20:55:21.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.637+0000 7f8cdc992740 20 client.4774 trim_cache size 0 max 16384 2023-11-27T20:55:21.640 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-27T20:55:21.640 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_fsid": "ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc", 2023-11-27T20:55:21.640 INFO:teuthology.orchestra.run.smithi088.stdout: "whoami": 1, 2023-11-27T20:55:21.640 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 34199, 2023-11-27T20:55:21.640 INFO:teuthology.orchestra.run.smithi088.stdout: "want_state": "up:active", 2023-11-27T20:55:21.640 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "up:active", 2023-11-27T20:55:21.640 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs", 2023-11-27T20:55:21.641 INFO:teuthology.orchestra.run.smithi088.stdout: "rank_uptime": 23.085783001999999, 2023-11-27T20:55:21.641 INFO:teuthology.orchestra.run.smithi088.stdout: "mdsmap_epoch": 19, 2023-11-27T20:55:21.641 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch": 28, 2023-11-27T20:55:21.641 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch_barrier": 28, 2023-11-27T20:55:21.641 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 66.364172386000007 2023-11-27T20:55:21.641 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-27T20:55:21.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.637+0000 7f8cd9d25640 1 -- 172.21.15.88:0/2447002821 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f8cc006b130 msgr2=0x7f8cc006d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.637+0000 7f8cd9d25640 1 --2- 172.21.15.88:0/2447002821 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f8cc006b130 0x7f8cc006d5f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0145b0 tx=0x7f8ccc009750 comp rx=0 tx=0).stop 2023-11-27T20:55:21.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.637+0000 7f8cd9d25640 1 -- 172.21.15.88:0/2447002821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cd40c44d0 msgr2=0x7f8cd41ee710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.637+0000 7f8cd9d25640 1 --2- 172.21.15.88:0/2447002821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cd40c44d0 0x7f8cd41ee710 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400c460 tx=0x7f8cc400c920 comp rx=0 tx=0).stop 2023-11-27T20:55:21.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.637+0000 7f8cd9d25640 1 -- 172.21.15.88:0/2447002821 shutdown_connections 2023-11-27T20:55:21.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.637+0000 7f8cd9d25640 1 --2- 172.21.15.88:0/2447002821 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f8cc006b130 0x7f8cc006d5f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.637+0000 7f8cd9d25640 1 --2- 172.21.15.88:0/2447002821 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cd41596e0 0x7f8cd4154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.637+0000 7f8cd9d25640 1 --2- 172.21.15.88:0/2447002821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cd4150530 0x7f8cd4155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.637+0000 7f8cd9d25640 1 --2- 172.21.15.88:0/2447002821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cd40c44d0 0x7f8cd41ee710 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.637+0000 7f8cd9d25640 1 -- 172.21.15.88:0/2447002821 >> 172.21.15.88:0/2447002821 conn(0x7f8cd406c5f0 msgr2=0x7f8cd406e270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:21.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.637+0000 7f8cd9d25640 1 -- 172.21.15.88:0/2447002821 shutdown_connections 2023-11-27T20:55:21.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.637+0000 7f8cd9d25640 1 -- 172.21.15.88:0/2447002821 wait complete. 2023-11-27T20:55:21.650 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-27T20:55:21.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.748+0000 7f50433d7640 1 Processor -- start 2023-11-27T20:55:21.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.748+0000 7f50433d7640 1 -- start start 2023-11-27T20:55:21.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.749+0000 7f50433d7640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f503c0c59e0 0x7f503c06d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.749+0000 7f50433d7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f503c06a4b0 0x7f503c06a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.749+0000 7f50433d7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f503c15c9c0 0x7f503c15ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.749+0000 7f50433d7640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503c15d350 con 0x7f503c0c59e0 2023-11-27T20:55:21.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.749+0000 7f50433d7640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503c159f80 con 0x7f503c06a4b0 2023-11-27T20:55:21.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.749+0000 7f50433d7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503c1593d0 con 0x7f503c15c9c0 2023-11-27T20:55:21.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.749+0000 7f5040972640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f503c06a4b0 0x7f503c06a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.749+0000 7f5041974640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f503c15c9c0 0x7f503c15ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.749+0000 7f5041173640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f503c0c59e0 0x7f503c06d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.749+0000 7f5040972640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f503c06a4b0 0x7f503c06a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:39696/0 (socket says 172.21.15.88:39696) 2023-11-27T20:55:21.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.749+0000 7f5040972640 1 -- 172.21.15.88:0/2940811504 learned_addr learned my addr 172.21.15.88:0/2940811504 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:21.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.751+0000 7f5040972640 1 -- 172.21.15.88:0/2940811504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f503c15c9c0 msgr2=0x7f503c15ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.752+0000 7f5040972640 1 --2- 172.21.15.88:0/2940811504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f503c15c9c0 0x7f503c15ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.752+0000 7f5040972640 1 -- 172.21.15.88:0/2940811504 >> v2:172.21.15.88:3300/0 conn(0x7f503c0c59e0 msgr2=0x7f503c06d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.752+0000 7f5040972640 1 --2- 172.21.15.88:0/2940811504 >> v2:172.21.15.88:3300/0 conn(0x7f503c0c59e0 0x7f503c06d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.752+0000 7f5040972640 1 -- 172.21.15.88:0/2940811504 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503c072650 con 0x7f503c06a4b0 2023-11-27T20:55:21.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.753+0000 7f5040972640 1 --2- 172.21.15.88:0/2940811504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f503c06a4b0 0x7f503c06a8e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f503c071980 tx=0x7f503002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f628509048e509e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:21.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.757+0000 7f502ffff640 1 -- 172.21.15.88:0/2940811504 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5030030860 con 0x7f503c06a4b0 2023-11-27T20:55:21.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.757+0000 7f502ffff640 1 -- 172.21.15.88:0/2940811504 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50300309c0 con 0x7f503c06a4b0 2023-11-27T20:55:21.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.757+0000 7f502ffff640 1 -- 172.21.15.88:0/2940811504 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5030030d50 con 0x7f503c06a4b0 2023-11-27T20:55:21.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.757+0000 7f50433d7640 1 -- 172.21.15.88:0/2940811504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f503c06a4b0 msgr2=0x7f503c06a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.757+0000 7f50433d7640 1 --2- 172.21.15.88:0/2940811504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f503c06a4b0 0x7f503c06a8e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f503c071980 tx=0x7f503002b9a0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.757+0000 7f50433d7640 1 -- 172.21.15.88:0/2940811504 shutdown_connections 2023-11-27T20:55:21.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.757+0000 7f50433d7640 1 --2- 172.21.15.88:0/2940811504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f503c15c9c0 0x7f503c15ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.757+0000 7f50433d7640 1 --2- 172.21.15.88:0/2940811504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f503c06a4b0 0x7f503c06a8e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.757+0000 7f50433d7640 1 --2- 172.21.15.88:0/2940811504 >> v2:172.21.15.88:3300/0 conn(0x7f503c0c59e0 0x7f503c06d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.757+0000 7f50433d7640 1 -- 172.21.15.88:0/2940811504 >> 172.21.15.88:0/2940811504 conn(0x7f503c06f6d0 msgr2=0x7f503c06fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:21.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.758+0000 7f50433d7640 1 -- 172.21.15.88:0/2940811504 shutdown_connections 2023-11-27T20:55:21.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.758+0000 7f50433d7640 1 -- 172.21.15.88:0/2940811504 wait complete. 2023-11-27T20:55:21.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.759+0000 7f50433d7640 1 Processor -- start 2023-11-27T20:55:21.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.759+0000 7f50433d7640 1 -- start start 2023-11-27T20:55:21.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.759+0000 7f50433d7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f503c06a4b0 0x7f503c1f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.759+0000 7f50433d7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f503c0c59e0 0x7f503c146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.759+0000 7f50433d7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f503c15c9c0 0x7f503c15c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.759+0000 7f50433d7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503c1f2ca0 con 0x7f503c06a4b0 2023-11-27T20:55:21.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.759+0000 7f50433d7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503c15c870 con 0x7f503c15c9c0 2023-11-27T20:55:21.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.759+0000 7f50433d7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503c15a730 con 0x7f503c0c59e0 2023-11-27T20:55:21.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.760+0000 7f5041173640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f503c06a4b0 0x7f503c1f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.760+0000 7f5041974640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f503c15c9c0 0x7f503c15c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.760+0000 7f5040972640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f503c0c59e0 0x7f503c146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.760+0000 7f5041173640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f503c06a4b0 0x7f503c1f30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36268/0 (socket says 172.21.15.88:36268) 2023-11-27T20:55:21.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.760+0000 7f5041173640 1 -- 172.21.15.88:0/3710775036 learned_addr learned my addr 172.21.15.88:0/3710775036 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:21.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.763+0000 7f5041173640 1 -- 172.21.15.88:0/3710775036 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f503c0c59e0 msgr2=0x7f503c146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.763+0000 7f5041173640 1 --2- 172.21.15.88:0/3710775036 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f503c0c59e0 0x7f503c146cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.763+0000 7f5041173640 1 -- 172.21.15.88:0/3710775036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f503c15c9c0 msgr2=0x7f503c15c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.763+0000 7f5041173640 1 --2- 172.21.15.88:0/3710775036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f503c15c9c0 0x7f503c15c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.763+0000 7f5041173640 1 -- 172.21.15.88:0/3710775036 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50300094d0 con 0x7f503c06a4b0 2023-11-27T20:55:21.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.765+0000 7f5041173640 1 --2- 172.21.15.88:0/3710775036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f503c06a4b0 0x7f503c1f30c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f503800e8a0 tx=0x7f503800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:21.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.769+0000 7f502dffb640 1 -- 172.21.15.88:0/3710775036 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503800ee90 con 0x7f503c06a4b0 2023-11-27T20:55:21.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.769+0000 7f502dffb640 1 -- 172.21.15.88:0/3710775036 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503800c940 con 0x7f503c06a4b0 2023-11-27T20:55:21.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.769+0000 7f502dffb640 1 -- 172.21.15.88:0/3710775036 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503800ccf0 con 0x7f503c06a4b0 2023-11-27T20:55:21.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.769+0000 7f50433d7640 1 -- 172.21.15.88:0/3710775036 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f503c15aa10 con 0x7f503c06a4b0 2023-11-27T20:55:21.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.769+0000 7f50433d7640 1 -- 172.21.15.88:0/3710775036 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f503c1f28c0 con 0x7f503c06a4b0 2023-11-27T20:55:21.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.772+0000 7f5045f6b740 1 Processor -- start 2023-11-27T20:55:21.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.772+0000 7f5045f6b740 1 -- start start 2023-11-27T20:55:21.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.773+0000 7f5045f6b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f027b650 0x5611f027ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.773+0000 7f5045f6b740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5611f02c54d0 0x5611f027bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.773+0000 7f5045f6b740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611f027a0b0 0x5611f02baeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.773+0000 7f5045f6b740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f0236980 con 0x5611f027a0b0 2023-11-27T20:55:21.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.773+0000 7f5045f6b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f01e8b90 con 0x5611f027b650 2023-11-27T20:55:21.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.773+0000 7f5045f6b740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611f01e6280 con 0x5611f02c54d0 2023-11-27T20:55:21.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.773+0000 7f5041974640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f027b650 0x5611f027ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.773+0000 7f5041173640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5611f02c54d0 0x5611f027bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.773+0000 7f5041974640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f027b650 0x5611f027ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:39720/0 (socket says 172.21.15.88:39720) 2023-11-27T20:55:21.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.773+0000 7f5041974640 1 -- 172.21.15.88:0/2857143623 learned_addr learned my addr 172.21.15.88:0/2857143623 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:21.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.775+0000 7f5041974640 1 -- 172.21.15.88:0/2857143623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5611f02c54d0 msgr2=0x5611f027bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.775+0000 7f5041974640 1 --2- 172.21.15.88:0/2857143623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5611f02c54d0 0x5611f027bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.775+0000 7f5041974640 1 -- 172.21.15.88:0/2857143623 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611f027a0b0 msgr2=0x5611f02baeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.775+0000 7f5041974640 1 --2- 172.21.15.88:0/2857143623 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611f027a0b0 0x5611f02baeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.775+0000 7f5041974640 1 -- 172.21.15.88:0/2857143623 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611f01a7500 con 0x5611f027b650 2023-11-27T20:55:21.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.777+0000 7f5041974640 1 --2- 172.21.15.88:0/2857143623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f027b650 0x5611f027ba30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f50340114a0 tx=0x7f5034009750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a6f16851ca34045 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:21.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.781+0000 7f501effd640 1 -- 172.21.15.88:0/2857143623 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503400e040 con 0x5611f027b650 2023-11-27T20:55:21.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.781+0000 7f501effd640 1 -- 172.21.15.88:0/2857143623 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503400f040 con 0x5611f027b650 2023-11-27T20:55:21.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.781+0000 7f501effd640 1 -- 172.21.15.88:0/2857143623 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034015a40 con 0x5611f027b650 2023-11-27T20:55:21.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.782+0000 7f5045f6b740 1 -- 172.21.15.88:0/2857143623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f027b650 msgr2=0x5611f027ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.782+0000 7f5045f6b740 1 --2- 172.21.15.88:0/2857143623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f027b650 0x5611f027ba30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f50340114a0 tx=0x7f5034009750 comp rx=0 tx=0).stop 2023-11-27T20:55:21.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.782+0000 7f5045f6b740 1 -- 172.21.15.88:0/2857143623 shutdown_connections 2023-11-27T20:55:21.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.782+0000 7f5045f6b740 1 --2- 172.21.15.88:0/2857143623 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611f027a0b0 0x5611f02baeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.782+0000 7f5045f6b740 1 --2- 172.21.15.88:0/2857143623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5611f02c54d0 0x5611f027bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.782+0000 7f5045f6b740 1 --2- 172.21.15.88:0/2857143623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f027b650 0x5611f027ba30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.782+0000 7f5045f6b740 1 -- 172.21.15.88:0/2857143623 >> 172.21.15.88:0/2857143623 conn(0x5611f0277dc0 msgr2=0x5611f027a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:21.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.782+0000 7f5045f6b740 1 -- 172.21.15.88:0/2857143623 shutdown_connections 2023-11-27T20:55:21.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.782+0000 7f5045f6b740 1 -- 172.21.15.88:0/2857143623 wait complete. 2023-11-27T20:55:21.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.782+0000 7f5045f6b740 1 -- start start 2023-11-27T20:55:21.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.783+0000 7f5045f6b740 1 Processor -- start 2023-11-27T20:55:21.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.783+0000 7f5045f6b740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5611f027b650 0x5611f02ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.783+0000 7f5045f6b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f02c54d0 0x5611f02a5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.783+0000 7f5045f6b740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611f02c0b00 0x5611f02c0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.783+0000 7f5045f6b740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f01e1b70 con 0x5611f02c0b00 2023-11-27T20:55:21.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.783+0000 7f5045f6b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f019be00 con 0x5611f02c54d0 2023-11-27T20:55:21.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.783+0000 7f5045f6b740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611f019baa0 con 0x5611f027b650 2023-11-27T20:55:21.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.783+0000 7f5045f6b740 10 client.0 _ll_register_callbacks cb 0x5611efef3ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T20:55:21.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.784+0000 7f5041974640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5611f027b650 0x5611f02ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.784+0000 7f5041173640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f02c54d0 0x5611f02a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.784+0000 7f5041173640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f02c54d0 0x5611f02a5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:39732/0 (socket says 172.21.15.88:39732) 2023-11-27T20:55:21.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.784+0000 7f5041173640 1 -- 172.21.15.88:0/2654128808 learned_addr learned my addr 172.21.15.88:0/2654128808 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:21.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.787+0000 7f5041173640 1 -- 172.21.15.88:0/2654128808 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5611f027b650 msgr2=0x5611f02ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.787+0000 7f5041173640 1 --2- 172.21.15.88:0/2654128808 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5611f027b650 0x5611f02ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.787+0000 7f5041173640 1 -- 172.21.15.88:0/2654128808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611f02c0b00 msgr2=0x5611f02c0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.787+0000 7f5041173640 1 --2- 172.21.15.88:0/2654128808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611f02c0b00 0x5611f02c0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.787+0000 7f5041173640 1 -- 172.21.15.88:0/2654128808 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5034011230 con 0x5611f02c54d0 2023-11-27T20:55:21.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.789+0000 7f502dffb640 1 -- 172.21.15.88:0/3710775036 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5038013970 con 0x7f503c06a4b0 2023-11-27T20:55:21.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.789+0000 7f502dffb640 1 --2- 172.21.15.88:0/3710775036 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f502006b180 0x7f502006d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.789+0000 7f5041173640 1 --2- 172.21.15.88:0/2654128808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f02c54d0 0x5611f02a5940 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f503800c520 tx=0x7f5038011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3cbafe0d3e411b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:21.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.789+0000 7f5041974640 1 --2- 172.21.15.88:0/3710775036 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f502006b180 0x7f502006d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.789+0000 7f5017fff640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-11-27T20:55:21.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.790+0000 7f5041974640 1 --2- 172.21.15.88:0/3710775036 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f502006b180 0x7f502006d640 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f503400b010 tx=0x7f5034017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:21.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.792+0000 7f502dffb640 1 -- 172.21.15.88:0/3710775036 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f503808b420 con 0x7f503c06a4b0 2023-11-27T20:55:21.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.793+0000 7f5017fff640 1 -- 172.21.15.88:0/2654128808 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503802c040 con 0x5611f02c54d0 2023-11-27T20:55:21.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.793+0000 7f5017fff640 1 -- 172.21.15.88:0/2654128808 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f503805af00 con 0x5611f02c54d0 2023-11-27T20:55:21.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.793+0000 7f5045f6b740 1 -- 172.21.15.88:0/2654128808 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611f01dab50 con 0x5611f02c54d0 2023-11-27T20:55:21.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.795+0000 7f5017fff640 1 -- 172.21.15.88:0/2654128808 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f503805a5d0 con 0x5611f02c54d0 2023-11-27T20:55:21.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.795+0000 7f5045f6b740 10 client.4786 fetch_fsmap learned FSMap version 19 2023-11-27T20:55:21.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.795+0000 7f5045f6b740 1 -- 172.21.15.88:0/2654128808 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x5611f01e01f0 con 0x5611f02c54d0 2023-11-27T20:55:21.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.798+0000 7f5017fff640 1 -- 172.21.15.88:0/2654128808 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5611f01dab50 con 0x5611f02c54d0 2023-11-27T20:55:21.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.798+0000 7f5017fff640 1 -- 172.21.15.88:0/2654128808 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f5038011070 con 0x5611f02c54d0 2023-11-27T20:55:21.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.798+0000 7f5045f6b740 10 client.4786 fetch_fsmap finished waiting for FSMap version 19 2023-11-27T20:55:21.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.798+0000 7f5045f6b740 10 client.4786 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-27T20:55:21.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.798+0000 7f5045f6b740 20 client.4786 populate_metadata read hostname 'smithi088' 2023-11-27T20:55:21.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.798+0000 7f5045f6b740 1 --2- 172.21.15.88:0/2654128808 >> [v2:172.21.15.88:6838/2120059880,v1:172.21.15.88:6839/2120059880] conn(0x5611f02a3630 0x5611f02a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.798+0000 7f5045f6b740 4 client.4786 mds_command: new command op to 34205 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-27T20:55:21.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.798+0000 7f5045f6b740 1 -- 172.21.15.88:0/2654128808 --> [v2:172.21.15.88:6838/2120059880,v1:172.21.15.88:6839/2120059880] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5611f01da870 con 0x5611f02a3630 2023-11-27T20:55:21.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.799+0000 7f5040972640 1 --2- 172.21.15.88:0/2654128808 >> [v2:172.21.15.88:6838/2120059880,v1:172.21.15.88:6839/2120059880] conn(0x5611f02a3630 0x5611f02a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.802+0000 7f5040972640 1 --2- 172.21.15.88:0/2654128808 >> [v2:172.21.15.88:6838/2120059880,v1:172.21.15.88:6839/2120059880] conn(0x5611f02a3630 0x5611f02a3a10 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c81ec84b1967a471 server_cookie=cee4303c12a80a0d in_seq=0 out_seq=0 2023-11-27T20:55:21.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.802+0000 7f5017fff640 10 client.4786 ms_handle_connect on v2:172.21.15.88:6838/2120059880 2023-11-27T20:55:21.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.819+0000 7f5017fff640 1 -- 172.21.15.88:0/2654128808 <== mds.0 v2:172.21.15.88:6838/2120059880 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5611f01da870 con 0x5611f02a3630 2023-11-27T20:55:21.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.819+0000 7f5017fff640 10 client.4786 handle_command_reply: tid=0 2023-11-27T20:55:21.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.819+0000 7f5045f6b740 1 client.4786 shutdown 2023-11-27T20:55:21.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.819+0000 7f5045f6b740 1 -- 172.21.15.88:0/2654128808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f02c54d0 msgr2=0x5611f02a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.819+0000 7f5045f6b740 1 --2- 172.21.15.88:0/2654128808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f02c54d0 0x5611f02a5940 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f503800c520 tx=0x7f5038011000 comp rx=0 tx=0).stop 2023-11-27T20:55:21.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.819+0000 7f5045f6b740 1 -- 172.21.15.88:0/2654128808 shutdown_connections 2023-11-27T20:55:21.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.819+0000 7f5045f6b740 1 --2- 172.21.15.88:0/2654128808 >> [v2:172.21.15.88:6838/2120059880,v1:172.21.15.88:6839/2120059880] conn(0x5611f02a3630 0x5611f02a3a10 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.819+0000 7f5045f6b740 1 --2- 172.21.15.88:0/2654128808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611f02c0b00 0x5611f02c0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.819+0000 7f5045f6b740 1 --2- 172.21.15.88:0/2654128808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f02c54d0 0x5611f02a5940 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.819+0000 7f5045f6b740 1 --2- 172.21.15.88:0/2654128808 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5611f027b650 0x5611f02ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.819+0000 7f5017fff640 0 client.4786 ms_handle_reset on v2:172.21.15.88:6838/2120059880 2023-11-27T20:55:21.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.819+0000 7f5045f6b740 1 -- 172.21.15.88:0/2654128808 >> 172.21.15.88:0/2654128808 conn(0x5611f027a0b0 msgr2=0x5611f027ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:21.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.819+0000 7f5045f6b740 1 -- 172.21.15.88:0/2654128808 shutdown_connections 2023-11-27T20:55:21.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.819+0000 7f5045f6b740 1 -- 172.21.15.88:0/2654128808 wait complete. 2023-11-27T20:55:21.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.820+0000 7f5045f6b740 20 client.4786 trim_cache size 0 max 16384 2023-11-27T20:55:21.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.835+0000 7f5045f6b740 1 Processor -- start 2023-11-27T20:55:21.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.835+0000 7f5045f6b740 1 -- start start 2023-11-27T20:55:21.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.836+0000 7f5045f6b740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5611f027b650 0x5611f02a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.836+0000 7f5045f6b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f02c0b00 0x5611f027ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.836+0000 7f5045f6b740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611f02c54d0 0x5611f027bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.836+0000 7f5045f6b740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f0161270 con 0x5611f02c54d0 2023-11-27T20:55:21.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.836+0000 7f5045f6b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f01b42d0 con 0x5611f02c0b00 2023-11-27T20:55:21.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.836+0000 7f5045f6b740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611f02cdfa0 con 0x5611f027b650 2023-11-27T20:55:21.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.836+0000 7f5040972640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f02c0b00 0x5611f027ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.836+0000 7f5041974640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611f02c54d0 0x5611f027bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.836+0000 7f5041173640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5611f027b650 0x5611f02a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.837+0000 7f5040972640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f02c0b00 0x5611f027ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:39734/0 (socket says 172.21.15.88:39734) 2023-11-27T20:55:21.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.837+0000 7f5040972640 1 -- 172.21.15.88:0/377768118 learned_addr learned my addr 172.21.15.88:0/377768118 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:21.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.839+0000 7f5040972640 1 -- 172.21.15.88:0/377768118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5611f027b650 msgr2=0x5611f02a5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.839+0000 7f5040972640 1 --2- 172.21.15.88:0/377768118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5611f027b650 0x5611f02a5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.839+0000 7f5040972640 1 -- 172.21.15.88:0/377768118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611f02c54d0 msgr2=0x5611f027bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.839+0000 7f5040972640 1 --2- 172.21.15.88:0/377768118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611f02c54d0 0x5611f027bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.839+0000 7f5040972640 1 -- 172.21.15.88:0/377768118 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611f017dd00 con 0x5611f02c0b00 2023-11-27T20:55:21.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.840+0000 7f5040972640 1 --2- 172.21.15.88:0/377768118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f02c0b00 0x5611f027ba30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5030000c00 tx=0x7f503002e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac5211caced6c3a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:21.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.844+0000 7f501f7fe640 1 -- 172.21.15.88:0/377768118 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5030030b30 con 0x5611f02c0b00 2023-11-27T20:55:21.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.844+0000 7f501f7fe640 1 -- 172.21.15.88:0/377768118 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5030030cf0 con 0x5611f02c0b00 2023-11-27T20:55:21.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.844+0000 7f501f7fe640 1 -- 172.21.15.88:0/377768118 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5030004280 con 0x5611f02c0b00 2023-11-27T20:55:21.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.844+0000 7f5045f6b740 1 -- 172.21.15.88:0/377768118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f02c0b00 msgr2=0x5611f027ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.844+0000 7f5045f6b740 1 --2- 172.21.15.88:0/377768118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f02c0b00 0x5611f027ba30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5030000c00 tx=0x7f503002e000 comp rx=0 tx=0).stop 2023-11-27T20:55:21.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.845+0000 7f5045f6b740 1 -- 172.21.15.88:0/377768118 shutdown_connections 2023-11-27T20:55:21.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.845+0000 7f5045f6b740 1 --2- 172.21.15.88:0/377768118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611f02c54d0 0x5611f027bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.845+0000 7f5045f6b740 1 --2- 172.21.15.88:0/377768118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f02c0b00 0x5611f027ba30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.845+0000 7f5045f6b740 1 --2- 172.21.15.88:0/377768118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5611f027b650 0x5611f02a5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.845+0000 7f5045f6b740 1 -- 172.21.15.88:0/377768118 >> 172.21.15.88:0/377768118 conn(0x5611f027a0b0 msgr2=0x5611f02c4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:21.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.845+0000 7f5045f6b740 1 -- 172.21.15.88:0/377768118 shutdown_connections 2023-11-27T20:55:21.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.845+0000 7f5045f6b740 1 -- 172.21.15.88:0/377768118 wait complete. 2023-11-27T20:55:21.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.845+0000 7f5045f6b740 1 -- start start 2023-11-27T20:55:21.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.845+0000 7f5045f6b740 1 Processor -- start 2023-11-27T20:55:21.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.846+0000 7f5045f6b740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5611f027b650 0x5611f02792d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.846+0000 7f5045f6b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f02c0b00 0x5611f02c36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.846+0000 7f5045f6b740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611f02c54d0 0x5611f0321540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.846+0000 7f5045f6b740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f0279810 con 0x5611f02c54d0 2023-11-27T20:55:21.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.846+0000 7f5045f6b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f02c40c0 con 0x5611f02c0b00 2023-11-27T20:55:21.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.846+0000 7f5045f6b740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611f02cd9e0 con 0x5611f027b650 2023-11-27T20:55:21.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.846+0000 7f5045f6b740 10 client.0 _ll_register_callbacks cb 0x7f5034009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T20:55:21.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.847+0000 7f5040972640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f02c0b00 0x5611f02c36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.847+0000 7f5041974640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611f02c54d0 0x5611f0321540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.847+0000 7f5041173640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5611f027b650 0x5611f02792d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.847+0000 7f5040972640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f02c0b00 0x5611f02c36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:39744/0 (socket says 172.21.15.88:39744) 2023-11-27T20:55:21.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.847+0000 7f5040972640 1 -- 172.21.15.88:0/3733131287 learned_addr learned my addr 172.21.15.88:0/3733131287 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:21.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.850+0000 7f5041974640 1 -- 172.21.15.88:0/3733131287 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5611f027b650 msgr2=0x5611f02792d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.850+0000 7f5041974640 1 --2- 172.21.15.88:0/3733131287 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5611f027b650 0x5611f02792d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.850+0000 7f5041974640 1 -- 172.21.15.88:0/3733131287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f02c0b00 msgr2=0x5611f02c36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:55:21.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.850+0000 7f5041974640 1 --2- 172.21.15.88:0/3733131287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f02c0b00 0x5611f02c36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.850+0000 7f5041974640 1 -- 172.21.15.88:0/3733131287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f503c072650 con 0x5611f02c54d0 2023-11-27T20:55:21.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.850+0000 7f5040972640 1 --2- 172.21.15.88:0/3733131287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f02c0b00 0x5611f02c36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:55:21.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.852+0000 7f5041974640 1 --2- 172.21.15.88:0/3733131287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611f02c54d0 0x5611f0321540 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f503401c000 tx=0x7f5034014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5856139d94eca53c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:21.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.852+0000 7f5017fff640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-11-27T20:55:21.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.856+0000 7f5017fff640 1 -- 172.21.15.88:0/3733131287 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503400e040 con 0x5611f02c54d0 2023-11-27T20:55:21.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.856+0000 7f5017fff640 1 -- 172.21.15.88:0/3733131287 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5034003b90 con 0x5611f02c54d0 2023-11-27T20:55:21.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.856+0000 7f5045f6b740 1 -- 172.21.15.88:0/3733131287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f503400f040 con 0x5611f02c54d0 2023-11-27T20:55:21.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.857+0000 7f5017fff640 1 -- 172.21.15.88:0/3733131287 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5034035620 con 0x5611f02c54d0 2023-11-27T20:55:21.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.857+0000 7f5045f6b740 10 client.4707 fetch_fsmap learned FSMap version 19 2023-11-27T20:55:21.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.857+0000 7f5045f6b740 1 -- 172.21.15.88:0/3733131287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x5611f01a34f0 con 0x5611f02c54d0 2023-11-27T20:55:21.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.861+0000 7f5017fff640 1 -- 172.21.15.88:0/3733131287 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503400f040 con 0x5611f02c54d0 2023-11-27T20:55:21.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.861+0000 7f5017fff640 1 -- 172.21.15.88:0/3733131287 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 19) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f503401b020 con 0x5611f02c54d0 2023-11-27T20:55:21.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.861+0000 7f5045f6b740 10 client.4707 fetch_fsmap finished waiting for FSMap version 19 2023-11-27T20:55:21.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.861+0000 7f5045f6b740 10 client.4707 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-27T20:55:21.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.861+0000 7f5045f6b740 20 client.4707 populate_metadata read hostname 'smithi088' 2023-11-27T20:55:21.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.861+0000 7f5045f6b740 1 --2- 172.21.15.88:0/3733131287 >> [v2:172.21.15.88:6838/2120059880,v1:172.21.15.88:6839/2120059880] conn(0x5611f02b4730 0x5611f02b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:21.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.861+0000 7f5045f6b740 4 client.4707 mds_command: new command op to 34205 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-27T20:55:21.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.861+0000 7f5045f6b740 1 -- 172.21.15.88:0/3733131287 --> [v2:172.21.15.88:6838/2120059880,v1:172.21.15.88:6839/2120059880] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5611efee26c0 con 0x5611f02b4730 2023-11-27T20:55:21.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.862+0000 7f5041173640 1 --2- 172.21.15.88:0/3733131287 >> [v2:172.21.15.88:6838/2120059880,v1:172.21.15.88:6839/2120059880] conn(0x5611f02b4730 0x5611f02b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:21.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.864+0000 7f5041173640 1 --2- 172.21.15.88:0/3733131287 >> [v2:172.21.15.88:6838/2120059880,v1:172.21.15.88:6839/2120059880] conn(0x5611f02b4730 0x5611f02b4b10 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7b03e0068af8af7 server_cookie=9d098d974839e0eb in_seq=0 out_seq=0 2023-11-27T20:55:21.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.864+0000 7f5017fff640 10 client.4707 ms_handle_connect on v2:172.21.15.88:6838/2120059880 2023-11-27T20:55:21.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.868+0000 7f5017fff640 1 -- 172.21.15.88:0/3733131287 <== mds.0 v2:172.21.15.88:6838/2120059880 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5611efee26c0 con 0x5611f02b4730 2023-11-27T20:55:21.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.868+0000 7f5017fff640 10 client.4707 handle_command_reply: tid=0 2023-11-27T20:55:21.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.868+0000 7f5045f6b740 1 client.4707 shutdown 2023-11-27T20:55:21.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.868+0000 7f5045f6b740 1 -- 172.21.15.88:0/3733131287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611f02c54d0 msgr2=0x5611f0321540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.868+0000 7f5045f6b740 1 --2- 172.21.15.88:0/3733131287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611f02c54d0 0x5611f0321540 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f503401c000 tx=0x7f5034014000 comp rx=0 tx=0).stop 2023-11-27T20:55:21.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.868+0000 7f5045f6b740 1 -- 172.21.15.88:0/3733131287 shutdown_connections 2023-11-27T20:55:21.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.868+0000 7f5045f6b740 1 --2- 172.21.15.88:0/3733131287 >> [v2:172.21.15.88:6838/2120059880,v1:172.21.15.88:6839/2120059880] conn(0x5611f02b4730 0x5611f02b4b10 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.868+0000 7f5045f6b740 1 --2- 172.21.15.88:0/3733131287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5611f02c54d0 0x5611f0321540 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.868+0000 7f5045f6b740 1 --2- 172.21.15.88:0/3733131287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611f02c0b00 0x5611f02c36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.868+0000 7f5017fff640 0 client.4707 ms_handle_reset on v2:172.21.15.88:6838/2120059880 2023-11-27T20:55:21.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.868+0000 7f5045f6b740 1 --2- 172.21.15.88:0/3733131287 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5611f027b650 0x5611f02792d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.868+0000 7f5045f6b740 1 -- 172.21.15.88:0/3733131287 >> 172.21.15.88:0/3733131287 conn(0x5611f027a0b0 msgr2=0x5611f027ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:21.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.868+0000 7f5045f6b740 1 -- 172.21.15.88:0/3733131287 shutdown_connections 2023-11-27T20:55:21.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.868+0000 7f5045f6b740 1 -- 172.21.15.88:0/3733131287 wait complete. 2023-11-27T20:55:21.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.868+0000 7f5045f6b740 20 client.4707 trim_cache size 0 max 16384 2023-11-27T20:55:21.871 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-27T20:55:21.871 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_fsid": "ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc", 2023-11-27T20:55:21.872 INFO:teuthology.orchestra.run.smithi088.stdout: "whoami": 0, 2023-11-27T20:55:21.872 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 34205, 2023-11-27T20:55:21.872 INFO:teuthology.orchestra.run.smithi088.stdout: "want_state": "up:active", 2023-11-27T20:55:21.872 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "up:active", 2023-11-27T20:55:21.872 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs", 2023-11-27T20:55:21.872 INFO:teuthology.orchestra.run.smithi088.stdout: "rank_uptime": 54.165660287000001, 2023-11-27T20:55:21.872 INFO:teuthology.orchestra.run.smithi088.stdout: "mdsmap_epoch": 19, 2023-11-27T20:55:21.872 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch": 28, 2023-11-27T20:55:21.872 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch_barrier": 28, 2023-11-27T20:55:21.872 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 66.602532366000005 2023-11-27T20:55:21.873 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-27T20:55:21.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.869+0000 7f50433d7640 1 -- 172.21.15.88:0/3710775036 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f502006b180 msgr2=0x7f502006d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.869+0000 7f50433d7640 1 --2- 172.21.15.88:0/3710775036 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f502006b180 0x7f502006d640 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f503400b010 tx=0x7f5034017000 comp rx=0 tx=0).stop 2023-11-27T20:55:21.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.869+0000 7f50433d7640 1 -- 172.21.15.88:0/3710775036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f503c06a4b0 msgr2=0x7f503c1f30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:21.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.869+0000 7f50433d7640 1 --2- 172.21.15.88:0/3710775036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f503c06a4b0 0x7f503c1f30c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f503800e8a0 tx=0x7f503800ed60 comp rx=0 tx=0).stop 2023-11-27T20:55:21.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.869+0000 7f50433d7640 1 -- 172.21.15.88:0/3710775036 shutdown_connections 2023-11-27T20:55:21.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.869+0000 7f50433d7640 1 --2- 172.21.15.88:0/3710775036 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f502006b180 0x7f502006d640 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.869+0000 7f50433d7640 1 --2- 172.21.15.88:0/3710775036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f503c15c9c0 0x7f503c15c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.869+0000 7f50433d7640 1 --2- 172.21.15.88:0/3710775036 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f503c0c59e0 0x7f503c146cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.869+0000 7f50433d7640 1 --2- 172.21.15.88:0/3710775036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f503c06a4b0 0x7f503c1f30c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:21.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.869+0000 7f50433d7640 1 -- 172.21.15.88:0/3710775036 >> 172.21.15.88:0/3710775036 conn(0x7f503c06f6d0 msgr2=0x7f503c0c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:21.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.869+0000 7f50433d7640 1 -- 172.21.15.88:0/3710775036 shutdown_connections 2023-11-27T20:55:21.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:21.869+0000 7f50433d7640 1 -- 172.21.15.88:0/3710775036 wait complete. 2023-11-27T20:55:21.881 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-27T20:55:21.892 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-27T20:55:21.892 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-11-27T20:55:21.892 INFO:tasks.ceph_fuse:client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2023-11-27T20:55:21.893 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-27T20:55:21.893 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-27T20:55:21.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:55:21.893 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-11-27T20:55:21.908 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-11-27T20:55:21.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:55:21.909 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-27T20:55:21.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:55:21.977 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2023-11-27T20:55:22.085 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-27T20:55:22.085 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T20:55:22.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.184+0000 7f6c99368640 1 Processor -- start 2023-11-27T20:55:22.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.184+0000 7f6c99368640 1 -- start start 2023-11-27T20:55:22.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.185+0000 7f6c99368640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6c940c46c0 0x7f6c940c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:22.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.185+0000 7f6c99368640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c940c76f0 con 0x7f6c940c4aa0 2023-11-27T20:55:22.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.185+0000 7f6c99368640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c940c2bc0 con 0x7f6c94150460 2023-11-27T20:55:22.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.185+0000 7f6c99368640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c940c6dc0 con 0x7f6c940c46c0 2023-11-27T20:55:22.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.185+0000 7f6c927fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6c940c4aa0 0x7f6c9414fd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39372/0 (socket says 172.21.15.88:39372) 2023-11-27T20:55:22.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.185+0000 7f6c927fc640 1 -- 172.21.15.88:0/499614468 learned_addr learned my addr 172.21.15.88:0/499614468 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T20:55:22.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.186+0000 7f6c92ffd640 1 --2- 172.21.15.88:0/499614468 >> v2:172.21.15.167:3300/0 conn(0x7f6c940c46c0 0x7f6c940c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:22.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.188+0000 7f6c91ffb640 1 -- 172.21.15.88:0/499614468 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 815942144 0 0) 0x7f6c940c76f0 con 0x7f6c940c4aa0 2023-11-27T20:55:22.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.188+0000 7f6c91ffb640 1 -- 172.21.15.88:0/499614468 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c80003520 con 0x7f6c940c4aa0 2023-11-27T20:55:22.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.190+0000 7f6c92ffd640 1 -- 172.21.15.88:0/499614468 >> v1:172.21.15.167:6789/0 conn(0x7f6c94150460 legacy=0x7f6c940c1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:22.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.190+0000 7f6c92ffd640 1 -- 172.21.15.88:0/499614468 >> v1:172.21.15.88:6789/0 conn(0x7f6c940c4aa0 legacy=0x7f6c9414fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:22.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.190+0000 7f6c92ffd640 1 -- 172.21.15.88:0/499614468 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c940c70a0 con 0x7f6c940c46c0 2023-11-27T20:55:22.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.194+0000 7f6c92ffd640 1 --2- 172.21.15.88:0/499614468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c940c46c0 0x7f6c940c53c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c0097a0 tx=0x7f6c8c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1b8f1dc633c30ab server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:22.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.198+0000 7f6c91ffb640 1 -- 172.21.15.88:0/499614468 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c030610 con 0x7f6c940c46c0 2023-11-27T20:55:22.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.198+0000 7f6c91ffb640 1 -- 172.21.15.88:0/499614468 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8c030770 con 0x7f6c940c46c0 2023-11-27T20:55:22.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.198+0000 7f6c91ffb640 1 -- 172.21.15.88:0/499614468 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c030b00 con 0x7f6c940c46c0 2023-11-27T20:55:22.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.199+0000 7f6c99368640 1 -- 172.21.15.88:0/499614468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c940c46c0 msgr2=0x7f6c940c53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:22.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.199+0000 7f6c99368640 1 --2- 172.21.15.88:0/499614468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c940c46c0 0x7f6c940c53c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c0097a0 tx=0x7f6c8c02b960 comp rx=0 tx=0).stop 2023-11-27T20:55:22.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.199+0000 7f6c99368640 1 -- 172.21.15.88:0/499614468 shutdown_connections 2023-11-27T20:55:22.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.199+0000 7f6c99368640 1 --2- 172.21.15.88:0/499614468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c940c46c0 0x7f6c940c53c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:22.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.199+0000 7f6c99368640 1 -- 172.21.15.88:0/499614468 >> 172.21.15.88:0/499614468 conn(0x7f6c9406c5f0 msgr2=0x7f6c9406c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:22.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.199+0000 7f6c99368640 1 -- 172.21.15.88:0/499614468 shutdown_connections 2023-11-27T20:55:22.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.199+0000 7f6c99368640 1 -- 172.21.15.88:0/499614468 wait complete. 2023-11-27T20:55:22.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.200+0000 7f6c99368640 1 Processor -- start 2023-11-27T20:55:22.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.200+0000 7f6c99368640 1 -- start start 2023-11-27T20:55:22.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.201+0000 7f6c99368640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c940c46c0 0x7f6c941f0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:22.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.201+0000 7f6c99368640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c940c4aa0 0x7f6c9414a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:22.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.201+0000 7f6c99368640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c94150460 0x7f6c940cac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:22.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.201+0000 7f6c99368640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c941f05e0 con 0x7f6c94150460 2023-11-27T20:55:22.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.201+0000 7f6c99368640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9414b070 con 0x7f6c940c4aa0 2023-11-27T20:55:22.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.201+0000 7f6c99368640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c94159c40 con 0x7f6c940c46c0 2023-11-27T20:55:22.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.201+0000 7f6c937fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c94150460 0x7f6c940cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:22.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.202+0000 7f6c927fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c940c4aa0 0x7f6c9414a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:22.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.202+0000 7f6c92ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c940c46c0 0x7f6c941f0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:22.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.202+0000 7f6c937fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c94150460 0x7f6c940cac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36314/0 (socket says 172.21.15.88:36314) 2023-11-27T20:55:22.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.202+0000 7f6c937fe640 1 -- 172.21.15.88:0/619363305 learned_addr learned my addr 172.21.15.88:0/619363305 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T20:55:22.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.205+0000 7f6c937fe640 1 -- 172.21.15.88:0/619363305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c940c46c0 msgr2=0x7f6c941f0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:22.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.205+0000 7f6c937fe640 1 --2- 172.21.15.88:0/619363305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c940c46c0 0x7f6c941f0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:22.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.205+0000 7f6c937fe640 1 -- 172.21.15.88:0/619363305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c940c4aa0 msgr2=0x7f6c9414a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:22.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.205+0000 7f6c937fe640 1 --2- 172.21.15.88:0/619363305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c940c4aa0 0x7f6c9414a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:22.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.205+0000 7f6c937fe640 1 -- 172.21.15.88:0/619363305 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c009400 con 0x7f6c94150460 2023-11-27T20:55:22.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.207+0000 7f6c937fe640 1 --2- 172.21.15.88:0/619363305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c94150460 0x7f6c940cac40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400c6e0 tx=0x7f6c8400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:22.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.211+0000 7f6c8b7fe640 1 -- 172.21.15.88:0/619363305 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c84003b70 con 0x7f6c94150460 2023-11-27T20:55:22.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.211+0000 7f6c8b7fe640 1 -- 172.21.15.88:0/619363305 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c84003cf0 con 0x7f6c94150460 2023-11-27T20:55:22.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.211+0000 7f6c8b7fe640 1 -- 172.21.15.88:0/619363305 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c84005310 con 0x7f6c94150460 2023-11-27T20:55:22.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.211+0000 7f6c99368640 1 -- 172.21.15.88:0/619363305 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c9414f570 con 0x7f6c94150460 2023-11-27T20:55:22.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.211+0000 7f6c99368640 1 -- 172.21.15.88:0/619363305 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c94159e90 con 0x7f6c94150460 2023-11-27T20:55:22.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.212+0000 7f6c99368640 1 -- 172.21.15.88:0/619363305 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c941f0790 con 0x7f6c94150460 2023-11-27T20:55:22.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.229+0000 7f6c8b7fe640 1 -- 172.21.15.88:0/619363305 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6c84005470 con 0x7f6c94150460 2023-11-27T20:55:22.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.230+0000 7f6c8b7fe640 1 --2- 172.21.15.88:0/619363305 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f6c7406b210 0x7f6c7406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:55:22.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.230+0000 7f6c92ffd640 1 --2- 172.21.15.88:0/619363305 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f6c7406b210 0x7f6c7406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:55:22.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.230+0000 7f6c92ffd640 1 --2- 172.21.15.88:0/619363305 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f6c7406b210 0x7f6c7406d6d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c036000 tx=0x7f6c8c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:55:22.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.233+0000 7f6c8b7fe640 1 -- 172.21.15.88:0/619363305 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6c84058a50 con 0x7f6c94150460 2023-11-27T20:55:22.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.468+0000 7f6c8b7fe640 1 -- 172.21.15.88:0/619363305 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f6c84054d90 con 0x7f6c94150460 2023-11-27T20:55:22.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.672+0000 7f6c99368640 1 -- 172.21.15.88:0/619363305 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6c941f0790 con 0x7f6c94150460 2023-11-27T20:55:22.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.676+0000 7f6c8b7fe640 1 -- 172.21.15.88:0/619363305 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+88 (secure 0 0 0) 0x7f6c941f0790 con 0x7f6c94150460 2023-11-27T20:55:22.677 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-27T20:55:22.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.678+0000 7f6c99368640 1 -- 172.21.15.88:0/619363305 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f6c7406b210 msgr2=0x7f6c7406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:22.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.678+0000 7f6c99368640 1 --2- 172.21.15.88:0/619363305 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f6c7406b210 0x7f6c7406d6d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c036000 tx=0x7f6c8c008030 comp rx=0 tx=0).stop 2023-11-27T20:55:22.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.678+0000 7f6c99368640 1 -- 172.21.15.88:0/619363305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c94150460 msgr2=0x7f6c940cac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:55:22.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.678+0000 7f6c99368640 1 --2- 172.21.15.88:0/619363305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c94150460 0x7f6c940cac40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400c6e0 tx=0x7f6c8400cba0 comp rx=0 tx=0).stop 2023-11-27T20:55:22.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.678+0000 7f6c99368640 1 -- 172.21.15.88:0/619363305 shutdown_connections 2023-11-27T20:55:22.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.678+0000 7f6c99368640 1 --2- 172.21.15.88:0/619363305 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f6c7406b210 0x7f6c7406d6d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:22.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.678+0000 7f6c99368640 1 --2- 172.21.15.88:0/619363305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c94150460 0x7f6c940cac40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:22.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.678+0000 7f6c99368640 1 --2- 172.21.15.88:0/619363305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c940c4aa0 0x7f6c9414a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:22.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.678+0000 7f6c99368640 1 --2- 172.21.15.88:0/619363305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c940c46c0 0x7f6c941f0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:55:22.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.678+0000 7f6c99368640 1 -- 172.21.15.88:0/619363305 >> 172.21.15.88:0/619363305 conn(0x7f6c9406c5f0 msgr2=0x7f6c94156600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:55:22.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.678+0000 7f6c99368640 1 -- 172.21.15.88:0/619363305 shutdown_connections 2023-11-27T20:55:22.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:22.678+0000 7f6c99368640 1 -- 172.21.15.88:0/619363305 wait complete. 2023-11-27T20:55:22.690 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-27T20:55:22.690 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T20:55:22.690 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2023-11-27T20:55:22.691 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-27T20:55:22.691 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-27T20:55:22.691 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-27T20:55:22.691 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-27T20:55:22.691 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-27T20:55:22.691 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-27T20:55:22.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:55:22.691 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2023-11-27T20:55:22.707 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T20:55:22.707 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T20:55:22.707 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T20:55:22.707 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:55:22.707 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-11-27T20:55:22.707 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:55:22.708 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:55:22.708 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:55:22.708 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2023-11-27T20:55:22.708 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:55:22.708 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:55:22.708 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2023-11-27T20:55:22.708 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:55:22.708 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2023-11-27T20:55:22.708 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T20:55:22.708 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2023-11-27T20:55:22.708 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-27T20:55:22.708 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42236sec preferred_lft 42236sec 2023-11-27T20:55:22.709 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2023-11-27T20:55:22.709 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:55:22.709 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-27T20:55:22.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:55:22.709 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-11-27T20:55:22.709 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-11-27T20:55:22.709 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add name ceph-brx type bridge 2023-11-27T20:55:22.709 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr flush dev ceph-brx 2023-11-27T20:55:22.709 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set ceph-brx up 2023-11-27T20:55:22.710 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-27T20:55:22.710 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-11-27T20:55:22.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:55:22.816 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T20:55:22.841 INFO:teuthology.orchestra.run.smithi088.stdout:1 2023-11-27T20:55:22.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:55:22.843 DEBUG:teuthology.orchestra.run.smithi088:> route 2023-11-27T20:55:22.899 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2023-11-27T20:55:22.899 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T20:55:22.899 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T20:55:22.899 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T20:55:22.899 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T20:55:22.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:55:22.899 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-11-27T20:55:22.900 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-11-27T20:55:22.900 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T20:55:22.900 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T20:55:22.900 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T20:55:22.900 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-11-27T20:55:22.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:55:22.998 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-11-27T20:55:23.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:55:23.012 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list-id 2023-11-27T20:55:23.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:55:23.067 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-11-27T20:55:23.068 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-11-27T20:55:23.068 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T20:55:23.068 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-27T20:55:23.068 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-11-27T20:55:23.149 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-27T20:55:23.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:55:23.150 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-11-27T20:55:23.151 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-11-27T20:55:23.151 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-27T20:55:23.151 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-27T20:55:23.151 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-27T20:55:23.151 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-27T20:55:23.152 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-27T20:55:23.152 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-11-27T20:55:23.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:55:23.274 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-11-27T20:55:23.274 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-11-27T20:55:23.274 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2023-11-27T20:55:23.274 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set dev brx.0 master ceph-brx 2023-11-27T20:55:23.274 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-11-27T20:55:23.315 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2023-11-27T20:55:23.316 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:55:23.316 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-27T20:55:23.374 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-27T20:55:23.374 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:55:23.374 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-27T20:55:23.428 DEBUG:tasks.ceph_manager:running client.0 under valgrind with args ['sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-11-27T20:55:23.429 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-11-27T20:55:23.498 DEBUG:teuthology.orchestra.run.smithi088:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T20:55:23.554 INFO:teuthology.orchestra.run.smithi088.stdout:/proc 2023-11-27T20:55:23.554 INFO:teuthology.orchestra.run.smithi088.stdout:/sys 2023-11-27T20:55:23.554 INFO:teuthology.orchestra.run.smithi088.stdout:/dev 2023-11-27T20:55:23.554 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/security 2023-11-27T20:55:23.554 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/shm 2023-11-27T20:55:23.555 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/pts 2023-11-27T20:55:23.555 INFO:teuthology.orchestra.run.smithi088.stdout:/run 2023-11-27T20:55:23.555 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/cgroup 2023-11-27T20:55:23.555 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/pstore 2023-11-27T20:55:23.555 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/bpf 2023-11-27T20:55:23.555 INFO:teuthology.orchestra.run.smithi088.stdout:/ 2023-11-27T20:55:23.555 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/selinux 2023-11-27T20:55:23.555 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T20:55:23.555 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/hugepages 2023-11-27T20:55:23.555 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/mqueue 2023-11-27T20:55:23.555 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/debug 2023-11-27T20:55:23.555 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/tracing 2023-11-27T20:55:23.556 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-27T20:55:23.556 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/fuse/connections 2023-11-27T20:55:23.556 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-sysctl.service 2023-11-27T20:55:23.556 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/config 2023-11-27T20:55:23.556 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-27T20:55:23.556 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/nfs/rpc_pipefs 2023-11-27T20:55:23.556 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/1000 2023-11-27T20:55:23.556 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph 2023-11-27T20:55:23.556 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T20:55:23.556 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T20:55:23.556 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T20:55:23.556 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T20:55:23.557 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns 2023-11-27T20:55:23.557 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T20:55:23.557 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T20:55:23.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:55:23.557 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-11-27T20:55:23.610 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-27T20:55:23.610 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-27T20:55:23.653 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-11-27T20:55:23.681 DEBUG:teuthology.orchestra.run.smithi088:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T20:55:23.737 INFO:teuthology.orchestra.run.smithi088.stdout:/proc 2023-11-27T20:55:23.737 INFO:teuthology.orchestra.run.smithi088.stdout:/sys 2023-11-27T20:55:23.737 INFO:teuthology.orchestra.run.smithi088.stdout:/dev 2023-11-27T20:55:23.737 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/security 2023-11-27T20:55:23.737 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/shm 2023-11-27T20:55:23.737 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/pts 2023-11-27T20:55:23.738 INFO:teuthology.orchestra.run.smithi088.stdout:/run 2023-11-27T20:55:23.738 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/cgroup 2023-11-27T20:55:23.738 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/pstore 2023-11-27T20:55:23.738 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/bpf 2023-11-27T20:55:23.738 INFO:teuthology.orchestra.run.smithi088.stdout:/ 2023-11-27T20:55:23.738 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/selinux 2023-11-27T20:55:23.738 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T20:55:23.738 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/hugepages 2023-11-27T20:55:23.738 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/mqueue 2023-11-27T20:55:23.738 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/debug 2023-11-27T20:55:23.738 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/tracing 2023-11-27T20:55:23.739 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-27T20:55:23.739 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/fuse/connections 2023-11-27T20:55:23.739 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-sysctl.service 2023-11-27T20:55:23.739 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/config 2023-11-27T20:55:23.739 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-27T20:55:23.739 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/nfs/rpc_pipefs 2023-11-27T20:55:23.739 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/1000 2023-11-27T20:55:23.739 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph 2023-11-27T20:55:23.739 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T20:55:23.739 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T20:55:23.740 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T20:55:23.740 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T20:55:23.740 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns 2023-11-27T20:55:23.740 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T20:55:23.740 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T20:55:23.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:55:23.740 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-11-27T20:55:24.894 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-11-27T20:55:24.924 DEBUG:teuthology.orchestra.run.smithi088:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T20:55:24.980 INFO:teuthology.orchestra.run.smithi088.stdout:/proc 2023-11-27T20:55:24.980 INFO:teuthology.orchestra.run.smithi088.stdout:/sys 2023-11-27T20:55:24.981 INFO:teuthology.orchestra.run.smithi088.stdout:/dev 2023-11-27T20:55:24.981 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/security 2023-11-27T20:55:24.981 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/shm 2023-11-27T20:55:24.981 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/pts 2023-11-27T20:55:24.981 INFO:teuthology.orchestra.run.smithi088.stdout:/run 2023-11-27T20:55:24.982 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/cgroup 2023-11-27T20:55:24.982 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/pstore 2023-11-27T20:55:24.982 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/bpf 2023-11-27T20:55:24.982 INFO:teuthology.orchestra.run.smithi088.stdout:/ 2023-11-27T20:55:24.982 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/selinux 2023-11-27T20:55:24.982 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T20:55:24.983 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/hugepages 2023-11-27T20:55:24.983 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/mqueue 2023-11-27T20:55:24.983 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/debug 2023-11-27T20:55:24.983 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/tracing 2023-11-27T20:55:24.983 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-27T20:55:24.983 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/fuse/connections 2023-11-27T20:55:24.984 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-sysctl.service 2023-11-27T20:55:24.984 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/config 2023-11-27T20:55:24.984 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-27T20:55:24.984 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/nfs/rpc_pipefs 2023-11-27T20:55:24.984 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/1000 2023-11-27T20:55:24.984 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph 2023-11-27T20:55:24.985 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T20:55:24.985 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T20:55:24.985 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T20:55:24.985 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T20:55:24.985 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns 2023-11-27T20:55:24.985 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T20:55:24.985 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T20:55:24.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:55:24.986 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-11-27T20:55:26.137 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-11-27T20:55:26.172 DEBUG:teuthology.orchestra.run.smithi088:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T20:55:26.234 INFO:teuthology.orchestra.run.smithi088.stdout:/proc 2023-11-27T20:55:26.234 INFO:teuthology.orchestra.run.smithi088.stdout:/sys 2023-11-27T20:55:26.234 INFO:teuthology.orchestra.run.smithi088.stdout:/dev 2023-11-27T20:55:26.234 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/security 2023-11-27T20:55:26.234 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/shm 2023-11-27T20:55:26.234 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/pts 2023-11-27T20:55:26.234 INFO:teuthology.orchestra.run.smithi088.stdout:/run 2023-11-27T20:55:26.234 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/cgroup 2023-11-27T20:55:26.234 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/pstore 2023-11-27T20:55:26.235 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/bpf 2023-11-27T20:55:26.235 INFO:teuthology.orchestra.run.smithi088.stdout:/ 2023-11-27T20:55:26.235 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/selinux 2023-11-27T20:55:26.235 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T20:55:26.235 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/hugepages 2023-11-27T20:55:26.235 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/mqueue 2023-11-27T20:55:26.235 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/debug 2023-11-27T20:55:26.235 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/tracing 2023-11-27T20:55:26.235 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-27T20:55:26.236 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/fuse/connections 2023-11-27T20:55:26.236 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-sysctl.service 2023-11-27T20:55:26.236 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/config 2023-11-27T20:55:26.236 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-27T20:55:26.236 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/nfs/rpc_pipefs 2023-11-27T20:55:26.236 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/1000 2023-11-27T20:55:26.236 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph 2023-11-27T20:55:26.236 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T20:55:26.236 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T20:55:26.236 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T20:55:26.236 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T20:55:26.237 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns 2023-11-27T20:55:26.237 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T20:55:26.237 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T20:55:26.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:55:26.238 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-11-27T20:55:27.398 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-11-27T20:55:27.425 DEBUG:teuthology.orchestra.run.smithi088:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T20:55:27.481 INFO:teuthology.orchestra.run.smithi088.stdout:/proc 2023-11-27T20:55:27.481 INFO:teuthology.orchestra.run.smithi088.stdout:/sys 2023-11-27T20:55:27.481 INFO:teuthology.orchestra.run.smithi088.stdout:/dev 2023-11-27T20:55:27.481 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/security 2023-11-27T20:55:27.481 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/shm 2023-11-27T20:55:27.481 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/pts 2023-11-27T20:55:27.481 INFO:teuthology.orchestra.run.smithi088.stdout:/run 2023-11-27T20:55:27.481 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/cgroup 2023-11-27T20:55:27.481 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/pstore 2023-11-27T20:55:27.482 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/bpf 2023-11-27T20:55:27.482 INFO:teuthology.orchestra.run.smithi088.stdout:/ 2023-11-27T20:55:27.482 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/selinux 2023-11-27T20:55:27.482 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T20:55:27.482 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/hugepages 2023-11-27T20:55:27.482 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/mqueue 2023-11-27T20:55:27.482 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/debug 2023-11-27T20:55:27.482 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/tracing 2023-11-27T20:55:27.482 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-27T20:55:27.482 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/fuse/connections 2023-11-27T20:55:27.482 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-sysctl.service 2023-11-27T20:55:27.483 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/config 2023-11-27T20:55:27.483 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-27T20:55:27.483 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/nfs/rpc_pipefs 2023-11-27T20:55:27.483 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/1000 2023-11-27T20:55:27.483 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph 2023-11-27T20:55:27.483 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T20:55:27.483 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T20:55:27.483 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T20:55:27.483 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T20:55:27.483 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns 2023-11-27T20:55:27.483 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T20:55:27.483 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T20:55:27.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:55:27.484 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-11-27T20:55:28.638 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-11-27T20:55:28.667 DEBUG:teuthology.orchestra.run.smithi088:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T20:55:28.723 INFO:teuthology.orchestra.run.smithi088.stdout:/proc 2023-11-27T20:55:28.723 INFO:teuthology.orchestra.run.smithi088.stdout:/sys 2023-11-27T20:55:28.723 INFO:teuthology.orchestra.run.smithi088.stdout:/dev 2023-11-27T20:55:28.723 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/security 2023-11-27T20:55:28.723 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/shm 2023-11-27T20:55:28.723 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/pts 2023-11-27T20:55:28.723 INFO:teuthology.orchestra.run.smithi088.stdout:/run 2023-11-27T20:55:28.723 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/cgroup 2023-11-27T20:55:28.724 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/pstore 2023-11-27T20:55:28.724 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/bpf 2023-11-27T20:55:28.724 INFO:teuthology.orchestra.run.smithi088.stdout:/ 2023-11-27T20:55:28.724 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/selinux 2023-11-27T20:55:28.724 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T20:55:28.724 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/hugepages 2023-11-27T20:55:28.724 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/mqueue 2023-11-27T20:55:28.724 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/debug 2023-11-27T20:55:28.724 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/tracing 2023-11-27T20:55:28.724 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-27T20:55:28.725 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/fuse/connections 2023-11-27T20:55:28.725 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-sysctl.service 2023-11-27T20:55:28.725 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/config 2023-11-27T20:55:28.725 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-27T20:55:28.725 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/nfs/rpc_pipefs 2023-11-27T20:55:28.725 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/1000 2023-11-27T20:55:28.725 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph 2023-11-27T20:55:28.725 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T20:55:28.725 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T20:55:28.725 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T20:55:28.725 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T20:55:28.725 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns 2023-11-27T20:55:28.726 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T20:55:28.726 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T20:55:28.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:55:28.726 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-11-27T20:55:29.364 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:ceph-fuse[99912]: starting ceph client 2023-11-27T20:55:29.444 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:2023-11-27T20:55:29.254+0000 64d2100 -1 init, newargv = 0x89f6a60 newargc=15 2023-11-27T20:55:29.878 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-11-27T20:55:29.907 DEBUG:teuthology.orchestra.run.smithi088:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T20:55:29.963 INFO:teuthology.orchestra.run.smithi088.stdout:/proc 2023-11-27T20:55:29.963 INFO:teuthology.orchestra.run.smithi088.stdout:/sys 2023-11-27T20:55:29.963 INFO:teuthology.orchestra.run.smithi088.stdout:/dev 2023-11-27T20:55:29.963 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/security 2023-11-27T20:55:29.963 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/shm 2023-11-27T20:55:29.963 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/pts 2023-11-27T20:55:29.963 INFO:teuthology.orchestra.run.smithi088.stdout:/run 2023-11-27T20:55:29.964 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/cgroup 2023-11-27T20:55:29.964 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/pstore 2023-11-27T20:55:29.964 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/bpf 2023-11-27T20:55:29.964 INFO:teuthology.orchestra.run.smithi088.stdout:/ 2023-11-27T20:55:29.964 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/selinux 2023-11-27T20:55:29.964 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T20:55:29.964 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/hugepages 2023-11-27T20:55:29.964 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/mqueue 2023-11-27T20:55:29.964 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/debug 2023-11-27T20:55:29.964 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/tracing 2023-11-27T20:55:29.964 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-27T20:55:29.964 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/fuse/connections 2023-11-27T20:55:29.965 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-sysctl.service 2023-11-27T20:55:29.965 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/config 2023-11-27T20:55:29.965 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-27T20:55:29.965 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/nfs/rpc_pipefs 2023-11-27T20:55:29.965 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/1000 2023-11-27T20:55:29.965 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph 2023-11-27T20:55:29.965 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T20:55:29.965 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T20:55:29.965 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T20:55:29.965 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T20:55:29.965 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns 2023-11-27T20:55:29.965 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T20:55:29.966 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T20:55:29.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:55:29.966 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-11-27T20:55:30.252 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:55:30.255 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:55:30.372 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:ceph-fuse[99912]: starting fuse 2023-11-27T20:55:31.119 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-11-27T20:55:31.147 DEBUG:teuthology.orchestra.run.smithi088:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T20:55:31.203 INFO:teuthology.orchestra.run.smithi088.stdout:/proc 2023-11-27T20:55:31.203 INFO:teuthology.orchestra.run.smithi088.stdout:/sys 2023-11-27T20:55:31.204 INFO:teuthology.orchestra.run.smithi088.stdout:/dev 2023-11-27T20:55:31.204 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/security 2023-11-27T20:55:31.204 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/shm 2023-11-27T20:55:31.204 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/pts 2023-11-27T20:55:31.204 INFO:teuthology.orchestra.run.smithi088.stdout:/run 2023-11-27T20:55:31.205 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/cgroup 2023-11-27T20:55:31.205 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/pstore 2023-11-27T20:55:31.205 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/bpf 2023-11-27T20:55:31.205 INFO:teuthology.orchestra.run.smithi088.stdout:/ 2023-11-27T20:55:31.205 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/selinux 2023-11-27T20:55:31.205 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T20:55:31.205 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/hugepages 2023-11-27T20:55:31.206 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/mqueue 2023-11-27T20:55:31.206 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/debug 2023-11-27T20:55:31.206 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/tracing 2023-11-27T20:55:31.206 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-27T20:55:31.206 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/fuse/connections 2023-11-27T20:55:31.206 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-sysctl.service 2023-11-27T20:55:31.206 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/config 2023-11-27T20:55:31.207 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-27T20:55:31.207 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/nfs/rpc_pipefs 2023-11-27T20:55:31.207 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/1000 2023-11-27T20:55:31.207 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph 2023-11-27T20:55:31.207 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T20:55:31.208 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T20:55:31.208 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T20:55:31.208 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T20:55:31.208 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns 2023-11-27T20:55:31.208 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T20:55:31.209 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T20:55:31.209 INFO:teuthology.orchestra.run.smithi088.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-27T20:55:31.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:55:31.209 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-11-27T20:55:31.258 INFO:teuthology.orchestra.run.smithi088.stdout:41 2023-11-27T20:55:31.258 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-27T20:55:31.259 DEBUG:teuthology.orchestra.run.smithi088:> sudo stdin-killer -- python3 -c ' 2023-11-27T20:55:31.259 DEBUG:teuthology.orchestra.run.smithi088:> import glob 2023-11-27T20:55:31.259 DEBUG:teuthology.orchestra.run.smithi088:> import re 2023-11-27T20:55:31.259 DEBUG:teuthology.orchestra.run.smithi088:> import os 2023-11-27T20:55:31.259 DEBUG:teuthology.orchestra.run.smithi088:> import subprocess 2023-11-27T20:55:31.259 DEBUG:teuthology.orchestra.run.smithi088:> 2023-11-27T20:55:31.259 DEBUG:teuthology.orchestra.run.smithi088:> def _find_admin_socket(client_name): 2023-11-27T20:55:31.259 DEBUG:teuthology.orchestra.run.smithi088:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-27T20:55:31.259 DEBUG:teuthology.orchestra.run.smithi088:> files = glob.glob(asok_path) 2023-11-27T20:55:31.259 DEBUG:teuthology.orchestra.run.smithi088:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-27T20:55:31.259 DEBUG:teuthology.orchestra.run.smithi088:> 2023-11-27T20:55:31.260 DEBUG:teuthology.orchestra.run.smithi088:> # Given a non-glob path, it better be there 2023-11-27T20:55:31.260 DEBUG:teuthology.orchestra.run.smithi088:> if "*" not in asok_path: 2023-11-27T20:55:31.260 DEBUG:teuthology.orchestra.run.smithi088:> assert(len(files) == 1) 2023-11-27T20:55:31.260 DEBUG:teuthology.orchestra.run.smithi088:> return files[0] 2023-11-27T20:55:31.260 DEBUG:teuthology.orchestra.run.smithi088:> 2023-11-27T20:55:31.260 DEBUG:teuthology.orchestra.run.smithi088:> for f in files: 2023-11-27T20:55:31.260 DEBUG:teuthology.orchestra.run.smithi088:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-27T20:55:31.260 DEBUG:teuthology.orchestra.run.smithi088:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-27T20:55:31.260 DEBUG:teuthology.orchestra.run.smithi088:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-27T20:55:31.260 DEBUG:teuthology.orchestra.run.smithi088:> contents = proc_f.read() 2023-11-27T20:55:31.260 DEBUG:teuthology.orchestra.run.smithi088:> if mountpoint in contents: 2023-11-27T20:55:31.260 DEBUG:teuthology.orchestra.run.smithi088:> return f 2023-11-27T20:55:31.261 DEBUG:teuthology.orchestra.run.smithi088:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-27T20:55:31.261 DEBUG:teuthology.orchestra.run.smithi088:> 2023-11-27T20:55:31.261 DEBUG:teuthology.orchestra.run.smithi088:> print(_find_admin_socket("client.0")) 2023-11-27T20:55:31.261 DEBUG:teuthology.orchestra.run.smithi088:> ' 2023-11-27T20:55:31.377 INFO:teuthology.orchestra.run.smithi088.stdout:/var/run/ceph/ceph-client.0.99912.asok 2023-11-27T20:55:31.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T20:55:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-27T20:55:31.387 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.99912.asok 2023-11-27T20:55:31.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:55:31.388 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.99912.asok status 2023-11-27T20:55:31.622 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-27T20:55:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: "metadata": { 2023-11-27T20:55:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_sha1": "369173db14b6995b2bd07c60ec5f63d01cf21631", 2023-11-27T20:55:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_version": "ceph version 18.0.0-7498-g369173db (369173db14b6995b2bd07c60ec5f63d01cf21631) squid (dev)", 2023-11-27T20:55:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: "entity_id": "0", 2023-11-27T20:55:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: "hostname": "smithi088", 2023-11-27T20:55:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-27T20:55:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: "pid": "99912", 2023-11-27T20:55:31.622 INFO:teuthology.orchestra.run.smithi088.stdout: "root": "/" 2023-11-27T20:55:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-27T20:55:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_count": 0, 2023-11-27T20:55:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_pinned_count": 0, 2023-11-27T20:55:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 34634, 2023-11-27T20:55:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: "inst": { 2023-11-27T20:55:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: "name": { 2023-11-27T20:55:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "client", 2023-11-27T20:55:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 34634 2023-11-27T20:55:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-27T20:55:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2023-11-27T20:55:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-11-27T20:55:31.623 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:0", 2023-11-27T20:55:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 1747959380 2023-11-27T20:55:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-27T20:55:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-27T20:55:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2023-11-27T20:55:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-11-27T20:55:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:0", 2023-11-27T20:55:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 1747959380 2023-11-27T20:55:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-27T20:55:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: "inst_str": "client.34634 172.21.15.88:0/1747959380", 2023-11-27T20:55:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: "addr_str": "172.21.15.88:0/1747959380", 2023-11-27T20:55:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: "inode_count": 1, 2023-11-27T20:55:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_epoch": 19, 2023-11-27T20:55:31.624 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch": 28, 2023-11-27T20:55:31.625 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch_barrier": 0, 2023-11-27T20:55:31.625 INFO:teuthology.orchestra.run.smithi088.stdout: "blocklisted": false, 2023-11-27T20:55:31.625 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs" 2023-11-27T20:55:31.625 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-27T20:55:31.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:55:31.631 DEBUG:teuthology.orchestra.run.smithi088:> stat --file-system '--printf=%T 2023-11-27T20:55:31.631 DEBUG:teuthology.orchestra.run.smithi088:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-27T20:55:31.684 INFO:teuthology.orchestra.run.smithi088.stdout:fuseblk 2023-11-27T20:55:31.684 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-27T20:55:31.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:55:31.684 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-27T20:55:31.735 INFO:teuthology.run_tasks:Running task workunit... 2023-11-27T20:55:31.747 INFO:tasks.workunit:Pulling workunits from ref 369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T20:55:31.747 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-11-27T20:55:31.748 INFO:tasks.workunit:timeout=3h 2023-11-27T20:55:31.748 INFO:tasks.workunit:cleanup=True 2023-11-27T20:55:31.748 DEBUG:teuthology.orchestra.run.smithi088:> stat -- /home/ubuntu/cephtest/mnt.0 2023-11-27T20:55:31.763 INFO:teuthology.orchestra.run.smithi088.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-11-27T20:55:31.764 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-11-27T20:55:31.764 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 29h/41d Inode: 1 Links: 2 2023-11-27T20:55:31.764 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T20:55:31.764 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:fusefs_t:s0 2023-11-27T20:55:31.764 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-11-27T20:55:31.764 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-11-27 20:54:27.986811387 +0000 2023-11-27T20:55:31.765 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-11-27 20:54:41.467683017 +0000 2023-11-27T20:55:31.765 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2023-11-27T20:55:31.765 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-11-27T20:55:31.765 DEBUG:teuthology.orchestra.run.smithi088:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-11-27T20:55:32.403 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T20:55:32.418 INFO:tasks.workunit.client.0.smithi088.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-11-27T20:56:00.312 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:56:00.316 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:56:20.585 INFO:tasks.workunit.client.0.smithi088.stderr:Note: switching to '369173db14b6995b2bd07c60ec5f63d01cf21631'. 2023-11-27T20:56:20.585 INFO:tasks.workunit.client.0.smithi088.stderr: 2023-11-27T20:56:20.585 INFO:tasks.workunit.client.0.smithi088.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-11-27T20:56:20.585 INFO:tasks.workunit.client.0.smithi088.stderr:changes and commit them, and you can discard any commits you make in this 2023-11-27T20:56:20.585 INFO:tasks.workunit.client.0.smithi088.stderr:state without impacting any branches by switching back to a branch. 2023-11-27T20:56:20.585 INFO:tasks.workunit.client.0.smithi088.stderr: 2023-11-27T20:56:20.585 INFO:tasks.workunit.client.0.smithi088.stderr:If you want to create a new branch to retain commits you create, you may 2023-11-27T20:56:20.585 INFO:tasks.workunit.client.0.smithi088.stderr:do so (now or later) by using -c with the switch command. Example: 2023-11-27T20:56:20.585 INFO:tasks.workunit.client.0.smithi088.stderr: 2023-11-27T20:56:20.586 INFO:tasks.workunit.client.0.smithi088.stderr: git switch -c 2023-11-27T20:56:20.586 INFO:tasks.workunit.client.0.smithi088.stderr: 2023-11-27T20:56:20.586 INFO:tasks.workunit.client.0.smithi088.stderr:Or undo this operation with: 2023-11-27T20:56:20.586 INFO:tasks.workunit.client.0.smithi088.stderr: 2023-11-27T20:56:20.586 INFO:tasks.workunit.client.0.smithi088.stderr: git switch - 2023-11-27T20:56:20.586 INFO:tasks.workunit.client.0.smithi088.stderr: 2023-11-27T20:56:20.586 INFO:tasks.workunit.client.0.smithi088.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-11-27T20:56:20.586 INFO:tasks.workunit.client.0.smithi088.stderr: 2023-11-27T20:56:20.586 INFO:tasks.workunit.client.0.smithi088.stderr:HEAD is now at 369173db14b Merge branch 'wip-all-kickoff-s-2' of https://github.com/rzarzynski/ceph into wip-yuri10-testing-2023-11-22-1112 2023-11-27T20:56:20.589 DEBUG:teuthology.orchestra.run.smithi088:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-11-27T20:56:20.616 INFO:tasks.workunit.client.0.smithi088.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-11-27T20:56:20.618 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-27T20:56:20.618 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-11-27T20:56:21.236 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-11-27T20:56:21.297 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-11-27T20:56:21.336 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-27T20:56:21.338 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-27T20:56:21.338 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-11-27T20:56:21.376 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-27T20:56:21.379 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T20:56:21.379 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-11-27T20:56:21.435 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2023-11-27T20:56:21.436 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2023-11-27T20:56:21.437 DEBUG:teuthology.orchestra.run.smithi088:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=369173db14b6995b2bd07c60ec5f63d01cf21631 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2023-11-27T20:56:21.853 INFO:tasks.workunit.client.0.smithi088.stderr:+ dbench 1 2023-11-27T20:56:21.862 INFO:tasks.workunit.client.0.smithi088.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-11-27T20:56:21.862 INFO:tasks.workunit.client.0.smithi088.stdout: 2023-11-27T20:56:21.862 INFO:tasks.workunit.client.0.smithi088.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-11-27T20:56:21.872 INFO:tasks.workunit.client.0.smithi088.stdout:0 of 1 processes prepared for launch 0 sec 2023-11-27T20:56:21.972 INFO:tasks.workunit.client.0.smithi088.stdout:1 of 1 processes prepared for launch 0 sec 2023-11-27T20:56:21.972 INFO:tasks.workunit.client.0.smithi088.stdout:releasing clients 2023-11-27T20:56:22.972 INFO:tasks.workunit.client.0.smithi088.stdout: 1 31 1.05 MB/sec warmup 1 sec latency 68.724 ms 2023-11-27T20:56:23.972 INFO:tasks.workunit.client.0.smithi088.stdout: 1 113 2.62 MB/sec warmup 2 sec latency 215.781 ms 2023-11-27T20:56:24.972 INFO:tasks.workunit.client.0.smithi088.stdout: 1 157 2.18 MB/sec warmup 3 sec latency 163.653 ms 2023-11-27T20:56:25.972 INFO:tasks.workunit.client.0.smithi088.stdout: 1 199 1.96 MB/sec warmup 4 sec latency 227.281 ms 2023-11-27T20:56:26.972 INFO:tasks.workunit.client.0.smithi088.stdout: 1 247 1.88 MB/sec warmup 5 sec latency 179.962 ms 2023-11-27T20:56:27.972 INFO:tasks.workunit.client.0.smithi088.stdout: 1 289 1.78 MB/sec warmup 6 sec latency 172.061 ms 2023-11-27T20:56:32.740 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:56:32.744 INFO:tasks.workunit.client.0.smithi088.stdout: 1 331 1.72 MB/sec warmup 7 sec latency 177.923 ms 2023-11-27T20:56:32.775 INFO:tasks.workunit.client.0.smithi088.stdout: 1 373 1.66 MB/sec warmup 8 sec latency 218.511 ms 2023-11-27T20:56:32.775 INFO:tasks.workunit.client.0.smithi088.stdout: 1 413 1.62 MB/sec warmup 9 sec latency 308.771 ms 2023-11-27T20:56:32.775 INFO:tasks.workunit.client.0.smithi088.stdout: 1 437 1.54 MB/sec warmup 10 sec latency 291.367 ms 2023-11-27T20:56:32.780 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:56:32.972 INFO:tasks.workunit.client.0.smithi088.stdout: 1 477 1.52 MB/sec warmup 11 sec latency 346.739 ms 2023-11-27T20:56:33.972 INFO:tasks.workunit.client.0.smithi088.stdout: 1 511 1.48 MB/sec warmup 12 sec latency 304.846 ms 2023-11-27T20:56:34.972 INFO:tasks.workunit.client.0.smithi088.stdout: 1 603 1.61 MB/sec warmup 13 sec latency 298.598 ms 2023-11-27T20:56:35.972 INFO:tasks.workunit.client.0.smithi088.stdout: 1 609 1.50 MB/sec warmup 14 sec latency 340.395 ms 2023-11-27T20:56:36.972 INFO:tasks.workunit.client.0.smithi088.stdout: 1 644 1.40 MB/sec warmup 15 sec latency 770.391 ms 2023-11-27T20:56:37.972 INFO:tasks.workunit.client.0.smithi088.stdout: 1 649 1.32 MB/sec warmup 16 sec latency 381.747 ms 2023-11-27T20:56:38.972 INFO:tasks.workunit.client.0.smithi088.stdout: 1 655 1.24 MB/sec warmup 17 sec latency 307.184 ms 2023-11-27T20:56:39.973 INFO:tasks.workunit.client.0.smithi088.stdout: 1 682 1.18 MB/sec warmup 18 sec latency 289.750 ms 2023-11-27T20:56:40.973 INFO:tasks.workunit.client.0.smithi088.stdout: 1 710 1.12 MB/sec warmup 19 sec latency 294.775 ms 2023-11-27T20:56:41.973 INFO:tasks.workunit.client.0.smithi088.stdout: 1 744 1.07 MB/sec warmup 20 sec latency 234.112 ms 2023-11-27T20:56:42.973 INFO:tasks.workunit.client.0.smithi088.stdout: 1 771 1.02 MB/sec warmup 21 sec latency 293.012 ms 2023-11-27T20:56:43.973 INFO:tasks.workunit.client.0.smithi088.stdout: 1 794 0.98 MB/sec warmup 22 sec latency 188.981 ms 2023-11-27T20:56:44.973 INFO:tasks.workunit.client.0.smithi088.stdout: 1 815 0.93 MB/sec warmup 23 sec latency 290.279 ms 2023-11-27T20:56:45.973 INFO:tasks.workunit.client.0.smithi088.stdout: 1 853 0.90 MB/sec warmup 24 sec latency 391.584 ms 2023-11-27T20:56:46.973 INFO:tasks.workunit.client.0.smithi088.stdout: 1 862 0.86 MB/sec warmup 25 sec latency 302.359 ms 2023-11-27T20:56:47.973 INFO:tasks.workunit.client.0.smithi088.stdout: 1 880 0.83 MB/sec warmup 26 sec latency 285.759 ms 2023-11-27T20:56:48.975 INFO:tasks.workunit.client.0.smithi088.stdout: 1 904 0.80 MB/sec warmup 27 sec latency 277.850 ms 2023-11-27T20:56:49.973 INFO:tasks.workunit.client.0.smithi088.stdout: 1 929 0.78 MB/sec warmup 28 sec latency 290.511 ms 2023-11-27T20:56:50.973 INFO:tasks.workunit.client.0.smithi088.stdout: 1 937 0.75 MB/sec warmup 29 sec latency 287.355 ms 2023-11-27T20:56:51.973 INFO:tasks.workunit.client.0.smithi088.stdout: 1 961 0.73 MB/sec warmup 30 sec latency 377.950 ms 2023-11-27T20:56:52.973 INFO:tasks.workunit.client.0.smithi088.stdout: 1 990 0.71 MB/sec warmup 31 sec latency 183.055 ms 2023-11-27T20:56:53.973 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1027 0.72 MB/sec warmup 32 sec latency 338.630 ms 2023-11-27T20:56:54.973 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1041 0.69 MB/sec warmup 33 sec latency 317.541 ms 2023-11-27T20:56:55.973 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1048 0.67 MB/sec warmup 34 sec latency 383.901 ms 2023-11-27T20:56:56.973 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1060 0.65 MB/sec warmup 35 sec latency 316.723 ms 2023-11-27T20:56:57.973 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1088 0.64 MB/sec warmup 36 sec latency 178.886 ms 2023-11-27T20:56:58.973 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1113 0.62 MB/sec warmup 37 sec latency 308.405 ms 2023-11-27T20:56:59.974 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1134 0.60 MB/sec warmup 38 sec latency 340.435 ms 2023-11-27T20:57:00.974 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1157 0.59 MB/sec warmup 39 sec latency 212.162 ms 2023-11-27T20:57:01.973 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1169 0.58 MB/sec warmup 40 sec latency 346.401 ms 2023-11-27T20:57:02.895 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:57:02.898 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:57:02.974 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1177 0.56 MB/sec warmup 41 sec latency 322.586 ms 2023-11-27T20:57:03.973 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1204 0.55 MB/sec warmup 42 sec latency 169.900 ms 2023-11-27T20:57:04.974 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1231 0.54 MB/sec warmup 43 sec latency 308.505 ms 2023-11-27T20:57:05.974 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1248 0.52 MB/sec warmup 44 sec latency 287.903 ms 2023-11-27T20:57:06.974 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1277 0.51 MB/sec warmup 45 sec latency 317.959 ms 2023-11-27T20:57:07.974 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1281 0.50 MB/sec warmup 46 sec latency 320.405 ms 2023-11-27T20:57:08.974 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1377 0.55 MB/sec warmup 47 sec latency 311.609 ms 2023-11-27T20:57:09.974 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1385 0.54 MB/sec warmup 48 sec latency 325.272 ms 2023-11-27T20:57:10.974 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1397 0.53 MB/sec warmup 49 sec latency 318.431 ms 2023-11-27T20:57:11.974 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1418 0.52 MB/sec warmup 50 sec latency 393.045 ms 2023-11-27T20:57:12.974 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1446 0.51 MB/sec warmup 51 sec latency 167.815 ms 2023-11-27T20:57:13.974 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1466 0.50 MB/sec warmup 52 sec latency 313.991 ms 2023-11-27T20:57:14.974 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1488 0.49 MB/sec warmup 53 sec latency 323.549 ms 2023-11-27T20:57:15.974 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1502 0.48 MB/sec warmup 54 sec latency 425.507 ms 2023-11-27T20:57:16.974 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1526 0.47 MB/sec warmup 55 sec latency 213.741 ms 2023-11-27T20:57:17.974 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1554 0.47 MB/sec warmup 56 sec latency 330.966 ms 2023-11-27T20:57:18.974 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1585 0.46 MB/sec warmup 57 sec latency 330.398 ms 2023-11-27T20:57:19.974 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1606 0.45 MB/sec warmup 58 sec latency 290.335 ms 2023-11-27T20:57:20.974 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1616 0.44 MB/sec warmup 59 sec latency 336.636 ms 2023-11-27T20:57:21.974 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1643 0.44 MB/sec warmup 60 sec latency 347.304 ms 2023-11-27T20:57:22.974 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1662 0.43 MB/sec warmup 61 sec latency 304.297 ms 2023-11-27T20:57:23.974 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1689 0.42 MB/sec warmup 62 sec latency 269.193 ms 2023-11-27T20:57:24.974 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1707 0.42 MB/sec warmup 63 sec latency 320.461 ms 2023-11-27T20:57:25.975 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1770 0.41 MB/sec warmup 64 sec latency 295.349 ms 2023-11-27T20:57:26.975 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1806 0.41 MB/sec warmup 65 sec latency 313.947 ms 2023-11-27T20:57:27.974 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1823 0.40 MB/sec warmup 66 sec latency 317.861 ms 2023-11-27T20:57:28.975 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1841 0.39 MB/sec warmup 67 sec latency 307.988 ms 2023-11-27T20:57:29.975 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1862 0.39 MB/sec warmup 68 sec latency 338.117 ms 2023-11-27T20:57:30.975 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1869 0.38 MB/sec warmup 69 sec latency 423.821 ms 2023-11-27T20:57:31.975 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1903 0.38 MB/sec warmup 70 sec latency 460.750 ms 2023-11-27T20:57:32.951 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:57:32.954 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:57:32.975 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1920 0.37 MB/sec warmup 71 sec latency 311.007 ms 2023-11-27T20:57:33.975 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1973 0.37 MB/sec warmup 72 sec latency 310.645 ms 2023-11-27T20:57:34.975 INFO:tasks.workunit.client.0.smithi088.stdout: 1 1998 0.36 MB/sec warmup 73 sec latency 320.520 ms 2023-11-27T20:57:35.977 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2043 0.36 MB/sec warmup 74 sec latency 315.340 ms 2023-11-27T20:57:36.975 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2054 0.35 MB/sec warmup 75 sec latency 316.132 ms 2023-11-27T20:57:37.975 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2079 0.35 MB/sec warmup 76 sec latency 311.855 ms 2023-11-27T20:57:38.975 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2093 0.35 MB/sec warmup 77 sec latency 306.840 ms 2023-11-27T20:57:39.975 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2138 0.34 MB/sec warmup 78 sec latency 312.648 ms 2023-11-27T20:57:40.975 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2162 0.34 MB/sec warmup 79 sec latency 449.011 ms 2023-11-27T20:57:41.975 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2180 0.33 MB/sec warmup 80 sec latency 327.834 ms 2023-11-27T20:57:42.975 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2202 0.33 MB/sec warmup 81 sec latency 303.696 ms 2023-11-27T20:57:43.975 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2253 0.33 MB/sec warmup 82 sec latency 330.941 ms 2023-11-27T20:57:44.975 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2299 0.33 MB/sec warmup 83 sec latency 297.521 ms 2023-11-27T20:57:45.975 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2307 0.33 MB/sec warmup 84 sec latency 391.596 ms 2023-11-27T20:57:46.975 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2329 0.33 MB/sec warmup 85 sec latency 323.811 ms 2023-11-27T20:57:47.975 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2340 0.32 MB/sec warmup 86 sec latency 321.815 ms 2023-11-27T20:57:48.975 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2361 0.32 MB/sec warmup 87 sec latency 318.018 ms 2023-11-27T20:57:49.976 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2366 0.32 MB/sec warmup 88 sec latency 334.682 ms 2023-11-27T20:57:50.975 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2383 0.31 MB/sec warmup 89 sec latency 468.790 ms 2023-11-27T20:57:51.977 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2396 0.31 MB/sec warmup 90 sec latency 342.335 ms 2023-11-27T20:57:52.975 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2410 0.31 MB/sec warmup 91 sec latency 166.112 ms 2023-11-27T20:57:53.976 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2431 0.31 MB/sec warmup 92 sec latency 310.798 ms 2023-11-27T20:57:54.976 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2439 0.30 MB/sec warmup 93 sec latency 325.677 ms 2023-11-27T20:57:55.976 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2453 0.30 MB/sec warmup 94 sec latency 180.095 ms 2023-11-27T20:57:56.976 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2484 0.30 MB/sec warmup 95 sec latency 323.674 ms 2023-11-27T20:57:57.976 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2494 0.30 MB/sec warmup 96 sec latency 294.775 ms 2023-11-27T20:57:58.976 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2549 0.30 MB/sec warmup 97 sec latency 300.478 ms 2023-11-27T20:57:59.976 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2559 0.29 MB/sec warmup 98 sec latency 334.504 ms 2023-11-27T20:58:00.976 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2577 0.29 MB/sec warmup 99 sec latency 326.267 ms 2023-11-27T20:58:01.976 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2583 0.29 MB/sec warmup 100 sec latency 317.575 ms 2023-11-27T20:58:02.976 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2600 0.29 MB/sec warmup 101 sec latency 250.663 ms 2023-11-27T20:58:03.005 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:58:03.007 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:58:03.977 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2615 0.29 MB/sec warmup 102 sec latency 318.972 ms 2023-11-27T20:58:04.976 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2621 0.28 MB/sec warmup 103 sec latency 338.397 ms 2023-11-27T20:58:05.976 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2745 0.31 MB/sec warmup 104 sec latency 318.528 ms 2023-11-27T20:58:06.976 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2761 0.30 MB/sec warmup 105 sec latency 332.608 ms 2023-11-27T20:58:07.976 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2779 0.30 MB/sec warmup 106 sec latency 173.397 ms 2023-11-27T20:58:08.976 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2876 0.30 MB/sec warmup 107 sec latency 310.365 ms 2023-11-27T20:58:09.976 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2900 0.30 MB/sec warmup 108 sec latency 172.143 ms 2023-11-27T20:58:10.976 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2925 0.31 MB/sec warmup 109 sec latency 268.347 ms 2023-11-27T20:58:11.976 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2938 0.30 MB/sec warmup 110 sec latency 177.470 ms 2023-11-27T20:58:12.976 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2974 0.30 MB/sec warmup 111 sec latency 329.928 ms 2023-11-27T20:58:13.976 INFO:tasks.workunit.client.0.smithi088.stdout: 1 2989 0.30 MB/sec warmup 112 sec latency 329.635 ms 2023-11-27T20:58:14.976 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3007 0.30 MB/sec warmup 113 sec latency 304.029 ms 2023-11-27T20:58:15.977 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3023 0.29 MB/sec warmup 114 sec latency 178.054 ms 2023-11-27T20:58:16.977 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3169 0.30 MB/sec warmup 115 sec latency 322.845 ms 2023-11-27T20:58:17.977 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3188 0.30 MB/sec warmup 116 sec latency 190.873 ms 2023-11-27T20:58:18.977 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3210 0.29 MB/sec warmup 117 sec latency 308.019 ms 2023-11-27T20:58:19.977 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3268 0.30 MB/sec warmup 118 sec latency 311.411 ms 2023-11-27T20:58:20.977 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3280 0.30 MB/sec warmup 119 sec latency 373.937 ms 2023-11-27T20:58:22.977 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3290 0.00 MB/sec execute 1 sec latency 460.397 ms 2023-11-27T20:58:23.977 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3293 0.00 MB/sec execute 2 sec latency 323.461 ms 2023-11-27T20:58:24.977 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3298 0.00 MB/sec execute 3 sec latency 338.460 ms 2023-11-27T20:58:25.977 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3306 0.01 MB/sec execute 4 sec latency 373.114 ms 2023-11-27T20:58:26.977 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3309 0.00 MB/sec execute 5 sec latency 331.350 ms 2023-11-27T20:58:27.977 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3312 0.00 MB/sec execute 6 sec latency 326.852 ms 2023-11-27T20:58:28.977 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3316 0.00 MB/sec execute 7 sec latency 331.536 ms 2023-11-27T20:58:29.977 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3319 0.00 MB/sec execute 8 sec latency 318.632 ms 2023-11-27T20:58:30.977 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3323 0.00 MB/sec execute 9 sec latency 466.504 ms 2023-11-27T20:58:31.977 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3326 0.00 MB/sec execute 10 sec latency 317.948 ms 2023-11-27T20:58:32.977 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3331 0.00 MB/sec execute 11 sec latency 323.934 ms 2023-11-27T20:58:33.125 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:58:33.127 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:58:33.977 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3334 0.00 MB/sec execute 12 sec latency 328.071 ms 2023-11-27T20:58:34.977 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3339 0.00 MB/sec execute 13 sec latency 322.911 ms 2023-11-27T20:58:35.978 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3361 0.01 MB/sec execute 14 sec latency 160.634 ms 2023-11-27T20:58:36.977 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3377 0.01 MB/sec execute 15 sec latency 167.331 ms 2023-11-27T20:58:37.978 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3393 0.01 MB/sec execute 16 sec latency 308.384 ms 2023-11-27T20:58:38.977 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3493 0.18 MB/sec execute 17 sec latency 321.677 ms 2023-11-27T20:58:39.978 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3516 0.17 MB/sec execute 18 sec latency 135.744 ms 2023-11-27T20:58:40.977 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3534 0.16 MB/sec execute 19 sec latency 342.891 ms 2023-11-27T20:58:41.977 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3557 0.15 MB/sec execute 20 sec latency 127.986 ms 2023-11-27T20:58:42.978 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3573 0.15 MB/sec execute 21 sec latency 310.618 ms 2023-11-27T20:58:43.978 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3617 0.15 MB/sec execute 22 sec latency 318.446 ms 2023-11-27T20:58:44.978 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3640 0.14 MB/sec execute 23 sec latency 223.628 ms 2023-11-27T20:58:45.978 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3651 0.14 MB/sec execute 24 sec latency 319.281 ms 2023-11-27T20:58:46.978 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3673 0.13 MB/sec execute 25 sec latency 318.966 ms 2023-11-27T20:58:47.978 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3689 0.13 MB/sec execute 26 sec latency 314.563 ms 2023-11-27T20:58:48.978 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3708 0.13 MB/sec execute 27 sec latency 225.930 ms 2023-11-27T20:58:49.978 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3755 0.16 MB/sec execute 28 sec latency 153.674 ms 2023-11-27T20:58:50.978 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3768 0.15 MB/sec execute 29 sec latency 328.679 ms 2023-11-27T20:58:51.978 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3780 0.15 MB/sec execute 30 sec latency 216.283 ms 2023-11-27T20:58:52.978 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3790 0.14 MB/sec execute 31 sec latency 228.378 ms 2023-11-27T20:58:53.978 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3799 0.14 MB/sec execute 32 sec latency 263.874 ms 2023-11-27T20:58:54.978 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3810 0.13 MB/sec execute 33 sec latency 226.326 ms 2023-11-27T20:58:55.978 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3820 0.13 MB/sec execute 34 sec latency 176.384 ms 2023-11-27T20:59:03.996 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:59:03.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3835 0.13 MB/sec execute 35 sec latency 196.480 ms 2023-11-27T20:59:03.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3846 0.12 MB/sec execute 36 sec latency 193.140 ms 2023-11-27T20:59:03.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3860 0.12 MB/sec execute 37 sec latency 178.786 ms 2023-11-27T20:59:03.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3870 0.12 MB/sec execute 38 sec latency 188.006 ms 2023-11-27T20:59:03.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3879 0.11 MB/sec execute 39 sec latency 356.025 ms 2023-11-27T20:59:03.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3896 0.12 MB/sec execute 40 sec latency 316.624 ms 2023-11-27T20:59:03.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3914 0.12 MB/sec execute 41 sec latency 336.029 ms 2023-11-27T20:59:03.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3926 0.11 MB/sec execute 42 sec latency 314.817 ms 2023-11-27T20:59:04.006 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:59:04.979 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3936 0.11 MB/sec execute 43 sec latency 221.707 ms 2023-11-27T20:59:05.979 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3942 0.11 MB/sec execute 44 sec latency 393.055 ms 2023-11-27T20:59:06.979 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3951 0.10 MB/sec execute 45 sec latency 278.776 ms 2023-11-27T20:59:07.979 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3962 0.10 MB/sec execute 46 sec latency 235.171 ms 2023-11-27T20:59:08.979 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3975 0.10 MB/sec execute 47 sec latency 179.383 ms 2023-11-27T20:59:09.979 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3987 0.10 MB/sec execute 48 sec latency 203.019 ms 2023-11-27T20:59:10.979 INFO:tasks.workunit.client.0.smithi088.stdout: 1 3999 0.10 MB/sec execute 49 sec latency 174.378 ms 2023-11-27T20:59:11.979 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4013 0.09 MB/sec execute 50 sec latency 189.474 ms 2023-11-27T20:59:12.979 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4023 0.09 MB/sec execute 51 sec latency 182.524 ms 2023-11-27T20:59:13.979 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4032 0.09 MB/sec execute 52 sec latency 320.391 ms 2023-11-27T20:59:14.979 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4040 0.09 MB/sec execute 53 sec latency 328.326 ms 2023-11-27T20:59:15.979 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4058 0.09 MB/sec execute 54 sec latency 323.591 ms 2023-11-27T20:59:16.979 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4071 0.09 MB/sec execute 55 sec latency 421.447 ms 2023-11-27T20:59:17.979 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4094 0.08 MB/sec execute 56 sec latency 305.351 ms 2023-11-27T20:59:18.979 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4107 0.08 MB/sec execute 57 sec latency 135.028 ms 2023-11-27T20:59:19.979 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4121 0.08 MB/sec execute 58 sec latency 139.404 ms 2023-11-27T20:59:20.979 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4136 0.08 MB/sec execute 59 sec latency 158.257 ms 2023-11-27T20:59:21.979 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4153 0.08 MB/sec execute 60 sec latency 148.798 ms 2023-11-27T20:59:22.979 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4162 0.08 MB/sec execute 61 sec latency 189.565 ms 2023-11-27T20:59:23.979 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4173 0.08 MB/sec execute 62 sec latency 295.036 ms 2023-11-27T20:59:24.979 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4186 0.08 MB/sec execute 63 sec latency 325.324 ms 2023-11-27T20:59:25.979 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4217 0.08 MB/sec execute 64 sec latency 568.203 ms 2023-11-27T20:59:26.979 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4226 0.07 MB/sec execute 65 sec latency 329.361 ms 2023-11-27T20:59:27.979 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4254 0.08 MB/sec execute 66 sec latency 341.409 ms 2023-11-27T20:59:28.980 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4282 0.07 MB/sec execute 67 sec latency 305.576 ms 2023-11-27T20:59:29.979 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4315 0.07 MB/sec execute 68 sec latency 275.108 ms 2023-11-27T20:59:30.979 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4344 0.07 MB/sec execute 69 sec latency 316.579 ms 2023-11-27T20:59:31.979 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4379 0.08 MB/sec execute 70 sec latency 191.123 ms 2023-11-27T20:59:32.980 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4387 0.07 MB/sec execute 71 sec latency 300.147 ms 2023-11-27T20:59:33.980 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4423 0.07 MB/sec execute 72 sec latency 320.761 ms 2023-11-27T20:59:34.057 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:59:34.060 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:59:34.980 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4432 0.07 MB/sec execute 73 sec latency 316.312 ms 2023-11-27T20:59:35.980 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4455 0.07 MB/sec execute 74 sec latency 396.279 ms 2023-11-27T20:59:36.980 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4474 0.07 MB/sec execute 75 sec latency 218.190 ms 2023-11-27T20:59:37.980 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4498 0.07 MB/sec execute 76 sec latency 335.482 ms 2023-11-27T20:59:38.980 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4503 0.07 MB/sec execute 77 sec latency 332.369 ms 2023-11-27T20:59:39.980 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4530 0.07 MB/sec execute 78 sec latency 329.146 ms 2023-11-27T20:59:40.981 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4554 0.07 MB/sec execute 79 sec latency 191.503 ms 2023-11-27T20:59:41.980 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4596 0.08 MB/sec execute 80 sec latency 316.799 ms 2023-11-27T20:59:42.980 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4614 0.08 MB/sec execute 81 sec latency 304.325 ms 2023-11-27T20:59:43.980 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4621 0.08 MB/sec execute 82 sec latency 316.276 ms 2023-11-27T20:59:44.980 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4653 0.08 MB/sec execute 83 sec latency 164.243 ms 2023-11-27T20:59:45.980 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4668 0.08 MB/sec execute 84 sec latency 303.202 ms 2023-11-27T20:59:46.980 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4690 0.08 MB/sec execute 85 sec latency 376.085 ms 2023-11-27T20:59:47.980 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4722 0.08 MB/sec execute 86 sec latency 212.344 ms 2023-11-27T20:59:48.980 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4735 0.08 MB/sec execute 87 sec latency 306.694 ms 2023-11-27T20:59:49.980 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4742 0.08 MB/sec execute 88 sec latency 325.876 ms 2023-11-27T20:59:50.980 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4767 0.08 MB/sec execute 89 sec latency 210.416 ms 2023-11-27T20:59:51.980 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4791 0.08 MB/sec execute 90 sec latency 318.166 ms 2023-11-27T20:59:52.980 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4814 0.08 MB/sec execute 91 sec latency 201.181 ms 2023-11-27T20:59:53.980 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4840 0.08 MB/sec execute 92 sec latency 323.383 ms 2023-11-27T20:59:54.980 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4847 0.07 MB/sec execute 93 sec latency 341.080 ms 2023-11-27T20:59:55.980 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4942 0.10 MB/sec execute 94 sec latency 337.612 ms 2023-11-27T20:59:56.981 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4948 0.10 MB/sec execute 95 sec latency 429.085 ms 2023-11-27T20:59:57.980 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4963 0.10 MB/sec execute 96 sec latency 298.807 ms 2023-11-27T20:59:58.981 INFO:tasks.workunit.client.0.smithi088.stdout: 1 4985 0.10 MB/sec execute 97 sec latency 333.855 ms 2023-11-27T20:59:59.981 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5014 0.10 MB/sec execute 98 sec latency 198.137 ms 2023-11-27T21:00:00.981 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5032 0.10 MB/sec execute 99 sec latency 326.403 ms 2023-11-27T21:00:01.981 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5055 0.10 MB/sec execute 100 sec latency 338.658 ms 2023-11-27T21:00:02.981 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5070 0.10 MB/sec execute 101 sec latency 326.757 ms 2023-11-27T21:00:03.981 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5094 0.10 MB/sec execute 102 sec latency 309.871 ms 2023-11-27T21:00:04.228 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:00:04.230 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:00:04.981 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5120 0.10 MB/sec execute 103 sec latency 354.722 ms 2023-11-27T21:00:05.981 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5149 0.10 MB/sec execute 104 sec latency 393.466 ms 2023-11-27T21:00:06.981 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5171 0.09 MB/sec execute 105 sec latency 292.535 ms 2023-11-27T21:00:07.981 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5181 0.09 MB/sec execute 106 sec latency 337.628 ms 2023-11-27T21:00:08.981 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5208 0.09 MB/sec execute 107 sec latency 320.635 ms 2023-11-27T21:00:09.981 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5227 0.09 MB/sec execute 108 sec latency 307.187 ms 2023-11-27T21:00:10.981 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5254 0.09 MB/sec execute 109 sec latency 237.226 ms 2023-11-27T21:00:11.981 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5272 0.09 MB/sec execute 110 sec latency 326.684 ms 2023-11-27T21:00:12.981 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5335 0.09 MB/sec execute 111 sec latency 325.487 ms 2023-11-27T21:00:13.981 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5369 0.09 MB/sec execute 112 sec latency 313.003 ms 2023-11-27T21:00:14.981 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5387 0.09 MB/sec execute 113 sec latency 325.745 ms 2023-11-27T21:00:15.981 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5403 0.09 MB/sec execute 114 sec latency 346.862 ms 2023-11-27T21:00:16.982 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5423 0.09 MB/sec execute 115 sec latency 313.476 ms 2023-11-27T21:00:17.981 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5434 0.09 MB/sec execute 116 sec latency 334.648 ms 2023-11-27T21:00:18.981 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5468 0.09 MB/sec execute 117 sec latency 325.920 ms 2023-11-27T21:00:19.982 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5485 0.09 MB/sec execute 118 sec latency 308.619 ms 2023-11-27T21:00:20.981 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5537 0.09 MB/sec execute 119 sec latency 322.606 ms 2023-11-27T21:00:21.981 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5562 0.09 MB/sec execute 120 sec latency 304.142 ms 2023-11-27T21:00:22.981 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5597 0.09 MB/sec execute 121 sec latency 301.650 ms 2023-11-27T21:00:23.981 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5615 0.09 MB/sec execute 122 sec latency 338.534 ms 2023-11-27T21:00:24.981 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5625 0.08 MB/sec execute 123 sec latency 303.450 ms 2023-11-27T21:00:25.982 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5651 0.08 MB/sec execute 124 sec latency 324.108 ms 2023-11-27T21:00:26.982 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5699 0.08 MB/sec execute 125 sec latency 319.655 ms 2023-11-27T21:00:27.982 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5708 0.08 MB/sec execute 126 sec latency 314.658 ms 2023-11-27T21:00:28.982 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5737 0.08 MB/sec execute 127 sec latency 339.627 ms 2023-11-27T21:00:29.982 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5759 0.08 MB/sec execute 128 sec latency 349.744 ms 2023-11-27T21:00:30.982 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5790 0.08 MB/sec execute 129 sec latency 383.122 ms 2023-11-27T21:00:31.982 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5855 0.09 MB/sec execute 130 sec latency 327.436 ms 2023-11-27T21:00:32.982 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5867 0.09 MB/sec execute 131 sec latency 325.898 ms 2023-11-27T21:00:33.982 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5887 0.09 MB/sec execute 132 sec latency 334.008 ms 2023-11-27T21:00:34.367 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:00:34.370 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:00:34.982 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5900 0.09 MB/sec execute 133 sec latency 301.157 ms 2023-11-27T21:00:35.982 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5921 0.09 MB/sec execute 134 sec latency 340.123 ms 2023-11-27T21:00:36.982 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5926 0.09 MB/sec execute 135 sec latency 348.771 ms 2023-11-27T21:00:37.982 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5942 0.09 MB/sec execute 136 sec latency 311.376 ms 2023-11-27T21:00:38.982 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5955 0.09 MB/sec execute 137 sec latency 335.986 ms 2023-11-27T21:00:39.982 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5970 0.09 MB/sec execute 138 sec latency 165.149 ms 2023-11-27T21:00:40.985 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5989 0.09 MB/sec execute 139 sec latency 322.550 ms 2023-11-27T21:00:41.982 INFO:tasks.workunit.client.0.smithi088.stdout: 1 5998 0.08 MB/sec execute 140 sec latency 312.428 ms 2023-11-27T21:00:42.982 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6013 0.08 MB/sec execute 141 sec latency 172.211 ms 2023-11-27T21:00:43.982 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6033 0.09 MB/sec execute 142 sec latency 308.809 ms 2023-11-27T21:00:44.982 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6052 0.09 MB/sec execute 143 sec latency 287.250 ms 2023-11-27T21:00:45.982 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6064 0.09 MB/sec execute 144 sec latency 351.376 ms 2023-11-27T21:00:46.982 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6114 0.09 MB/sec execute 145 sec latency 349.270 ms 2023-11-27T21:00:47.982 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6130 0.09 MB/sec execute 146 sec latency 308.919 ms 2023-11-27T21:00:48.985 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6140 0.09 MB/sec execute 147 sec latency 331.917 ms 2023-11-27T21:00:49.983 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6158 0.09 MB/sec execute 148 sec latency 188.813 ms 2023-11-27T21:00:50.983 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6166 0.09 MB/sec execute 149 sec latency 307.782 ms 2023-11-27T21:00:51.983 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6176 0.09 MB/sec execute 150 sec latency 343.712 ms 2023-11-27T21:00:52.983 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6275 0.10 MB/sec execute 151 sec latency 321.626 ms 2023-11-27T21:00:53.983 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6316 0.10 MB/sec execute 152 sec latency 336.597 ms 2023-11-27T21:00:54.983 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6332 0.10 MB/sec execute 153 sec latency 316.203 ms 2023-11-27T21:00:55.983 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6427 0.10 MB/sec execute 154 sec latency 328.497 ms 2023-11-27T21:00:56.983 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6451 0.11 MB/sec execute 155 sec latency 327.728 ms 2023-11-27T21:00:57.983 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6473 0.11 MB/sec execute 156 sec latency 198.626 ms 2023-11-27T21:00:58.983 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6493 0.11 MB/sec execute 157 sec latency 189.402 ms 2023-11-27T21:00:59.983 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6526 0.11 MB/sec execute 158 sec latency 360.364 ms 2023-11-27T21:01:00.983 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6533 0.11 MB/sec execute 159 sec latency 322.174 ms 2023-11-27T21:01:01.983 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6550 0.11 MB/sec execute 160 sec latency 308.338 ms 2023-11-27T21:01:02.983 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6572 0.11 MB/sec execute 161 sec latency 194.647 ms 2023-11-27T21:01:03.983 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6586 0.11 MB/sec execute 162 sec latency 283.667 ms 2023-11-27T21:01:04.584 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:01:04.586 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:01:04.983 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6731 0.11 MB/sec execute 163 sec latency 315.249 ms 2023-11-27T21:01:05.983 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6754 0.11 MB/sec execute 164 sec latency 314.408 ms 2023-11-27T21:01:06.983 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6820 0.12 MB/sec execute 165 sec latency 192.166 ms 2023-11-27T21:01:07.983 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6834 0.12 MB/sec execute 166 sec latency 327.813 ms 2023-11-27T21:01:08.983 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6837 0.11 MB/sec execute 167 sec latency 326.182 ms 2023-11-27T21:01:09.983 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6841 0.11 MB/sec execute 168 sec latency 329.942 ms 2023-11-27T21:01:10.983 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6846 0.11 MB/sec execute 169 sec latency 491.059 ms 2023-11-27T21:01:11.984 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6849 0.11 MB/sec execute 170 sec latency 350.437 ms 2023-11-27T21:01:12.984 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6858 0.11 MB/sec execute 171 sec latency 332.410 ms 2023-11-27T21:01:13.984 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6863 0.11 MB/sec execute 172 sec latency 346.978 ms 2023-11-27T21:01:14.984 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6866 0.11 MB/sec execute 173 sec latency 329.796 ms 2023-11-27T21:01:15.984 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6869 0.11 MB/sec execute 174 sec latency 396.334 ms 2023-11-27T21:01:16.984 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6873 0.11 MB/sec execute 175 sec latency 327.909 ms 2023-11-27T21:01:17.984 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6877 0.11 MB/sec execute 176 sec latency 334.394 ms 2023-11-27T21:01:18.984 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6880 0.11 MB/sec execute 177 sec latency 315.591 ms 2023-11-27T21:01:19.984 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6885 0.11 MB/sec execute 178 sec latency 325.904 ms 2023-11-27T21:01:25.518 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6887 0.11 MB/sec execute 179 sec latency 485.859 ms 2023-11-27T21:01:25.518 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6891 0.11 MB/sec execute 180 sec latency 488.692 ms 2023-11-27T21:01:25.518 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6900 0.11 MB/sec execute 181 sec latency 317.622 ms 2023-11-27T21:01:25.518 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6920 0.11 MB/sec execute 182 sec latency 175.263 ms 2023-11-27T21:01:25.518 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6934 0.11 MB/sec execute 183 sec latency 190.106 ms 2023-11-27T21:01:25.984 INFO:tasks.workunit.client.0.smithi088.stdout: 1 6949 0.10 MB/sec execute 184 sec latency 353.464 ms 2023-11-27T21:01:26.984 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7054 0.12 MB/sec execute 185 sec latency 320.773 ms 2023-11-27T21:01:27.984 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7077 0.12 MB/sec execute 186 sec latency 153.386 ms 2023-11-27T21:01:28.984 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7099 0.12 MB/sec execute 187 sec latency 303.290 ms 2023-11-27T21:01:29.984 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7109 0.12 MB/sec execute 188 sec latency 302.693 ms 2023-11-27T21:01:30.984 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7126 0.12 MB/sec execute 189 sec latency 446.368 ms 2023-11-27T21:01:31.984 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7173 0.12 MB/sec execute 190 sec latency 316.725 ms 2023-11-27T21:01:32.984 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7187 0.12 MB/sec execute 191 sec latency 243.276 ms 2023-11-27T21:01:33.984 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7209 0.12 MB/sec execute 192 sec latency 324.548 ms 2023-11-27T21:01:34.696 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:01:34.700 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:01:34.984 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7220 0.12 MB/sec execute 193 sec latency 307.332 ms 2023-11-27T21:01:35.984 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7240 0.12 MB/sec execute 194 sec latency 402.409 ms 2023-11-27T21:01:36.984 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7253 0.12 MB/sec execute 195 sec latency 237.453 ms 2023-11-27T21:01:37.985 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7302 0.12 MB/sec execute 196 sec latency 155.989 ms 2023-11-27T21:01:38.985 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7315 0.12 MB/sec execute 197 sec latency 329.376 ms 2023-11-27T21:01:39.985 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7328 0.12 MB/sec execute 198 sec latency 193.882 ms 2023-11-27T21:01:40.985 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7335 0.12 MB/sec execute 199 sec latency 238.687 ms 2023-11-27T21:01:41.985 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7344 0.12 MB/sec execute 200 sec latency 240.402 ms 2023-11-27T21:01:42.985 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7354 0.12 MB/sec execute 201 sec latency 226.661 ms 2023-11-27T21:01:43.985 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7366 0.12 MB/sec execute 202 sec latency 191.261 ms 2023-11-27T21:01:44.985 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7379 0.12 MB/sec execute 203 sec latency 206.556 ms 2023-11-27T21:01:45.985 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7390 0.12 MB/sec execute 204 sec latency 191.891 ms 2023-11-27T21:01:46.985 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7403 0.11 MB/sec execute 205 sec latency 209.284 ms 2023-11-27T21:01:47.985 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7414 0.11 MB/sec execute 206 sec latency 178.117 ms 2023-11-27T21:01:48.985 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7422 0.11 MB/sec execute 207 sec latency 314.413 ms 2023-11-27T21:01:49.985 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7440 0.11 MB/sec execute 208 sec latency 304.820 ms 2023-11-27T21:01:50.985 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7458 0.11 MB/sec execute 209 sec latency 327.120 ms 2023-11-27T21:01:51.985 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7467 0.11 MB/sec execute 210 sec latency 426.922 ms 2023-11-27T21:01:52.985 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7478 0.11 MB/sec execute 211 sec latency 227.916 ms 2023-11-27T21:01:53.985 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7486 0.11 MB/sec execute 212 sec latency 268.212 ms 2023-11-27T21:01:54.985 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7494 0.11 MB/sec execute 213 sec latency 271.549 ms 2023-11-27T21:01:55.985 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7504 0.11 MB/sec execute 214 sec latency 217.300 ms 2023-11-27T21:01:56.985 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7518 0.11 MB/sec execute 215 sec latency 183.653 ms 2023-11-27T21:01:57.985 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7530 0.11 MB/sec execute 216 sec latency 175.399 ms 2023-11-27T21:01:58.986 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7543 0.11 MB/sec execute 217 sec latency 177.121 ms 2023-11-27T21:01:59.986 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7556 0.11 MB/sec execute 218 sec latency 190.143 ms 2023-11-27T21:02:00.986 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7566 0.11 MB/sec execute 219 sec latency 189.974 ms 2023-11-27T21:02:01.986 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7574 0.11 MB/sec execute 220 sec latency 317.250 ms 2023-11-27T21:02:02.986 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7580 0.11 MB/sec execute 221 sec latency 328.721 ms 2023-11-27T21:02:03.986 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7602 0.11 MB/sec execute 222 sec latency 321.535 ms 2023-11-27T21:02:04.844 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:02:04.847 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:02:04.986 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7615 0.11 MB/sec execute 223 sec latency 313.338 ms 2023-11-27T21:02:05.986 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7635 0.11 MB/sec execute 224 sec latency 312.239 ms 2023-11-27T21:02:06.986 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7649 0.11 MB/sec execute 225 sec latency 144.448 ms 2023-11-27T21:02:07.986 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7662 0.11 MB/sec execute 226 sec latency 158.881 ms 2023-11-27T21:02:08.986 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7677 0.11 MB/sec execute 227 sec latency 174.304 ms 2023-11-27T21:02:09.986 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7691 0.10 MB/sec execute 228 sec latency 148.410 ms 2023-11-27T21:02:10.986 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7702 0.10 MB/sec execute 229 sec latency 172.782 ms 2023-11-27T21:02:11.986 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7713 0.10 MB/sec execute 230 sec latency 179.125 ms 2023-11-27T21:02:12.986 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7721 0.10 MB/sec execute 231 sec latency 320.023 ms 2023-11-27T21:02:13.986 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7758 0.10 MB/sec execute 232 sec latency 347.348 ms 2023-11-27T21:02:14.986 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7767 0.10 MB/sec execute 233 sec latency 306.282 ms 2023-11-27T21:02:15.986 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7794 0.10 MB/sec execute 234 sec latency 309.436 ms 2023-11-27T21:02:16.986 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7818 0.10 MB/sec execute 235 sec latency 339.775 ms 2023-11-27T21:02:17.986 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7853 0.10 MB/sec execute 236 sec latency 185.964 ms 2023-11-27T21:02:18.986 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7872 0.10 MB/sec execute 237 sec latency 320.783 ms 2023-11-27T21:02:19.986 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7893 0.10 MB/sec execute 238 sec latency 192.177 ms 2023-11-27T21:02:20.986 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7925 0.10 MB/sec execute 239 sec latency 376.947 ms 2023-11-27T21:02:21.986 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7930 0.10 MB/sec execute 240 sec latency 413.444 ms 2023-11-27T21:02:22.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7966 0.10 MB/sec execute 241 sec latency 327.232 ms 2023-11-27T21:02:23.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 7975 0.10 MB/sec execute 242 sec latency 335.549 ms 2023-11-27T21:02:24.986 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8006 0.10 MB/sec execute 243 sec latency 315.072 ms 2023-11-27T21:02:25.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8030 0.10 MB/sec execute 244 sec latency 199.376 ms 2023-11-27T21:02:26.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8041 0.10 MB/sec execute 245 sec latency 309.868 ms 2023-11-27T21:02:27.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8048 0.10 MB/sec execute 246 sec latency 318.942 ms 2023-11-27T21:02:28.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8078 0.10 MB/sec execute 247 sec latency 323.242 ms 2023-11-27T21:02:29.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8105 0.10 MB/sec execute 248 sec latency 194.775 ms 2023-11-27T21:02:30.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8144 0.10 MB/sec execute 249 sec latency 322.991 ms 2023-11-27T21:02:31.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8157 0.10 MB/sec execute 250 sec latency 361.734 ms 2023-11-27T21:02:32.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8169 0.10 MB/sec execute 251 sec latency 329.805 ms 2023-11-27T21:02:33.988 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8195 0.10 MB/sec execute 252 sec latency 165.555 ms 2023-11-27T21:02:34.923 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:02:34.926 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:02:34.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8210 0.10 MB/sec execute 253 sec latency 305.715 ms 2023-11-27T21:02:35.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8237 0.10 MB/sec execute 254 sec latency 372.956 ms 2023-11-27T21:02:36.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8266 0.10 MB/sec execute 255 sec latency 192.553 ms 2023-11-27T21:02:37.264 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:09:01.173 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:02:37.320 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:09:01.229 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:02:37.370 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:09:01.256 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:02:37.371 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:09:01.257 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:02:37.432 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:09:01.318 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:02:37.433 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:09:01.319 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:02:37.726 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:09:01.636 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:02:37.827 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:09:01.713 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:02:37.830 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:09:01.716 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:02:37.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8276 0.10 MB/sec execute 256 sec latency 391.747 ms 2023-11-27T21:02:38.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8281 0.10 MB/sec execute 257 sec latency 408.143 ms 2023-11-27T21:02:39.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8309 0.10 MB/sec execute 258 sec latency 179.586 ms 2023-11-27T21:02:40.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8323 0.10 MB/sec execute 259 sec latency 338.844 ms 2023-11-27T21:02:41.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8353 0.10 MB/sec execute 260 sec latency 209.883 ms 2023-11-27T21:02:42.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8371 0.10 MB/sec execute 261 sec latency 326.476 ms 2023-11-27T21:02:43.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8388 0.10 MB/sec execute 262 sec latency 319.703 ms 2023-11-27T21:02:44.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8485 0.11 MB/sec execute 263 sec latency 313.992 ms 2023-11-27T21:02:45.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8491 0.11 MB/sec execute 264 sec latency 328.714 ms 2023-11-27T21:02:46.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8506 0.11 MB/sec execute 265 sec latency 315.537 ms 2023-11-27T21:02:47.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8527 0.11 MB/sec execute 266 sec latency 336.501 ms 2023-11-27T21:02:48.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8555 0.11 MB/sec execute 267 sec latency 149.801 ms 2023-11-27T21:02:49.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8575 0.11 MB/sec execute 268 sec latency 318.233 ms 2023-11-27T21:02:50.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8595 0.11 MB/sec execute 269 sec latency 373.118 ms 2023-11-27T21:02:51.987 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8610 0.11 MB/sec execute 270 sec latency 309.928 ms 2023-11-27T21:02:52.988 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8635 0.11 MB/sec execute 271 sec latency 170.551 ms 2023-11-27T21:02:53.988 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8661 0.11 MB/sec execute 272 sec latency 322.253 ms 2023-11-27T21:02:54.988 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8692 0.11 MB/sec execute 273 sec latency 307.847 ms 2023-11-27T21:02:55.988 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8714 0.11 MB/sec execute 274 sec latency 375.348 ms 2023-11-27T21:02:56.988 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8724 0.11 MB/sec execute 275 sec latency 336.890 ms 2023-11-27T21:02:57.988 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8751 0.11 MB/sec execute 276 sec latency 327.301 ms 2023-11-27T21:02:58.988 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8770 0.11 MB/sec execute 277 sec latency 319.717 ms 2023-11-27T21:02:59.988 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8797 0.10 MB/sec execute 278 sec latency 237.516 ms 2023-11-27T21:03:00.988 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8815 0.10 MB/sec execute 279 sec latency 345.045 ms 2023-11-27T21:03:01.988 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8877 0.10 MB/sec execute 280 sec latency 457.461 ms 2023-11-27T21:03:02.988 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8910 0.10 MB/sec execute 281 sec latency 305.763 ms 2023-11-27T21:03:03.988 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8930 0.10 MB/sec execute 282 sec latency 324.086 ms 2023-11-27T21:03:04.988 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8947 0.10 MB/sec execute 283 sec latency 329.829 ms 2023-11-27T21:03:05.071 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:03:05.074 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:03:05.988 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8967 0.10 MB/sec execute 284 sec latency 389.460 ms 2023-11-27T21:03:06.988 INFO:tasks.workunit.client.0.smithi088.stdout: 1 8978 0.10 MB/sec execute 285 sec latency 328.128 ms 2023-11-27T21:03:07.989 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9012 0.10 MB/sec execute 286 sec latency 346.324 ms 2023-11-27T21:03:08.988 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9029 0.10 MB/sec execute 287 sec latency 332.901 ms 2023-11-27T21:03:09.988 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9074 0.10 MB/sec execute 288 sec latency 335.384 ms 2023-11-27T21:03:10.988 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9098 0.10 MB/sec execute 289 sec latency 314.257 ms 2023-11-27T21:03:11.988 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9141 0.10 MB/sec execute 290 sec latency 338.553 ms 2023-11-27T21:03:12.427 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:09:36.336 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:03:12.436 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:09:36.345 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:03:12.448 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:09:36.333 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:03:12.450 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:09:36.335 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:03:12.450 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:09:36.336 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:03:12.452 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:09:36.338 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:03:12.493 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:09:36.402 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:03:12.499 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:09:36.385 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:03:12.499 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:09:36.385 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:03:12.989 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9157 0.10 MB/sec execute 291 sec latency 367.995 ms 2023-11-27T21:03:13.988 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9167 0.10 MB/sec execute 292 sec latency 334.841 ms 2023-11-27T21:03:14.988 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9187 0.10 MB/sec execute 293 sec latency 309.603 ms 2023-11-27T21:03:15.988 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9202 0.10 MB/sec execute 294 sec latency 368.098 ms 2023-11-27T21:03:16.989 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9247 0.10 MB/sec execute 295 sec latency 324.093 ms 2023-11-27T21:03:17.988 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9281 0.10 MB/sec execute 296 sec latency 336.628 ms 2023-11-27T21:03:18.989 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9290 0.10 MB/sec execute 297 sec latency 341.481 ms 2023-11-27T21:03:19.989 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9326 0.10 MB/sec execute 298 sec latency 180.203 ms 2023-11-27T21:03:20.989 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9397 0.10 MB/sec execute 299 sec latency 334.967 ms 2023-11-27T21:03:21.989 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9407 0.10 MB/sec execute 300 sec latency 336.627 ms 2023-11-27T21:03:22.989 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9428 0.10 MB/sec execute 301 sec latency 326.118 ms 2023-11-27T21:03:23.989 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9439 0.10 MB/sec execute 302 sec latency 316.586 ms 2023-11-27T21:03:24.989 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9457 0.10 MB/sec execute 303 sec latency 296.799 ms 2023-11-27T21:03:25.989 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9466 0.10 MB/sec execute 304 sec latency 387.052 ms 2023-11-27T21:03:26.989 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9472 0.10 MB/sec execute 305 sec latency 369.259 ms 2023-11-27T21:03:27.989 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9493 0.10 MB/sec execute 306 sec latency 321.822 ms 2023-11-27T21:03:28.989 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9504 0.10 MB/sec execute 307 sec latency 307.441 ms 2023-11-27T21:03:29.989 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9527 0.10 MB/sec execute 308 sec latency 292.749 ms 2023-11-27T21:03:30.989 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9536 0.10 MB/sec execute 309 sec latency 314.147 ms 2023-11-27T21:03:31.989 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9544 0.10 MB/sec execute 310 sec latency 371.961 ms 2023-11-27T21:03:32.989 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9558 0.10 MB/sec execute 311 sec latency 206.208 ms 2023-11-27T21:03:33.989 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9589 0.10 MB/sec execute 312 sec latency 346.712 ms 2023-11-27T21:03:34.989 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9598 0.10 MB/sec execute 313 sec latency 306.581 ms 2023-11-27T21:03:35.137 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:03:35.139 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:03:35.989 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9651 0.10 MB/sec execute 314 sec latency 384.026 ms 2023-11-27T21:03:36.989 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9661 0.10 MB/sec execute 315 sec latency 364.148 ms 2023-11-27T21:03:37.989 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9679 0.10 MB/sec execute 316 sec latency 349.689 ms 2023-11-27T21:03:38.989 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9685 0.10 MB/sec execute 317 sec latency 318.170 ms 2023-11-27T21:03:39.990 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9702 0.10 MB/sec execute 318 sec latency 245.491 ms 2023-11-27T21:03:40.990 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9717 0.10 MB/sec execute 319 sec latency 311.323 ms 2023-11-27T21:03:41.990 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9723 0.10 MB/sec execute 320 sec latency 392.775 ms 2023-11-27T21:03:42.990 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9820 0.11 MB/sec execute 321 sec latency 338.294 ms 2023-11-27T21:03:43.990 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9860 0.11 MB/sec execute 322 sec latency 332.412 ms 2023-11-27T21:03:44.990 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9876 0.11 MB/sec execute 323 sec latency 307.713 ms 2023-11-27T21:03:45.990 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9971 0.11 MB/sec execute 324 sec latency 299.536 ms 2023-11-27T21:03:46.990 INFO:tasks.workunit.client.0.smithi088.stdout: 1 9995 0.11 MB/sec execute 325 sec latency 399.679 ms 2023-11-27T21:03:47.990 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10017 0.11 MB/sec execute 326 sec latency 217.941 ms 2023-11-27T21:03:48.990 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10037 0.11 MB/sec execute 327 sec latency 183.986 ms 2023-11-27T21:03:49.990 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10070 0.11 MB/sec execute 328 sec latency 330.234 ms 2023-11-27T21:03:50.990 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10083 0.11 MB/sec execute 329 sec latency 351.251 ms 2023-11-27T21:03:51.990 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10095 0.11 MB/sec execute 330 sec latency 312.903 ms 2023-11-27T21:03:52.990 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10116 0.11 MB/sec execute 331 sec latency 195.510 ms 2023-11-27T21:03:53.990 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10130 0.11 MB/sec execute 332 sec latency 229.226 ms 2023-11-27T21:03:54.990 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10275 0.11 MB/sec execute 333 sec latency 316.152 ms 2023-11-27T21:03:55.990 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10298 0.11 MB/sec execute 334 sec latency 323.068 ms 2023-11-27T21:03:56.990 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10331 0.11 MB/sec execute 335 sec latency 197.840 ms 2023-11-27T21:03:57.990 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10371 0.11 MB/sec execute 336 sec latency 328.962 ms 2023-11-27T21:03:58.990 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10381 0.11 MB/sec execute 337 sec latency 330.713 ms 2023-11-27T21:03:59.990 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10385 0.11 MB/sec execute 338 sec latency 327.341 ms 2023-11-27T21:04:00.990 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10390 0.11 MB/sec execute 339 sec latency 373.317 ms 2023-11-27T21:04:01.991 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10393 0.11 MB/sec execute 340 sec latency 374.603 ms 2023-11-27T21:04:02.991 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10398 0.11 MB/sec execute 341 sec latency 327.204 ms 2023-11-27T21:04:03.991 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10406 0.11 MB/sec execute 342 sec latency 333.843 ms 2023-11-27T21:04:04.991 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10409 0.11 MB/sec execute 343 sec latency 309.996 ms 2023-11-27T21:04:05.267 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:04:05.270 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:04:05.991 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10412 0.11 MB/sec execute 344 sec latency 386.753 ms 2023-11-27T21:04:06.991 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10415 0.11 MB/sec execute 345 sec latency 437.719 ms 2023-11-27T21:04:07.991 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10419 0.11 MB/sec execute 346 sec latency 326.939 ms 2023-11-27T21:04:08.991 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10423 0.11 MB/sec execute 347 sec latency 346.514 ms 2023-11-27T21:04:09.991 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10426 0.11 MB/sec execute 348 sec latency 345.712 ms 2023-11-27T21:04:10.991 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10430 0.11 MB/sec execute 349 sec latency 364.873 ms 2023-11-27T21:04:11.991 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10434 0.11 MB/sec execute 350 sec latency 352.463 ms 2023-11-27T21:04:12.991 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10440 0.11 MB/sec execute 351 sec latency 336.363 ms 2023-11-27T21:04:13.991 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10460 0.11 MB/sec execute 352 sec latency 183.189 ms 2023-11-27T21:04:14.991 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10475 0.11 MB/sec execute 353 sec latency 198.298 ms 2023-11-27T21:04:15.991 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10490 0.11 MB/sec execute 354 sec latency 278.412 ms 2023-11-27T21:04:16.991 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10496 0.11 MB/sec execute 355 sec latency 381.348 ms 2023-11-27T21:04:17.991 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10611 0.12 MB/sec execute 356 sec latency 312.570 ms 2023-11-27T21:04:18.991 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10627 0.12 MB/sec execute 357 sec latency 269.470 ms 2023-11-27T21:04:19.991 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10649 0.12 MB/sec execute 358 sec latency 314.156 ms 2023-11-27T21:04:24.691 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10659 0.12 MB/sec execute 359 sec latency 367.814 ms 2023-11-27T21:04:24.692 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10680 0.11 MB/sec execute 360 sec latency 340.028 ms 2023-11-27T21:04:24.692 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10725 0.12 MB/sec execute 361 sec latency 311.190 ms 2023-11-27T21:04:24.692 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10736 0.11 MB/sec execute 362 sec latency 321.533 ms 2023-11-27T21:04:24.991 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10763 0.11 MB/sec execute 363 sec latency 127.039 ms 2023-11-27T21:04:25.991 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10776 0.11 MB/sec execute 364 sec latency 297.901 ms 2023-11-27T21:04:26.992 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10788 0.11 MB/sec execute 365 sec latency 371.426 ms 2023-11-27T21:04:27.991 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10810 0.11 MB/sec execute 366 sec latency 187.674 ms 2023-11-27T21:04:28.992 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10850 0.12 MB/sec execute 367 sec latency 325.035 ms 2023-11-27T21:04:29.992 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10860 0.12 MB/sec execute 368 sec latency 536.149 ms 2023-11-27T21:04:30.992 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10870 0.12 MB/sec execute 369 sec latency 196.939 ms 2023-11-27T21:04:31.992 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10879 0.12 MB/sec execute 370 sec latency 264.402 ms 2023-11-27T21:04:32.992 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10887 0.11 MB/sec execute 371 sec latency 263.875 ms 2023-11-27T21:04:33.993 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10895 0.11 MB/sec execute 372 sec latency 261.420 ms 2023-11-27T21:04:34.992 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10909 0.11 MB/sec execute 373 sec latency 186.804 ms 2023-11-27T21:04:35.397 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:04:35.400 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:04:35.992 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10918 0.11 MB/sec execute 374 sec latency 200.769 ms 2023-11-27T21:04:36.992 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10930 0.11 MB/sec execute 375 sec latency 225.576 ms 2023-11-27T21:04:37.992 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10942 0.11 MB/sec execute 376 sec latency 179.946 ms 2023-11-27T21:04:38.992 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10956 0.11 MB/sec execute 377 sec latency 183.811 ms 2023-11-27T21:04:39.992 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10964 0.11 MB/sec execute 378 sec latency 310.066 ms 2023-11-27T21:04:40.992 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10974 0.11 MB/sec execute 379 sec latency 331.426 ms 2023-11-27T21:04:41.992 INFO:tasks.workunit.client.0.smithi088.stdout: 1 10987 0.11 MB/sec execute 380 sec latency 338.896 ms 2023-11-27T21:04:42.992 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11004 0.11 MB/sec execute 381 sec latency 319.081 ms 2023-11-27T21:04:43.992 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11016 0.11 MB/sec execute 382 sec latency 329.305 ms 2023-11-27T21:04:44.992 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11026 0.11 MB/sec execute 383 sec latency 236.527 ms 2023-11-27T21:04:45.992 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11033 0.11 MB/sec execute 384 sec latency 287.136 ms 2023-11-27T21:04:46.993 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11041 0.11 MB/sec execute 385 sec latency 277.309 ms 2023-11-27T21:04:47.992 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11053 0.11 MB/sec execute 386 sec latency 222.176 ms 2023-11-27T21:04:48.993 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11065 0.11 MB/sec execute 387 sec latency 184.890 ms 2023-11-27T21:04:49.993 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11077 0.11 MB/sec execute 388 sec latency 185.225 ms 2023-11-27T21:04:50.993 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11089 0.11 MB/sec execute 389 sec latency 189.882 ms 2023-11-27T21:04:51.993 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11102 0.11 MB/sec execute 390 sec latency 252.780 ms 2023-11-27T21:04:52.993 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11112 0.11 MB/sec execute 391 sec latency 175.567 ms 2023-11-27T21:04:53.993 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11120 0.11 MB/sec execute 392 sec latency 326.437 ms 2023-11-27T21:04:54.993 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11127 0.11 MB/sec execute 393 sec latency 325.058 ms 2023-11-27T21:04:55.993 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11148 0.11 MB/sec execute 394 sec latency 384.042 ms 2023-11-27T21:04:56.993 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11161 0.11 MB/sec execute 395 sec latency 336.070 ms 2023-11-27T21:04:57.993 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11181 0.11 MB/sec execute 396 sec latency 329.891 ms 2023-11-27T21:04:58.993 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11196 0.11 MB/sec execute 397 sec latency 143.625 ms 2023-11-27T21:04:59.993 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11207 0.11 MB/sec execute 398 sec latency 149.008 ms 2023-11-27T21:05:00.993 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11224 0.11 MB/sec execute 399 sec latency 160.053 ms 2023-11-27T21:05:01.993 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11235 0.11 MB/sec execute 400 sec latency 174.202 ms 2023-11-27T21:05:02.993 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11247 0.11 MB/sec execute 401 sec latency 176.253 ms 2023-11-27T21:05:03.993 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11260 0.11 MB/sec execute 402 sec latency 167.553 ms 2023-11-27T21:05:04.993 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11269 0.11 MB/sec execute 403 sec latency 338.310 ms 2023-11-27T21:05:05.721 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:05:05.725 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:05:05.993 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11300 0.11 MB/sec execute 404 sec latency 555.864 ms 2023-11-27T21:05:06.993 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11313 0.11 MB/sec execute 405 sec latency 334.154 ms 2023-11-27T21:05:07.993 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11341 0.11 MB/sec execute 406 sec latency 303.364 ms 2023-11-27T21:05:08.994 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11361 0.11 MB/sec execute 407 sec latency 330.706 ms 2023-11-27T21:05:09.994 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11390 0.11 MB/sec execute 408 sec latency 184.315 ms 2023-11-27T21:05:10.994 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11406 0.11 MB/sec execute 409 sec latency 586.874 ms 2023-11-27T21:05:11.994 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11436 0.11 MB/sec execute 410 sec latency 444.536 ms 2023-11-27T21:05:12.994 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11471 0.11 MB/sec execute 411 sec latency 186.625 ms 2023-11-27T21:05:13.994 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11475 0.11 MB/sec execute 412 sec latency 333.469 ms 2023-11-27T21:05:14.994 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11512 0.11 MB/sec execute 413 sec latency 314.310 ms 2023-11-27T21:05:15.994 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11521 0.11 MB/sec execute 414 sec latency 323.081 ms 2023-11-27T21:05:16.994 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11547 0.11 MB/sec execute 415 sec latency 336.787 ms 2023-11-27T21:05:17.994 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11563 0.11 MB/sec execute 416 sec latency 191.341 ms 2023-11-27T21:05:18.994 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11587 0.11 MB/sec execute 417 sec latency 315.761 ms 2023-11-27T21:05:19.994 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11595 0.10 MB/sec execute 418 sec latency 307.291 ms 2023-11-27T21:05:20.994 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11622 0.10 MB/sec execute 419 sec latency 321.328 ms 2023-11-27T21:05:21.994 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11644 0.10 MB/sec execute 420 sec latency 206.454 ms 2023-11-27T21:05:22.994 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11685 0.11 MB/sec execute 421 sec latency 332.629 ms 2023-11-27T21:05:23.994 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11703 0.11 MB/sec execute 422 sec latency 328.744 ms 2023-11-27T21:05:24.994 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11708 0.11 MB/sec execute 423 sec latency 326.911 ms 2023-11-27T21:05:25.994 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11741 0.11 MB/sec execute 424 sec latency 157.019 ms 2023-11-27T21:05:26.994 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11757 0.11 MB/sec execute 425 sec latency 326.664 ms 2023-11-27T21:05:27.994 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11779 0.11 MB/sec execute 426 sec latency 334.135 ms 2023-11-27T21:05:28.994 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11805 0.11 MB/sec execute 427 sec latency 201.402 ms 2023-11-27T21:05:29.994 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11825 0.11 MB/sec execute 428 sec latency 317.900 ms 2023-11-27T21:05:30.994 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11829 0.10 MB/sec execute 429 sec latency 432.598 ms 2023-11-27T21:05:31.994 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11856 0.10 MB/sec execute 430 sec latency 188.702 ms 2023-11-27T21:05:32.994 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11871 0.10 MB/sec execute 431 sec latency 333.630 ms 2023-11-27T21:05:33.995 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11901 0.10 MB/sec execute 432 sec latency 215.714 ms 2023-11-27T21:05:34.995 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11926 0.10 MB/sec execute 433 sec latency 294.260 ms 2023-11-27T21:05:35.778 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:05:35.780 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:05:35.995 INFO:tasks.workunit.client.0.smithi088.stdout: 1 11936 0.10 MB/sec execute 434 sec latency 349.854 ms 2023-11-27T21:05:36.995 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12032 0.11 MB/sec execute 435 sec latency 339.810 ms 2023-11-27T21:05:37.995 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12037 0.11 MB/sec execute 436 sec latency 356.503 ms 2023-11-27T21:05:38.995 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12053 0.11 MB/sec execute 437 sec latency 328.011 ms 2023-11-27T21:05:39.995 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12074 0.11 MB/sec execute 438 sec latency 325.184 ms 2023-11-27T21:05:40.995 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12102 0.11 MB/sec execute 439 sec latency 151.320 ms 2023-11-27T21:05:41.995 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12121 0.11 MB/sec execute 440 sec latency 312.565 ms 2023-11-27T21:05:42.995 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12142 0.11 MB/sec execute 441 sec latency 344.259 ms 2023-11-27T21:05:43.995 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12157 0.11 MB/sec execute 442 sec latency 314.802 ms 2023-11-27T21:05:44.995 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12182 0.11 MB/sec execute 443 sec latency 156.109 ms 2023-11-27T21:05:45.995 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12208 0.11 MB/sec execute 444 sec latency 389.826 ms 2023-11-27T21:05:46.995 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12235 0.11 MB/sec execute 445 sec latency 308.640 ms 2023-11-27T21:05:47.995 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12258 0.11 MB/sec execute 446 sec latency 324.167 ms 2023-11-27T21:05:48.995 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12271 0.11 MB/sec execute 447 sec latency 328.170 ms 2023-11-27T21:05:49.995 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12296 0.11 MB/sec execute 448 sec latency 321.897 ms 2023-11-27T21:05:50.995 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12310 0.11 MB/sec execute 449 sec latency 394.586 ms 2023-11-27T21:05:51.995 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12342 0.11 MB/sec execute 450 sec latency 240.504 ms 2023-11-27T21:05:52.995 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12362 0.11 MB/sec execute 451 sec latency 343.001 ms 2023-11-27T21:05:53.995 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12424 0.11 MB/sec execute 452 sec latency 321.481 ms 2023-11-27T21:05:54.995 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12457 0.11 MB/sec execute 453 sec latency 316.646 ms 2023-11-27T21:05:55.995 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12477 0.11 MB/sec execute 454 sec latency 398.728 ms 2023-11-27T21:05:56.995 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12493 0.11 MB/sec execute 455 sec latency 314.949 ms 2023-11-27T21:05:57.995 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12514 0.11 MB/sec execute 456 sec latency 318.245 ms 2023-11-27T21:05:58.996 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12527 0.11 MB/sec execute 457 sec latency 309.038 ms 2023-11-27T21:05:59.996 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12561 0.11 MB/sec execute 458 sec latency 355.641 ms 2023-11-27T21:06:00.996 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12578 0.11 MB/sec execute 459 sec latency 320.958 ms 2023-11-27T21:06:01.996 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12620 0.11 MB/sec execute 460 sec latency 427.803 ms 2023-11-27T21:06:02.996 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12647 0.11 MB/sec execute 461 sec latency 300.469 ms 2023-11-27T21:06:03.996 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12690 0.11 MB/sec execute 462 sec latency 302.250 ms 2023-11-27T21:06:04.996 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12707 0.11 MB/sec execute 463 sec latency 334.175 ms 2023-11-27T21:06:05.925 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:06:05.928 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:06:05.996 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12716 0.10 MB/sec execute 464 sec latency 327.150 ms 2023-11-27T21:06:06.996 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12743 0.10 MB/sec execute 465 sec latency 340.965 ms 2023-11-27T21:06:07.997 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12759 0.10 MB/sec execute 466 sec latency 325.904 ms 2023-11-27T21:06:08.996 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12801 0.10 MB/sec execute 467 sec latency 315.910 ms 2023-11-27T21:06:09.996 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12830 0.10 MB/sec execute 468 sec latency 342.738 ms 2023-11-27T21:06:10.996 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12839 0.10 MB/sec execute 469 sec latency 340.656 ms 2023-11-27T21:06:11.996 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12875 0.10 MB/sec execute 470 sec latency 190.885 ms 2023-11-27T21:06:12.996 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12947 0.11 MB/sec execute 471 sec latency 325.789 ms 2023-11-27T21:06:13.996 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12957 0.11 MB/sec execute 472 sec latency 350.505 ms 2023-11-27T21:06:14.996 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12978 0.11 MB/sec execute 473 sec latency 376.736 ms 2023-11-27T21:06:15.996 INFO:tasks.workunit.client.0.smithi088.stdout: 1 12989 0.11 MB/sec execute 474 sec latency 329.120 ms 2023-11-27T21:06:16.996 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13007 0.11 MB/sec execute 475 sec latency 361.139 ms 2023-11-27T21:06:17.996 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13016 0.10 MB/sec execute 476 sec latency 332.728 ms 2023-11-27T21:06:18.996 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13025 0.10 MB/sec execute 477 sec latency 369.107 ms 2023-11-27T21:06:19.996 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13045 0.10 MB/sec execute 478 sec latency 323.445 ms 2023-11-27T21:06:20.996 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13054 0.10 MB/sec execute 479 sec latency 333.130 ms 2023-11-27T21:06:21.996 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13077 0.10 MB/sec execute 480 sec latency 299.543 ms 2023-11-27T21:06:22.996 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13086 0.10 MB/sec execute 481 sec latency 311.748 ms 2023-11-27T21:06:23.996 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13101 0.10 MB/sec execute 482 sec latency 325.777 ms 2023-11-27T21:06:24.996 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13120 0.10 MB/sec execute 483 sec latency 198.979 ms 2023-11-27T21:06:25.997 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13143 0.10 MB/sec execute 484 sec latency 320.928 ms 2023-11-27T21:06:26.997 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13150 0.10 MB/sec execute 485 sec latency 339.979 ms 2023-11-27T21:06:27.997 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13203 0.10 MB/sec execute 486 sec latency 335.869 ms 2023-11-27T21:06:28.997 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13212 0.10 MB/sec execute 487 sec latency 327.085 ms 2023-11-27T21:06:29.471 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:12:53.380 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:06:29.474 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:12:53.383 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:06:29.523 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:12:53.409 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:06:29.526 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:12:53.411 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:06:29.527 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:12:53.413 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:06:29.529 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:12:53.415 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:06:29.554 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:12:53.463 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:06:29.602 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:12:53.488 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:06:29.616 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:12:53.502 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:06:29.997 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13232 0.10 MB/sec execute 488 sec latency 320.684 ms 2023-11-27T21:06:30.997 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13243 0.10 MB/sec execute 489 sec latency 354.947 ms 2023-11-27T21:06:31.997 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13254 0.10 MB/sec execute 490 sec latency 333.266 ms 2023-11-27T21:06:32.997 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13267 0.10 MB/sec execute 491 sec latency 239.945 ms 2023-11-27T21:06:33.997 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13273 0.10 MB/sec execute 492 sec latency 338.596 ms 2023-11-27T21:06:34.997 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13400 0.11 MB/sec execute 493 sec latency 345.246 ms 2023-11-27T21:06:35.997 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13413 0.11 MB/sec execute 494 sec latency 329.269 ms 2023-11-27T21:06:36.081 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:06:36.084 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:06:36.997 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13431 0.11 MB/sec execute 495 sec latency 181.162 ms 2023-11-27T21:06:37.997 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13529 0.11 MB/sec execute 496 sec latency 330.635 ms 2023-11-27T21:06:38.997 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13552 0.11 MB/sec execute 497 sec latency 185.762 ms 2023-11-27T21:06:39.997 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13581 0.11 MB/sec execute 498 sec latency 211.288 ms 2023-11-27T21:06:40.997 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13616 0.11 MB/sec execute 499 sec latency 420.433 ms 2023-11-27T21:06:41.997 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13624 0.11 MB/sec execute 500 sec latency 425.311 ms 2023-11-27T21:06:42.997 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13640 0.11 MB/sec execute 501 sec latency 319.058 ms 2023-11-27T21:06:43.997 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13658 0.11 MB/sec execute 502 sec latency 312.460 ms 2023-11-27T21:06:44.997 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13674 0.11 MB/sec execute 503 sec latency 187.567 ms 2023-11-27T21:06:45.997 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13819 0.11 MB/sec execute 504 sec latency 325.027 ms 2023-11-27T21:06:46.997 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13838 0.11 MB/sec execute 505 sec latency 180.605 ms 2023-11-27T21:06:47.997 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13859 0.11 MB/sec execute 506 sec latency 331.330 ms 2023-11-27T21:06:48.997 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13917 0.11 MB/sec execute 507 sec latency 319.417 ms 2023-11-27T21:06:49.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13929 0.11 MB/sec execute 508 sec latency 352.200 ms 2023-11-27T21:06:50.997 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13932 0.11 MB/sec execute 509 sec latency 390.929 ms 2023-11-27T21:06:51.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13936 0.11 MB/sec execute 510 sec latency 438.415 ms 2023-11-27T21:06:52.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13941 0.11 MB/sec execute 511 sec latency 326.469 ms 2023-11-27T21:06:53.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13944 0.11 MB/sec execute 512 sec latency 324.184 ms 2023-11-27T21:06:54.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13952 0.11 MB/sec execute 513 sec latency 340.396 ms 2023-11-27T21:06:55.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13957 0.11 MB/sec execute 514 sec latency 360.953 ms 2023-11-27T21:06:56.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13960 0.11 MB/sec execute 515 sec latency 338.753 ms 2023-11-27T21:06:57.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13963 0.11 MB/sec execute 516 sec latency 330.225 ms 2023-11-27T21:06:58.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13968 0.11 MB/sec execute 517 sec latency 320.561 ms 2023-11-27T21:06:59.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13972 0.11 MB/sec execute 518 sec latency 336.941 ms 2023-11-27T21:07:00.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13974 0.11 MB/sec execute 519 sec latency 396.625 ms 2023-11-27T21:07:01.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13979 0.11 MB/sec execute 520 sec latency 383.210 ms 2023-11-27T21:07:02.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13982 0.11 MB/sec execute 521 sec latency 317.799 ms 2023-11-27T21:07:03.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 13986 0.11 MB/sec execute 522 sec latency 324.575 ms 2023-11-27T21:07:04.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14002 0.11 MB/sec execute 523 sec latency 329.665 ms 2023-11-27T21:07:05.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14021 0.11 MB/sec execute 524 sec latency 201.051 ms 2023-11-27T21:07:06.211 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:07:06.214 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:07:06.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14040 0.11 MB/sec execute 525 sec latency 188.617 ms 2023-11-27T21:07:07.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14044 0.11 MB/sec execute 526 sec latency 340.940 ms 2023-11-27T21:07:08.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14151 0.11 MB/sec execute 527 sec latency 334.939 ms 2023-11-27T21:07:09.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14177 0.11 MB/sec execute 528 sec latency 180.604 ms 2023-11-27T21:07:10.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14197 0.11 MB/sec execute 529 sec latency 306.122 ms 2023-11-27T21:07:11.998 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14207 0.11 MB/sec execute 530 sec latency 319.527 ms 2023-11-27T21:07:12.999 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14228 0.11 MB/sec execute 531 sec latency 317.079 ms 2023-11-27T21:07:14.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14269 0.11 MB/sec execute 532 sec latency 340.624 ms 2023-11-27T21:07:14.999 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14283 0.11 MB/sec execute 533 sec latency 285.352 ms 2023-11-27T21:07:15.999 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14307 0.11 MB/sec execute 534 sec latency 317.426 ms 2023-11-27T21:07:16.999 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14318 0.11 MB/sec execute 535 sec latency 336.909 ms 2023-11-27T21:07:17.999 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14336 0.11 MB/sec execute 536 sec latency 316.153 ms 2023-11-27T21:07:18.999 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14356 0.11 MB/sec execute 537 sec latency 230.355 ms 2023-11-27T21:07:19.999 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14399 0.11 MB/sec execute 538 sec latency 323.498 ms 2023-11-27T21:07:20.999 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14413 0.11 MB/sec execute 539 sec latency 277.370 ms 2023-11-27T21:07:21.999 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14424 0.11 MB/sec execute 540 sec latency 189.061 ms 2023-11-27T21:07:22.999 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14431 0.11 MB/sec execute 541 sec latency 241.282 ms 2023-11-27T21:07:23.999 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14440 0.11 MB/sec execute 542 sec latency 268.799 ms 2023-11-27T21:07:24.999 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14451 0.11 MB/sec execute 543 sec latency 277.310 ms 2023-11-27T21:07:25.999 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14463 0.11 MB/sec execute 544 sec latency 224.457 ms 2023-11-27T21:07:26.999 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14475 0.11 MB/sec execute 545 sec latency 185.577 ms 2023-11-27T21:07:27.999 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14487 0.11 MB/sec execute 546 sec latency 190.037 ms 2023-11-27T21:07:28.999 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14499 0.11 MB/sec execute 547 sec latency 187.852 ms 2023-11-27T21:07:29.999 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14509 0.11 MB/sec execute 548 sec latency 214.067 ms 2023-11-27T21:07:30.999 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14519 0.11 MB/sec execute 549 sec latency 320.249 ms 2023-11-27T21:07:31.999 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14536 0.11 MB/sec execute 550 sec latency 302.465 ms 2023-11-27T21:07:32.999 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14553 0.11 MB/sec execute 551 sec latency 322.468 ms 2023-11-27T21:07:33.999 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14565 0.11 MB/sec execute 552 sec latency 331.293 ms 2023-11-27T21:07:34.999 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14575 0.11 MB/sec execute 553 sec latency 229.647 ms 2023-11-27T21:07:35.999 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14582 0.11 MB/sec execute 554 sec latency 325.455 ms 2023-11-27T21:07:36.325 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:07:36.328 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:07:36.999 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14589 0.11 MB/sec execute 555 sec latency 290.753 ms 2023-11-27T21:07:37.999 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14600 0.11 MB/sec execute 556 sec latency 197.126 ms 2023-11-27T21:07:39.000 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14613 0.11 MB/sec execute 557 sec latency 177.269 ms 2023-11-27T21:07:40.000 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14625 0.11 MB/sec execute 558 sec latency 195.712 ms 2023-11-27T21:07:41.000 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14638 0.11 MB/sec execute 559 sec latency 191.101 ms 2023-11-27T21:07:42.000 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14649 0.11 MB/sec execute 560 sec latency 186.714 ms 2023-11-27T21:07:43.000 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14661 0.11 MB/sec execute 561 sec latency 174.981 ms 2023-11-27T21:07:44.000 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14669 0.11 MB/sec execute 562 sec latency 335.949 ms 2023-11-27T21:07:45.000 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14674 0.11 MB/sec execute 563 sec latency 323.313 ms 2023-11-27T21:07:46.000 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14694 0.11 MB/sec execute 564 sec latency 383.369 ms 2023-11-27T21:07:47.000 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14705 0.11 MB/sec execute 565 sec latency 460.281 ms 2023-11-27T21:07:48.000 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14723 0.11 MB/sec execute 566 sec latency 311.112 ms 2023-11-27T21:07:49.000 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14740 0.11 MB/sec execute 567 sec latency 152.106 ms 2023-11-27T21:07:50.000 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14752 0.11 MB/sec execute 568 sec latency 153.451 ms 2023-11-27T21:07:51.000 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14766 0.11 MB/sec execute 569 sec latency 159.197 ms 2023-11-27T21:07:52.000 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14780 0.11 MB/sec execute 570 sec latency 151.527 ms 2023-11-27T21:07:53.000 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14794 0.11 MB/sec execute 571 sec latency 165.424 ms 2023-11-27T21:07:54.000 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14807 0.11 MB/sec execute 572 sec latency 150.199 ms 2023-11-27T21:07:55.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14817 0.11 MB/sec execute 573 sec latency 317.492 ms 2023-11-27T21:07:56.000 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14852 0.11 MB/sec execute 574 sec latency 531.045 ms 2023-11-27T21:07:57.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14860 0.11 MB/sec execute 575 sec latency 426.495 ms 2023-11-27T21:07:58.000 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14888 0.11 MB/sec execute 576 sec latency 325.677 ms 2023-11-27T21:07:59.000 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14908 0.11 MB/sec execute 577 sec latency 323.773 ms 2023-11-27T21:08:00.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14937 0.11 MB/sec execute 578 sec latency 198.551 ms 2023-11-27T21:08:01.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14953 0.11 MB/sec execute 579 sec latency 578.003 ms 2023-11-27T21:08:02.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 14985 0.11 MB/sec execute 580 sec latency 321.551 ms 2023-11-27T21:08:03.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 15019 0.11 MB/sec execute 581 sec latency 205.052 ms 2023-11-27T21:08:04.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 15024 0.11 MB/sec execute 582 sec latency 334.397 ms 2023-11-27T21:08:05.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 15060 0.11 MB/sec execute 583 sec latency 324.830 ms 2023-11-27T21:08:06.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 15069 0.11 MB/sec execute 584 sec latency 337.963 ms 2023-11-27T21:08:06.396 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:08:06.399 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:08:07.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 15098 0.11 MB/sec execute 585 sec latency 305.851 ms 2023-11-27T21:08:08.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 15116 0.11 MB/sec execute 586 sec latency 209.198 ms 2023-11-27T21:08:09.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 15134 0.11 MB/sec execute 587 sec latency 308.803 ms 2023-11-27T21:08:10.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 15141 0.11 MB/sec execute 588 sec latency 325.994 ms 2023-11-27T21:08:11.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 15166 0.11 MB/sec execute 589 sec latency 356.711 ms 2023-11-27T21:08:12.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 15195 0.11 MB/sec execute 590 sec latency 197.397 ms 2023-11-27T21:08:13.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 15233 0.11 MB/sec execute 591 sec latency 317.976 ms 2023-11-27T21:08:14.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 15250 0.11 MB/sec execute 592 sec latency 324.989 ms 2023-11-27T21:08:15.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 15257 0.11 MB/sec execute 593 sec latency 329.335 ms 2023-11-27T21:08:16.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 15288 0.11 MB/sec execute 594 sec latency 174.448 ms 2023-11-27T21:08:17.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 15304 0.11 MB/sec execute 595 sec latency 354.398 ms 2023-11-27T21:08:18.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 15326 0.11 MB/sec execute 596 sec latency 327.150 ms 2023-11-27T21:08:19.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 15358 0.11 MB/sec execute 597 sec latency 197.460 ms 2023-11-27T21:08:20.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 15371 0.11 MB/sec execute 598 sec latency 338.606 ms 2023-11-27T21:08:21.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 15377 0.11 MB/sec execute 599 sec latency 448.118 ms 2023-11-27T21:08:22.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 cleanup 600 sec 2023-11-27T21:08:23.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 cleanup 601 sec 2023-11-27T21:08:24.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 cleanup 602 sec 2023-11-27T21:08:25.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 cleanup 603 sec 2023-11-27T21:08:26.001 INFO:tasks.workunit.client.0.smithi088.stdout: 1 cleanup 604 sec 2023-11-27T21:08:27.002 INFO:tasks.workunit.client.0.smithi088.stdout: 1 cleanup 605 sec 2023-11-27T21:08:28.002 INFO:tasks.workunit.client.0.smithi088.stdout: 1 cleanup 606 sec 2023-11-27T21:08:29.002 INFO:tasks.workunit.client.0.smithi088.stdout: 1 cleanup 607 sec 2023-11-27T21:08:30.002 INFO:tasks.workunit.client.0.smithi088.stdout: 1 cleanup 608 sec 2023-11-27T21:08:31.002 INFO:tasks.workunit.client.0.smithi088.stdout: 1 cleanup 609 sec 2023-11-27T21:08:32.002 INFO:tasks.workunit.client.0.smithi088.stdout: 1 cleanup 610 sec 2023-11-27T21:08:33.002 INFO:tasks.workunit.client.0.smithi088.stdout: 1 cleanup 611 sec 2023-11-27T21:08:34.002 INFO:tasks.workunit.client.0.smithi088.stdout: 1 cleanup 612 sec 2023-11-27T21:08:35.002 INFO:tasks.workunit.client.0.smithi088.stdout: 1 cleanup 613 sec 2023-11-27T21:08:35.214 INFO:tasks.workunit.client.0.smithi088.stdout: 0 cleanup 613 sec 2023-11-27T21:08:35.214 INFO:tasks.workunit.client.0.smithi088.stdout: 2023-11-27T21:08:35.214 INFO:tasks.workunit.client.0.smithi088.stdout: Operation Count AvgLat MaxLat 2023-11-27T21:08:35.215 INFO:tasks.workunit.client.0.smithi088.stdout: ---------------------------------------- 2023-11-27T21:08:35.215 INFO:tasks.workunit.client.0.smithi088.stdout: NTCreateX 2135 78.663 536.144 2023-11-27T21:08:35.215 INFO:tasks.workunit.client.0.smithi088.stdout: Close 1546 1.125 11.654 2023-11-27T21:08:35.215 INFO:tasks.workunit.client.0.smithi088.stdout: Rename 90 174.313 240.497 2023-11-27T21:08:35.215 INFO:tasks.workunit.client.0.smithi088.stdout: Unlink 460 99.175 253.473 2023-11-27T21:08:35.215 INFO:tasks.workunit.client.0.smithi088.stdout: Qpathinfo 1906 58.985 306.890 2023-11-27T21:08:35.216 INFO:tasks.workunit.client.0.smithi088.stdout: Qfileinfo 313 0.976 7.102 2023-11-27T21:08:35.216 INFO:tasks.workunit.client.0.smithi088.stdout: Qfsinfo 372 10.569 134.506 2023-11-27T21:08:35.216 INFO:tasks.workunit.client.0.smithi088.stdout: Sfileinfo 177 21.260 125.212 2023-11-27T21:08:35.216 INFO:tasks.workunit.client.0.smithi088.stdout: Find 756 318.978 586.869 2023-11-27T21:08:35.216 INFO:tasks.workunit.client.0.smithi088.stdout: WriteX 1030 3.237 38.175 2023-11-27T21:08:35.216 INFO:tasks.workunit.client.0.smithi088.stdout: ReadX 3167 0.024 2.343 2023-11-27T21:08:35.217 INFO:tasks.workunit.client.0.smithi088.stdout: LockX 6 18.839 30.332 2023-11-27T21:08:35.217 INFO:tasks.workunit.client.0.smithi088.stdout: UnlockX 6 17.459 25.742 2023-11-27T21:08:35.217 INFO:tasks.workunit.client.0.smithi088.stdout: Flush 157 26.551 53.147 2023-11-27T21:08:35.217 INFO:tasks.workunit.client.0.smithi088.stdout: 2023-11-27T21:08:35.217 INFO:tasks.workunit.client.0.smithi088.stdout:Throughput 0.107095 MB/sec 1 clients 1 procs max_latency=586.874 ms 2023-11-27T21:08:35.217 INFO:tasks.workunit.client.0.smithi088.stderr:+ dbench 10 2023-11-27T21:08:35.218 INFO:tasks.workunit.client.0.smithi088.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-11-27T21:08:35.218 INFO:tasks.workunit.client.0.smithi088.stdout: 2023-11-27T21:08:35.219 INFO:tasks.workunit.client.0.smithi088.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-11-27T21:08:35.219 INFO:tasks.workunit.client.0.smithi088.stdout:9 of 10 processes prepared for launch 0 sec 2023-11-27T21:08:35.315 INFO:tasks.workunit.client.0.smithi088.stdout:10 of 10 processes prepared for launch 0 sec 2023-11-27T21:08:35.315 INFO:tasks.workunit.client.0.smithi088.stdout:releasing clients 2023-11-27T21:08:36.316 INFO:tasks.workunit.client.0.smithi088.stdout: 0 3 0.00 MB/sec warmup 1 sec latency 999.940 ms 2023-11-27T21:08:36.520 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:08:36.523 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:08:37.315 INFO:tasks.workunit.client.0.smithi088.stdout: 0 4 0.00 MB/sec warmup 2 sec latency 1999.997 ms 2023-11-27T21:08:38.315 INFO:tasks.workunit.client.0.smithi088.stdout: 3 11 1.05 MB/sec warmup 3 sec latency 3000.051 ms 2023-11-27T21:08:39.315 INFO:tasks.workunit.client.0.smithi088.stdout: 3 19 1.57 MB/sec warmup 4 sec latency 672.110 ms 2023-11-27T21:08:40.315 INFO:tasks.workunit.client.0.smithi088.stdout: 3 27 1.89 MB/sec warmup 5 sec latency 768.985 ms 2023-11-27T21:08:41.315 INFO:tasks.workunit.client.0.smithi088.stdout: 8 40 2.57 MB/sec warmup 6 sec latency 972.574 ms 2023-11-27T21:08:42.315 INFO:tasks.workunit.client.0.smithi088.stdout: 10 55 3.31 MB/sec warmup 7 sec latency 1001.961 ms 2023-11-27T21:08:43.315 INFO:tasks.workunit.client.0.smithi088.stdout: 10 69 3.84 MB/sec warmup 8 sec latency 1225.247 ms 2023-11-27T21:08:44.315 INFO:tasks.workunit.client.0.smithi088.stdout: 10 82 4.11 MB/sec warmup 9 sec latency 1313.769 ms 2023-11-27T21:08:45.315 INFO:tasks.workunit.client.0.smithi088.stdout: 10 98 4.49 MB/sec warmup 10 sec latency 1341.484 ms 2023-11-27T21:08:46.315 INFO:tasks.workunit.client.0.smithi088.stdout: 10 111 4.65 MB/sec warmup 11 sec latency 993.224 ms 2023-11-27T21:08:47.315 INFO:tasks.workunit.client.0.smithi088.stdout: 10 118 4.54 MB/sec warmup 12 sec latency 1383.488 ms 2023-11-27T21:08:48.315 INFO:tasks.workunit.client.0.smithi088.stdout: 10 123 4.29 MB/sec warmup 13 sec latency 1415.339 ms 2023-11-27T21:08:49.315 INFO:tasks.workunit.client.0.smithi088.stdout: 10 127 4.06 MB/sec warmup 14 sec latency 2357.269 ms 2023-11-27T21:08:50.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 133 3.93 MB/sec warmup 15 sec latency 3357.329 ms 2023-11-27T21:08:51.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 138 3.78 MB/sec warmup 16 sec latency 4357.355 ms 2023-11-27T21:08:52.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 141 3.60 MB/sec warmup 17 sec latency 5357.380 ms 2023-11-27T21:08:53.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 146 3.48 MB/sec warmup 18 sec latency 5594.290 ms 2023-11-27T21:08:54.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 151 3.38 MB/sec warmup 19 sec latency 2692.405 ms 2023-11-27T21:08:55.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 160 3.34 MB/sec warmup 20 sec latency 1721.219 ms 2023-11-27T21:08:56.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 168 3.30 MB/sec warmup 21 sec latency 1800.146 ms 2023-11-27T21:08:57.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 175 3.25 MB/sec warmup 22 sec latency 1078.970 ms 2023-11-27T21:08:58.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 183 3.21 MB/sec warmup 23 sec latency 2056.340 ms 2023-11-27T21:08:59.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 192 3.19 MB/sec warmup 24 sec latency 938.978 ms 2023-11-27T21:09:00.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 201 3.18 MB/sec warmup 25 sec latency 962.365 ms 2023-11-27T21:09:01.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 209 3.16 MB/sec warmup 26 sec latency 862.974 ms 2023-11-27T21:09:02.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 217 3.12 MB/sec warmup 27 sec latency 864.273 ms 2023-11-27T21:09:03.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 226 3.12 MB/sec warmup 28 sec latency 826.109 ms 2023-11-27T21:09:04.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 234 3.09 MB/sec warmup 29 sec latency 761.352 ms 2023-11-27T21:09:05.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 244 3.08 MB/sec warmup 30 sec latency 863.034 ms 2023-11-27T21:09:06.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 253 3.10 MB/sec warmup 31 sec latency 880.757 ms 2023-11-27T21:09:06.660 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:09:06.663 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:09:07.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 261 3.08 MB/sec warmup 32 sec latency 882.070 ms 2023-11-27T21:09:08.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 269 3.06 MB/sec warmup 33 sec latency 1303.380 ms 2023-11-27T21:09:09.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 277 3.05 MB/sec warmup 34 sec latency 899.969 ms 2023-11-27T21:09:10.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 285 3.04 MB/sec warmup 35 sec latency 953.344 ms 2023-11-27T21:09:11.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 293 3.02 MB/sec warmup 36 sec latency 990.446 ms 2023-11-27T21:09:12.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 302 3.01 MB/sec warmup 37 sec latency 954.908 ms 2023-11-27T21:09:13.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 309 2.99 MB/sec warmup 38 sec latency 817.179 ms 2023-11-27T21:09:14.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 317 2.97 MB/sec warmup 39 sec latency 744.626 ms 2023-11-27T21:09:15.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 326 2.96 MB/sec warmup 40 sec latency 794.652 ms 2023-11-27T21:09:16.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 334 2.95 MB/sec warmup 41 sec latency 932.609 ms 2023-11-27T21:09:17.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 342 2.95 MB/sec warmup 42 sec latency 935.022 ms 2023-11-27T21:09:18.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 350 2.93 MB/sec warmup 43 sec latency 895.394 ms 2023-11-27T21:09:19.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 358 2.92 MB/sec warmup 44 sec latency 886.038 ms 2023-11-27T21:09:20.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 367 2.91 MB/sec warmup 45 sec latency 926.733 ms 2023-11-27T21:09:21.316 INFO:tasks.workunit.client.0.smithi088.stdout: 10 376 2.92 MB/sec warmup 46 sec latency 802.744 ms 2023-11-27T21:09:22.317 INFO:tasks.workunit.client.0.smithi088.stdout: 10 384 2.91 MB/sec warmup 47 sec latency 1092.992 ms 2023-11-27T21:09:23.317 INFO:tasks.workunit.client.0.smithi088.stdout: 10 393 2.91 MB/sec warmup 48 sec latency 899.045 ms 2023-11-27T21:09:24.317 INFO:tasks.workunit.client.0.smithi088.stdout: 10 401 2.91 MB/sec warmup 49 sec latency 907.320 ms 2023-11-27T21:09:25.321 INFO:tasks.workunit.client.0.smithi088.stdout: 10 409 2.90 MB/sec warmup 50 sec latency 990.397 ms 2023-11-27T21:09:26.317 INFO:tasks.workunit.client.0.smithi088.stdout: 10 417 2.89 MB/sec warmup 51 sec latency 895.911 ms 2023-11-27T21:09:27.317 INFO:tasks.workunit.client.0.smithi088.stdout: 10 426 2.89 MB/sec warmup 52 sec latency 1021.840 ms 2023-11-27T21:09:28.317 INFO:tasks.workunit.client.0.smithi088.stdout: 10 435 2.90 MB/sec warmup 53 sec latency 965.139 ms 2023-11-27T21:09:29.317 INFO:tasks.workunit.client.0.smithi088.stdout: 10 443 2.89 MB/sec warmup 54 sec latency 913.333 ms 2023-11-27T21:09:30.317 INFO:tasks.workunit.client.0.smithi088.stdout: 10 454 2.90 MB/sec warmup 55 sec latency 926.647 ms 2023-11-27T21:09:31.317 INFO:tasks.workunit.client.0.smithi088.stdout: 10 462 2.89 MB/sec warmup 56 sec latency 1000.793 ms 2023-11-27T21:09:32.317 INFO:tasks.workunit.client.0.smithi088.stdout: 10 469 2.88 MB/sec warmup 57 sec latency 1022.455 ms 2023-11-27T21:09:33.317 INFO:tasks.workunit.client.0.smithi088.stdout: 10 476 2.87 MB/sec warmup 58 sec latency 893.097 ms 2023-11-27T21:09:34.317 INFO:tasks.workunit.client.0.smithi088.stdout: 10 484 2.87 MB/sec warmup 59 sec latency 1399.971 ms 2023-11-27T21:09:35.317 INFO:tasks.workunit.client.0.smithi088.stdout: 10 491 2.85 MB/sec warmup 60 sec latency 946.207 ms 2023-11-27T21:09:36.317 INFO:tasks.workunit.client.0.smithi088.stdout: 10 499 2.84 MB/sec warmup 61 sec latency 1442.030 ms 2023-11-27T21:09:36.807 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:09:36.810 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:09:37.317 INFO:tasks.workunit.client.0.smithi088.stdout: 10 505 2.82 MB/sec warmup 62 sec latency 1055.924 ms 2023-11-27T21:09:38.317 INFO:tasks.workunit.client.0.smithi088.stdout: 10 511 2.80 MB/sec warmup 63 sec latency 1315.848 ms 2023-11-27T21:09:39.317 INFO:tasks.workunit.client.0.smithi088.stdout: 10 516 2.79 MB/sec warmup 64 sec latency 1285.508 ms 2023-11-27T21:09:40.317 INFO:tasks.workunit.client.0.smithi088.stdout: 10 525 2.79 MB/sec warmup 65 sec latency 1150.964 ms 2023-11-27T21:09:41.317 INFO:tasks.workunit.client.0.smithi088.stdout: 10 535 2.78 MB/sec warmup 66 sec latency 913.426 ms 2023-11-27T21:09:42.317 INFO:tasks.workunit.client.0.smithi088.stdout: 10 547 2.80 MB/sec warmup 67 sec latency 1026.903 ms 2023-11-27T21:09:43.317 INFO:tasks.workunit.client.0.smithi088.stdout: 10 561 2.85 MB/sec warmup 68 sec latency 1027.645 ms 2023-11-27T21:09:44.317 INFO:tasks.workunit.client.0.smithi088.stdout: 10 579 2.87 MB/sec warmup 69 sec latency 1131.525 ms 2023-11-27T21:09:45.317 INFO:tasks.workunit.client.0.smithi088.stdout: 10 604 2.94 MB/sec warmup 70 sec latency 741.615 ms 2023-11-27T21:09:46.317 INFO:tasks.workunit.client.0.smithi088.stdout: 10 613 2.96 MB/sec warmup 71 sec latency 1199.033 ms 2023-11-27T21:09:47.317 INFO:tasks.workunit.client.0.smithi088.stdout: 10 615 2.92 MB/sec warmup 72 sec latency 1328.082 ms 2023-11-27T21:09:48.317 INFO:tasks.workunit.client.0.smithi088.stdout: 10 624 2.88 MB/sec warmup 73 sec latency 1361.185 ms 2023-11-27T21:09:49.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 627 2.84 MB/sec warmup 74 sec latency 1304.643 ms 2023-11-27T21:09:52.452 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:16:16.255 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:09:52.452 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:16:16.275 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:09:52.452 INFO:tasks.workunit.client.0.smithi088.stdout: 10 635 2.80 MB/sec warmup 75 sec latency 1278.903 ms 2023-11-27T21:09:52.452 INFO:tasks.workunit.client.0.smithi088.stdout: 10 647 2.77 MB/sec warmup 76 sec latency 1340.391 ms 2023-11-27T21:09:52.453 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:16:16.223 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:09:52.453 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:16:16.324 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:09:52.453 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:16:16.325 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:09:52.453 INFO:tasks.workunit.client.0.smithi088.stdout: 10 653 2.74 MB/sec warmup 77 sec latency 1129.312 ms 2023-11-27T21:09:52.453 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:16:16.280 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:09:52.474 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:16:16.382 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:09:52.477 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:16:16.363 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:09:52.525 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:16:16.410 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:09:53.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 656 2.70 MB/sec warmup 78 sec latency 1296.596 ms 2023-11-27T21:09:54.317 INFO:tasks.workunit.client.0.smithi088.stdout: 10 659 2.67 MB/sec warmup 79 sec latency 1286.545 ms 2023-11-27T21:09:55.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 664 2.64 MB/sec warmup 80 sec latency 1328.220 ms 2023-11-27T21:09:56.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 668 2.61 MB/sec warmup 81 sec latency 1224.594 ms 2023-11-27T21:09:57.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 672 2.58 MB/sec warmup 82 sec latency 1724.418 ms 2023-11-27T21:09:58.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 680 2.55 MB/sec warmup 83 sec latency 2174.108 ms 2023-11-27T21:09:59.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 687 2.52 MB/sec warmup 84 sec latency 1216.464 ms 2023-11-27T21:10:00.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 694 2.49 MB/sec warmup 85 sec latency 1109.634 ms 2023-11-27T21:10:01.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 700 2.47 MB/sec warmup 86 sec latency 1145.755 ms 2023-11-27T21:10:02.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 705 2.44 MB/sec warmup 87 sec latency 1107.335 ms 2023-11-27T21:10:03.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 713 2.41 MB/sec warmup 88 sec latency 1129.256 ms 2023-11-27T21:10:04.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 720 2.39 MB/sec warmup 89 sec latency 768.668 ms 2023-11-27T21:10:05.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 727 2.36 MB/sec warmup 90 sec latency 900.164 ms 2023-11-27T21:10:06.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 734 2.34 MB/sec warmup 91 sec latency 1363.842 ms 2023-11-27T21:10:06.891 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:10:06.893 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:10:07.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 741 2.32 MB/sec warmup 92 sec latency 1155.754 ms 2023-11-27T21:10:08.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 748 2.29 MB/sec warmup 93 sec latency 1135.921 ms 2023-11-27T21:10:09.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 753 2.27 MB/sec warmup 94 sec latency 1207.860 ms 2023-11-27T21:10:10.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 758 2.25 MB/sec warmup 95 sec latency 1210.527 ms 2023-11-27T21:10:11.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 769 2.23 MB/sec warmup 96 sec latency 1379.278 ms 2023-11-27T21:10:12.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 776 2.20 MB/sec warmup 97 sec latency 1136.033 ms 2023-11-27T21:10:13.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 782 2.18 MB/sec warmup 98 sec latency 983.466 ms 2023-11-27T21:10:14.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 788 2.16 MB/sec warmup 99 sec latency 1059.198 ms 2023-11-27T21:10:15.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 797 2.14 MB/sec warmup 100 sec latency 819.350 ms 2023-11-27T21:10:16.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 802 2.12 MB/sec warmup 101 sec latency 1344.792 ms 2023-11-27T21:10:17.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 810 2.11 MB/sec warmup 102 sec latency 1053.724 ms 2023-11-27T21:10:18.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 815 2.09 MB/sec warmup 103 sec latency 1172.989 ms 2023-11-27T21:10:19.342 INFO:tasks.workunit.client.0.smithi088.stdout: 10 818 2.07 MB/sec warmup 104 sec latency 1210.291 ms 2023-11-27T21:10:20.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 822 2.05 MB/sec warmup 105 sec latency 1202.148 ms 2023-11-27T21:10:21.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 828 2.03 MB/sec warmup 106 sec latency 1330.166 ms 2023-11-27T21:10:22.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 830 2.01 MB/sec warmup 107 sec latency 1387.543 ms 2023-11-27T21:10:23.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 842 2.00 MB/sec warmup 108 sec latency 1278.043 ms 2023-11-27T21:10:24.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 846 1.98 MB/sec warmup 109 sec latency 1167.663 ms 2023-11-27T21:10:25.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 853 1.96 MB/sec warmup 110 sec latency 1320.148 ms 2023-11-27T21:10:26.318 INFO:tasks.workunit.client.0.smithi088.stdout: 10 859 1.94 MB/sec warmup 111 sec latency 1250.855 ms 2023-11-27T21:10:27.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 863 1.93 MB/sec warmup 112 sec latency 1334.396 ms 2023-11-27T21:10:28.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 864 1.91 MB/sec warmup 113 sec latency 1306.773 ms 2023-11-27T21:10:29.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 870 1.90 MB/sec warmup 114 sec latency 1365.968 ms 2023-11-27T21:10:30.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 877 1.88 MB/sec warmup 115 sec latency 1149.326 ms 2023-11-27T21:10:31.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 879 1.87 MB/sec warmup 116 sec latency 1393.545 ms 2023-11-27T21:10:32.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 886 1.85 MB/sec warmup 117 sec latency 1399.711 ms 2023-11-27T21:10:33.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 893 1.84 MB/sec warmup 118 sec latency 1136.893 ms 2023-11-27T21:10:34.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 899 1.82 MB/sec warmup 119 sec latency 1281.770 ms 2023-11-27T21:10:36.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 911 0.34 MB/sec execute 1 sec latency 1154.879 ms 2023-11-27T21:10:37.013 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:10:37.016 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:10:37.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 917 0.23 MB/sec execute 2 sec latency 930.815 ms 2023-11-27T21:10:38.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 921 0.20 MB/sec execute 3 sec latency 1100.617 ms 2023-11-27T21:10:39.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 926 0.18 MB/sec execute 4 sec latency 1128.132 ms 2023-11-27T21:10:40.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 931 0.17 MB/sec execute 5 sec latency 1185.154 ms 2023-11-27T21:10:41.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 933 0.14 MB/sec execute 6 sec latency 1188.965 ms 2023-11-27T21:10:42.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 936 0.18 MB/sec execute 7 sec latency 1333.873 ms 2023-11-27T21:10:43.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 941 0.24 MB/sec execute 8 sec latency 1170.810 ms 2023-11-27T21:10:44.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 944 0.22 MB/sec execute 9 sec latency 1364.141 ms 2023-11-27T21:10:45.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 948 0.20 MB/sec execute 10 sec latency 1183.260 ms 2023-11-27T21:10:46.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 951 0.18 MB/sec execute 11 sec latency 1377.849 ms 2023-11-27T21:10:47.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 958 0.18 MB/sec execute 12 sec latency 1330.883 ms 2023-11-27T21:10:48.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 963 0.17 MB/sec execute 13 sec latency 1074.118 ms 2023-11-27T21:10:49.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 968 0.16 MB/sec execute 14 sec latency 1263.098 ms 2023-11-27T21:10:50.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 972 0.16 MB/sec execute 15 sec latency 1194.541 ms 2023-11-27T21:10:51.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 982 0.20 MB/sec execute 16 sec latency 1239.916 ms 2023-11-27T21:10:52.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 988 0.22 MB/sec execute 17 sec latency 1174.790 ms 2023-11-27T21:10:53.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 993 0.22 MB/sec execute 18 sec latency 1007.014 ms 2023-11-27T21:10:54.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1000 0.26 MB/sec execute 19 sec latency 1112.879 ms 2023-11-27T21:10:55.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1012 0.35 MB/sec execute 20 sec latency 1195.560 ms 2023-11-27T21:10:56.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1018 0.38 MB/sec execute 21 sec latency 1112.309 ms 2023-11-27T21:10:57.319 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1021 0.37 MB/sec execute 22 sec latency 1158.251 ms 2023-11-27T21:10:58.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1028 0.41 MB/sec execute 23 sec latency 1309.445 ms 2023-11-27T21:10:58.721 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:17:22.630 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:10:58.724 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:17:22.634 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:10:58.763 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:17:22.672 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:10:58.792 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:17:22.677 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:10:58.795 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:17:22.681 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:10:58.795 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:17:22.681 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:10:58.821 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:17:22.706 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:10:58.848 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:17:22.733 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:10:58.866 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:17:22.751 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:10:59.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1034 0.43 MB/sec execute 24 sec latency 1195.841 ms 2023-11-27T21:11:00.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1040 0.44 MB/sec execute 25 sec latency 1149.713 ms 2023-11-27T21:11:01.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1044 0.42 MB/sec execute 26 sec latency 1183.880 ms 2023-11-27T21:11:02.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1046 0.41 MB/sec execute 27 sec latency 1435.676 ms 2023-11-27T21:11:03.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1051 0.40 MB/sec execute 28 sec latency 1330.429 ms 2023-11-27T21:11:04.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1057 0.42 MB/sec execute 29 sec latency 1347.696 ms 2023-11-27T21:11:05.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1063 0.40 MB/sec execute 30 sec latency 1195.117 ms 2023-11-27T21:11:06.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1066 0.39 MB/sec execute 31 sec latency 1198.421 ms 2023-11-27T21:11:07.086 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:11:07.088 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:11:07.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1069 0.38 MB/sec execute 32 sec latency 1351.646 ms 2023-11-27T21:11:08.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1077 0.37 MB/sec execute 33 sec latency 1102.835 ms 2023-11-27T21:11:09.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1082 0.36 MB/sec execute 34 sec latency 1057.993 ms 2023-11-27T21:11:10.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1087 0.35 MB/sec execute 35 sec latency 1068.777 ms 2023-11-27T21:11:11.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1091 0.35 MB/sec execute 36 sec latency 1540.515 ms 2023-11-27T21:11:12.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1097 0.34 MB/sec execute 37 sec latency 1274.730 ms 2023-11-27T21:11:13.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1102 0.33 MB/sec execute 38 sec latency 1011.406 ms 2023-11-27T21:11:14.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1106 0.32 MB/sec execute 39 sec latency 1294.444 ms 2023-11-27T21:11:15.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1113 0.32 MB/sec execute 40 sec latency 1143.077 ms 2023-11-27T21:11:16.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1117 0.31 MB/sec execute 41 sec latency 1237.944 ms 2023-11-27T21:11:17.321 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1124 0.30 MB/sec execute 42 sec latency 1403.044 ms 2023-11-27T21:11:18.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1130 0.30 MB/sec execute 43 sec latency 1024.113 ms 2023-11-27T21:11:19.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1134 0.29 MB/sec execute 44 sec latency 1050.315 ms 2023-11-27T21:11:20.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1142 0.29 MB/sec execute 45 sec latency 1010.738 ms 2023-11-27T21:11:21.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1146 0.28 MB/sec execute 46 sec latency 1026.568 ms 2023-11-27T21:11:22.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1152 0.28 MB/sec execute 47 sec latency 1164.561 ms 2023-11-27T21:11:23.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1156 0.27 MB/sec execute 48 sec latency 1074.804 ms 2023-11-27T21:11:24.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1161 0.27 MB/sec execute 49 sec latency 1198.192 ms 2023-11-27T21:11:25.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1167 0.26 MB/sec execute 50 sec latency 936.768 ms 2023-11-27T21:11:26.320 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1170 0.26 MB/sec execute 51 sec latency 1321.497 ms 2023-11-27T21:11:27.321 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1174 0.26 MB/sec execute 52 sec latency 1353.560 ms 2023-11-27T21:11:28.321 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1178 0.25 MB/sec execute 53 sec latency 1210.642 ms 2023-11-27T21:11:29.321 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1180 0.25 MB/sec execute 54 sec latency 1238.407 ms 2023-11-27T21:11:30.321 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1185 0.24 MB/sec execute 55 sec latency 1168.482 ms 2023-11-27T21:11:31.321 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1188 0.24 MB/sec execute 56 sec latency 1220.641 ms 2023-11-27T21:11:32.321 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1195 0.24 MB/sec execute 57 sec latency 1402.293 ms 2023-11-27T21:11:33.321 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1201 0.23 MB/sec execute 58 sec latency 1075.909 ms 2023-11-27T21:11:34.321 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1205 0.23 MB/sec execute 59 sec latency 1102.332 ms 2023-11-27T21:11:35.321 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1209 0.23 MB/sec execute 60 sec latency 1189.856 ms 2023-11-27T21:11:36.321 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1215 0.22 MB/sec execute 61 sec latency 1279.061 ms 2023-11-27T21:11:37.208 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:11:37.210 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:11:37.321 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1220 0.22 MB/sec execute 62 sec latency 1271.077 ms 2023-11-27T21:11:38.321 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1234 0.26 MB/sec execute 63 sec latency 1051.733 ms 2023-11-27T21:11:39.321 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1239 0.26 MB/sec execute 64 sec latency 1055.397 ms 2023-11-27T21:11:40.321 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1246 0.26 MB/sec execute 65 sec latency 877.371 ms 2023-11-27T21:11:41.321 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1251 0.25 MB/sec execute 66 sec latency 1110.659 ms 2023-11-27T21:11:42.321 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1255 0.25 MB/sec execute 67 sec latency 1025.663 ms 2023-11-27T21:11:43.321 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1259 0.25 MB/sec execute 68 sec latency 1248.151 ms 2023-11-27T21:11:44.321 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1265 0.25 MB/sec execute 69 sec latency 1128.699 ms 2023-11-27T21:11:45.321 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1274 0.26 MB/sec execute 70 sec latency 983.860 ms 2023-11-27T21:11:46.321 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1284 0.28 MB/sec execute 71 sec latency 1431.741 ms 2023-11-27T21:11:47.321 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1288 0.28 MB/sec execute 72 sec latency 1207.480 ms 2023-11-27T21:11:48.321 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1293 0.28 MB/sec execute 73 sec latency 1221.458 ms 2023-11-27T21:11:49.321 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1298 0.27 MB/sec execute 74 sec latency 1287.909 ms 2023-11-27T21:11:50.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1309 0.31 MB/sec execute 75 sec latency 1315.904 ms 2023-11-27T21:11:51.321 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1311 0.30 MB/sec execute 76 sec latency 1554.191 ms 2023-11-27T21:11:52.321 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1324 0.34 MB/sec execute 77 sec latency 1431.487 ms 2023-11-27T21:11:53.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1336 0.37 MB/sec execute 78 sec latency 1235.714 ms 2023-11-27T21:11:54.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1348 0.40 MB/sec execute 79 sec latency 1312.204 ms 2023-11-27T21:11:55.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1359 0.43 MB/sec execute 80 sec latency 1322.626 ms 2023-11-27T21:11:56.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1373 0.47 MB/sec execute 81 sec latency 1384.245 ms 2023-11-27T21:11:57.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1382 0.49 MB/sec execute 82 sec latency 1540.426 ms 2023-11-27T21:11:58.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1384 0.48 MB/sec execute 83 sec latency 1420.523 ms 2023-11-27T21:11:59.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1387 0.48 MB/sec execute 84 sec latency 1339.907 ms 2023-11-27T21:12:00.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1390 0.47 MB/sec execute 85 sec latency 1378.690 ms 2023-11-27T21:12:01.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1396 0.47 MB/sec execute 86 sec latency 1387.555 ms 2023-11-27T21:12:02.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1407 0.50 MB/sec execute 87 sec latency 1201.891 ms 2023-11-27T21:12:03.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1411 0.49 MB/sec execute 88 sec latency 1295.207 ms 2023-11-27T21:12:04.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1415 0.49 MB/sec execute 89 sec latency 1247.996 ms 2023-11-27T21:12:05.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1420 0.48 MB/sec execute 90 sec latency 1125.456 ms 2023-11-27T21:12:06.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1424 0.48 MB/sec execute 91 sec latency 1438.012 ms 2023-11-27T21:12:07.289 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:12:07.291 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:12:07.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1428 0.47 MB/sec execute 92 sec latency 1528.717 ms 2023-11-27T21:12:08.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1432 0.47 MB/sec execute 93 sec latency 1200.233 ms 2023-11-27T21:12:09.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1440 0.46 MB/sec execute 94 sec latency 1162.761 ms 2023-11-27T21:12:10.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1445 0.46 MB/sec execute 95 sec latency 1172.881 ms 2023-11-27T21:12:11.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1450 0.45 MB/sec execute 96 sec latency 1188.855 ms 2023-11-27T21:12:12.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1453 0.45 MB/sec execute 97 sec latency 1284.404 ms 2023-11-27T21:12:13.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1458 0.44 MB/sec execute 98 sec latency 1197.257 ms 2023-11-27T21:12:14.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1463 0.44 MB/sec execute 99 sec latency 1246.584 ms 2023-11-27T21:12:15.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1468 0.43 MB/sec execute 100 sec latency 1088.629 ms 2023-11-27T21:12:16.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1472 0.43 MB/sec execute 101 sec latency 1138.610 ms 2023-11-27T21:12:17.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1477 0.43 MB/sec execute 102 sec latency 1310.341 ms 2023-11-27T21:12:18.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1482 0.42 MB/sec execute 103 sec latency 1056.681 ms 2023-11-27T21:12:19.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1486 0.42 MB/sec execute 104 sec latency 1162.590 ms 2023-11-27T21:12:20.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1491 0.42 MB/sec execute 105 sec latency 1280.975 ms 2023-11-27T21:12:21.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1496 0.41 MB/sec execute 106 sec latency 1135.517 ms 2023-11-27T21:12:22.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1499 0.41 MB/sec execute 107 sec latency 1135.513 ms 2023-11-27T21:12:23.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1505 0.40 MB/sec execute 108 sec latency 1366.030 ms 2023-11-27T21:12:24.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1509 0.40 MB/sec execute 109 sec latency 1199.576 ms 2023-11-27T21:12:25.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1511 0.40 MB/sec execute 110 sec latency 791.596 ms 2023-11-27T21:12:26.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1515 0.39 MB/sec execute 111 sec latency 1356.270 ms 2023-11-27T21:12:27.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1523 0.39 MB/sec execute 112 sec latency 1024.800 ms 2023-11-27T21:12:28.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1527 0.39 MB/sec execute 113 sec latency 1134.937 ms 2023-11-27T21:12:29.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1534 0.39 MB/sec execute 114 sec latency 1004.749 ms 2023-11-27T21:12:30.322 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1538 0.38 MB/sec execute 115 sec latency 1182.004 ms 2023-11-27T21:12:31.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1540 0.38 MB/sec execute 116 sec latency 1409.812 ms 2023-11-27T21:12:32.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1544 0.38 MB/sec execute 117 sec latency 1246.489 ms 2023-11-27T21:12:33.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1550 0.37 MB/sec execute 118 sec latency 1183.587 ms 2023-11-27T21:12:34.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1556 0.37 MB/sec execute 119 sec latency 1118.119 ms 2023-11-27T21:12:35.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1561 0.37 MB/sec execute 120 sec latency 1210.248 ms 2023-11-27T21:12:36.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1567 0.37 MB/sec execute 121 sec latency 1155.218 ms 2023-11-27T21:12:37.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1572 0.36 MB/sec execute 122 sec latency 1016.329 ms 2023-11-27T21:12:37.395 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:12:37.397 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:12:38.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1576 0.36 MB/sec execute 123 sec latency 1291.974 ms 2023-11-27T21:12:39.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1582 0.36 MB/sec execute 124 sec latency 1058.820 ms 2023-11-27T21:12:40.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1588 0.36 MB/sec execute 125 sec latency 750.408 ms 2023-11-27T21:12:41.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1592 0.35 MB/sec execute 126 sec latency 1059.652 ms 2023-11-27T21:12:42.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1598 0.35 MB/sec execute 127 sec latency 1193.759 ms 2023-11-27T21:12:43.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1602 0.35 MB/sec execute 128 sec latency 1121.740 ms 2023-11-27T21:12:44.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1607 0.35 MB/sec execute 129 sec latency 1138.310 ms 2023-11-27T21:12:45.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1611 0.34 MB/sec execute 130 sec latency 1221.613 ms 2023-11-27T21:12:46.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1615 0.34 MB/sec execute 131 sec latency 1239.888 ms 2023-11-27T21:12:47.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1619 0.34 MB/sec execute 132 sec latency 1353.692 ms 2023-11-27T21:12:48.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1624 0.34 MB/sec execute 133 sec latency 1168.222 ms 2023-11-27T21:12:49.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1628 0.33 MB/sec execute 134 sec latency 1194.251 ms 2023-11-27T21:12:50.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1631 0.33 MB/sec execute 135 sec latency 1154.663 ms 2023-11-27T21:12:51.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1636 0.33 MB/sec execute 136 sec latency 1220.231 ms 2023-11-27T21:12:52.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1642 0.33 MB/sec execute 137 sec latency 1129.425 ms 2023-11-27T21:12:53.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1647 0.33 MB/sec execute 138 sec latency 1199.222 ms 2023-11-27T21:12:54.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1653 0.32 MB/sec execute 139 sec latency 1248.410 ms 2023-11-27T21:12:55.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1661 0.32 MB/sec execute 140 sec latency 1453.153 ms 2023-11-27T21:12:56.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1665 0.32 MB/sec execute 141 sec latency 1126.891 ms 2023-11-27T21:12:57.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1670 0.32 MB/sec execute 142 sec latency 1432.831 ms 2023-11-27T21:12:58.323 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1676 0.32 MB/sec execute 143 sec latency 1182.795 ms 2023-11-27T21:12:59.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1681 0.31 MB/sec execute 144 sec latency 1256.697 ms 2023-11-27T21:13:00.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1688 0.31 MB/sec execute 145 sec latency 1233.346 ms 2023-11-27T21:13:01.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1696 0.31 MB/sec execute 146 sec latency 1294.066 ms 2023-11-27T21:13:02.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1701 0.31 MB/sec execute 147 sec latency 1123.606 ms 2023-11-27T21:13:03.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1706 0.31 MB/sec execute 148 sec latency 1177.277 ms 2023-11-27T21:13:04.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1709 0.30 MB/sec execute 149 sec latency 1585.188 ms 2023-11-27T21:13:05.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1714 0.30 MB/sec execute 150 sec latency 1954.733 ms 2023-11-27T21:13:06.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1719 0.30 MB/sec execute 151 sec latency 1475.353 ms 2023-11-27T21:13:07.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1726 0.30 MB/sec execute 152 sec latency 1571.988 ms 2023-11-27T21:13:07.543 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:13:07.545 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:13:08.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1730 0.30 MB/sec execute 153 sec latency 1068.122 ms 2023-11-27T21:13:09.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1735 0.30 MB/sec execute 154 sec latency 1552.396 ms 2023-11-27T21:13:10.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1741 0.30 MB/sec execute 155 sec latency 956.618 ms 2023-11-27T21:13:11.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1749 0.29 MB/sec execute 156 sec latency 1045.090 ms 2023-11-27T21:13:12.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1758 0.29 MB/sec execute 157 sec latency 849.821 ms 2023-11-27T21:13:13.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1766 0.29 MB/sec execute 158 sec latency 916.501 ms 2023-11-27T21:13:14.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1773 0.29 MB/sec execute 159 sec latency 1030.664 ms 2023-11-27T21:13:15.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1779 0.29 MB/sec execute 160 sec latency 1204.911 ms 2023-11-27T21:13:16.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1786 0.29 MB/sec execute 161 sec latency 1191.340 ms 2023-11-27T21:13:17.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1790 0.28 MB/sec execute 162 sec latency 1059.811 ms 2023-11-27T21:13:18.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1794 0.28 MB/sec execute 163 sec latency 1104.756 ms 2023-11-27T21:13:19.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1799 0.28 MB/sec execute 164 sec latency 962.735 ms 2023-11-27T21:13:20.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1804 0.28 MB/sec execute 165 sec latency 1342.769 ms 2023-11-27T21:13:21.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1809 0.28 MB/sec execute 166 sec latency 1267.035 ms 2023-11-27T21:13:22.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1813 0.28 MB/sec execute 167 sec latency 1146.297 ms 2023-11-27T21:13:23.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1818 0.28 MB/sec execute 168 sec latency 1171.514 ms 2023-11-27T21:13:24.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1822 0.27 MB/sec execute 169 sec latency 1206.841 ms 2023-11-27T21:13:25.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1829 0.27 MB/sec execute 170 sec latency 1117.603 ms 2023-11-27T21:13:26.324 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1833 0.27 MB/sec execute 171 sec latency 1337.441 ms 2023-11-27T21:13:27.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1836 0.27 MB/sec execute 172 sec latency 1140.636 ms 2023-11-27T21:13:28.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1840 0.27 MB/sec execute 173 sec latency 1222.394 ms 2023-11-27T21:13:29.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1844 0.27 MB/sec execute 174 sec latency 1258.563 ms 2023-11-27T21:13:30.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1849 0.27 MB/sec execute 175 sec latency 1120.529 ms 2023-11-27T21:13:31.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1853 0.27 MB/sec execute 176 sec latency 1091.298 ms 2023-11-27T21:13:32.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1856 0.26 MB/sec execute 177 sec latency 1305.725 ms 2023-11-27T21:13:33.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1861 0.26 MB/sec execute 178 sec latency 1148.642 ms 2023-11-27T21:13:34.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1868 0.26 MB/sec execute 179 sec latency 1158.322 ms 2023-11-27T21:13:35.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1872 0.26 MB/sec execute 180 sec latency 1041.136 ms 2023-11-27T21:13:36.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1876 0.26 MB/sec execute 181 sec latency 1182.244 ms 2023-11-27T21:13:37.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1880 0.26 MB/sec execute 182 sec latency 1456.889 ms 2023-11-27T21:13:37.606 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:13:37.609 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:13:38.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1887 0.26 MB/sec execute 183 sec latency 1221.889 ms 2023-11-27T21:13:39.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1892 0.26 MB/sec execute 184 sec latency 1219.737 ms 2023-11-27T21:13:40.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1896 0.25 MB/sec execute 185 sec latency 1535.807 ms 2023-11-27T21:13:41.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1900 0.25 MB/sec execute 186 sec latency 1220.054 ms 2023-11-27T21:13:42.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1906 0.25 MB/sec execute 187 sec latency 1249.263 ms 2023-11-27T21:13:43.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1911 0.25 MB/sec execute 188 sec latency 1141.438 ms 2023-11-27T21:13:44.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1919 0.25 MB/sec execute 189 sec latency 1261.518 ms 2023-11-27T21:13:45.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1925 0.25 MB/sec execute 190 sec latency 1174.162 ms 2023-11-27T21:13:46.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1929 0.25 MB/sec execute 191 sec latency 1160.348 ms 2023-11-27T21:13:47.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1936 0.25 MB/sec execute 192 sec latency 1379.110 ms 2023-11-27T21:13:48.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1942 0.25 MB/sec execute 193 sec latency 1314.563 ms 2023-11-27T21:13:49.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1946 0.25 MB/sec execute 194 sec latency 1193.473 ms 2023-11-27T21:13:50.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1952 0.24 MB/sec execute 195 sec latency 1148.726 ms 2023-11-27T21:13:51.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1958 0.24 MB/sec execute 196 sec latency 1288.114 ms 2023-11-27T21:13:52.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1965 0.24 MB/sec execute 197 sec latency 1373.925 ms 2023-11-27T21:13:53.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1971 0.24 MB/sec execute 198 sec latency 1409.697 ms 2023-11-27T21:13:54.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1977 0.24 MB/sec execute 199 sec latency 909.926 ms 2023-11-27T21:13:55.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1985 0.24 MB/sec execute 200 sec latency 1348.815 ms 2023-11-27T21:13:56.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1990 0.24 MB/sec execute 201 sec latency 981.882 ms 2023-11-27T21:13:57.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1994 0.24 MB/sec execute 202 sec latency 1105.885 ms 2023-11-27T21:13:58.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 1999 0.24 MB/sec execute 203 sec latency 1427.377 ms 2023-11-27T21:13:59.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2004 0.24 MB/sec execute 204 sec latency 1509.559 ms 2023-11-27T21:14:00.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2010 0.24 MB/sec execute 205 sec latency 1576.540 ms 2023-11-27T21:14:01.325 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2014 0.24 MB/sec execute 206 sec latency 1254.369 ms 2023-11-27T21:14:02.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2018 0.23 MB/sec execute 207 sec latency 1276.781 ms 2023-11-27T21:14:03.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2024 0.23 MB/sec execute 208 sec latency 1135.153 ms 2023-11-27T21:14:04.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2029 0.23 MB/sec execute 209 sec latency 1185.788 ms 2023-11-27T21:14:05.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2033 0.23 MB/sec execute 210 sec latency 1160.833 ms 2023-11-27T21:14:06.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2040 0.23 MB/sec execute 211 sec latency 1304.995 ms 2023-11-27T21:14:07.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2045 0.23 MB/sec execute 212 sec latency 1577.990 ms 2023-11-27T21:14:07.729 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:14:07.731 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:14:08.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2048 0.23 MB/sec execute 213 sec latency 1097.510 ms 2023-11-27T21:14:09.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2056 0.23 MB/sec execute 214 sec latency 1250.114 ms 2023-11-27T21:14:10.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2058 0.23 MB/sec execute 215 sec latency 1369.349 ms 2023-11-27T21:14:11.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2062 0.23 MB/sec execute 216 sec latency 1411.906 ms 2023-11-27T21:14:12.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2068 0.23 MB/sec execute 217 sec latency 1591.900 ms 2023-11-27T21:14:13.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2073 0.23 MB/sec execute 218 sec latency 1225.546 ms 2023-11-27T21:14:14.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2076 0.23 MB/sec execute 219 sec latency 1205.016 ms 2023-11-27T21:14:15.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2079 0.22 MB/sec execute 220 sec latency 1195.575 ms 2023-11-27T21:14:16.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2083 0.22 MB/sec execute 221 sec latency 1218.039 ms 2023-11-27T21:14:17.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2088 0.22 MB/sec execute 222 sec latency 1523.014 ms 2023-11-27T21:14:18.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2093 0.22 MB/sec execute 223 sec latency 1097.365 ms 2023-11-27T21:14:19.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2100 0.22 MB/sec execute 224 sec latency 1206.965 ms 2023-11-27T21:14:20.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2105 0.22 MB/sec execute 225 sec latency 1128.496 ms 2023-11-27T21:14:21.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2111 0.22 MB/sec execute 226 sec latency 1091.493 ms 2023-11-27T21:14:22.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2117 0.22 MB/sec execute 227 sec latency 1298.363 ms 2023-11-27T21:14:23.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2119 0.22 MB/sec execute 228 sec latency 1235.841 ms 2023-11-27T21:14:24.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2123 0.22 MB/sec execute 229 sec latency 1307.843 ms 2023-11-27T21:14:25.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2127 0.22 MB/sec execute 230 sec latency 1184.255 ms 2023-11-27T21:14:26.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2136 0.22 MB/sec execute 231 sec latency 1300.414 ms 2023-11-27T21:14:27.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2144 0.22 MB/sec execute 232 sec latency 1001.274 ms 2023-11-27T21:14:28.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2149 0.22 MB/sec execute 233 sec latency 1152.031 ms 2023-11-27T21:14:29.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2154 0.21 MB/sec execute 234 sec latency 1336.599 ms 2023-11-27T21:14:30.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2161 0.21 MB/sec execute 235 sec latency 1166.952 ms 2023-11-27T21:14:31.326 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2165 0.21 MB/sec execute 236 sec latency 1407.543 ms 2023-11-27T21:14:32.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2170 0.21 MB/sec execute 237 sec latency 1217.639 ms 2023-11-27T21:14:33.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2178 0.22 MB/sec execute 238 sec latency 1171.619 ms 2023-11-27T21:14:34.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2186 0.22 MB/sec execute 239 sec latency 876.769 ms 2023-11-27T21:14:35.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2189 0.22 MB/sec execute 240 sec latency 1513.947 ms 2023-11-27T21:14:36.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2197 0.22 MB/sec execute 241 sec latency 950.062 ms 2023-11-27T21:14:37.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2200 0.22 MB/sec execute 242 sec latency 1470.220 ms 2023-11-27T21:14:37.988 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:14:37.991 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:14:38.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2203 0.22 MB/sec execute 243 sec latency 1178.993 ms 2023-11-27T21:14:39.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2206 0.22 MB/sec execute 244 sec latency 1204.269 ms 2023-11-27T21:14:40.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2214 0.21 MB/sec execute 245 sec latency 1283.616 ms 2023-11-27T21:14:41.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2219 0.21 MB/sec execute 246 sec latency 1210.366 ms 2023-11-27T21:14:42.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2225 0.21 MB/sec execute 247 sec latency 1264.220 ms 2023-11-27T21:14:43.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2238 0.22 MB/sec execute 248 sec latency 1103.349 ms 2023-11-27T21:14:44.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2242 0.22 MB/sec execute 249 sec latency 1117.037 ms 2023-11-27T21:14:45.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2250 0.22 MB/sec execute 250 sec latency 1169.782 ms 2023-11-27T21:14:46.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2257 0.22 MB/sec execute 251 sec latency 1209.084 ms 2023-11-27T21:14:47.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2263 0.22 MB/sec execute 252 sec latency 1299.787 ms 2023-11-27T21:14:48.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2269 0.22 MB/sec execute 253 sec latency 1060.672 ms 2023-11-27T21:14:49.537 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2278 0.22 MB/sec execute 254 sec latency 1065.672 ms 2023-11-27T21:14:50.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2287 0.22 MB/sec execute 255 sec latency 1130.096 ms 2023-11-27T21:14:51.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2294 0.23 MB/sec execute 256 sec latency 1337.941 ms 2023-11-27T21:14:52.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2300 0.23 MB/sec execute 257 sec latency 1299.633 ms 2023-11-27T21:14:53.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2304 0.23 MB/sec execute 258 sec latency 1183.388 ms 2023-11-27T21:14:54.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2308 0.23 MB/sec execute 259 sec latency 1365.014 ms 2023-11-27T21:14:55.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2310 0.23 MB/sec execute 260 sec latency 1412.893 ms 2023-11-27T21:14:56.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2313 0.23 MB/sec execute 261 sec latency 1597.969 ms 2023-11-27T21:14:57.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2316 0.23 MB/sec execute 262 sec latency 1487.623 ms 2023-11-27T21:14:58.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2321 0.23 MB/sec execute 263 sec latency 1353.594 ms 2023-11-27T21:14:59.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2325 0.23 MB/sec execute 264 sec latency 1394.511 ms 2023-11-27T21:15:00.327 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2330 0.23 MB/sec execute 265 sec latency 1233.343 ms 2023-11-27T21:15:01.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2335 0.23 MB/sec execute 266 sec latency 1353.311 ms 2023-11-27T21:15:02.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2340 0.23 MB/sec execute 267 sec latency 1239.386 ms 2023-11-27T21:15:03.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2343 0.23 MB/sec execute 268 sec latency 1042.567 ms 2023-11-27T21:15:04.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2346 0.23 MB/sec execute 269 sec latency 1202.092 ms 2023-11-27T21:15:05.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2351 0.23 MB/sec execute 270 sec latency 1299.024 ms 2023-11-27T21:15:06.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2355 0.23 MB/sec execute 271 sec latency 1148.501 ms 2023-11-27T21:15:07.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2361 0.23 MB/sec execute 272 sec latency 1344.357 ms 2023-11-27T21:15:08.041 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:15:08.043 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:15:08.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2367 0.23 MB/sec execute 273 sec latency 1053.382 ms 2023-11-27T21:15:09.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2371 0.23 MB/sec execute 274 sec latency 1218.279 ms 2023-11-27T21:15:10.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2374 0.23 MB/sec execute 275 sec latency 1252.268 ms 2023-11-27T21:15:11.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2378 0.23 MB/sec execute 276 sec latency 1567.390 ms 2023-11-27T21:15:12.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2380 0.23 MB/sec execute 277 sec latency 1348.538 ms 2023-11-27T21:15:13.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2383 0.23 MB/sec execute 278 sec latency 1251.336 ms 2023-11-27T21:15:14.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2385 0.22 MB/sec execute 279 sec latency 1291.227 ms 2023-11-27T21:15:15.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2390 0.22 MB/sec execute 280 sec latency 1175.774 ms 2023-11-27T21:15:16.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2395 0.23 MB/sec execute 281 sec latency 1143.752 ms 2023-11-27T21:15:17.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2400 0.23 MB/sec execute 282 sec latency 1549.875 ms 2023-11-27T21:15:18.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2406 0.23 MB/sec execute 283 sec latency 1060.286 ms 2023-11-27T21:15:19.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2411 0.23 MB/sec execute 284 sec latency 1014.000 ms 2023-11-27T21:15:20.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2414 0.23 MB/sec execute 285 sec latency 1162.820 ms 2023-11-27T21:15:21.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2417 0.23 MB/sec execute 286 sec latency 1238.610 ms 2023-11-27T21:15:22.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2422 0.23 MB/sec execute 287 sec latency 1170.026 ms 2023-11-27T21:15:23.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2425 0.22 MB/sec execute 288 sec latency 1136.008 ms 2023-11-27T21:15:24.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2431 0.22 MB/sec execute 289 sec latency 1079.362 ms 2023-11-27T21:15:25.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2434 0.22 MB/sec execute 290 sec latency 1016.645 ms 2023-11-27T21:15:26.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2442 0.22 MB/sec execute 291 sec latency 1261.266 ms 2023-11-27T21:15:27.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2448 0.23 MB/sec execute 292 sec latency 1350.944 ms 2023-11-27T21:15:28.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2451 0.22 MB/sec execute 293 sec latency 1116.381 ms 2023-11-27T21:15:29.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2454 0.22 MB/sec execute 294 sec latency 1219.986 ms 2023-11-27T21:15:30.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2463 0.23 MB/sec execute 295 sec latency 1239.378 ms 2023-11-27T21:15:31.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2465 0.23 MB/sec execute 296 sec latency 1435.125 ms 2023-11-27T21:15:32.328 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2469 0.23 MB/sec execute 297 sec latency 1504.990 ms 2023-11-27T21:15:33.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2475 0.23 MB/sec execute 298 sec latency 1136.887 ms 2023-11-27T21:15:34.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2480 0.23 MB/sec execute 299 sec latency 997.988 ms 2023-11-27T21:15:35.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2484 0.23 MB/sec execute 300 sec latency 1040.923 ms 2023-11-27T21:15:36.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2487 0.23 MB/sec execute 301 sec latency 1281.351 ms 2023-11-27T21:15:37.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2496 0.23 MB/sec execute 302 sec latency 1636.646 ms 2023-11-27T21:15:38.161 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:15:38.164 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:15:38.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2501 0.23 MB/sec execute 303 sec latency 1082.500 ms 2023-11-27T21:15:39.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2506 0.23 MB/sec execute 304 sec latency 1158.642 ms 2023-11-27T21:15:40.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2510 0.23 MB/sec execute 305 sec latency 1157.972 ms 2023-11-27T21:15:41.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2521 0.23 MB/sec execute 306 sec latency 1246.539 ms 2023-11-27T21:15:42.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2524 0.23 MB/sec execute 307 sec latency 1312.694 ms 2023-11-27T21:15:43.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2528 0.23 MB/sec execute 308 sec latency 1218.374 ms 2023-11-27T21:15:44.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2532 0.23 MB/sec execute 309 sec latency 1302.897 ms 2023-11-27T21:15:45.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2535 0.23 MB/sec execute 310 sec latency 1121.429 ms 2023-11-27T21:15:46.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2541 0.23 MB/sec execute 311 sec latency 1279.465 ms 2023-11-27T21:15:47.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2549 0.23 MB/sec execute 312 sec latency 1269.655 ms 2023-11-27T21:15:48.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2557 0.23 MB/sec execute 313 sec latency 1280.801 ms 2023-11-27T21:15:49.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2573 0.24 MB/sec execute 314 sec latency 1267.636 ms 2023-11-27T21:15:50.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2574 0.24 MB/sec execute 315 sec latency 1188.020 ms 2023-11-27T21:15:51.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2580 0.24 MB/sec execute 316 sec latency 1294.208 ms 2023-11-27T21:15:52.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2582 0.24 MB/sec execute 317 sec latency 1239.284 ms 2023-11-27T21:15:53.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2596 0.24 MB/sec execute 318 sec latency 1031.410 ms 2023-11-27T21:15:54.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2601 0.24 MB/sec execute 319 sec latency 1064.672 ms 2023-11-27T21:15:55.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2608 0.24 MB/sec execute 320 sec latency 998.817 ms 2023-11-27T21:15:56.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2611 0.24 MB/sec execute 321 sec latency 1308.465 ms 2023-11-27T21:15:57.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2614 0.24 MB/sec execute 322 sec latency 1247.096 ms 2023-11-27T21:15:58.329 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2617 0.24 MB/sec execute 323 sec latency 1293.025 ms 2023-11-27T21:15:59.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2622 0.24 MB/sec execute 324 sec latency 1199.826 ms 2023-11-27T21:16:00.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2626 0.24 MB/sec execute 325 sec latency 1257.659 ms 2023-11-27T21:16:01.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2637 0.25 MB/sec execute 326 sec latency 1320.059 ms 2023-11-27T21:16:02.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2649 0.25 MB/sec execute 327 sec latency 1128.977 ms 2023-11-27T21:16:03.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2652 0.25 MB/sec execute 328 sec latency 1348.197 ms 2023-11-27T21:16:04.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2669 0.26 MB/sec execute 329 sec latency 1019.297 ms 2023-11-27T21:16:05.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2678 0.27 MB/sec execute 330 sec latency 1131.589 ms 2023-11-27T21:16:06.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2685 0.27 MB/sec execute 331 sec latency 1196.305 ms 2023-11-27T21:16:07.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2699 0.27 MB/sec execute 332 sec latency 1377.717 ms 2023-11-27T21:16:08.252 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:16:08.255 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:16:08.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2706 0.27 MB/sec execute 333 sec latency 1413.782 ms 2023-11-27T21:16:09.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2709 0.27 MB/sec execute 334 sec latency 1161.761 ms 2023-11-27T21:16:10.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2722 0.28 MB/sec execute 335 sec latency 1212.454 ms 2023-11-27T21:16:11.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2738 0.29 MB/sec execute 336 sec latency 1260.067 ms 2023-11-27T21:16:12.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2757 0.30 MB/sec execute 337 sec latency 1264.781 ms 2023-11-27T21:16:13.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2762 0.30 MB/sec execute 338 sec latency 1229.762 ms 2023-11-27T21:16:14.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2772 0.30 MB/sec execute 339 sec latency 1177.853 ms 2023-11-27T21:16:15.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2788 0.30 MB/sec execute 340 sec latency 993.700 ms 2023-11-27T21:16:16.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2792 0.30 MB/sec execute 341 sec latency 1171.562 ms 2023-11-27T21:16:17.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2802 0.30 MB/sec execute 342 sec latency 1100.311 ms 2023-11-27T21:16:18.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2816 0.30 MB/sec execute 343 sec latency 1111.520 ms 2023-11-27T21:16:20.583 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2820 0.30 MB/sec execute 344 sec latency 1268.079 ms 2023-11-27T21:16:20.583 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2824 0.30 MB/sec execute 345 sec latency 1049.489 ms 2023-11-27T21:16:21.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2830 0.30 MB/sec execute 346 sec latency 979.651 ms 2023-11-27T21:16:22.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2838 0.31 MB/sec execute 347 sec latency 1040.289 ms 2023-11-27T21:16:23.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2851 0.31 MB/sec execute 348 sec latency 1195.744 ms 2023-11-27T21:16:24.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2863 0.31 MB/sec execute 349 sec latency 1144.250 ms 2023-11-27T21:16:25.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2876 0.31 MB/sec execute 350 sec latency 1107.624 ms 2023-11-27T21:16:26.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2889 0.31 MB/sec execute 351 sec latency 1151.477 ms 2023-11-27T21:16:27.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2896 0.31 MB/sec execute 352 sec latency 1147.981 ms 2023-11-27T21:16:28.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2901 0.31 MB/sec execute 353 sec latency 1031.010 ms 2023-11-27T21:16:29.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2905 0.31 MB/sec execute 354 sec latency 1180.699 ms 2023-11-27T21:16:29.477 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:22:53.386 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:16:29.482 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:22:53.391 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:16:29.488 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:22:53.373 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:16:29.490 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:22:53.376 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:16:29.495 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:22:53.381 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:16:29.498 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:22:53.384 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:16:29.616 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:22:53.502 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:16:29.623 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:22:53.532 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:16:29.629 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:22:53.515 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:16:30.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2911 0.31 MB/sec execute 355 sec latency 1226.665 ms 2023-11-27T21:16:31.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2918 0.32 MB/sec execute 356 sec latency 1260.050 ms 2023-11-27T21:16:32.330 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2936 0.32 MB/sec execute 357 sec latency 1381.112 ms 2023-11-27T21:16:33.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2946 0.32 MB/sec execute 358 sec latency 1226.939 ms 2023-11-27T21:16:34.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2956 0.33 MB/sec execute 359 sec latency 864.130 ms 2023-11-27T21:16:35.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2959 0.33 MB/sec execute 360 sec latency 1067.648 ms 2023-11-27T21:16:36.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2965 0.32 MB/sec execute 361 sec latency 1173.275 ms 2023-11-27T21:16:37.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2972 0.32 MB/sec execute 362 sec latency 1141.510 ms 2023-11-27T21:16:38.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2978 0.32 MB/sec execute 363 sec latency 1177.540 ms 2023-11-27T21:16:38.400 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:16:38.404 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:16:39.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 2984 0.32 MB/sec execute 364 sec latency 1130.601 ms 2023-11-27T21:16:40.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3003 0.32 MB/sec execute 365 sec latency 1229.897 ms 2023-11-27T21:16:41.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3009 0.32 MB/sec execute 366 sec latency 1220.568 ms 2023-11-27T21:16:42.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3015 0.32 MB/sec execute 367 sec latency 1154.348 ms 2023-11-27T21:16:43.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3019 0.32 MB/sec execute 368 sec latency 1130.436 ms 2023-11-27T21:16:44.334 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3036 0.32 MB/sec execute 369 sec latency 1191.343 ms 2023-11-27T21:16:45.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3041 0.32 MB/sec execute 370 sec latency 995.591 ms 2023-11-27T21:16:46.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3044 0.32 MB/sec execute 371 sec latency 1065.828 ms 2023-11-27T21:16:47.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3048 0.32 MB/sec execute 372 sec latency 1405.552 ms 2023-11-27T21:16:48.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3084 0.33 MB/sec execute 373 sec latency 1267.725 ms 2023-11-27T21:16:49.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3092 0.32 MB/sec execute 374 sec latency 1189.378 ms 2023-11-27T21:16:50.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3098 0.32 MB/sec execute 375 sec latency 1179.419 ms 2023-11-27T21:16:51.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3104 0.32 MB/sec execute 376 sec latency 907.353 ms 2023-11-27T21:16:52.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3110 0.33 MB/sec execute 377 sec latency 924.080 ms 2023-11-27T21:16:53.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3116 0.33 MB/sec execute 378 sec latency 1117.315 ms 2023-11-27T21:16:54.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3123 0.33 MB/sec execute 379 sec latency 1156.966 ms 2023-11-27T21:16:55.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3167 0.33 MB/sec execute 380 sec latency 1198.926 ms 2023-11-27T21:16:56.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3170 0.33 MB/sec execute 381 sec latency 1225.562 ms 2023-11-27T21:16:57.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3189 0.33 MB/sec execute 382 sec latency 1367.425 ms 2023-11-27T21:16:58.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3196 0.34 MB/sec execute 383 sec latency 1235.081 ms 2023-11-27T21:16:59.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3205 0.34 MB/sec execute 384 sec latency 1042.269 ms 2023-11-27T21:17:00.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3206 0.34 MB/sec execute 385 sec latency 1257.312 ms 2023-11-27T21:17:01.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3211 0.34 MB/sec execute 386 sec latency 1372.191 ms 2023-11-27T21:17:02.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3215 0.34 MB/sec execute 387 sec latency 1292.645 ms 2023-11-27T21:17:03.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3219 0.34 MB/sec execute 388 sec latency 1160.070 ms 2023-11-27T21:17:04.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3228 0.34 MB/sec execute 389 sec latency 1173.186 ms 2023-11-27T21:17:05.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3235 0.34 MB/sec execute 390 sec latency 1386.172 ms 2023-11-27T21:17:06.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3244 0.34 MB/sec execute 391 sec latency 1432.440 ms 2023-11-27T21:17:07.331 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3247 0.34 MB/sec execute 392 sec latency 1392.558 ms 2023-11-27T21:17:08.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3250 0.34 MB/sec execute 393 sec latency 1267.220 ms 2023-11-27T21:17:08.555 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:17:08.559 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:17:09.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3252 0.34 MB/sec execute 394 sec latency 1368.847 ms 2023-11-27T21:17:10.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3255 0.34 MB/sec execute 395 sec latency 1342.134 ms 2023-11-27T21:17:11.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3257 0.34 MB/sec execute 396 sec latency 1415.407 ms 2023-11-27T21:17:12.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3259 0.34 MB/sec execute 397 sec latency 1314.275 ms 2023-11-27T21:17:13.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3260 0.34 MB/sec execute 398 sec latency 1317.276 ms 2023-11-27T21:17:14.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3262 0.34 MB/sec execute 399 sec latency 1410.480 ms 2023-11-27T21:17:15.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3263 0.34 MB/sec execute 400 sec latency 1443.250 ms 2023-11-27T21:17:16.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3264 0.34 MB/sec execute 401 sec latency 1322.995 ms 2023-11-27T21:17:17.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3266 0.34 MB/sec execute 402 sec latency 1316.530 ms 2023-11-27T21:17:18.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3268 0.33 MB/sec execute 403 sec latency 1321.529 ms 2023-11-27T21:17:19.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3269 0.33 MB/sec execute 404 sec latency 1307.333 ms 2023-11-27T21:17:20.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3271 0.33 MB/sec execute 405 sec latency 1347.343 ms 2023-11-27T21:17:21.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3272 0.33 MB/sec execute 406 sec latency 1417.827 ms 2023-11-27T21:17:22.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3274 0.33 MB/sec execute 407 sec latency 1318.110 ms 2023-11-27T21:17:23.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3275 0.33 MB/sec execute 408 sec latency 1321.762 ms 2023-11-27T21:17:24.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3276 0.33 MB/sec execute 409 sec latency 1327.151 ms 2023-11-27T21:17:25.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3291 0.33 MB/sec execute 410 sec latency 1459.881 ms 2023-11-27T21:17:26.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3292 0.33 MB/sec execute 411 sec latency 1385.474 ms 2023-11-27T21:17:27.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3293 0.33 MB/sec execute 412 sec latency 1484.054 ms 2023-11-27T21:17:28.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3295 0.33 MB/sec execute 413 sec latency 1271.284 ms 2023-11-27T21:17:29.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3296 0.33 MB/sec execute 414 sec latency 1370.055 ms 2023-11-27T21:17:30.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3299 0.33 MB/sec execute 415 sec latency 1293.103 ms 2023-11-27T21:17:31.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3300 0.33 MB/sec execute 416 sec latency 1600.217 ms 2023-11-27T21:17:32.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3301 0.33 MB/sec execute 417 sec latency 1643.720 ms 2023-11-27T21:17:33.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3303 0.32 MB/sec execute 418 sec latency 1262.527 ms 2023-11-27T21:17:34.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3305 0.32 MB/sec execute 419 sec latency 1300.177 ms 2023-11-27T21:17:35.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3306 0.32 MB/sec execute 420 sec latency 1306.366 ms 2023-11-27T21:17:36.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3308 0.32 MB/sec execute 421 sec latency 1282.677 ms 2023-11-27T21:17:37.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3311 0.32 MB/sec execute 422 sec latency 1274.464 ms 2023-11-27T21:17:38.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3315 0.32 MB/sec execute 423 sec latency 1289.874 ms 2023-11-27T21:17:38.610 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:17:38.612 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:17:39.332 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3316 0.32 MB/sec execute 424 sec latency 1412.652 ms 2023-11-27T21:17:40.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3318 0.32 MB/sec execute 425 sec latency 1431.484 ms 2023-11-27T21:17:41.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3319 0.32 MB/sec execute 426 sec latency 1374.409 ms 2023-11-27T21:17:42.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3321 0.32 MB/sec execute 427 sec latency 1364.482 ms 2023-11-27T21:17:43.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3323 0.32 MB/sec execute 428 sec latency 1235.996 ms 2023-11-27T21:17:44.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3324 0.32 MB/sec execute 429 sec latency 1333.997 ms 2023-11-27T21:17:45.217 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:24:09.126 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:17:45.222 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:24:09.131 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:17:45.270 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:24:09.179 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:17:45.280 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:24:09.166 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:17:45.282 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:24:09.168 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:17:45.285 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:24:09.171 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:17:45.289 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:24:09.174 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:17:45.327 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:24:09.212 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:17:45.332 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:24:09.217 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:17:45.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3326 0.32 MB/sec execute 430 sec latency 1380.936 ms 2023-11-27T21:17:46.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3327 0.32 MB/sec execute 431 sec latency 1578.507 ms 2023-11-27T21:17:47.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3328 0.32 MB/sec execute 432 sec latency 1440.318 ms 2023-11-27T21:17:48.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3330 0.32 MB/sec execute 433 sec latency 1395.920 ms 2023-11-27T21:17:49.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3331 0.32 MB/sec execute 434 sec latency 1369.180 ms 2023-11-27T21:17:50.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3333 0.31 MB/sec execute 435 sec latency 1385.406 ms 2023-11-27T21:17:51.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3337 0.32 MB/sec execute 436 sec latency 1396.254 ms 2023-11-27T21:17:52.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3345 0.32 MB/sec execute 437 sec latency 1365.981 ms 2023-11-27T21:17:53.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3348 0.32 MB/sec execute 438 sec latency 1281.289 ms 2023-11-27T21:17:54.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3351 0.32 MB/sec execute 439 sec latency 1289.090 ms 2023-11-27T21:17:55.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3353 0.32 MB/sec execute 440 sec latency 1290.833 ms 2023-11-27T21:17:56.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3356 0.32 MB/sec execute 441 sec latency 1334.783 ms 2023-11-27T21:17:57.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3357 0.32 MB/sec execute 442 sec latency 1404.425 ms 2023-11-27T21:17:58.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3360 0.32 MB/sec execute 443 sec latency 1395.246 ms 2023-11-27T21:17:59.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3363 0.32 MB/sec execute 444 sec latency 1334.521 ms 2023-11-27T21:18:00.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3366 0.31 MB/sec execute 445 sec latency 1321.280 ms 2023-11-27T21:18:01.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3369 0.31 MB/sec execute 446 sec latency 1192.119 ms 2023-11-27T21:18:02.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3380 0.32 MB/sec execute 447 sec latency 1345.880 ms 2023-11-27T21:18:03.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3383 0.32 MB/sec execute 448 sec latency 1369.238 ms 2023-11-27T21:18:04.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3387 0.32 MB/sec execute 449 sec latency 1165.717 ms 2023-11-27T21:18:05.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3392 0.32 MB/sec execute 450 sec latency 1168.472 ms 2023-11-27T21:18:06.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3395 0.32 MB/sec execute 451 sec latency 1116.121 ms 2023-11-27T21:18:07.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3409 0.32 MB/sec execute 452 sec latency 1271.443 ms 2023-11-27T21:18:08.334 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3413 0.32 MB/sec execute 453 sec latency 1073.274 ms 2023-11-27T21:18:08.774 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:18:08.777 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:18:09.333 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3416 0.32 MB/sec execute 454 sec latency 1253.443 ms 2023-11-27T21:18:10.334 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3420 0.32 MB/sec execute 455 sec latency 1420.270 ms 2023-11-27T21:18:11.334 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3426 0.32 MB/sec execute 456 sec latency 1191.833 ms 2023-11-27T21:18:12.334 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3431 0.32 MB/sec execute 457 sec latency 1114.580 ms 2023-11-27T21:18:13.334 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3447 0.33 MB/sec execute 458 sec latency 1167.440 ms 2023-11-27T21:18:14.334 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3456 0.33 MB/sec execute 459 sec latency 1231.658 ms 2023-11-27T21:18:15.334 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3460 0.33 MB/sec execute 460 sec latency 1300.354 ms 2023-11-27T21:18:16.334 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3465 0.33 MB/sec execute 461 sec latency 1185.262 ms 2023-11-27T21:18:17.334 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3467 0.33 MB/sec execute 462 sec latency 1292.571 ms 2023-11-27T21:18:18.334 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3475 0.33 MB/sec execute 463 sec latency 1351.896 ms 2023-11-27T21:18:19.334 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3497 0.34 MB/sec execute 464 sec latency 1130.412 ms 2023-11-27T21:18:20.334 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3507 0.35 MB/sec execute 465 sec latency 1140.814 ms 2023-11-27T21:18:21.334 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3514 0.35 MB/sec execute 466 sec latency 958.017 ms 2023-11-27T21:18:22.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3517 0.35 MB/sec execute 467 sec latency 1311.806 ms 2023-11-27T21:18:23.334 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3525 0.35 MB/sec execute 468 sec latency 1313.412 ms 2023-11-27T21:18:24.334 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3529 0.34 MB/sec execute 469 sec latency 1206.688 ms 2023-11-27T21:18:25.334 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3532 0.34 MB/sec execute 470 sec latency 1270.833 ms 2023-11-27T21:18:26.334 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3536 0.34 MB/sec execute 471 sec latency 1150.603 ms 2023-11-27T21:18:27.334 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3543 0.34 MB/sec execute 472 sec latency 1366.157 ms 2023-11-27T21:18:28.334 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3555 0.35 MB/sec execute 473 sec latency 1190.820 ms 2023-11-27T21:18:29.334 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3560 0.35 MB/sec execute 474 sec latency 1163.876 ms 2023-11-27T21:18:30.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3565 0.35 MB/sec execute 475 sec latency 1031.671 ms 2023-11-27T21:18:31.334 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3569 0.35 MB/sec execute 476 sec latency 937.371 ms 2023-11-27T21:18:32.334 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3576 0.35 MB/sec execute 477 sec latency 1135.454 ms 2023-11-27T21:18:33.334 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3583 0.35 MB/sec execute 478 sec latency 1187.261 ms 2023-11-27T21:18:34.334 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3587 0.35 MB/sec execute 479 sec latency 1241.755 ms 2023-11-27T21:18:35.334 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3593 0.35 MB/sec execute 480 sec latency 1193.268 ms 2023-11-27T21:18:36.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3599 0.35 MB/sec execute 481 sec latency 1036.814 ms 2023-11-27T21:18:37.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3603 0.35 MB/sec execute 482 sec latency 1248.476 ms 2023-11-27T21:18:38.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3609 0.35 MB/sec execute 483 sec latency 1323.848 ms 2023-11-27T21:18:38.888 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:18:38.891 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:18:39.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3614 0.34 MB/sec execute 484 sec latency 1183.658 ms 2023-11-27T21:18:40.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3618 0.34 MB/sec execute 485 sec latency 1152.214 ms 2023-11-27T21:18:41.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3626 0.34 MB/sec execute 486 sec latency 1079.583 ms 2023-11-27T21:18:42.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3633 0.34 MB/sec execute 487 sec latency 1010.119 ms 2023-11-27T21:18:43.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3637 0.34 MB/sec execute 488 sec latency 739.591 ms 2023-11-27T21:18:44.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3640 0.34 MB/sec execute 489 sec latency 1137.135 ms 2023-11-27T21:18:45.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3644 0.34 MB/sec execute 490 sec latency 1310.684 ms 2023-11-27T21:18:46.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3651 0.34 MB/sec execute 491 sec latency 790.529 ms 2023-11-27T21:18:47.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3657 0.34 MB/sec execute 492 sec latency 1104.778 ms 2023-11-27T21:18:48.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3662 0.34 MB/sec execute 493 sec latency 1388.764 ms 2023-11-27T21:18:49.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3667 0.34 MB/sec execute 494 sec latency 1168.254 ms 2023-11-27T21:18:50.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3673 0.34 MB/sec execute 495 sec latency 1165.074 ms 2023-11-27T21:18:51.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3677 0.34 MB/sec execute 496 sec latency 1133.669 ms 2023-11-27T21:18:52.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3683 0.34 MB/sec execute 497 sec latency 1176.933 ms 2023-11-27T21:18:53.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3696 0.35 MB/sec execute 498 sec latency 881.348 ms 2023-11-27T21:18:54.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3699 0.35 MB/sec execute 499 sec latency 1162.195 ms 2023-11-27T21:18:55.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3704 0.35 MB/sec execute 500 sec latency 864.533 ms 2023-11-27T21:18:56.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3713 0.35 MB/sec execute 501 sec latency 710.480 ms 2023-11-27T21:18:57.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3718 0.35 MB/sec execute 502 sec latency 1086.940 ms 2023-11-27T21:18:58.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3722 0.35 MB/sec execute 503 sec latency 1146.893 ms 2023-11-27T21:18:59.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3726 0.35 MB/sec execute 504 sec latency 1121.892 ms 2023-11-27T21:19:00.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3730 0.35 MB/sec execute 505 sec latency 1179.872 ms 2023-11-27T21:19:01.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3734 0.35 MB/sec execute 506 sec latency 984.434 ms 2023-11-27T21:19:02.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3740 0.35 MB/sec execute 507 sec latency 757.355 ms 2023-11-27T21:19:03.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3743 0.35 MB/sec execute 508 sec latency 1167.384 ms 2023-11-27T21:19:04.335 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3748 0.35 MB/sec execute 509 sec latency 1390.395 ms 2023-11-27T21:19:05.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3751 0.35 MB/sec execute 510 sec latency 781.067 ms 2023-11-27T21:19:06.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3754 0.35 MB/sec execute 511 sec latency 729.770 ms 2023-11-27T21:19:07.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3760 0.35 MB/sec execute 512 sec latency 1282.185 ms 2023-11-27T21:19:08.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3765 0.35 MB/sec execute 513 sec latency 662.187 ms 2023-11-27T21:19:08.987 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:19:08.989 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:19:09.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3770 0.35 MB/sec execute 514 sec latency 984.985 ms 2023-11-27T21:19:10.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3774 0.35 MB/sec execute 515 sec latency 1119.719 ms 2023-11-27T21:19:11.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3779 0.35 MB/sec execute 516 sec latency 864.173 ms 2023-11-27T21:19:12.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3784 0.35 MB/sec execute 517 sec latency 1134.542 ms 2023-11-27T21:19:13.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3787 0.35 MB/sec execute 518 sec latency 906.632 ms 2023-11-27T21:19:14.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3791 0.35 MB/sec execute 519 sec latency 589.165 ms 2023-11-27T21:19:15.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3796 0.35 MB/sec execute 520 sec latency 1083.098 ms 2023-11-27T21:19:16.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3801 0.35 MB/sec execute 521 sec latency 961.971 ms 2023-11-27T21:19:17.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3805 0.34 MB/sec execute 522 sec latency 976.532 ms 2023-11-27T21:19:18.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3807 0.34 MB/sec execute 523 sec latency 983.621 ms 2023-11-27T21:19:19.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3811 0.34 MB/sec execute 524 sec latency 693.302 ms 2023-11-27T21:19:20.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3815 0.34 MB/sec execute 525 sec latency 643.917 ms 2023-11-27T21:19:20.651 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:25:44.560 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:19:20.710 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:25:44.619 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:19:20.760 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:25:44.668 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:19:20.772 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:25:44.657 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:19:20.775 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:25:44.660 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:19:20.777 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:25:44.663 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:19:20.780 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:25:44.666 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:19:20.818 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:25:44.703 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:19:20.823 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:25:44.709 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:19:21.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3817 0.34 MB/sec execute 526 sec latency 1142.047 ms 2023-11-27T21:19:22.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3821 0.34 MB/sec execute 527 sec latency 695.985 ms 2023-11-27T21:19:23.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3824 0.34 MB/sec execute 528 sec latency 1147.308 ms 2023-11-27T21:19:24.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3828 0.34 MB/sec execute 529 sec latency 1033.262 ms 2023-11-27T21:19:25.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3831 0.34 MB/sec execute 530 sec latency 991.219 ms 2023-11-27T21:19:26.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3835 0.34 MB/sec execute 531 sec latency 989.194 ms 2023-11-27T21:19:27.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3838 0.34 MB/sec execute 532 sec latency 987.918 ms 2023-11-27T21:19:28.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3842 0.34 MB/sec execute 533 sec latency 612.505 ms 2023-11-27T21:19:29.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3846 0.34 MB/sec execute 534 sec latency 902.697 ms 2023-11-27T21:19:30.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3849 0.34 MB/sec execute 535 sec latency 944.646 ms 2023-11-27T21:19:31.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3852 0.34 MB/sec execute 536 sec latency 1239.595 ms 2023-11-27T21:19:32.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3855 0.34 MB/sec execute 537 sec latency 1021.122 ms 2023-11-27T21:19:33.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3859 0.34 MB/sec execute 538 sec latency 1105.721 ms 2023-11-27T21:19:34.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3863 0.34 MB/sec execute 539 sec latency 734.036 ms 2023-11-27T21:19:35.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3866 0.33 MB/sec execute 540 sec latency 894.366 ms 2023-11-27T21:19:36.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3871 0.33 MB/sec execute 541 sec latency 1073.303 ms 2023-11-27T21:19:37.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3874 0.33 MB/sec execute 542 sec latency 1220.229 ms 2023-11-27T21:19:38.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3877 0.33 MB/sec execute 543 sec latency 1093.830 ms 2023-11-27T21:19:39.109 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:19:39.111 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:19:39.336 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3880 0.33 MB/sec execute 544 sec latency 1133.436 ms 2023-11-27T21:19:40.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3884 0.33 MB/sec execute 545 sec latency 602.257 ms 2023-11-27T21:19:41.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3889 0.33 MB/sec execute 546 sec latency 662.809 ms 2023-11-27T21:19:42.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3892 0.33 MB/sec execute 547 sec latency 1003.233 ms 2023-11-27T21:19:43.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3897 0.33 MB/sec execute 548 sec latency 1196.950 ms 2023-11-27T21:19:44.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3900 0.33 MB/sec execute 549 sec latency 1440.629 ms 2023-11-27T21:19:45.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3903 0.33 MB/sec execute 550 sec latency 1132.744 ms 2023-11-27T21:19:45.887 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:26:09.796 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:19:45.891 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:26:09.800 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:19:45.897 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:26:09.783 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:19:45.900 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:26:09.785 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:19:45.901 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:26:09.787 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:19:45.905 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:26:09.791 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:19:45.928 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:26:09.837 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:19:45.942 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:26:09.828 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:19:45.953 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:26:09.838 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:19:46.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3907 0.33 MB/sec execute 551 sec latency 1331.837 ms 2023-11-27T21:19:47.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3910 0.33 MB/sec execute 552 sec latency 877.755 ms 2023-11-27T21:19:48.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3915 0.33 MB/sec execute 553 sec latency 1096.464 ms 2023-11-27T21:19:49.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3918 0.33 MB/sec execute 554 sec latency 1059.942 ms 2023-11-27T21:19:50.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3920 0.33 MB/sec execute 555 sec latency 1039.311 ms 2023-11-27T21:19:51.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3924 0.33 MB/sec execute 556 sec latency 1145.675 ms 2023-11-27T21:19:52.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3927 0.33 MB/sec execute 557 sec latency 1182.037 ms 2023-11-27T21:19:53.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3931 0.33 MB/sec execute 558 sec latency 930.327 ms 2023-11-27T21:19:54.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3933 0.33 MB/sec execute 559 sec latency 1203.253 ms 2023-11-27T21:19:55.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3937 0.33 MB/sec execute 560 sec latency 1237.839 ms 2023-11-27T21:19:56.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3941 0.33 MB/sec execute 561 sec latency 920.362 ms 2023-11-27T21:19:57.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3944 0.33 MB/sec execute 562 sec latency 1382.192 ms 2023-11-27T21:19:58.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3947 0.33 MB/sec execute 563 sec latency 1572.336 ms 2023-11-27T21:19:59.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3950 0.33 MB/sec execute 564 sec latency 1142.627 ms 2023-11-27T21:20:00.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3954 0.32 MB/sec execute 565 sec latency 639.645 ms 2023-11-27T21:20:01.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3956 0.32 MB/sec execute 566 sec latency 656.688 ms 2023-11-27T21:20:02.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3960 0.32 MB/sec execute 567 sec latency 796.941 ms 2023-11-27T21:20:03.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3964 0.32 MB/sec execute 568 sec latency 1093.949 ms 2023-11-27T21:20:04.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3967 0.32 MB/sec execute 569 sec latency 790.287 ms 2023-11-27T21:20:05.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3969 0.32 MB/sec execute 570 sec latency 957.981 ms 2023-11-27T21:20:06.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3973 0.32 MB/sec execute 571 sec latency 657.417 ms 2023-11-27T21:20:07.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3977 0.32 MB/sec execute 572 sec latency 751.753 ms 2023-11-27T21:20:08.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3980 0.32 MB/sec execute 573 sec latency 712.677 ms 2023-11-27T21:20:09.199 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:20:09.203 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:20:09.337 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3982 0.32 MB/sec execute 574 sec latency 1085.176 ms 2023-11-27T21:20:10.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3986 0.32 MB/sec execute 575 sec latency 1262.382 ms 2023-11-27T21:20:11.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3989 0.32 MB/sec execute 576 sec latency 1071.271 ms 2023-11-27T21:20:12.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3992 0.32 MB/sec execute 577 sec latency 1244.511 ms 2023-11-27T21:20:13.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3996 0.32 MB/sec execute 578 sec latency 994.908 ms 2023-11-27T21:20:14.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 3999 0.32 MB/sec execute 579 sec latency 641.875 ms 2023-11-27T21:20:15.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 4003 0.32 MB/sec execute 580 sec latency 663.250 ms 2023-11-27T21:20:16.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 4006 0.32 MB/sec execute 581 sec latency 1002.212 ms 2023-11-27T21:20:17.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 4009 0.32 MB/sec execute 582 sec latency 897.483 ms 2023-11-27T21:20:18.339 INFO:tasks.workunit.client.0.smithi088.stdout: 10 4013 0.31 MB/sec execute 583 sec latency 1014.870 ms 2023-11-27T21:20:19.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 4016 0.31 MB/sec execute 584 sec latency 1052.120 ms 2023-11-27T21:20:20.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 4019 0.31 MB/sec execute 585 sec latency 853.245 ms 2023-11-27T21:20:21.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 4023 0.31 MB/sec execute 586 sec latency 1010.947 ms 2023-11-27T21:20:22.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 4025 0.31 MB/sec execute 587 sec latency 1046.280 ms 2023-11-27T21:20:23.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 4029 0.31 MB/sec execute 588 sec latency 1037.251 ms 2023-11-27T21:20:24.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 4032 0.31 MB/sec execute 589 sec latency 1030.794 ms 2023-11-27T21:20:25.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 4036 0.31 MB/sec execute 590 sec latency 1154.865 ms 2023-11-27T21:20:26.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 4039 0.31 MB/sec execute 591 sec latency 1161.029 ms 2023-11-27T21:20:27.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 4042 0.31 MB/sec execute 592 sec latency 1318.124 ms 2023-11-27T21:20:28.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 4046 0.31 MB/sec execute 593 sec latency 1309.416 ms 2023-11-27T21:20:29.341 INFO:tasks.workunit.client.0.smithi088.stdout: 10 4050 0.31 MB/sec execute 594 sec latency 1069.765 ms 2023-11-27T21:20:30.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 4054 0.31 MB/sec execute 595 sec latency 794.405 ms 2023-11-27T21:20:31.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 4057 0.31 MB/sec execute 596 sec latency 1248.239 ms 2023-11-27T21:20:32.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 4060 0.31 MB/sec execute 597 sec latency 1411.158 ms 2023-11-27T21:20:33.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 4063 0.31 MB/sec execute 598 sec latency 1194.751 ms 2023-11-27T21:20:34.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 4066 0.31 MB/sec execute 599 sec latency 1026.429 ms 2023-11-27T21:20:35.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 cleanup 600 sec 2023-11-27T21:20:36.339 INFO:tasks.workunit.client.0.smithi088.stdout: 10 cleanup 601 sec 2023-11-27T21:20:37.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 cleanup 602 sec 2023-11-27T21:20:38.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 cleanup 603 sec 2023-11-27T21:20:39.329 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:20:39.331 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:20:39.338 INFO:tasks.workunit.client.0.smithi088.stdout: 10 cleanup 604 sec 2023-11-27T21:20:40.339 INFO:tasks.workunit.client.0.smithi088.stdout: 10 cleanup 605 sec 2023-11-27T21:20:41.339 INFO:tasks.workunit.client.0.smithi088.stdout: 10 cleanup 606 sec 2023-11-27T21:20:42.339 INFO:tasks.workunit.client.0.smithi088.stdout: 10 cleanup 607 sec 2023-11-27T21:20:43.339 INFO:tasks.workunit.client.0.smithi088.stdout: 10 cleanup 608 sec 2023-11-27T21:20:44.339 INFO:tasks.workunit.client.0.smithi088.stdout: 10 cleanup 609 sec 2023-11-27T21:20:45.339 INFO:tasks.workunit.client.0.smithi088.stdout: 10 cleanup 610 sec 2023-11-27T21:20:46.339 INFO:tasks.workunit.client.0.smithi088.stdout: 10 cleanup 611 sec 2023-11-27T21:20:47.339 INFO:tasks.workunit.client.0.smithi088.stdout: 10 cleanup 612 sec 2023-11-27T21:20:48.339 INFO:tasks.workunit.client.0.smithi088.stdout: 10 cleanup 613 sec 2023-11-27T21:20:49.339 INFO:tasks.workunit.client.0.smithi088.stdout: 10 cleanup 614 sec 2023-11-27T21:20:50.339 INFO:tasks.workunit.client.0.smithi088.stdout: 10 cleanup 615 sec 2023-11-27T21:20:51.339 INFO:tasks.workunit.client.0.smithi088.stdout: 10 cleanup 616 sec 2023-11-27T21:20:52.339 INFO:tasks.workunit.client.0.smithi088.stdout: 10 cleanup 617 sec 2023-11-27T21:20:53.339 INFO:tasks.workunit.client.0.smithi088.stdout: 10 cleanup 618 sec 2023-11-27T21:20:54.339 INFO:tasks.workunit.client.0.smithi088.stdout: 10 cleanup 619 sec 2023-11-27T21:20:55.339 INFO:tasks.workunit.client.0.smithi088.stdout: 10 cleanup 620 sec 2023-11-27T21:20:56.339 INFO:tasks.workunit.client.0.smithi088.stdout: 10 cleanup 621 sec 2023-11-27T21:20:57.339 INFO:tasks.workunit.client.0.smithi088.stdout: 10 cleanup 622 sec 2023-11-27T21:20:58.339 INFO:tasks.workunit.client.0.smithi088.stdout: 10 cleanup 623 sec 2023-11-27T21:20:59.339 INFO:tasks.workunit.client.0.smithi088.stdout: 10 cleanup 624 sec 2023-11-27T21:21:00.339 INFO:tasks.workunit.client.0.smithi088.stdout: 8 cleanup 625 sec 2023-11-27T21:21:01.339 INFO:tasks.workunit.client.0.smithi088.stdout: 8 cleanup 626 sec 2023-11-27T21:21:02.339 INFO:tasks.workunit.client.0.smithi088.stdout: 7 cleanup 627 sec 2023-11-27T21:21:03.339 INFO:tasks.workunit.client.0.smithi088.stdout: 7 cleanup 628 sec 2023-11-27T21:21:04.339 INFO:tasks.workunit.client.0.smithi088.stdout: 6 cleanup 629 sec 2023-11-27T21:21:05.339 INFO:tasks.workunit.client.0.smithi088.stdout: 6 cleanup 630 sec 2023-11-27T21:21:06.339 INFO:tasks.workunit.client.0.smithi088.stdout: 6 cleanup 631 sec 2023-11-27T21:21:07.339 INFO:tasks.workunit.client.0.smithi088.stdout: 6 cleanup 632 sec 2023-11-27T21:21:08.339 INFO:tasks.workunit.client.0.smithi088.stdout: 6 cleanup 633 sec 2023-11-27T21:21:09.340 INFO:tasks.workunit.client.0.smithi088.stdout: 5 cleanup 634 sec 2023-11-27T21:21:09.460 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:21:09.463 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:21:10.339 INFO:tasks.workunit.client.0.smithi088.stdout: 5 cleanup 635 sec 2023-11-27T21:21:11.339 INFO:tasks.workunit.client.0.smithi088.stdout: 2 cleanup 636 sec 2023-11-27T21:21:12.340 INFO:tasks.workunit.client.0.smithi088.stdout: 1 cleanup 637 sec 2023-11-27T21:21:13.340 INFO:tasks.workunit.client.0.smithi088.stdout: 1 cleanup 638 sec 2023-11-27T21:21:14.188 INFO:tasks.workunit.client.0.smithi088.stdout: 0 cleanup 639 sec 2023-11-27T21:21:14.188 INFO:tasks.workunit.client.0.smithi088.stdout: 2023-11-27T21:21:14.188 INFO:tasks.workunit.client.0.smithi088.stdout: Operation Count AvgLat MaxLat 2023-11-27T21:21:14.189 INFO:tasks.workunit.client.0.smithi088.stdout: ---------------------------------------- 2023-11-27T21:21:14.189 INFO:tasks.workunit.client.0.smithi088.stdout: NTCreateX 5483 376.500 1237.199 2023-11-27T21:21:14.189 INFO:tasks.workunit.client.0.smithi088.stdout: Close 3999 6.382 87.989 2023-11-27T21:21:14.189 INFO:tasks.workunit.client.0.smithi088.stdout: Rename 234 784.002 1177.271 2023-11-27T21:21:14.189 INFO:tasks.workunit.client.0.smithi088.stdout: Unlink 932 313.197 571.543 2023-11-27T21:21:14.189 INFO:tasks.workunit.client.0.smithi088.stdout: Qpathinfo 5215 206.203 833.825 2023-11-27T21:21:14.189 INFO:tasks.workunit.client.0.smithi088.stdout: Qfileinfo 899 19.386 86.115 2023-11-27T21:21:14.190 INFO:tasks.workunit.client.0.smithi088.stdout: Qfsinfo 860 47.987 204.379 2023-11-27T21:21:14.190 INFO:tasks.workunit.client.0.smithi088.stdout: Sfileinfo 368 134.312 375.193 2023-11-27T21:21:14.190 INFO:tasks.workunit.client.0.smithi088.stdout: Find 1864 1160.105 1954.726 2023-11-27T21:21:14.190 INFO:tasks.workunit.client.0.smithi088.stdout: WriteX 2656 26.766 159.273 2023-11-27T21:21:14.190 INFO:tasks.workunit.client.0.smithi088.stdout: ReadX 8891 0.130 68.630 2023-11-27T21:21:14.190 INFO:tasks.workunit.client.0.smithi088.stdout: LockX 20 44.927 69.330 2023-11-27T21:21:14.190 INFO:tasks.workunit.client.0.smithi088.stdout: UnlockX 20 43.868 85.651 2023-11-27T21:21:14.191 INFO:tasks.workunit.client.0.smithi088.stdout: Flush 228 90.668 373.025 2023-11-27T21:21:14.191 INFO:tasks.workunit.client.0.smithi088.stdout: 2023-11-27T21:21:14.191 INFO:tasks.workunit.client.0.smithi088.stdout:Throughput 0.306866 MB/sec 10 clients 10 procs max_latency=1954.733 ms 2023-11-27T21:21:14.191 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-11-27T21:21:14.192 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-11-27T21:21:39.567 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:21:39.569 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:21:40.943 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2023-11-27T21:21:40.943 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-11-27T21:21:41.215 DEBUG:teuthology.parallel:result is None 2023-11-27T21:21:41.215 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-11-27T21:21:41.560 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-11-27T21:21:41.561 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-27T21:21:41.598 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-27T21:21:41.598 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T21:21:41.598 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T21:21:41.614 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T21:21:41.615 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T21:21:41.670 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T21:21:41.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.809+0000 7f46ed848640 1 Processor -- start 2023-11-27T21:21:41.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.809+0000 7f46ed848640 1 -- start start 2023-11-27T21:21:41.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.809+0000 7f46ed848640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f46e80cda70 0x7f46e80ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:41.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.809+0000 7f46ed848640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46e80cc420 0x7f46e8159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:41.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.810+0000 7f46ed848640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f46e8159b50 0x7f46e80c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:41.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.810+0000 7f46ed848640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e80cc230 con 0x7f46e80cda70 2023-11-27T21:21:41.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.810+0000 7f46ed848640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e80cbda0 con 0x7f46e8159b50 2023-11-27T21:21:41.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.810+0000 7f46ed848640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e80cb4e0 con 0x7f46e80cc420 2023-11-27T21:21:41.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.810+0000 7f46e6ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f46e80cda70 0x7f46e80ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:41.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.810+0000 7f46e77fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f46e8159b50 0x7f46e80c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:41.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.810+0000 7f46e67fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46e80cc420 0x7f46e8159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:41.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.811+0000 7f46e6ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f46e80cda70 0x7f46e80ce350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58756/0 (socket says 172.21.15.88:58756) 2023-11-27T21:21:41.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.811+0000 7f46e6ffd640 1 -- 172.21.15.88:0/268235891 learned_addr learned my addr 172.21.15.88:0/268235891 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:41.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.813+0000 7f46e6ffd640 1 -- 172.21.15.88:0/268235891 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46e80cc420 msgr2=0x7f46e8159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:21:41.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.813+0000 7f46e6ffd640 1 --2- 172.21.15.88:0/268235891 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46e80cc420 0x7f46e8159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:41.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.813+0000 7f46e6ffd640 1 -- 172.21.15.88:0/268235891 >> v2:172.21.15.167:3300/0 conn(0x7f46e8159b50 msgr2=0x7f46e80c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:21:41.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.813+0000 7f46e6ffd640 1 --2- 172.21.15.88:0/268235891 >> v2:172.21.15.167:3300/0 conn(0x7f46e8159b50 0x7f46e80c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:41.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.813+0000 7f46e6ffd640 1 -- 172.21.15.88:0/268235891 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e80cce00 con 0x7f46e80cda70 2023-11-27T21:21:41.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.815+0000 7f46e6ffd640 1 --2- 172.21.15.88:0/268235891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46e80cda70 0x7f46e80ce350 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f46e806a7f0 tx=0x7f46d802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6410b20877ef7ed8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:41.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.819+0000 7f46e5ffb640 1 -- 172.21.15.88:0/268235891 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d8030860 con 0x7f46e80cda70 2023-11-27T21:21:41.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.819+0000 7f46e5ffb640 1 -- 172.21.15.88:0/268235891 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d80309c0 con 0x7f46e80cda70 2023-11-27T21:21:41.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.819+0000 7f46e5ffb640 1 -- 172.21.15.88:0/268235891 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d8030d50 con 0x7f46e80cda70 2023-11-27T21:21:41.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.820+0000 7f46ed848640 1 -- 172.21.15.88:0/268235891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46e80cda70 msgr2=0x7f46e80ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:41.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.820+0000 7f46ed848640 1 --2- 172.21.15.88:0/268235891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46e80cda70 0x7f46e80ce350 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f46e806a7f0 tx=0x7f46d802b9a0 comp rx=0 tx=0).stop 2023-11-27T21:21:41.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.820+0000 7f46ed848640 1 -- 172.21.15.88:0/268235891 shutdown_connections 2023-11-27T21:21:41.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.820+0000 7f46ed848640 1 --2- 172.21.15.88:0/268235891 >> v2:172.21.15.167:3300/0 conn(0x7f46e8159b50 0x7f46e80c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:41.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.820+0000 7f46ed848640 1 --2- 172.21.15.88:0/268235891 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46e80cc420 0x7f46e8159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:41.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.820+0000 7f46ed848640 1 --2- 172.21.15.88:0/268235891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46e80cda70 0x7f46e80ce350 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:41.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.820+0000 7f46ed848640 1 -- 172.21.15.88:0/268235891 >> 172.21.15.88:0/268235891 conn(0x7f46e80b07b0 msgr2=0x7f46e80b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:41.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.820+0000 7f46ed848640 1 -- 172.21.15.88:0/268235891 shutdown_connections 2023-11-27T21:21:41.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.820+0000 7f46ed848640 1 -- 172.21.15.88:0/268235891 wait complete. 2023-11-27T21:21:41.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.821+0000 7f46ed848640 1 Processor -- start 2023-11-27T21:21:41.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.821+0000 7f46ed848640 1 -- start start 2023-11-27T21:21:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.822+0000 7f46ed848640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46e80cc420 0x7f46e8158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.822+0000 7f46ed848640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46e80cda70 0x7f46e8152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.822+0000 7f46ed848640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46e8159b50 0x7f46e8157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.822+0000 7f46ed848640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e80b27a0 con 0x7f46e80cda70 2023-11-27T21:21:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.822+0000 7f46ed848640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e80b3450 con 0x7f46e80cc420 2023-11-27T21:21:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.822+0000 7f46ed848640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e8159350 con 0x7f46e8159b50 2023-11-27T21:21:41.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.822+0000 7f46e67fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46e80cda70 0x7f46e8152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:41.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.823+0000 7f46e67fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46e80cda70 0x7f46e8152b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58764/0 (socket says 172.21.15.88:58764) 2023-11-27T21:21:41.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.823+0000 7f46e67fc640 1 -- 172.21.15.88:0/2287714774 learned_addr learned my addr 172.21.15.88:0/2287714774 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:41.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.824+0000 7f46e6ffd640 1 --2- 172.21.15.88:0/2287714774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46e80cc420 0x7f46e8158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:41.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.824+0000 7f46e77fe640 1 --2- 172.21.15.88:0/2287714774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46e8159b50 0x7f46e8157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:41.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.826+0000 7f46e67fc640 1 -- 172.21.15.88:0/2287714774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46e8159b50 msgr2=0x7f46e8157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:41.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.826+0000 7f46e67fc640 1 --2- 172.21.15.88:0/2287714774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46e8159b50 0x7f46e8157e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:41.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.826+0000 7f46e67fc640 1 -- 172.21.15.88:0/2287714774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46e80cc420 msgr2=0x7f46e8158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:41.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.826+0000 7f46e67fc640 1 --2- 172.21.15.88:0/2287714774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46e80cc420 0x7f46e8158ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:41.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.826+0000 7f46e67fc640 1 -- 172.21.15.88:0/2287714774 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d80094d0 con 0x7f46e80cda70 2023-11-27T21:21:41.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.828+0000 7f46e67fc640 1 --2- 172.21.15.88:0/2287714774 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46e80cda70 0x7f46e8152b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00e980 tx=0x7f46dc00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:41.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.832+0000 7f46cffff640 1 -- 172.21.15.88:0/2287714774 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc009670 con 0x7f46e80cda70 2023-11-27T21:21:41.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.832+0000 7f46cffff640 1 -- 172.21.15.88:0/2287714774 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc00ca00 con 0x7f46e80cda70 2023-11-27T21:21:41.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.832+0000 7f46cffff640 1 -- 172.21.15.88:0/2287714774 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc00cd90 con 0x7f46e80cda70 2023-11-27T21:21:41.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.832+0000 7f46ed848640 1 -- 172.21.15.88:0/2287714774 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e8159630 con 0x7f46e80cda70 2023-11-27T21:21:41.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.832+0000 7f46ed848640 1 -- 172.21.15.88:0/2287714774 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e80b2e00 con 0x7f46e80cda70 2023-11-27T21:21:41.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.833+0000 7f46ed848640 1 -- 172.21.15.88:0/2287714774 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e8067470 con 0x7f46e80cda70 2023-11-27T21:21:41.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.851+0000 7f46cffff640 1 -- 172.21.15.88:0/2287714774 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f46dc013470 con 0x7f46e80cda70 2023-11-27T21:21:41.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.851+0000 7f46cffff640 1 --2- 172.21.15.88:0/2287714774 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f46d406b210 0x7f46d406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:41.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.852+0000 7f46e6ffd640 1 --2- 172.21.15.88:0/2287714774 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f46d406b210 0x7f46d406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:41.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.852+0000 7f46e6ffd640 1 --2- 172.21.15.88:0/2287714774 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f46d406b210 0x7f46d406d6d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f46d8036000 tx=0x7f46d8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:41.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:41.855+0000 7f46cffff640 1 -- 172.21.15.88:0/2287714774 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f46dc058df0 con 0x7f46e80cda70 2023-11-27T21:21:42.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.087+0000 7f46cffff640 1 -- 172.21.15.88:0/2287714774 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f46dc055130 con 0x7f46e80cda70 2023-11-27T21:21:42.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.273+0000 7f46ed848640 1 -- 172.21.15.88:0/2287714774 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46e80cf600 con 0x7f46e80cda70 2023-11-27T21:21:42.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.318+0000 7f46cffff640 1 -- 172.21.15.88:0/2287714774 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18666 (secure 0 0 0) 0x7f46dc021020 con 0x7f46e80cda70 2023-11-27T21:21:42.321 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T21:21:42.321 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":28,"fsid":"ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc","created":"2023-11-27T20:53:53.110827+0000","modified":"2023-11-27T20:55:00.550945+0000","last_up_change":"2023-11-27T20:54:08.219383+0000","last_in_change":"2023-11-27T20:53:59.022798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:54:09.277670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:54:24.503156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:54:25.744043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T20:54:29.704111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1207ca0f-bef1-44c6-b66b-58bf0e080ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6819","nonce":3952326022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6821","nonce":3952326022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6825","nonce":3952326022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6823","nonce":3952326022}]},"public_addr":"172.21.15.88:6819/3952326022","cluster_addr":"172.21.15.88:6821/3952326022","heartbeat_back_addr":"172.21.15.88:6825/3952326022","heartbeat_front_addr":"172.21.15.88:6823/3952326022","state":["exists","up"]},{"osd":1,"uuid":"8d1be479-4241-4335-9633-1394311fde76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6827","nonce":1788401966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6829","nonce":1788401966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6833","nonce":1788401966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6831","nonce":1788401966}]},"public_addr":"172.21.15.88:6827/1788401966","cluster_addr":"172.21.15.88:6829/1788401966","heartbeat_back_addr":"172.21.15.88:6833/1788401966","heartbeat_front_addr":"172.21.15.88:6831/1788401966","state":["exists","up"]},{"osd":2,"uuid":"7536b008-05dd-40eb-9d4a-bdac4b1c38c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6803","nonce":1166333913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6805","nonce":1166333913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6809","nonce":1166333913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6807","nonce":1166333913}]},"public_addr":"172.21.15.88:6803/1166333913","cluster_addr":"172.21.15.88:6805/1166333913","heartbeat_back_addr":"172.21.15.88:6809/1166333913","heartbeat_front_addr":"172.21.15.88:6807/1166333913","state":["exists","up"]},{"osd":3,"uuid":"47edd4d7-e99c-4ce3-851b-cc9c8e2d4480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6811","nonce":406887502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6813","nonce":406887502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6817","nonce":406887502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6815","nonce":406887502}]},"public_addr":"172.21.15.88:6811/406887502","cluster_addr":"172.21.15.88:6813/406887502","heartbeat_back_addr":"172.21.15.88:6817/406887502","heartbeat_front_addr":"172.21.15.88:6815/406887502","state":["exists","up"]},{"osd":4,"uuid":"0a81dd31-1a8b-41af-b933-d74aae63f3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6801","nonce":2551293703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6803","nonce":2551293703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6807","nonce":2551293703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6805","nonce":2551293703}]},"public_addr":"172.21.15.167:6801/2551293703","cluster_addr":"172.21.15.167:6803/2551293703","heartbeat_back_addr":"172.21.15.167:6807/2551293703","heartbeat_front_addr":"172.21.15.167:6805/2551293703","state":["exists","up"]},{"osd":5,"uuid":"1c462d0d-3361-48b3-a82a-86a920539e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6825","nonce":866085094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6827","nonce":866085094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6831","nonce":866085094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6829","nonce":866085094}]},"public_addr":"172.21.15.167:6825/866085094","cluster_addr":"172.21.15.167:6827/866085094","heartbeat_back_addr":"172.21.15.167:6831/866085094","heartbeat_front_addr":"172.21.15.167:6829/866085094","state":["exists","up"]},{"osd":6,"uuid":"d687c5ad-6c88-4a15-8120-0cdbc5610535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6809","nonce":2766725538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6811","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6813","nonce":2766725538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6819","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6821","nonce":2766725538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6815","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6817","nonce":2766725538}]},"public_addr":"172.21.15.167:6809/2766725538","cluster_addr":"172.21.15.167:6813/2766725538","heartbeat_back_addr":"172.21.15.167:6821/2766725538","heartbeat_front_addr":"172.21.15.167:6817/2766725538","state":["exists","up"]},{"osd":7,"uuid":"c9a50596-4981-4bd8-a8ef-d7679f8d9559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6812","nonce":2695037266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6816","nonce":2695037266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6823","nonce":2695037266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6820","nonce":2695037266}]},"public_addr":"172.21.15.167:6812/2695037266","cluster_addr":"172.21.15.167:6816/2695037266","heartbeat_back_addr":"172.21.15.167:6823/2695037266","heartbeat_front_addr":"172.21.15.167:6820/2695037266","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.522590+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.483170+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.492504+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.432204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.414964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.459803+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.437250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.460394+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.1d","mappings":[{"from":0,"to":1}]},{"pgid":"3.35","mappings":[{"from":0,"to":7}]},{"pgid":"4.4","mappings":[{"from":6,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":4}]},{"pgid":"4.e","mappings":[{"from":3,"to":5}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T21:21:42.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.320+0000 7f46ed848640 1 -- 172.21.15.88:0/2287714774 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f46d406b210 msgr2=0x7f46d406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:42.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.320+0000 7f46ed848640 1 --2- 172.21.15.88:0/2287714774 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f46d406b210 0x7f46d406d6d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f46d8036000 tx=0x7f46d8008030 comp rx=0 tx=0).stop 2023-11-27T21:21:42.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.320+0000 7f46ed848640 1 -- 172.21.15.88:0/2287714774 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46e80cda70 msgr2=0x7f46e8152b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:42.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.320+0000 7f46ed848640 1 --2- 172.21.15.88:0/2287714774 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46e80cda70 0x7f46e8152b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00e980 tx=0x7f46dc00ee40 comp rx=0 tx=0).stop 2023-11-27T21:21:42.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.320+0000 7f46ed848640 1 -- 172.21.15.88:0/2287714774 shutdown_connections 2023-11-27T21:21:42.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.320+0000 7f46ed848640 1 --2- 172.21.15.88:0/2287714774 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f46d406b210 0x7f46d406d6d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:42.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.320+0000 7f46ed848640 1 --2- 172.21.15.88:0/2287714774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46e8159b50 0x7f46e8157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:42.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.320+0000 7f46ed848640 1 --2- 172.21.15.88:0/2287714774 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46e80cda70 0x7f46e8152b00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:42.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.320+0000 7f46ed848640 1 --2- 172.21.15.88:0/2287714774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46e80cc420 0x7f46e8158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:42.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.320+0000 7f46ed848640 1 -- 172.21.15.88:0/2287714774 >> 172.21.15.88:0/2287714774 conn(0x7f46e80b07b0 msgr2=0x7f46e80af8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:42.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.321+0000 7f46ed848640 1 -- 172.21.15.88:0/2287714774 shutdown_connections 2023-11-27T21:21:42.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.321+0000 7f46ed848640 1 -- 172.21.15.88:0/2287714774 wait complete. 2023-11-27T21:21:42.334 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:54:09.277670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:54:24.503156+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:54:25.744043+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-27T20:54:29.704111+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-27T21:21:42.334 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T21:21:42.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.436+0000 7f52156c9640 1 Processor -- start 2023-11-27T21:21:42.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.436+0000 7f52156c9640 1 -- start start 2023-11-27T21:21:42.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.437+0000 7f52156c9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f521015c390 0x7f521015a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:42.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.437+0000 7f52156c9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f521015a550 con 0x7f52100cc430 2023-11-27T21:21:42.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.437+0000 7f52156c9640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f521006cf20 con 0x7f52100cb4f0 2023-11-27T21:21:42.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.437+0000 7f52156c9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52100cc250 con 0x7f521015c390 2023-11-27T21:21:42.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.437+0000 7f520e7fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f52100cc430 0x7f521006c810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43588/0 (socket says 172.21.15.88:43588) 2023-11-27T21:21:42.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.437+0000 7f520e7fc640 1 -- 172.21.15.88:0/167926089 learned_addr learned my addr 172.21.15.88:0/167926089 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:21:42.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.438+0000 7f520effd640 1 --2- 172.21.15.88:0/167926089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f521015c390 0x7f521015a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:42.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.440+0000 7f520dffb640 1 -- 172.21.15.88:0/167926089 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4203852501 0 0) 0x7f5204001110 con 0x7f52100cc430 2023-11-27T21:21:42.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.440+0000 7f520dffb640 1 -- 172.21.15.88:0/167926089 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f8003520 con 0x7f52100cc430 2023-11-27T21:21:42.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.440+0000 7f520dffb640 1 -- 172.21.15.88:0/167926089 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3527867370 0 0) 0x7f521006cf20 con 0x7f52100cb4f0 2023-11-27T21:21:42.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.440+0000 7f520dffb640 1 -- 172.21.15.88:0/167926089 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5204001110 con 0x7f52100cb4f0 2023-11-27T21:21:42.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.441+0000 7f520effd640 1 -- 172.21.15.88:0/167926089 >> v1:172.21.15.167:6789/0 conn(0x7f52100cb4f0 legacy=0x7f5210163e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:42.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.441+0000 7f520effd640 1 -- 172.21.15.88:0/167926089 >> v1:172.21.15.88:6789/0 conn(0x7f52100cc430 legacy=0x7f521006c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:42.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.441+0000 7f520effd640 1 -- 172.21.15.88:0/167926089 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52100c9ae0 con 0x7f521015c390 2023-11-27T21:21:42.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.444+0000 7f520effd640 1 --2- 172.21.15.88:0/167926089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f521015c390 0x7f521015a010 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f52080097d0 tx=0x7f520802b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7002c111c99b8bf server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:42.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.448+0000 7f520dffb640 1 -- 172.21.15.88:0/167926089 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5208030880 con 0x7f521015c390 2023-11-27T21:21:42.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.448+0000 7f520dffb640 1 -- 172.21.15.88:0/167926089 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52080309e0 con 0x7f521015c390 2023-11-27T21:21:42.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.448+0000 7f520dffb640 1 -- 172.21.15.88:0/167926089 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5208030d70 con 0x7f521015c390 2023-11-27T21:21:42.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.448+0000 7f52156c9640 1 -- 172.21.15.88:0/167926089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f521015c390 msgr2=0x7f521015a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:42.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.448+0000 7f52156c9640 1 --2- 172.21.15.88:0/167926089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f521015c390 0x7f521015a010 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f52080097d0 tx=0x7f520802b9c0 comp rx=0 tx=0).stop 2023-11-27T21:21:42.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.448+0000 7f52156c9640 1 -- 172.21.15.88:0/167926089 shutdown_connections 2023-11-27T21:21:42.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.448+0000 7f52156c9640 1 --2- 172.21.15.88:0/167926089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f521015c390 0x7f521015a010 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:42.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.448+0000 7f52156c9640 1 -- 172.21.15.88:0/167926089 >> 172.21.15.88:0/167926089 conn(0x7f52100ced20 msgr2=0x7f52100cf130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:42.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.448+0000 7f52156c9640 1 -- 172.21.15.88:0/167926089 shutdown_connections 2023-11-27T21:21:42.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.448+0000 7f52156c9640 1 -- 172.21.15.88:0/167926089 wait complete. 2023-11-27T21:21:42.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.450+0000 7f52156c9640 1 Processor -- start 2023-11-27T21:21:42.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.450+0000 7f52156c9640 1 -- start start 2023-11-27T21:21:42.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.451+0000 7f52156c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52100cb4f0 0x7f52100c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:42.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.451+0000 7f52156c9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52100cc430 0x7f52101f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:42.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.451+0000 7f52156c9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f521015c390 0x7f521014faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:42.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.451+0000 7f52156c9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52100c25e0 con 0x7f521015c390 2023-11-27T21:21:42.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.451+0000 7f52156c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52101f2e90 con 0x7f52100cb4f0 2023-11-27T21:21:42.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.451+0000 7f52156c9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52101f1d40 con 0x7f52100cc430 2023-11-27T21:21:42.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.451+0000 7f520f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f521015c390 0x7f521014faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:42.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.451+0000 7f520effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52100cb4f0 0x7f52100c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:42.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.451+0000 7f520f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f521015c390 0x7f521014faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58772/0 (socket says 172.21.15.88:58772) 2023-11-27T21:21:42.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.451+0000 7f520f7fe640 1 -- 172.21.15.88:0/2683746812 learned_addr learned my addr 172.21.15.88:0/2683746812 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:42.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.455+0000 7f520f7fe640 1 -- 172.21.15.88:0/2683746812 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52100cc430 msgr2=0x7f52101f21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:42.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.455+0000 7f520f7fe640 1 --2- 172.21.15.88:0/2683746812 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52100cc430 0x7f52101f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:42.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.455+0000 7f520f7fe640 1 -- 172.21.15.88:0/2683746812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52100cb4f0 msgr2=0x7f52100c4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:42.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.455+0000 7f520f7fe640 1 --2- 172.21.15.88:0/2683746812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52100cb4f0 0x7f52100c4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:42.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.455+0000 7f520f7fe640 1 -- 172.21.15.88:0/2683746812 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5208009400 con 0x7f521015c390 2023-11-27T21:21:42.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.457+0000 7f520f7fe640 1 --2- 172.21.15.88:0/2683746812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f521015c390 0x7f521014faf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f520000c6e0 tx=0x7f520000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:42.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.460+0000 7f51f77fe640 1 -- 172.21.15.88:0/2683746812 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5200003b70 con 0x7f521015c390 2023-11-27T21:21:42.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.461+0000 7f51f77fe640 1 -- 172.21.15.88:0/2683746812 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5200003cd0 con 0x7f521015c390 2023-11-27T21:21:42.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.461+0000 7f51f77fe640 1 -- 172.21.15.88:0/2683746812 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52000052d0 con 0x7f521015c390 2023-11-27T21:21:42.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.461+0000 7f52156c9640 1 -- 172.21.15.88:0/2683746812 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52101eff90 con 0x7f521015c390 2023-11-27T21:21:42.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.461+0000 7f52156c9640 1 -- 172.21.15.88:0/2683746812 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52100c4910 con 0x7f521015c390 2023-11-27T21:21:42.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.462+0000 7f52156c9640 1 -- 172.21.15.88:0/2683746812 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52101f0120 con 0x7f521015c390 2023-11-27T21:21:42.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.479+0000 7f51f77fe640 1 -- 172.21.15.88:0/2683746812 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5200005430 con 0x7f521015c390 2023-11-27T21:21:42.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.480+0000 7f51f77fe640 1 --2- 172.21.15.88:0/2683746812 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f51fc06b210 0x7f51fc06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:42.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.480+0000 7f520effd640 1 --2- 172.21.15.88:0/2683746812 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f51fc06b210 0x7f51fc06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:42.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.480+0000 7f520effd640 1 --2- 172.21.15.88:0/2683746812 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f51fc06b210 0x7f51fc06d6d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5208036000 tx=0x7f5208008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:42.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.484+0000 7f51f77fe640 1 -- 172.21.15.88:0/2683746812 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5200059330 con 0x7f521015c390 2023-11-27T21:21:42.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.752+0000 7f51f77fe640 1 -- 172.21.15.88:0/2683746812 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5200054f70 con 0x7f521015c390 2023-11-27T21:21:42.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.918+0000 7f52156c9640 1 -- 172.21.15.88:0/2683746812 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5210067470 con 0x7f521015c390 2023-11-27T21:21:42.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.923+0000 7f51f77fe640 1 -- 172.21.15.88:0/2683746812 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5200058590 con 0x7f521015c390 2023-11-27T21:21:42.925 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-27T21:21:42.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.925+0000 7f52156c9640 1 -- 172.21.15.88:0/2683746812 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f51fc06b210 msgr2=0x7f51fc06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:42.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.925+0000 7f52156c9640 1 --2- 172.21.15.88:0/2683746812 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f51fc06b210 0x7f51fc06d6d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5208036000 tx=0x7f5208008030 comp rx=0 tx=0).stop 2023-11-27T21:21:42.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.925+0000 7f52156c9640 1 -- 172.21.15.88:0/2683746812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f521015c390 msgr2=0x7f521014faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:42.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.925+0000 7f52156c9640 1 --2- 172.21.15.88:0/2683746812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f521015c390 0x7f521014faf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f520000c6e0 tx=0x7f520000cba0 comp rx=0 tx=0).stop 2023-11-27T21:21:42.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.925+0000 7f52156c9640 1 -- 172.21.15.88:0/2683746812 shutdown_connections 2023-11-27T21:21:42.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.925+0000 7f52156c9640 1 --2- 172.21.15.88:0/2683746812 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f51fc06b210 0x7f51fc06d6d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:42.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.925+0000 7f52156c9640 1 --2- 172.21.15.88:0/2683746812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f521015c390 0x7f521014faf0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:42.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.925+0000 7f52156c9640 1 --2- 172.21.15.88:0/2683746812 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52100cc430 0x7f52101f21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:42.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.925+0000 7f52156c9640 1 --2- 172.21.15.88:0/2683746812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52100cb4f0 0x7f52100c4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:42.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.925+0000 7f52156c9640 1 -- 172.21.15.88:0/2683746812 >> 172.21.15.88:0/2683746812 conn(0x7f52100ced20 msgr2=0x7f5210158970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:42.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.925+0000 7f52156c9640 1 -- 172.21.15.88:0/2683746812 shutdown_connections 2023-11-27T21:21:42.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:42.925+0000 7f52156c9640 1 -- 172.21.15.88:0/2683746812 wait complete. 2023-11-27T21:21:42.938 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T21:21:43.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.038+0000 7f423177c640 1 Processor -- start 2023-11-27T21:21:43.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.038+0000 7f423177c640 1 -- start start 2023-11-27T21:21:43.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.039+0000 7f423177c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f422c0c7650 0x7f422c15a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:43.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.039+0000 7f423177c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f422c0c7a30 0x7f422c1560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:43.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.039+0000 7f423177c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f422c159dd0 con 0x7f422c0c6c40 2023-11-27T21:21:43.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.039+0000 7f423177c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f422c0c5ad0 con 0x7f422c0c7650 2023-11-27T21:21:43.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.039+0000 7f423177c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f422c0c5cc0 con 0x7f422c0c7a30 2023-11-27T21:21:43.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.040+0000 7f422affd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f422c0c7650 0x7f422c15a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:43.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.040+0000 7f422a7fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f422c0c7a30 0x7f422c1560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:43.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.040+0000 7f422affd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f422c0c7650 0x7f422c15a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58778/0 (socket says 172.21.15.88:58778) 2023-11-27T21:21:43.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.040+0000 7f422affd640 1 -- 172.21.15.88:0/336760292 learned_addr learned my addr 172.21.15.88:0/336760292 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:43.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.043+0000 7f422a7fc640 1 -- 172.21.15.88:0/336760292 >> v2:172.21.15.88:3300/0 conn(0x7f422c0c7650 msgr2=0x7f422c15a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:21:43.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.043+0000 7f422a7fc640 1 --2- 172.21.15.88:0/336760292 >> v2:172.21.15.88:3300/0 conn(0x7f422c0c7650 0x7f422c15a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:43.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.043+0000 7f422a7fc640 1 -- 172.21.15.88:0/336760292 >> v1:172.21.15.88:6789/0 conn(0x7f422c0c6c40 legacy=0x7f422c0c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:43.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.043+0000 7f422a7fc640 1 -- 172.21.15.88:0/336760292 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c0c6260 con 0x7f422c0c7a30 2023-11-27T21:21:43.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.046+0000 7f422a7fc640 1 --2- 172.21.15.88:0/336760292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f422c0c7a30 0x7f422c1560f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f422c0c1250 tx=0x7f422002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=705f4a1dbe7a4089 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:43.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.050+0000 7f4229ffb640 1 -- 172.21.15.88:0/336760292 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422002e070 con 0x7f422c0c7a30 2023-11-27T21:21:43.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.050+0000 7f4229ffb640 1 -- 172.21.15.88:0/336760292 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42200315a0 con 0x7f422c0c7a30 2023-11-27T21:21:43.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.050+0000 7f4229ffb640 1 -- 172.21.15.88:0/336760292 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220031930 con 0x7f422c0c7a30 2023-11-27T21:21:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.050+0000 7f423177c640 1 -- 172.21.15.88:0/336760292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f422c0c7a30 msgr2=0x7f422c1560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.050+0000 7f423177c640 1 --2- 172.21.15.88:0/336760292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f422c0c7a30 0x7f422c1560f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f422c0c1250 tx=0x7f422002b840 comp rx=0 tx=0).stop 2023-11-27T21:21:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.051+0000 7f423177c640 1 -- 172.21.15.88:0/336760292 shutdown_connections 2023-11-27T21:21:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.051+0000 7f423177c640 1 --2- 172.21.15.88:0/336760292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f422c0c7a30 0x7f422c1560f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.051+0000 7f423177c640 1 --2- 172.21.15.88:0/336760292 >> v2:172.21.15.88:3300/0 conn(0x7f422c0c7650 0x7f422c15a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.051+0000 7f423177c640 1 -- 172.21.15.88:0/336760292 >> 172.21.15.88:0/336760292 conn(0x7f422c06c5f0 msgr2=0x7f422c06c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.051+0000 7f423177c640 1 -- 172.21.15.88:0/336760292 shutdown_connections 2023-11-27T21:21:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.051+0000 7f423177c640 1 -- 172.21.15.88:0/336760292 wait complete. 2023-11-27T21:21:43.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.052+0000 7f423177c640 1 Processor -- start 2023-11-27T21:21:43.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.052+0000 7f423177c640 1 -- start start 2023-11-27T21:21:43.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.053+0000 7f423177c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f422c0c6c40 0x7f422c072390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:43.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.053+0000 7f423177c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f422c0c7650 0x7f422c1eed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:43.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.053+0000 7f423177c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f422c0c7a30 0x7f422c1ef250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:43.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.053+0000 7f423177c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c0c9150 con 0x7f422c0c6c40 2023-11-27T21:21:43.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.053+0000 7f423177c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c158e20 con 0x7f422c0c7a30 2023-11-27T21:21:43.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.053+0000 7f423177c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422c14b960 con 0x7f422c0c7650 2023-11-27T21:21:43.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.053+0000 7f422affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f422c0c6c40 0x7f422c072390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:43.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.053+0000 7f422affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f422c0c6c40 0x7f422c072390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58784/0 (socket says 172.21.15.88:58784) 2023-11-27T21:21:43.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.053+0000 7f422affd640 1 -- 172.21.15.88:0/3066483880 learned_addr learned my addr 172.21.15.88:0/3066483880 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:43.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.055+0000 7f422b7fe640 1 --2- 172.21.15.88:0/3066483880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f422c0c7a30 0x7f422c1ef250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:43.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.056+0000 7f422a7fc640 1 --2- 172.21.15.88:0/3066483880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f422c0c7650 0x7f422c1eed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:43.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.057+0000 7f422affd640 1 -- 172.21.15.88:0/3066483880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f422c0c7650 msgr2=0x7f422c1eed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:43.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.057+0000 7f422affd640 1 --2- 172.21.15.88:0/3066483880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f422c0c7650 0x7f422c1eed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:43.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.057+0000 7f422affd640 1 -- 172.21.15.88:0/3066483880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f422c0c7a30 msgr2=0x7f422c1ef250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:43.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.057+0000 7f422affd640 1 --2- 172.21.15.88:0/3066483880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f422c0c7a30 0x7f422c1ef250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:43.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.057+0000 7f422affd640 1 -- 172.21.15.88:0/3066483880 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4220009400 con 0x7f422c0c6c40 2023-11-27T21:21:43.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.059+0000 7f422affd640 1 --2- 172.21.15.88:0/3066483880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f422c0c6c40 0x7f422c072390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f421c009d90 tx=0x7f421c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:43.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.063+0000 7f42137fe640 1 -- 172.21.15.88:0/3066483880 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c00cda0 con 0x7f422c0c6c40 2023-11-27T21:21:43.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.063+0000 7f42137fe640 1 -- 172.21.15.88:0/3066483880 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421c00f040 con 0x7f422c0c6c40 2023-11-27T21:21:43.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.063+0000 7f42137fe640 1 -- 172.21.15.88:0/3066483880 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c014680 con 0x7f422c0c6c40 2023-11-27T21:21:43.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.063+0000 7f423177c640 1 -- 172.21.15.88:0/3066483880 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f422c14c200 con 0x7f422c0c6c40 2023-11-27T21:21:43.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.063+0000 7f423177c640 1 -- 172.21.15.88:0/3066483880 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f422c159350 con 0x7f422c0c6c40 2023-11-27T21:21:43.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.064+0000 7f423177c640 1 -- 172.21.15.88:0/3066483880 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f422c067470 con 0x7f422c0c6c40 2023-11-27T21:21:43.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.332+0000 7f42137fe640 1 -- 172.21.15.88:0/3066483880 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f421c0147e0 con 0x7f422c0c6c40 2023-11-27T21:21:43.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.332+0000 7f42137fe640 1 --2- 172.21.15.88:0/3066483880 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f421806b210 0x7f421806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:43.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.332+0000 7f422a7fc640 1 --2- 172.21.15.88:0/3066483880 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f421806b210 0x7f421806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:43.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.333+0000 7f422a7fc640 1 --2- 172.21.15.88:0/3066483880 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f421806b210 0x7f421806d6d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4220036000 tx=0x7f422003d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:43.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.347+0000 7f42137fe640 1 -- 172.21.15.88:0/3066483880 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f421c05a1d0 con 0x7f422c0c6c40 2023-11-27T21:21:43.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.347+0000 7f42137fe640 1 -- 172.21.15.88:0/3066483880 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f421c055e10 con 0x7f422c0c6c40 2023-11-27T21:21:43.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.521+0000 7f423177c640 1 -- 172.21.15.88:0/3066483880 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f422c0c1840 con 0x7f422c0c6c40 2023-11-27T21:21:43.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.528+0000 7f42137fe640 1 -- 172.21.15.88:0/3066483880 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f421c059430 con 0x7f422c0c6c40 2023-11-27T21:21:43.530 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-27T21:21:43.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.530+0000 7f423177c640 1 -- 172.21.15.88:0/3066483880 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f421806b210 msgr2=0x7f421806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:43.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.530+0000 7f423177c640 1 --2- 172.21.15.88:0/3066483880 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f421806b210 0x7f421806d6d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4220036000 tx=0x7f422003d040 comp rx=0 tx=0).stop 2023-11-27T21:21:43.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.530+0000 7f423177c640 1 -- 172.21.15.88:0/3066483880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f422c0c6c40 msgr2=0x7f422c072390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:43.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.530+0000 7f423177c640 1 --2- 172.21.15.88:0/3066483880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f422c0c6c40 0x7f422c072390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f421c009d90 tx=0x7f421c00c490 comp rx=0 tx=0).stop 2023-11-27T21:21:43.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.530+0000 7f423177c640 1 -- 172.21.15.88:0/3066483880 shutdown_connections 2023-11-27T21:21:43.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.530+0000 7f423177c640 1 --2- 172.21.15.88:0/3066483880 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f421806b210 0x7f421806d6d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:43.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.530+0000 7f423177c640 1 --2- 172.21.15.88:0/3066483880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f422c0c7a30 0x7f422c1ef250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:43.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.530+0000 7f423177c640 1 --2- 172.21.15.88:0/3066483880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f422c0c7650 0x7f422c1eed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:43.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.530+0000 7f423177c640 1 --2- 172.21.15.88:0/3066483880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f422c0c6c40 0x7f422c072390 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:43.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.530+0000 7f423177c640 1 -- 172.21.15.88:0/3066483880 >> 172.21.15.88:0/3066483880 conn(0x7f422c06c5f0 msgr2=0x7f422c0c1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:43.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.530+0000 7f423177c640 1 -- 172.21.15.88:0/3066483880 shutdown_connections 2023-11-27T21:21:43.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.530+0000 7f423177c640 1 -- 172.21.15.88:0/3066483880 wait complete. 2023-11-27T21:21:43.545 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T21:21:43.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.646+0000 7f0a240bb640 1 Processor -- start 2023-11-27T21:21:43.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.647+0000 7f0a240bb640 1 -- start start 2023-11-27T21:21:43.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.647+0000 7f0a240bb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a1c14fba0 0x7f0a1c0c1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:43.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.647+0000 7f0a240bb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0a1c06e480 0x7f0a1c06e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:43.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.648+0000 7f0a240bb640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a1c0c1ba0 con 0x7f0a1c14ff80 2023-11-27T21:21:43.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.648+0000 7f0a240bb640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a1c0c3c20 con 0x7f0a1c06e480 2023-11-27T21:21:43.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.648+0000 7f0a240bb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c0c3f00 con 0x7f0a1c14fba0 2023-11-27T21:21:43.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.648+0000 7f0a21e57640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a1c14fba0 0x7f0a1c0c1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:43.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.648+0000 7f0a22658640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0a1c06e480 0x7f0a1c06e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:43.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.649+0000 7f0a21e57640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a1c14fba0 0x7f0a1c0c1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:56096/0 (socket says 172.21.15.88:56096) 2023-11-27T21:21:43.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.649+0000 7f0a21e57640 1 -- 172.21.15.88:0/1979371700 learned_addr learned my addr 172.21.15.88:0/1979371700 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:43.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.651+0000 7f0a21e57640 1 -- 172.21.15.88:0/1979371700 >> v2:172.21.15.167:3300/0 conn(0x7f0a1c06e480 msgr2=0x7f0a1c06e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:21:43.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.651+0000 7f0a21e57640 1 --2- 172.21.15.88:0/1979371700 >> v2:172.21.15.167:3300/0 conn(0x7f0a1c06e480 0x7f0a1c06e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:43.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.651+0000 7f0a21e57640 1 -- 172.21.15.88:0/1979371700 >> v1:172.21.15.167:6789/0 conn(0x7f0a1c14ff80 legacy=0x7f0a1c0c12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:43.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.651+0000 7f0a21e57640 1 -- 172.21.15.88:0/1979371700 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1c0c41e0 con 0x7f0a1c14fba0 2023-11-27T21:21:43.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.653+0000 7f0a21e57640 1 --2- 172.21.15.88:0/1979371700 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a1c14fba0 0x7f0a1c0c1f30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800af60 tx=0x7f0a1802d100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7341a55a6898da21 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:43.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.657+0000 7f0a20e55640 1 -- 172.21.15.88:0/1979371700 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1802daa0 con 0x7f0a1c14fba0 2023-11-27T21:21:43.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.657+0000 7f0a20e55640 1 -- 172.21.15.88:0/1979371700 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1802dc00 con 0x7f0a1c14fba0 2023-11-27T21:21:43.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.657+0000 7f0a20e55640 1 -- 172.21.15.88:0/1979371700 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a18008500 con 0x7f0a1c14fba0 2023-11-27T21:21:43.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.658+0000 7f0a240bb640 1 -- 172.21.15.88:0/1979371700 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a1c14fba0 msgr2=0x7f0a1c0c1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:43.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.658+0000 7f0a240bb640 1 --2- 172.21.15.88:0/1979371700 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a1c14fba0 0x7f0a1c0c1f30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800af60 tx=0x7f0a1802d100 comp rx=0 tx=0).stop 2023-11-27T21:21:43.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.658+0000 7f0a240bb640 1 -- 172.21.15.88:0/1979371700 shutdown_connections 2023-11-27T21:21:43.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.658+0000 7f0a240bb640 1 --2- 172.21.15.88:0/1979371700 >> v2:172.21.15.167:3300/0 conn(0x7f0a1c06e480 0x7f0a1c06e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:43.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.658+0000 7f0a240bb640 1 --2- 172.21.15.88:0/1979371700 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a1c14fba0 0x7f0a1c0c1f30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:43.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.658+0000 7f0a240bb640 1 -- 172.21.15.88:0/1979371700 >> 172.21.15.88:0/1979371700 conn(0x7f0a1c06c5f0 msgr2=0x7f0a1c06c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:43.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.658+0000 7f0a240bb640 1 -- 172.21.15.88:0/1979371700 shutdown_connections 2023-11-27T21:21:43.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.658+0000 7f0a240bb640 1 -- 172.21.15.88:0/1979371700 wait complete. 2023-11-27T21:21:43.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.659+0000 7f0a240bb640 1 Processor -- start 2023-11-27T21:21:43.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.659+0000 7f0a240bb640 1 -- start start 2023-11-27T21:21:43.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.660+0000 7f0a240bb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a1c06e480 0x7f0a1c149300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:43.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.660+0000 7f0a240bb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a1c14fba0 0x7f0a1c1ed7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:43.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.660+0000 7f0a240bb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a1c1f19e0 0x7f0a1c1595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:43.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.660+0000 7f0a240bb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c0caa50 con 0x7f0a1c14fba0 2023-11-27T21:21:43.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.660+0000 7f0a240bb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c148490 con 0x7f0a1c06e480 2023-11-27T21:21:43.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.660+0000 7f0a240bb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c148750 con 0x7f0a1c1f19e0 2023-11-27T21:21:43.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.660+0000 7f0a21e57640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a1c06e480 0x7f0a1c149300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:43.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.660+0000 7f0a21656640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a1c14fba0 0x7f0a1c1ed7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:43.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.660+0000 7f0a22658640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a1c1f19e0 0x7f0a1c1595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:43.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.660+0000 7f0a21e57640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a1c06e480 0x7f0a1c149300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:36884/0 (socket says 172.21.15.88:36884) 2023-11-27T21:21:43.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.660+0000 7f0a21e57640 1 -- 172.21.15.88:0/1215856778 learned_addr learned my addr 172.21.15.88:0/1215856778 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:43.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.664+0000 7f0a21e57640 1 -- 172.21.15.88:0/1215856778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a1c1f19e0 msgr2=0x7f0a1c1595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:43.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.664+0000 7f0a21e57640 1 --2- 172.21.15.88:0/1215856778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a1c1f19e0 0x7f0a1c1595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:43.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.664+0000 7f0a21e57640 1 -- 172.21.15.88:0/1215856778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a1c14fba0 msgr2=0x7f0a1c1ed7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:43.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.664+0000 7f0a21e57640 1 --2- 172.21.15.88:0/1215856778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a1c14fba0 0x7f0a1c1ed7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:43.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.664+0000 7f0a21e57640 1 -- 172.21.15.88:0/1215856778 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1800ac40 con 0x7f0a1c06e480 2023-11-27T21:21:43.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.666+0000 7f0a21e57640 1 --2- 172.21.15.88:0/1215856778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a1c06e480 0x7f0a1c149300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0a18000f80 tx=0x7f0a18004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:43.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.670+0000 7f0a127fc640 1 -- 172.21.15.88:0/1215856778 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1802daa0 con 0x7f0a1c06e480 2023-11-27T21:21:43.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.670+0000 7f0a127fc640 1 -- 172.21.15.88:0/1215856778 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a18040690 con 0x7f0a1c06e480 2023-11-27T21:21:43.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.670+0000 7f0a240bb640 1 -- 172.21.15.88:0/1215856778 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1c148a30 con 0x7f0a1c06e480 2023-11-27T21:21:43.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.670+0000 7f0a127fc640 1 -- 172.21.15.88:0/1215856778 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a18040a40 con 0x7f0a1c06e480 2023-11-27T21:21:43.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.670+0000 7f0a240bb640 1 -- 172.21.15.88:0/1215856778 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1c1f11e0 con 0x7f0a1c06e480 2023-11-27T21:21:43.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.671+0000 7f0a240bb640 1 -- 172.21.15.88:0/1215856778 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a1c1f0d60 con 0x7f0a1c06e480 2023-11-27T21:21:43.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.918+0000 7f0a127fc640 1 -- 172.21.15.88:0/1215856778 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0a18040ba0 con 0x7f0a1c06e480 2023-11-27T21:21:43.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.919+0000 7f0a127fc640 1 --2- 172.21.15.88:0/1215856778 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f0a0006b210 0x7f0a0006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:43.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.919+0000 7f0a21656640 1 --2- 172.21.15.88:0/1215856778 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f0a0006b210 0x7f0a0006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:43.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.920+0000 7f0a21656640 1 --2- 172.21.15.88:0/1215856778 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f0a0006b210 0x7f0a0006d6d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c1eb420 tx=0x7f0a0c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:43.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.921+0000 7f0a127fc640 1 -- 172.21.15.88:0/1215856778 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0a1807c260 con 0x7f0a1c06e480 2023-11-27T21:21:43.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:43.932+0000 7f0a127fc640 1 -- 172.21.15.88:0/1215856778 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0a180785a0 con 0x7f0a1c06e480 2023-11-27T21:21:44.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.097+0000 7f0a240bb640 1 -- 172.21.15.88:0/1215856778 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0a1c1f0d60 con 0x7f0a1c06e480 2023-11-27T21:21:44.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.104+0000 7f0a127fc640 1 -- 172.21.15.88:0/1215856778 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0a1c1f0d60 con 0x7f0a1c06e480 2023-11-27T21:21:44.106 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-11-27T21:21:44.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.106+0000 7f0a240bb640 1 -- 172.21.15.88:0/1215856778 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f0a0006b210 msgr2=0x7f0a0006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:44.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.106+0000 7f0a240bb640 1 --2- 172.21.15.88:0/1215856778 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f0a0006b210 0x7f0a0006d6d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c1eb420 tx=0x7f0a0c009040 comp rx=0 tx=0).stop 2023-11-27T21:21:44.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.106+0000 7f0a240bb640 1 -- 172.21.15.88:0/1215856778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a1c06e480 msgr2=0x7f0a1c149300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:44.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.106+0000 7f0a240bb640 1 --2- 172.21.15.88:0/1215856778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a1c06e480 0x7f0a1c149300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0a18000f80 tx=0x7f0a18004a40 comp rx=0 tx=0).stop 2023-11-27T21:21:44.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.106+0000 7f0a240bb640 1 -- 172.21.15.88:0/1215856778 shutdown_connections 2023-11-27T21:21:44.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.106+0000 7f0a240bb640 1 --2- 172.21.15.88:0/1215856778 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f0a0006b210 0x7f0a0006d6d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:44.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.106+0000 7f0a240bb640 1 --2- 172.21.15.88:0/1215856778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a1c1f19e0 0x7f0a1c1595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:44.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.106+0000 7f0a240bb640 1 --2- 172.21.15.88:0/1215856778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a1c14fba0 0x7f0a1c1ed7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:44.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.106+0000 7f0a240bb640 1 --2- 172.21.15.88:0/1215856778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a1c06e480 0x7f0a1c149300 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:44.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.106+0000 7f0a240bb640 1 -- 172.21.15.88:0/1215856778 >> 172.21.15.88:0/1215856778 conn(0x7f0a1c06c5f0 msgr2=0x7f0a1c155c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:44.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.106+0000 7f0a240bb640 1 -- 172.21.15.88:0/1215856778 shutdown_connections 2023-11-27T21:21:44.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.106+0000 7f0a240bb640 1 -- 172.21.15.88:0/1215856778 wait complete. 2023-11-27T21:21:44.119 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-27T21:21:44.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.223+0000 7f87257f1640 1 Processor -- start 2023-11-27T21:21:44.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.223+0000 7f87257f1640 1 -- start start 2023-11-27T21:21:44.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.223+0000 7f87257f1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f87200cda70 0x7f87200ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:44.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.223+0000 7f87257f1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f87200cc420 0x7f8720159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:44.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.223+0000 7f87257f1640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87200cbda0 con 0x7f8720159b50 2023-11-27T21:21:44.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.223+0000 7f87257f1640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87200cc230 con 0x7f87200cda70 2023-11-27T21:21:44.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.223+0000 7f87257f1640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87200cb4e0 con 0x7f87200cc420 2023-11-27T21:21:44.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.224+0000 7f871effd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f87200cda70 0x7f87200ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:44.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.224+0000 7f871e7fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f87200cc420 0x7f8720159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:44.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.224+0000 7f871e7fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f87200cc420 0x7f8720159610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:36886/0 (socket says 172.21.15.88:36886) 2023-11-27T21:21:44.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.224+0000 7f871e7fc640 1 -- 172.21.15.88:0/502802374 learned_addr learned my addr 172.21.15.88:0/502802374 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:44.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.227+0000 7f871e7fc640 1 -- 172.21.15.88:0/502802374 >> v2:172.21.15.88:3300/0 conn(0x7f87200cda70 msgr2=0x7f87200ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:21:44.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.227+0000 7f871e7fc640 1 --2- 172.21.15.88:0/502802374 >> v2:172.21.15.88:3300/0 conn(0x7f87200cda70 0x7f87200ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:44.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.227+0000 7f871e7fc640 1 -- 172.21.15.88:0/502802374 >> v1:172.21.15.88:6789/0 conn(0x7f8720159b50 legacy=0x7f87200c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:44.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.227+0000 7f871e7fc640 1 -- 172.21.15.88:0/502802374 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87200cce00 con 0x7f87200cc420 2023-11-27T21:21:44.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.229+0000 7f871e7fc640 1 --2- 172.21.15.88:0/502802374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87200cc420 0x7f8720159610 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f87200cfda0 tx=0x7f871402ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23925c03ad650b4c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:44.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.232+0000 7f871dffb640 1 -- 172.21.15.88:0/502802374 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871402f850 con 0x7f87200cc420 2023-11-27T21:21:44.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.232+0000 7f871dffb640 1 -- 172.21.15.88:0/502802374 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871402f9b0 con 0x7f87200cc420 2023-11-27T21:21:44.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.232+0000 7f871dffb640 1 -- 172.21.15.88:0/502802374 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871402fd40 con 0x7f87200cc420 2023-11-27T21:21:44.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.233+0000 7f87257f1640 1 -- 172.21.15.88:0/502802374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87200cc420 msgr2=0x7f8720159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:44.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.233+0000 7f87257f1640 1 --2- 172.21.15.88:0/502802374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87200cc420 0x7f8720159610 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f87200cfda0 tx=0x7f871402ba30 comp rx=0 tx=0).stop 2023-11-27T21:21:44.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.233+0000 7f87257f1640 1 -- 172.21.15.88:0/502802374 shutdown_connections 2023-11-27T21:21:44.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.233+0000 7f87257f1640 1 --2- 172.21.15.88:0/502802374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87200cc420 0x7f8720159610 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:44.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.233+0000 7f87257f1640 1 --2- 172.21.15.88:0/502802374 >> v2:172.21.15.88:3300/0 conn(0x7f87200cda70 0x7f87200ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:44.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.233+0000 7f87257f1640 1 -- 172.21.15.88:0/502802374 >> 172.21.15.88:0/502802374 conn(0x7f87200b07b0 msgr2=0x7f87200b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:44.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.233+0000 7f87257f1640 1 -- 172.21.15.88:0/502802374 shutdown_connections 2023-11-27T21:21:44.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.233+0000 7f87257f1640 1 -- 172.21.15.88:0/502802374 wait complete. 2023-11-27T21:21:44.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.234+0000 7f87257f1640 1 Processor -- start 2023-11-27T21:21:44.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.235+0000 7f87257f1640 1 -- start start 2023-11-27T21:21:44.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.235+0000 7f87257f1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87200cc420 0x7f87200b1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:44.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.235+0000 7f87257f1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87200cda70 0x7f87200c3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:44.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.235+0000 7f87257f1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8720159b50 0x7f87201f2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:44.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.235+0000 7f87257f1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87200b1d80 con 0x7f87200cc420 2023-11-27T21:21:44.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.235+0000 7f87257f1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8720154830 con 0x7f8720159b50 2023-11-27T21:21:44.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.235+0000 7f87257f1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87201553b0 con 0x7f87200cda70 2023-11-27T21:21:44.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.236+0000 7f871effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87200cc420 0x7f87200b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:44.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.236+0000 7f871effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87200cc420 0x7f87200b1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58802/0 (socket says 172.21.15.88:58802) 2023-11-27T21:21:44.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.236+0000 7f871effd640 1 -- 172.21.15.88:0/490105356 learned_addr learned my addr 172.21.15.88:0/490105356 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:44.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.236+0000 7f871f7fe640 1 --2- 172.21.15.88:0/490105356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8720159b50 0x7f87201f2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:44.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.236+0000 7f871e7fc640 1 --2- 172.21.15.88:0/490105356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87200cda70 0x7f87200c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:44.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.239+0000 7f871effd640 1 -- 172.21.15.88:0/490105356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87200cda70 msgr2=0x7f87200c3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:44.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.239+0000 7f871effd640 1 --2- 172.21.15.88:0/490105356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87200cda70 0x7f87200c3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:44.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.239+0000 7f871effd640 1 -- 172.21.15.88:0/490105356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8720159b50 msgr2=0x7f87201f2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:44.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.239+0000 7f871effd640 1 --2- 172.21.15.88:0/490105356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8720159b50 0x7f87201f2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:44.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.239+0000 7f871effd640 1 -- 172.21.15.88:0/490105356 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87140094d0 con 0x7f87200cc420 2023-11-27T21:21:44.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.242+0000 7f871effd640 1 --2- 172.21.15.88:0/490105356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87200cc420 0x7f87200b1840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8710009db0 tx=0x7f871000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:44.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.245+0000 7f87077fe640 1 -- 172.21.15.88:0/490105356 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710014480 con 0x7f87200cc420 2023-11-27T21:21:44.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.245+0000 7f87077fe640 1 -- 172.21.15.88:0/490105356 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871000f040 con 0x7f87200cc420 2023-11-27T21:21:44.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.246+0000 7f87077fe640 1 -- 172.21.15.88:0/490105356 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710014800 con 0x7f87200cc420 2023-11-27T21:21:44.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.246+0000 7f87257f1640 1 -- 172.21.15.88:0/490105356 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8720156a50 con 0x7f87200cc420 2023-11-27T21:21:44.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.246+0000 7f87257f1640 1 -- 172.21.15.88:0/490105356 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8720154d60 con 0x7f87200cc420 2023-11-27T21:21:44.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.246+0000 7f87257f1640 1 -- 172.21.15.88:0/490105356 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8720067470 con 0x7f87200cc420 2023-11-27T21:21:44.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.265+0000 7f87077fe640 1 -- 172.21.15.88:0/490105356 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8710014960 con 0x7f87200cc420 2023-11-27T21:21:44.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.265+0000 7f87077fe640 1 --2- 172.21.15.88:0/490105356 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f870c06b210 0x7f870c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:44.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.266+0000 7f871e7fc640 1 --2- 172.21.15.88:0/490105356 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f870c06b210 0x7f870c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:44.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.266+0000 7f871e7fc640 1 --2- 172.21.15.88:0/490105356 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f870c06b210 0x7f870c06d6d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8714036000 tx=0x7f8714008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:44.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.512+0000 7f87077fe640 1 -- 172.21.15.88:0/490105356 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8710027e60 con 0x7f87200cc420 2023-11-27T21:21:44.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.513+0000 7f87077fe640 1 -- 172.21.15.88:0/490105356 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8710055bf0 con 0x7f87200cc420 2023-11-27T21:21:44.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.685+0000 7f87257f1640 1 -- 172.21.15.88:0/490105356 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f87200b4c20 con 0x7f87200cc420 2023-11-27T21:21:44.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.690+0000 7f87077fe640 1 -- 172.21.15.88:0/490105356 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8710059210 con 0x7f87200cc420 2023-11-27T21:21:44.692 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-27T21:21:44.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.692+0000 7f87257f1640 1 -- 172.21.15.88:0/490105356 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f870c06b210 msgr2=0x7f870c06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:44.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.692+0000 7f87257f1640 1 --2- 172.21.15.88:0/490105356 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f870c06b210 0x7f870c06d6d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8714036000 tx=0x7f8714008030 comp rx=0 tx=0).stop 2023-11-27T21:21:44.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.692+0000 7f87257f1640 1 -- 172.21.15.88:0/490105356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87200cc420 msgr2=0x7f87200b1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:44.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.692+0000 7f87257f1640 1 --2- 172.21.15.88:0/490105356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87200cc420 0x7f87200b1840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8710009db0 tx=0x7f871000c490 comp rx=0 tx=0).stop 2023-11-27T21:21:44.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.692+0000 7f87257f1640 1 -- 172.21.15.88:0/490105356 shutdown_connections 2023-11-27T21:21:44.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.692+0000 7f87257f1640 1 --2- 172.21.15.88:0/490105356 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f870c06b210 0x7f870c06d6d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:44.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.692+0000 7f87257f1640 1 --2- 172.21.15.88:0/490105356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8720159b50 0x7f87201f2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:44.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.692+0000 7f87257f1640 1 --2- 172.21.15.88:0/490105356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87200cda70 0x7f87200c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:44.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.692+0000 7f87257f1640 1 --2- 172.21.15.88:0/490105356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87200cc420 0x7f87200b1840 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:44.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.692+0000 7f87257f1640 1 -- 172.21.15.88:0/490105356 >> 172.21.15.88:0/490105356 conn(0x7f87200b07b0 msgr2=0x7f87200c6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:44.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.692+0000 7f87257f1640 1 -- 172.21.15.88:0/490105356 shutdown_connections 2023-11-27T21:21:44.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.692+0000 7f87257f1640 1 -- 172.21.15.88:0/490105356 wait complete. 2023-11-27T21:21:44.706 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T21:21:44.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.804+0000 7f219ddbe640 1 Processor -- start 2023-11-27T21:21:44.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.804+0000 7f219ddbe640 1 -- start start 2023-11-27T21:21:44.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.805+0000 7f219ddbe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21980c5080 0x7f219806b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:44.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.805+0000 7f219ddbe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f219815ae40 0x7f219815b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:44.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.805+0000 7f219ddbe640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f219806a4b0 con 0x7f21980c4ca0 2023-11-27T21:21:44.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.805+0000 7f219ddbe640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f219815b830 con 0x7f219815ae40 2023-11-27T21:21:44.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.805+0000 7f219ddbe640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21980c8330 con 0x7f21980c5080 2023-11-27T21:21:44.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.806+0000 7f2196ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21980c5080 0x7f219806b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:44.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.806+0000 7f21977fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f21980c4ca0 0x7f2198157f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:57948/0 (socket says 172.21.15.88:57948) 2023-11-27T21:21:44.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.806+0000 7f21977fe640 1 -- 172.21.15.88:0/290669341 learned_addr learned my addr 172.21.15.88:0/290669341 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:21:44.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.806+0000 7f2197fff640 1 --2- 172.21.15.88:0/290669341 >> v2:172.21.15.167:3300/0 conn(0x7f219815ae40 0x7f219815b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:44.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.809+0000 7f2196ffd640 1 -- 172.21.15.88:0/290669341 >> v2:172.21.15.167:3300/0 conn(0x7f219815ae40 msgr2=0x7f219815b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:21:44.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.809+0000 7f2196ffd640 1 --2- 172.21.15.88:0/290669341 >> v2:172.21.15.167:3300/0 conn(0x7f219815ae40 0x7f219815b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:44.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.809+0000 7f2196ffd640 1 -- 172.21.15.88:0/290669341 >> v1:172.21.15.167:6789/0 conn(0x7f21980c4ca0 legacy=0x7f2198157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:44.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.809+0000 7f2196ffd640 1 -- 172.21.15.88:0/290669341 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21980c85d0 con 0x7f21980c5080 2023-11-27T21:21:44.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.811+0000 7f2196ffd640 1 --2- 172.21.15.88:0/290669341 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21980c5080 0x7f219806b930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f218c0097a0 tx=0x7f218c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db7ac081c2019d33 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:44.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.816+0000 7f21967fc640 1 -- 172.21.15.88:0/290669341 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c031830 con 0x7f21980c5080 2023-11-27T21:21:44.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.816+0000 7f21967fc640 1 -- 172.21.15.88:0/290669341 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218c031990 con 0x7f21980c5080 2023-11-27T21:21:44.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.816+0000 7f21967fc640 1 -- 172.21.15.88:0/290669341 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c031d20 con 0x7f21980c5080 2023-11-27T21:21:44.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.816+0000 7f219ddbe640 1 -- 172.21.15.88:0/290669341 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21980c5080 msgr2=0x7f219806b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:44.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.816+0000 7f219ddbe640 1 --2- 172.21.15.88:0/290669341 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21980c5080 0x7f219806b930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f218c0097a0 tx=0x7f218c02b8d0 comp rx=0 tx=0).stop 2023-11-27T21:21:44.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.816+0000 7f219ddbe640 1 -- 172.21.15.88:0/290669341 shutdown_connections 2023-11-27T21:21:44.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.816+0000 7f219ddbe640 1 --2- 172.21.15.88:0/290669341 >> v2:172.21.15.167:3300/0 conn(0x7f219815ae40 0x7f219815b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:44.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.816+0000 7f219ddbe640 1 --2- 172.21.15.88:0/290669341 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21980c5080 0x7f219806b930 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:44.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.816+0000 7f219ddbe640 1 -- 172.21.15.88:0/290669341 >> 172.21.15.88:0/290669341 conn(0x7f219806d170 msgr2=0x7f219806d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:44.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.816+0000 7f219ddbe640 1 -- 172.21.15.88:0/290669341 shutdown_connections 2023-11-27T21:21:44.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.816+0000 7f219ddbe640 1 -- 172.21.15.88:0/290669341 wait complete. 2023-11-27T21:21:44.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.817+0000 7f219ddbe640 1 Processor -- start 2023-11-27T21:21:44.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.818+0000 7f219ddbe640 1 -- start start 2023-11-27T21:21:44.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.818+0000 7f219ddbe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21980c4ca0 0x7f219815a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:44.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.818+0000 7f219ddbe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21980c5080 0x7f2198159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:44.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.818+0000 7f219ddbe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f219815ae40 0x7f2198143000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:44.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.818+0000 7f219ddbe640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219814d770 con 0x7f21980c5080 2023-11-27T21:21:44.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.818+0000 7f219ddbe640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2198143540 con 0x7f219815ae40 2023-11-27T21:21:44.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.818+0000 7f219ddbe640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2198159680 con 0x7f21980c4ca0 2023-11-27T21:21:44.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.819+0000 7f2196ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21980c5080 0x7f2198159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:44.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.819+0000 7f2197fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f219815ae40 0x7f2198143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:44.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.819+0000 7f21977fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21980c4ca0 0x7f219815a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:44.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.819+0000 7f2196ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21980c5080 0x7f2198159cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58804/0 (socket says 172.21.15.88:58804) 2023-11-27T21:21:44.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.819+0000 7f2196ffd640 1 -- 172.21.15.88:0/650510726 learned_addr learned my addr 172.21.15.88:0/650510726 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:44.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.822+0000 7f2196ffd640 1 -- 172.21.15.88:0/650510726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21980c4ca0 msgr2=0x7f219815a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:44.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.822+0000 7f2196ffd640 1 --2- 172.21.15.88:0/650510726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21980c4ca0 0x7f219815a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:44.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.822+0000 7f2196ffd640 1 -- 172.21.15.88:0/650510726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f219815ae40 msgr2=0x7f2198143000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:44.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.822+0000 7f2196ffd640 1 --2- 172.21.15.88:0/650510726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f219815ae40 0x7f2198143000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:44.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.823+0000 7f2196ffd640 1 -- 172.21.15.88:0/650510726 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218c009400 con 0x7f21980c5080 2023-11-27T21:21:44.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.825+0000 7f2196ffd640 1 --2- 172.21.15.88:0/650510726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21980c5080 0x7f2198159cc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f218c02bee0 tx=0x7f218c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:44.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.828+0000 7f217ffff640 1 -- 172.21.15.88:0/650510726 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c03b9f0 con 0x7f21980c5080 2023-11-27T21:21:44.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.828+0000 7f217ffff640 1 -- 172.21.15.88:0/650510726 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218c03bb70 con 0x7f21980c5080 2023-11-27T21:21:44.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.828+0000 7f217ffff640 1 -- 172.21.15.88:0/650510726 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c0453f0 con 0x7f21980c5080 2023-11-27T21:21:44.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.828+0000 7f219ddbe640 1 -- 172.21.15.88:0/650510726 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21981ec9c0 con 0x7f21980c5080 2023-11-27T21:21:44.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.828+0000 7f219ddbe640 1 -- 172.21.15.88:0/650510726 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21981ecf80 con 0x7f21980c5080 2023-11-27T21:21:44.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.829+0000 7f219ddbe640 1 -- 172.21.15.88:0/650510726 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2198067470 con 0x7f21980c5080 2023-11-27T21:21:44.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.848+0000 7f217ffff640 1 -- 172.21.15.88:0/650510726 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f218c045550 con 0x7f21980c5080 2023-11-27T21:21:44.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.848+0000 7f217ffff640 1 --2- 172.21.15.88:0/650510726 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f218406b240 0x7f218406d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:44.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.849+0000 7f21977fe640 1 --2- 172.21.15.88:0/650510726 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f218406b240 0x7f218406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:44.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:44.849+0000 7f21977fe640 1 --2- 172.21.15.88:0/650510726 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f218406b240 0x7f218406d700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2188007fd0 tx=0x7f2188007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:45.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.081+0000 7f217ffff640 1 -- 172.21.15.88:0/650510726 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f218c04fe60 con 0x7f21980c5080 2023-11-27T21:21:45.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.081+0000 7f217ffff640 1 -- 172.21.15.88:0/650510726 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f218c076f30 con 0x7f21980c5080 2023-11-27T21:21:45.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.261+0000 7f219ddbe640 1 -- 172.21.15.88:0/650510726 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f21980c8bc0 con 0x7f21980c5080 2023-11-27T21:21:45.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.266+0000 7f217ffff640 1 -- 172.21.15.88:0/650510726 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f218c035080 con 0x7f21980c5080 2023-11-27T21:21:45.268 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-11-27T21:21:45.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.268+0000 7f219ddbe640 1 -- 172.21.15.88:0/650510726 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f218406b240 msgr2=0x7f218406d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:45.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.268+0000 7f219ddbe640 1 --2- 172.21.15.88:0/650510726 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f218406b240 0x7f218406d700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2188007fd0 tx=0x7f2188007e80 comp rx=0 tx=0).stop 2023-11-27T21:21:45.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.268+0000 7f219ddbe640 1 -- 172.21.15.88:0/650510726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21980c5080 msgr2=0x7f2198159cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:45.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.268+0000 7f219ddbe640 1 --2- 172.21.15.88:0/650510726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21980c5080 0x7f2198159cc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f218c02bee0 tx=0x7f218c0046c0 comp rx=0 tx=0).stop 2023-11-27T21:21:45.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.268+0000 7f219ddbe640 1 -- 172.21.15.88:0/650510726 shutdown_connections 2023-11-27T21:21:45.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.268+0000 7f219ddbe640 1 --2- 172.21.15.88:0/650510726 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f218406b240 0x7f218406d700 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:45.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.268+0000 7f219ddbe640 1 --2- 172.21.15.88:0/650510726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f219815ae40 0x7f2198143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:45.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.268+0000 7f219ddbe640 1 --2- 172.21.15.88:0/650510726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21980c5080 0x7f2198159cc0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:45.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.268+0000 7f219ddbe640 1 --2- 172.21.15.88:0/650510726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21980c4ca0 0x7f219815a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:45.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.268+0000 7f219ddbe640 1 -- 172.21.15.88:0/650510726 >> 172.21.15.88:0/650510726 conn(0x7f219806d170 msgr2=0x7f219806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:45.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.268+0000 7f219ddbe640 1 -- 172.21.15.88:0/650510726 shutdown_connections 2023-11-27T21:21:45.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.268+0000 7f219ddbe640 1 -- 172.21.15.88:0/650510726 wait complete. 2023-11-27T21:21:45.284 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-27T21:21:45.284 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T21:21:45.299 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T21:21:45.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.437+0000 7f2a8cb25640 1 Processor -- start 2023-11-27T21:21:45.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.437+0000 7f2a8cb25640 1 -- start start 2023-11-27T21:21:45.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.438+0000 7f2a8cb25640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2a880721e0 0x7f2a881598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:45.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.438+0000 7f2a8cb25640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a88072af0 con 0x7f2a88159de0 2023-11-27T21:21:45.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.438+0000 7f2a8cb25640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a880c1c10 con 0x7f2a881594c0 2023-11-27T21:21:45.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.438+0000 7f2a8cb25640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a880c04e0 con 0x7f2a880721e0 2023-11-27T21:21:45.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.439+0000 7f2a8659c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f2a881594c0 0x7f2a8806cbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:57958/0 (socket says 172.21.15.88:57958) 2023-11-27T21:21:45.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.439+0000 7f2a8659c640 1 -- 172.21.15.88:0/4137558646 learned_addr learned my addr 172.21.15.88:0/4137558646 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:21:45.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.439+0000 7f2a85d9b640 1 --2- 172.21.15.88:0/4137558646 >> v2:172.21.15.167:3300/0 conn(0x7f2a880721e0 0x7f2a881598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:45.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.443+0000 7f2a85d9b640 1 -- 172.21.15.88:0/4137558646 >> v1:172.21.15.167:6789/0 conn(0x7f2a881594c0 legacy=0x7f2a8806cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:45.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.443+0000 7f2a85d9b640 1 -- 172.21.15.88:0/4137558646 >> v1:172.21.15.88:6789/0 conn(0x7f2a88159de0 legacy=0x7f2a88163d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:45.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.443+0000 7f2a85d9b640 1 -- 172.21.15.88:0/4137558646 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a880c20a0 con 0x7f2a880721e0 2023-11-27T21:21:45.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.446+0000 7f2a85d9b640 1 --2- 172.21.15.88:0/4137558646 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a880721e0 0x7f2a881598a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2a700097a0 tx=0x7f2a7002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=465ef0f76cc19cd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.452+0000 7f2a8559a640 1 -- 172.21.15.88:0/4137558646 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a70030610 con 0x7f2a880721e0 2023-11-27T21:21:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.452+0000 7f2a8559a640 1 -- 172.21.15.88:0/4137558646 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a70030770 con 0x7f2a880721e0 2023-11-27T21:21:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.452+0000 7f2a8559a640 1 -- 172.21.15.88:0/4137558646 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a70030b00 con 0x7f2a880721e0 2023-11-27T21:21:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.452+0000 7f2a8cb25640 1 -- 172.21.15.88:0/4137558646 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a880721e0 msgr2=0x7f2a881598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.452+0000 7f2a8cb25640 1 --2- 172.21.15.88:0/4137558646 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a880721e0 0x7f2a881598a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2a700097a0 tx=0x7f2a7002b960 comp rx=0 tx=0).stop 2023-11-27T21:21:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.453+0000 7f2a8cb25640 1 -- 172.21.15.88:0/4137558646 shutdown_connections 2023-11-27T21:21:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.453+0000 7f2a8cb25640 1 --2- 172.21.15.88:0/4137558646 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a880721e0 0x7f2a881598a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.453+0000 7f2a8cb25640 1 -- 172.21.15.88:0/4137558646 >> 172.21.15.88:0/4137558646 conn(0x7f2a880c79a0 msgr2=0x7f2a880c7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.453+0000 7f2a8cb25640 1 -- 172.21.15.88:0/4137558646 shutdown_connections 2023-11-27T21:21:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.453+0000 7f2a8cb25640 1 -- 172.21.15.88:0/4137558646 wait complete. 2023-11-27T21:21:45.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.454+0000 7f2a8cb25640 1 Processor -- start 2023-11-27T21:21:45.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.454+0000 7f2a8cb25640 1 -- start start 2023-11-27T21:21:45.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.455+0000 7f2a8cb25640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a880721e0 0x7f2a881f2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:45.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.455+0000 7f2a8cb25640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a881594c0 0x7f2a880c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:45.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.455+0000 7f2a8cb25640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a88159de0 0x7f2a8814a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:45.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.455+0000 7f2a8cb25640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a881f3130 con 0x7f2a881594c0 2023-11-27T21:21:45.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.455+0000 7f2a8cb25640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a881577d0 con 0x7f2a880721e0 2023-11-27T21:21:45.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.455+0000 7f2a8cb25640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a880ca4a0 con 0x7f2a88159de0 2023-11-27T21:21:45.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.455+0000 7f2a85d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a881594c0 0x7f2a880c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:45.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.455+0000 7f2a8659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a880721e0 0x7f2a881f2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:45.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.455+0000 7f2a86d9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a88159de0 0x7f2a8814a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:45.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.455+0000 7f2a8659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a880721e0 0x7f2a881f2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:36932/0 (socket says 172.21.15.88:36932) 2023-11-27T21:21:45.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.455+0000 7f2a8659c640 1 -- 172.21.15.88:0/3221261742 learned_addr learned my addr 172.21.15.88:0/3221261742 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:45.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.459+0000 7f2a8659c640 1 -- 172.21.15.88:0/3221261742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a88159de0 msgr2=0x7f2a8814a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:45.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.459+0000 7f2a8659c640 1 --2- 172.21.15.88:0/3221261742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a88159de0 0x7f2a8814a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:45.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.459+0000 7f2a8659c640 1 -- 172.21.15.88:0/3221261742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a881594c0 msgr2=0x7f2a880c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:45.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.459+0000 7f2a8659c640 1 --2- 172.21.15.88:0/3221261742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a881594c0 0x7f2a880c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:45.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.459+0000 7f2a8659c640 1 -- 172.21.15.88:0/3221261742 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a70009400 con 0x7f2a880721e0 2023-11-27T21:21:45.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.461+0000 7f2a8659c640 1 --2- 172.21.15.88:0/3221261742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a880721e0 0x7f2a881f2bf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2a8000cba0 tx=0x7f2a8000a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:45.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.465+0000 7f2a7effd640 1 -- 172.21.15.88:0/3221261742 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8000ad40 con 0x7f2a880721e0 2023-11-27T21:21:45.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.465+0000 7f2a7effd640 1 -- 172.21.15.88:0/3221261742 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a80012400 con 0x7f2a880721e0 2023-11-27T21:21:45.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.465+0000 7f2a7effd640 1 -- 172.21.15.88:0/3221261742 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8000aea0 con 0x7f2a880721e0 2023-11-27T21:21:45.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.465+0000 7f2a8cb25640 1 -- 172.21.15.88:0/3221261742 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a880ca780 con 0x7f2a880721e0 2023-11-27T21:21:45.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.465+0000 7f2a8cb25640 1 -- 172.21.15.88:0/3221261742 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a88157460 con 0x7f2a880721e0 2023-11-27T21:21:45.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.466+0000 7f2a8cb25640 1 -- 172.21.15.88:0/3221261742 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a880caca0 con 0x7f2a880721e0 2023-11-27T21:21:45.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.485+0000 7f2a7effd640 1 -- 172.21.15.88:0/3221261742 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2a80007070 con 0x7f2a880721e0 2023-11-27T21:21:45.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.485+0000 7f2a7effd640 1 --2- 172.21.15.88:0/3221261742 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f2a6806b210 0x7f2a6806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:45.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.486+0000 7f2a85d9b640 1 --2- 172.21.15.88:0/3221261742 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f2a6806b210 0x7f2a6806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:45.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.486+0000 7f2a85d9b640 1 --2- 172.21.15.88:0/3221261742 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f2a6806b210 0x7f2a6806d6d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2a70036000 tx=0x7f2a70008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:45.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.489+0000 7f2a7effd640 1 -- 172.21.15.88:0/3221261742 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2a80058760 con 0x7f2a880721e0 2023-11-27T21:21:45.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.729+0000 7f2a7effd640 1 -- 172.21.15.88:0/3221261742 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2a80054aa0 con 0x7f2a880721e0 2023-11-27T21:21:45.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.912+0000 7f2a8cb25640 1 -- 172.21.15.88:0/3221261742 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a880caca0 con 0x7f2a880721e0 2023-11-27T21:21:45.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.953+0000 7f2a7effd640 1 -- 172.21.15.88:0/3221261742 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18666 (secure 0 0 0) 0x7f2a880caca0 con 0x7f2a880721e0 2023-11-27T21:21:45.960 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T21:21:45.960 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":28,"fsid":"ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc","created":"2023-11-27T20:53:53.110827+0000","modified":"2023-11-27T20:55:00.550945+0000","last_up_change":"2023-11-27T20:54:08.219383+0000","last_in_change":"2023-11-27T20:53:59.022798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:54:09.277670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:54:24.503156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:54:25.744043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T20:54:29.704111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1207ca0f-bef1-44c6-b66b-58bf0e080ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6819","nonce":3952326022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6821","nonce":3952326022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6825","nonce":3952326022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6823","nonce":3952326022}]},"public_addr":"172.21.15.88:6819/3952326022","cluster_addr":"172.21.15.88:6821/3952326022","heartbeat_back_addr":"172.21.15.88:6825/3952326022","heartbeat_front_addr":"172.21.15.88:6823/3952326022","state":["exists","up"]},{"osd":1,"uuid":"8d1be479-4241-4335-9633-1394311fde76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6827","nonce":1788401966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6829","nonce":1788401966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6833","nonce":1788401966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6831","nonce":1788401966}]},"public_addr":"172.21.15.88:6827/1788401966","cluster_addr":"172.21.15.88:6829/1788401966","heartbeat_back_addr":"172.21.15.88:6833/1788401966","heartbeat_front_addr":"172.21.15.88:6831/1788401966","state":["exists","up"]},{"osd":2,"uuid":"7536b008-05dd-40eb-9d4a-bdac4b1c38c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6803","nonce":1166333913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6805","nonce":1166333913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6809","nonce":1166333913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6807","nonce":1166333913}]},"public_addr":"172.21.15.88:6803/1166333913","cluster_addr":"172.21.15.88:6805/1166333913","heartbeat_back_addr":"172.21.15.88:6809/1166333913","heartbeat_front_addr":"172.21.15.88:6807/1166333913","state":["exists","up"]},{"osd":3,"uuid":"47edd4d7-e99c-4ce3-851b-cc9c8e2d4480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6811","nonce":406887502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6813","nonce":406887502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6817","nonce":406887502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6815","nonce":406887502}]},"public_addr":"172.21.15.88:6811/406887502","cluster_addr":"172.21.15.88:6813/406887502","heartbeat_back_addr":"172.21.15.88:6817/406887502","heartbeat_front_addr":"172.21.15.88:6815/406887502","state":["exists","up"]},{"osd":4,"uuid":"0a81dd31-1a8b-41af-b933-d74aae63f3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6801","nonce":2551293703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6803","nonce":2551293703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6807","nonce":2551293703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6805","nonce":2551293703}]},"public_addr":"172.21.15.167:6801/2551293703","cluster_addr":"172.21.15.167:6803/2551293703","heartbeat_back_addr":"172.21.15.167:6807/2551293703","heartbeat_front_addr":"172.21.15.167:6805/2551293703","state":["exists","up"]},{"osd":5,"uuid":"1c462d0d-3361-48b3-a82a-86a920539e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6825","nonce":866085094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6827","nonce":866085094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6831","nonce":866085094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6829","nonce":866085094}]},"public_addr":"172.21.15.167:6825/866085094","cluster_addr":"172.21.15.167:6827/866085094","heartbeat_back_addr":"172.21.15.167:6831/866085094","heartbeat_front_addr":"172.21.15.167:6829/866085094","state":["exists","up"]},{"osd":6,"uuid":"d687c5ad-6c88-4a15-8120-0cdbc5610535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6809","nonce":2766725538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6811","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6813","nonce":2766725538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6819","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6821","nonce":2766725538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6815","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6817","nonce":2766725538}]},"public_addr":"172.21.15.167:6809/2766725538","cluster_addr":"172.21.15.167:6813/2766725538","heartbeat_back_addr":"172.21.15.167:6821/2766725538","heartbeat_front_addr":"172.21.15.167:6817/2766725538","state":["exists","up"]},{"osd":7,"uuid":"c9a50596-4981-4bd8-a8ef-d7679f8d9559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6812","nonce":2695037266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6816","nonce":2695037266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6823","nonce":2695037266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6820","nonce":2695037266}]},"public_addr":"172.21.15.167:6812/2695037266","cluster_addr":"172.21.15.167:6816/2695037266","heartbeat_back_addr":"172.21.15.167:6823/2695037266","heartbeat_front_addr":"172.21.15.167:6820/2695037266","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.522590+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.483170+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.492504+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.432204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.414964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.459803+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.437250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.460394+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.1d","mappings":[{"from":0,"to":1}]},{"pgid":"3.35","mappings":[{"from":0,"to":7}]},{"pgid":"4.4","mappings":[{"from":6,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":4}]},{"pgid":"4.e","mappings":[{"from":3,"to":5}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T21:21:45.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.955+0000 7f2a8cb25640 1 -- 172.21.15.88:0/3221261742 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f2a6806b210 msgr2=0x7f2a6806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:45.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.955+0000 7f2a8cb25640 1 --2- 172.21.15.88:0/3221261742 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f2a6806b210 0x7f2a6806d6d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2a70036000 tx=0x7f2a70008030 comp rx=0 tx=0).stop 2023-11-27T21:21:45.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.955+0000 7f2a8cb25640 1 -- 172.21.15.88:0/3221261742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a880721e0 msgr2=0x7f2a881f2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:45.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.955+0000 7f2a8cb25640 1 --2- 172.21.15.88:0/3221261742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a880721e0 0x7f2a881f2bf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2a8000cba0 tx=0x7f2a8000a430 comp rx=0 tx=0).stop 2023-11-27T21:21:45.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.955+0000 7f2a8cb25640 1 -- 172.21.15.88:0/3221261742 shutdown_connections 2023-11-27T21:21:45.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.955+0000 7f2a8cb25640 1 --2- 172.21.15.88:0/3221261742 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f2a6806b210 0x7f2a6806d6d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:45.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.955+0000 7f2a8cb25640 1 --2- 172.21.15.88:0/3221261742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a88159de0 0x7f2a8814a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:45.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.955+0000 7f2a8cb25640 1 --2- 172.21.15.88:0/3221261742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a881594c0 0x7f2a880c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:45.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.955+0000 7f2a8cb25640 1 --2- 172.21.15.88:0/3221261742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a880721e0 0x7f2a881f2bf0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:45.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.955+0000 7f2a8cb25640 1 -- 172.21.15.88:0/3221261742 >> 172.21.15.88:0/3221261742 conn(0x7f2a880c79a0 msgr2=0x7f2a88152280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:45.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.955+0000 7f2a8cb25640 1 -- 172.21.15.88:0/3221261742 shutdown_connections 2023-11-27T21:21:45.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:45.955+0000 7f2a8cb25640 1 -- 172.21.15.88:0/3221261742 wait complete. 2023-11-27T21:21:45.969 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:54:09.277670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:54:24.503156+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:54:25.744043+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-27T20:54:29.704111+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-27T21:21:45.970 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T21:21:46.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.074+0000 7f1ca0283640 1 Processor -- start 2023-11-27T21:21:46.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.074+0000 7f1ca0283640 1 -- start start 2023-11-27T21:21:46.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.075+0000 7f1ca0283640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c980cbf00 0x7f1c980ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:46.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.075+0000 7f1ca0283640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1c980cd000 0x7f1c980cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:46.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.075+0000 7f1ca0283640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c980cba70 con 0x7f1c980c9c70 2023-11-27T21:21:46.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.075+0000 7f1ca0283640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c98153c60 con 0x7f1c980cd000 2023-11-27T21:21:46.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.075+0000 7f1ca0283640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c980cb490 con 0x7f1c980cbf00 2023-11-27T21:21:46.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.076+0000 7f1c9e820640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1c980cd000 0x7f1c980cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:46.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.076+0000 7f1c9e820640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1c980cd000 0x7f1c980cd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58816/0 (socket says 172.21.15.88:58816) 2023-11-27T21:21:46.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.076+0000 7f1c9e820640 1 -- 172.21.15.88:0/1353860939 learned_addr learned my addr 172.21.15.88:0/1353860939 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:46.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.078+0000 7f1c9e820640 1 -- 172.21.15.88:0/1353860939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c980cbf00 msgr2=0x7f1c980ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:21:46.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.078+0000 7f1c9e820640 1 --2- 172.21.15.88:0/1353860939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c980cbf00 0x7f1c980ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:46.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.078+0000 7f1c9e820640 1 -- 172.21.15.88:0/1353860939 >> v1:172.21.15.167:6789/0 conn(0x7f1c980c9c70 legacy=0x7f1c981594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:21:46.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.078+0000 7f1c9e820640 1 -- 172.21.15.88:0/1353860939 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c980ce2f0 con 0x7f1c980cd000 2023-11-27T21:21:46.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.080+0000 7f1c9e820640 1 --2- 172.21.15.88:0/1353860939 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c980cd000 0x7f1c980cd430 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1c90009870 tx=0x7f1c9002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4cb6c465b73635 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:46.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.084+0000 7f1c9d01d640 1 -- 172.21.15.88:0/1353860939 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c90031640 con 0x7f1c980cd000 2023-11-27T21:21:46.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.084+0000 7f1c9d01d640 1 -- 172.21.15.88:0/1353860939 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c900317a0 con 0x7f1c980cd000 2023-11-27T21:21:46.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.084+0000 7f1c9d01d640 1 -- 172.21.15.88:0/1353860939 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c90031b30 con 0x7f1c980cd000 2023-11-27T21:21:46.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.084+0000 7f1ca0283640 1 -- 172.21.15.88:0/1353860939 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c980cd000 msgr2=0x7f1c980cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:46.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.084+0000 7f1ca0283640 1 --2- 172.21.15.88:0/1353860939 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c980cd000 0x7f1c980cd430 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1c90009870 tx=0x7f1c9002b8f0 comp rx=0 tx=0).stop 2023-11-27T21:21:46.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.084+0000 7f1ca0283640 1 -- 172.21.15.88:0/1353860939 shutdown_connections 2023-11-27T21:21:46.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.084+0000 7f1ca0283640 1 --2- 172.21.15.88:0/1353860939 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c980cd000 0x7f1c980cd430 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:46.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.084+0000 7f1ca0283640 1 --2- 172.21.15.88:0/1353860939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c980cbf00 0x7f1c980ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:46.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.084+0000 7f1ca0283640 1 -- 172.21.15.88:0/1353860939 >> 172.21.15.88:0/1353860939 conn(0x7f1c980b07d0 msgr2=0x7f1c980b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:46.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.084+0000 7f1ca0283640 1 -- 172.21.15.88:0/1353860939 shutdown_connections 2023-11-27T21:21:46.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.084+0000 7f1ca0283640 1 -- 172.21.15.88:0/1353860939 wait complete. 2023-11-27T21:21:46.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.086+0000 7f1ca0283640 1 Processor -- start 2023-11-27T21:21:46.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.086+0000 7f1ca0283640 1 -- start start 2023-11-27T21:21:46.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.086+0000 7f1ca0283640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c980c9c70 0x7f1c981ef290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:46.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.086+0000 7f1ca0283640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c980cbf00 0x7f1c981585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:46.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.086+0000 7f1ca0283640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c980cd000 0x7f1c9815bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:46.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.086+0000 7f1ca0283640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c98155f30 con 0x7f1c980cd000 2023-11-27T21:21:46.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.086+0000 7f1ca0283640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9815b7b0 con 0x7f1c980cbf00 2023-11-27T21:21:46.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.086+0000 7f1ca0283640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9815a620 con 0x7f1c980c9c70 2023-11-27T21:21:46.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.087+0000 7f1c9e820640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c980cd000 0x7f1c9815bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:46.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.087+0000 7f1c9e820640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c980cd000 0x7f1c9815bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58818/0 (socket says 172.21.15.88:58818) 2023-11-27T21:21:46.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.087+0000 7f1c9e820640 1 -- 172.21.15.88:0/472268871 learned_addr learned my addr 172.21.15.88:0/472268871 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:46.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.090+0000 7f1c9e820640 1 -- 172.21.15.88:0/472268871 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c980c9c70 msgr2=0x7f1c981ef290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:46.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.090+0000 7f1c9e820640 1 --2- 172.21.15.88:0/472268871 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c980c9c70 0x7f1c981ef290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:46.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.090+0000 7f1c9e820640 1 -- 172.21.15.88:0/472268871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c980cbf00 msgr2=0x7f1c981585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:46.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.090+0000 7f1c9e820640 1 --2- 172.21.15.88:0/472268871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c980cbf00 0x7f1c981585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:46.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.090+0000 7f1c9e820640 1 -- 172.21.15.88:0/472268871 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c900094d0 con 0x7f1c980cd000 2023-11-27T21:21:46.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.093+0000 7f1c9e820640 1 --2- 172.21.15.88:0/472268871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c980cd000 0x7f1c9815bc60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1c90034040 tx=0x7f1c900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:46.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.096+0000 7f1c8effd640 1 -- 172.21.15.88:0/472268871 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9003abe0 con 0x7f1c980cd000 2023-11-27T21:21:46.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.096+0000 7f1c8effd640 1 -- 172.21.15.88:0/472268871 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9003ad40 con 0x7f1c980cd000 2023-11-27T21:21:46.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.096+0000 7f1ca0283640 1 -- 172.21.15.88:0/472268871 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c9815a8c0 con 0x7f1c980cd000 2023-11-27T21:21:46.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.096+0000 7f1c8effd640 1 -- 172.21.15.88:0/472268871 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c90044610 con 0x7f1c980cd000 2023-11-27T21:21:46.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.096+0000 7f1ca0283640 1 -- 172.21.15.88:0/472268871 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c9815ae80 con 0x7f1c980cd000 2023-11-27T21:21:46.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.097+0000 7f1ca0283640 1 -- 172.21.15.88:0/472268871 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c98073dc0 con 0x7f1c980cd000 2023-11-27T21:21:46.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.115+0000 7f1c8effd640 1 -- 172.21.15.88:0/472268871 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1c9002f050 con 0x7f1c980cd000 2023-11-27T21:21:46.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.115+0000 7f1c8effd640 1 --2- 172.21.15.88:0/472268871 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1c7c06b240 0x7f1c7c06d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:46.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.115+0000 7f1c9e01f640 1 --2- 172.21.15.88:0/472268871 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1c7c06b240 0x7f1c7c06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:46.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.116+0000 7f1c9e01f640 1 --2- 172.21.15.88:0/472268871 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1c7c06b240 0x7f1c7c06d700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1c94001c60 tx=0x7f1c94007d10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:46.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.119+0000 7f1c8effd640 1 -- 172.21.15.88:0/472268871 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1c9007ae20 con 0x7f1c980cd000 2023-11-27T21:21:46.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.351+0000 7f1c8effd640 1 -- 172.21.15.88:0/472268871 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f1c90076a60 con 0x7f1c980cd000 2023-11-27T21:21:46.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.520+0000 7f1ca0283640 1 -- 172.21.15.88:0/472268871 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1c98074060 con 0x7f1c980cd000 2023-11-27T21:21:46.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.524+0000 7f1c8effd640 1 -- 172.21.15.88:0/472268871 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1c9007a080 con 0x7f1c980cd000 2023-11-27T21:21:46.526 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-27T21:21:46.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.526+0000 7f1ca0283640 1 -- 172.21.15.88:0/472268871 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1c7c06b240 msgr2=0x7f1c7c06d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:46.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.526+0000 7f1ca0283640 1 --2- 172.21.15.88:0/472268871 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1c7c06b240 0x7f1c7c06d700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1c94001c60 tx=0x7f1c94007d10 comp rx=0 tx=0).stop 2023-11-27T21:21:46.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.526+0000 7f1ca0283640 1 -- 172.21.15.88:0/472268871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c980cd000 msgr2=0x7f1c9815bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:46.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.526+0000 7f1ca0283640 1 --2- 172.21.15.88:0/472268871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c980cd000 0x7f1c9815bc60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1c90034040 tx=0x7f1c900046c0 comp rx=0 tx=0).stop 2023-11-27T21:21:46.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.526+0000 7f1ca0283640 1 -- 172.21.15.88:0/472268871 shutdown_connections 2023-11-27T21:21:46.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.526+0000 7f1ca0283640 1 --2- 172.21.15.88:0/472268871 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1c7c06b240 0x7f1c7c06d700 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:46.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.526+0000 7f1ca0283640 1 --2- 172.21.15.88:0/472268871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c980cd000 0x7f1c9815bc60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:46.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.526+0000 7f1ca0283640 1 --2- 172.21.15.88:0/472268871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c980cbf00 0x7f1c981585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:46.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.526+0000 7f1ca0283640 1 --2- 172.21.15.88:0/472268871 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c980c9c70 0x7f1c981ef290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:46.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.526+0000 7f1ca0283640 1 -- 172.21.15.88:0/472268871 >> 172.21.15.88:0/472268871 conn(0x7f1c980b07d0 msgr2=0x7f1c980ca6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:46.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.526+0000 7f1ca0283640 1 -- 172.21.15.88:0/472268871 shutdown_connections 2023-11-27T21:21:46.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.526+0000 7f1ca0283640 1 -- 172.21.15.88:0/472268871 wait complete. 2023-11-27T21:21:46.539 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T21:21:46.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.640+0000 7f5356d39640 1 Processor -- start 2023-11-27T21:21:46.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.640+0000 7f5356d39640 1 -- start start 2023-11-27T21:21:46.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.641+0000 7f5356d39640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53500c46c0 0x7f53500c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:46.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.641+0000 7f5356d39640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5350150460 0x7f53500c1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:46.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.641+0000 7f5356d39640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53500c76f0 con 0x7f53500c4aa0 2023-11-27T21:21:46.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.641+0000 7f5356d39640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53500c2bc0 con 0x7f5350150460 2023-11-27T21:21:46.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.641+0000 7f5356d39640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53500c6dc0 con 0x7f53500c46c0 2023-11-27T21:21:46.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.642+0000 7f5354ad5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53500c46c0 0x7f53500c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:46.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.642+0000 7f534ffff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f53500c4aa0 0x7f535014fd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43612/0 (socket says 172.21.15.88:43612) 2023-11-27T21:21:46.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.642+0000 7f534ffff640 1 -- 172.21.15.88:0/3335583185 learned_addr learned my addr 172.21.15.88:0/3335583185 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:21:46.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.644+0000 7f534f7fe640 1 -- 172.21.15.88:0/3335583185 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576011291 0 0) 0x7f53500c76f0 con 0x7f53500c4aa0 2023-11-27T21:21:46.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.644+0000 7f534f7fe640 1 -- 172.21.15.88:0/3335583185 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5338003520 con 0x7f53500c4aa0 2023-11-27T21:21:46.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.644+0000 7f5354ad5640 1 -- 172.21.15.88:0/3335583185 >> v2:172.21.15.167:3300/0 conn(0x7f5350150460 msgr2=0x7f53500c1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:21:46.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.644+0000 7f5354ad5640 1 --2- 172.21.15.88:0/3335583185 >> v2:172.21.15.167:3300/0 conn(0x7f5350150460 0x7f53500c1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:46.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.644+0000 7f5354ad5640 1 -- 172.21.15.88:0/3335583185 >> v1:172.21.15.88:6789/0 conn(0x7f53500c4aa0 legacy=0x7f535014fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:46.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.644+0000 7f5354ad5640 1 -- 172.21.15.88:0/3335583185 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53500c70a0 con 0x7f53500c46c0 2023-11-27T21:21:46.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.647+0000 7f5354ad5640 1 --2- 172.21.15.88:0/3335583185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53500c46c0 0x7f53500c53c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f53400097a0 tx=0x7f534002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d41a7788dad512a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:46.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.650+0000 7f534f7fe640 1 -- 172.21.15.88:0/3335583185 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340031830 con 0x7f53500c46c0 2023-11-27T21:21:46.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.650+0000 7f534f7fe640 1 -- 172.21.15.88:0/3335583185 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5340031990 con 0x7f53500c46c0 2023-11-27T21:21:46.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.650+0000 7f534f7fe640 1 -- 172.21.15.88:0/3335583185 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340031d20 con 0x7f53500c46c0 2023-11-27T21:21:46.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.651+0000 7f5356d39640 1 -- 172.21.15.88:0/3335583185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53500c46c0 msgr2=0x7f53500c53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:46.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.651+0000 7f5356d39640 1 --2- 172.21.15.88:0/3335583185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53500c46c0 0x7f53500c53c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f53400097a0 tx=0x7f534002b8d0 comp rx=0 tx=0).stop 2023-11-27T21:21:46.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.651+0000 7f5356d39640 1 -- 172.21.15.88:0/3335583185 shutdown_connections 2023-11-27T21:21:46.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.651+0000 7f5356d39640 1 --2- 172.21.15.88:0/3335583185 >> v2:172.21.15.167:3300/0 conn(0x7f5350150460 0x7f53500c1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:46.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.651+0000 7f5356d39640 1 --2- 172.21.15.88:0/3335583185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53500c46c0 0x7f53500c53c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:46.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.651+0000 7f5356d39640 1 -- 172.21.15.88:0/3335583185 >> 172.21.15.88:0/3335583185 conn(0x7f535006c5f0 msgr2=0x7f535006c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:46.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.651+0000 7f5356d39640 1 -- 172.21.15.88:0/3335583185 shutdown_connections 2023-11-27T21:21:46.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.651+0000 7f5356d39640 1 -- 172.21.15.88:0/3335583185 wait complete. 2023-11-27T21:21:46.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.652+0000 7f5356d39640 1 Processor -- start 2023-11-27T21:21:46.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.652+0000 7f5356d39640 1 -- start start 2023-11-27T21:21:46.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.653+0000 7f5356d39640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53500c46c0 0x7f53501513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:46.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.653+0000 7f5356d39640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53500c4aa0 0x7f5350152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:46.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.653+0000 7f5356d39640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5350150460 0x7f53501e3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:46.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.653+0000 7f5356d39640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5350152100 con 0x7f53500c46c0 2023-11-27T21:21:46.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.653+0000 7f5356d39640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53500c8e20 con 0x7f5350150460 2023-11-27T21:21:46.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.653+0000 7f5356d39640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53500c9680 con 0x7f53500c4aa0 2023-11-27T21:21:46.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.654+0000 7f534ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53500c4aa0 0x7f5350152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:46.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.654+0000 7f534ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53500c4aa0 0x7f5350152ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:56206/0 (socket says 172.21.15.88:56206) 2023-11-27T21:21:46.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.655+0000 7f534ffff640 1 -- 172.21.15.88:0/2376531618 learned_addr learned my addr 172.21.15.88:0/2376531618 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:46.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.655+0000 7f53552d6640 1 --2- 172.21.15.88:0/2376531618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5350150460 0x7f53501e3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:46.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.659+0000 7f534ffff640 1 -- 172.21.15.88:0/2376531618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5350150460 msgr2=0x7f53501e3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:46.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.659+0000 7f534ffff640 1 --2- 172.21.15.88:0/2376531618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5350150460 0x7f53501e3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:46.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.659+0000 7f534ffff640 1 -- 172.21.15.88:0/2376531618 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53500c46c0 msgr2=0x7f53501513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:46.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.659+0000 7f534ffff640 1 --2- 172.21.15.88:0/2376531618 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53500c46c0 0x7f53501513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:46.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.659+0000 7f534ffff640 1 -- 172.21.15.88:0/2376531618 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5340009400 con 0x7f53500c4aa0 2023-11-27T21:21:46.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.663+0000 7f534ffff640 1 --2- 172.21.15.88:0/2376531618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53500c4aa0 0x7f5350152ca0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f534400c430 tx=0x7f534400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:46.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.667+0000 7f534d7fa640 1 -- 172.21.15.88:0/2376531618 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5344005ce0 con 0x7f53500c4aa0 2023-11-27T21:21:46.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.668+0000 7f534d7fa640 1 -- 172.21.15.88:0/2376531618 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5344005e40 con 0x7f53500c4aa0 2023-11-27T21:21:46.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.668+0000 7f534d7fa640 1 -- 172.21.15.88:0/2376531618 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53440072f0 con 0x7f53500c4aa0 2023-11-27T21:21:46.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.668+0000 7f5356d39640 1 -- 172.21.15.88:0/2376531618 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53500c9b10 con 0x7f53500c4aa0 2023-11-27T21:21:46.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.668+0000 7f5356d39640 1 -- 172.21.15.88:0/2376531618 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53501537e0 con 0x7f53500c4aa0 2023-11-27T21:21:46.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.669+0000 7f5356d39640 1 -- 172.21.15.88:0/2376531618 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53500c6760 con 0x7f53500c4aa0 2023-11-27T21:21:46.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.689+0000 7f534d7fa640 1 -- 172.21.15.88:0/2376531618 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5344007450 con 0x7f53500c4aa0 2023-11-27T21:21:46.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.689+0000 7f534d7fa640 1 --2- 172.21.15.88:0/2376531618 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f533c06b1f0 0x7f533c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:46.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.690+0000 7f5354ad5640 1 --2- 172.21.15.88:0/2376531618 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f533c06b1f0 0x7f533c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:46.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.690+0000 7f5354ad5640 1 --2- 172.21.15.88:0/2376531618 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f533c06b1f0 0x7f533c06d6b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5340036000 tx=0x7f5340030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:46.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.692+0000 7f534d7fa640 1 -- 172.21.15.88:0/2376531618 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5344057ef0 con 0x7f53500c4aa0 2023-11-27T21:21:46.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:46.935+0000 7f534d7fa640 1 -- 172.21.15.88:0/2376531618 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5344054230 con 0x7f53500c4aa0 2023-11-27T21:21:47.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.109+0000 7f5356d39640 1 -- 172.21.15.88:0/2376531618 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5350067470 con 0x7f53500c4aa0 2023-11-27T21:21:47.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.137+0000 7f534d7fa640 1 -- 172.21.15.88:0/2376531618 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5344017070 con 0x7f53500c4aa0 2023-11-27T21:21:47.139 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-27T21:21:47.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.138+0000 7f5356d39640 1 -- 172.21.15.88:0/2376531618 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f533c06b1f0 msgr2=0x7f533c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:47.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.138+0000 7f5356d39640 1 --2- 172.21.15.88:0/2376531618 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f533c06b1f0 0x7f533c06d6b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5340036000 tx=0x7f5340030000 comp rx=0 tx=0).stop 2023-11-27T21:21:47.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.138+0000 7f5356d39640 1 -- 172.21.15.88:0/2376531618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53500c4aa0 msgr2=0x7f5350152ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:47.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.138+0000 7f5356d39640 1 --2- 172.21.15.88:0/2376531618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53500c4aa0 0x7f5350152ca0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f534400c430 tx=0x7f534400c8f0 comp rx=0 tx=0).stop 2023-11-27T21:21:47.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.138+0000 7f5356d39640 1 -- 172.21.15.88:0/2376531618 shutdown_connections 2023-11-27T21:21:47.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.138+0000 7f5356d39640 1 --2- 172.21.15.88:0/2376531618 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f533c06b1f0 0x7f533c06d6b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:47.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.138+0000 7f5356d39640 1 --2- 172.21.15.88:0/2376531618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5350150460 0x7f53501e3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:47.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.138+0000 7f5356d39640 1 --2- 172.21.15.88:0/2376531618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53500c4aa0 0x7f5350152ca0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:47.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.138+0000 7f5356d39640 1 --2- 172.21.15.88:0/2376531618 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53500c46c0 0x7f53501513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:47.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.139+0000 7f5356d39640 1 -- 172.21.15.88:0/2376531618 >> 172.21.15.88:0/2376531618 conn(0x7f535006c5f0 msgr2=0x7f535006c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:47.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.139+0000 7f5356d39640 1 -- 172.21.15.88:0/2376531618 shutdown_connections 2023-11-27T21:21:47.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.139+0000 7f5356d39640 1 -- 172.21.15.88:0/2376531618 wait complete. 2023-11-27T21:21:47.152 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T21:21:47.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.253+0000 7f27d972c640 1 Processor -- start 2023-11-27T21:21:47.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.253+0000 7f27d972c640 1 -- start start 2023-11-27T21:21:47.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.254+0000 7f27d972c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f27d4153770 0x7f27d4159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:47.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.254+0000 7f27d972c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f27d40cd500 0x7f27d415a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:47.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.254+0000 7f27d972c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d415d550 con 0x7f27d4153b50 2023-11-27T21:21:47.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.254+0000 7f27d972c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d415da80 con 0x7f27d40cd500 2023-11-27T21:21:47.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.254+0000 7f27d972c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d41596e0 con 0x7f27d4153770 2023-11-27T21:21:47.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.254+0000 7f27d37fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f27d40cd500 0x7f27d415a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:47.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.255+0000 7f27d2ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f27d4153770 0x7f27d4159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:47.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.255+0000 7f27d2ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f27d4153770 0x7f27d4159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:36968/0 (socket says 172.21.15.88:36968) 2023-11-27T21:21:47.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.255+0000 7f27d2ffd640 1 -- 172.21.15.88:0/1508460228 learned_addr learned my addr 172.21.15.88:0/1508460228 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:47.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.257+0000 7f27d2ffd640 1 -- 172.21.15.88:0/1508460228 >> v2:172.21.15.88:3300/0 conn(0x7f27d40cd500 msgr2=0x7f27d415a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:21:47.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.257+0000 7f27d2ffd640 1 --2- 172.21.15.88:0/1508460228 >> v2:172.21.15.88:3300/0 conn(0x7f27d40cd500 0x7f27d415a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:47.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.257+0000 7f27d2ffd640 1 -- 172.21.15.88:0/1508460228 >> v1:172.21.15.88:6789/0 conn(0x7f27d4153b50 legacy=0x7f27d406c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:47.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.257+0000 7f27d2ffd640 1 -- 172.21.15.88:0/1508460228 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d415d7a0 con 0x7f27d4153770 2023-11-27T21:21:47.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.259+0000 7f27d2ffd640 1 --2- 172.21.15.88:0/1508460228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27d4153770 0x7f27d4159b90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f27d40cf8d0 tx=0x7f27c402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37db668eeae78eee server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:47.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.263+0000 7f27d1ffb640 1 -- 172.21.15.88:0/1508460228 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4030860 con 0x7f27d4153770 2023-11-27T21:21:47.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.263+0000 7f27d1ffb640 1 -- 172.21.15.88:0/1508460228 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c40309c0 con 0x7f27d4153770 2023-11-27T21:21:47.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.263+0000 7f27d1ffb640 1 -- 172.21.15.88:0/1508460228 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4030d50 con 0x7f27d4153770 2023-11-27T21:21:47.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.264+0000 7f27d972c640 1 -- 172.21.15.88:0/1508460228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27d4153770 msgr2=0x7f27d4159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:47.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.264+0000 7f27d972c640 1 --2- 172.21.15.88:0/1508460228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27d4153770 0x7f27d4159b90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f27d40cf8d0 tx=0x7f27c402b9a0 comp rx=0 tx=0).stop 2023-11-27T21:21:47.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.264+0000 7f27d972c640 1 -- 172.21.15.88:0/1508460228 shutdown_connections 2023-11-27T21:21:47.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.264+0000 7f27d972c640 1 --2- 172.21.15.88:0/1508460228 >> v2:172.21.15.88:3300/0 conn(0x7f27d40cd500 0x7f27d415a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:47.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.264+0000 7f27d972c640 1 --2- 172.21.15.88:0/1508460228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27d4153770 0x7f27d4159b90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:47.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.264+0000 7f27d972c640 1 -- 172.21.15.88:0/1508460228 >> 172.21.15.88:0/1508460228 conn(0x7f27d4060f20 msgr2=0x7f27d4061330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:47.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.264+0000 7f27d972c640 1 -- 172.21.15.88:0/1508460228 shutdown_connections 2023-11-27T21:21:47.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.264+0000 7f27d972c640 1 -- 172.21.15.88:0/1508460228 wait complete. 2023-11-27T21:21:47.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.265+0000 7f27d972c640 1 Processor -- start 2023-11-27T21:21:47.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.265+0000 7f27d972c640 1 -- start start 2023-11-27T21:21:47.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.266+0000 7f27d972c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27d40cd500 0x7f27d41f81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:47.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.266+0000 7f27d972c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27d4153770 0x7f27d415b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:47.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.266+0000 7f27d972c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27d4157c80 0x7f27d41e5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:47.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.266+0000 7f27d972c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d41f7d90 con 0x7f27d4153770 2023-11-27T21:21:47.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.266+0000 7f27d972c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d415a730 con 0x7f27d40cd500 2023-11-27T21:21:47.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.266+0000 7f27d972c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d40af760 con 0x7f27d4157c80 2023-11-27T21:21:47.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.266+0000 7f27d2ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27d40cd500 0x7f27d41f81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:47.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.267+0000 7f27d37fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27d4157c80 0x7f27d41e5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:47.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.267+0000 7f27d2ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27d40cd500 0x7f27d41f81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:36978/0 (socket says 172.21.15.88:36978) 2023-11-27T21:21:47.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.267+0000 7f27d2ffd640 1 -- 172.21.15.88:0/756250204 learned_addr learned my addr 172.21.15.88:0/756250204 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:47.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.270+0000 7f27d2ffd640 1 -- 172.21.15.88:0/756250204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27d4157c80 msgr2=0x7f27d41e5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:47.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.270+0000 7f27d2ffd640 1 --2- 172.21.15.88:0/756250204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27d4157c80 0x7f27d41e5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:47.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.270+0000 7f27d2ffd640 1 -- 172.21.15.88:0/756250204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27d4153770 msgr2=0x7f27d415b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:47.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.270+0000 7f27d2ffd640 1 --2- 172.21.15.88:0/756250204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27d4153770 0x7f27d415b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:47.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.270+0000 7f27d2ffd640 1 -- 172.21.15.88:0/756250204 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c40094d0 con 0x7f27d40cd500 2023-11-27T21:21:47.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.273+0000 7f27d2ffd640 1 --2- 172.21.15.88:0/756250204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27d40cd500 0x7f27d41f81b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f27c4000c00 tx=0x7f27c4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:47.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.276+0000 7f27bb7fe640 1 -- 172.21.15.88:0/756250204 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4039c90 con 0x7f27d40cd500 2023-11-27T21:21:47.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.276+0000 7f27bb7fe640 1 -- 172.21.15.88:0/756250204 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c4039e10 con 0x7f27d40cd500 2023-11-27T21:21:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.276+0000 7f27bb7fe640 1 -- 172.21.15.88:0/756250204 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c40446c0 con 0x7f27d40cd500 2023-11-27T21:21:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.276+0000 7f27d972c640 1 -- 172.21.15.88:0/756250204 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d41580e0 con 0x7f27d40cd500 2023-11-27T21:21:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.276+0000 7f27d972c640 1 -- 172.21.15.88:0/756250204 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d415a960 con 0x7f27d40cd500 2023-11-27T21:21:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.278+0000 7f27d972c640 1 -- 172.21.15.88:0/756250204 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d41f7ed0 con 0x7f27d40cd500 2023-11-27T21:21:47.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.528+0000 7f27bb7fe640 1 -- 172.21.15.88:0/756250204 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f27c404d3b0 con 0x7f27d40cd500 2023-11-27T21:21:47.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.528+0000 7f27bb7fe640 1 --2- 172.21.15.88:0/756250204 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f27c006b210 0x7f27c006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:47.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.528+0000 7f27d27fc640 1 --2- 172.21.15.88:0/756250204 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f27c006b210 0x7f27c006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:47.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.529+0000 7f27d27fc640 1 --2- 172.21.15.88:0/756250204 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f27c006b210 0x7f27c006d6d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f27c8000f60 tx=0x7f27c80079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:47.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.532+0000 7f27bb7fe640 1 -- 172.21.15.88:0/756250204 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f27c403e070 con 0x7f27d40cd500 2023-11-27T21:21:47.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.546+0000 7f27bb7fe640 1 -- 172.21.15.88:0/756250204 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f27c40776e0 con 0x7f27d40cd500 2023-11-27T21:21:47.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.714+0000 7f27d972c640 1 -- 172.21.15.88:0/756250204 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f27d41f7ed0 con 0x7f27d40cd500 2023-11-27T21:21:47.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.719+0000 7f27bb7fe640 1 -- 172.21.15.88:0/756250204 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f27c4049020 con 0x7f27d40cd500 2023-11-27T21:21:47.721 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-11-27T21:21:47.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.721+0000 7f27d972c640 1 -- 172.21.15.88:0/756250204 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f27c006b210 msgr2=0x7f27c006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:47.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.721+0000 7f27d972c640 1 --2- 172.21.15.88:0/756250204 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f27c006b210 0x7f27c006d6d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f27c8000f60 tx=0x7f27c80079b0 comp rx=0 tx=0).stop 2023-11-27T21:21:47.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.721+0000 7f27d972c640 1 -- 172.21.15.88:0/756250204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27d40cd500 msgr2=0x7f27d41f81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:47.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.721+0000 7f27d972c640 1 --2- 172.21.15.88:0/756250204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27d40cd500 0x7f27d41f81b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f27c4000c00 tx=0x7f27c4004730 comp rx=0 tx=0).stop 2023-11-27T21:21:47.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.721+0000 7f27d972c640 1 -- 172.21.15.88:0/756250204 shutdown_connections 2023-11-27T21:21:47.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.721+0000 7f27d972c640 1 --2- 172.21.15.88:0/756250204 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f27c006b210 0x7f27c006d6d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:47.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.721+0000 7f27d972c640 1 --2- 172.21.15.88:0/756250204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27d4157c80 0x7f27d41e5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:47.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.721+0000 7f27d972c640 1 --2- 172.21.15.88:0/756250204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27d4153770 0x7f27d415b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:47.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.721+0000 7f27d972c640 1 --2- 172.21.15.88:0/756250204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27d40cd500 0x7f27d41f81b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:47.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.721+0000 7f27d972c640 1 -- 172.21.15.88:0/756250204 >> 172.21.15.88:0/756250204 conn(0x7f27d4060f20 msgr2=0x7f27d4150f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:47.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.721+0000 7f27d972c640 1 -- 172.21.15.88:0/756250204 shutdown_connections 2023-11-27T21:21:47.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.721+0000 7f27d972c640 1 -- 172.21.15.88:0/756250204 wait complete. 2023-11-27T21:21:47.735 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-27T21:21:47.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.836+0000 7f4b28e9b640 1 Processor -- start 2023-11-27T21:21:47.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.836+0000 7f4b28e9b640 1 -- start start 2023-11-27T21:21:47.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.837+0000 7f4b28e9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4b240c52e0 0x7f4b240c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:47.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.837+0000 7f4b28e9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b240c56c0 0x7f4b240c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:47.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.837+0000 7f4b28e9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4b2415ac30 0x7f4b2415b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:47.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.837+0000 7f4b28e9b640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b240c7250 con 0x7f4b2415ac30 2023-11-27T21:21:47.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.837+0000 7f4b28e9b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2415a7a0 con 0x7f4b240c52e0 2023-11-27T21:21:47.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.837+0000 7f4b28e9b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2415b600 con 0x7f4b240c56c0 2023-11-27T21:21:47.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.838+0000 7f4b22d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4b2415ac30 0x7f4b2415b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:47.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.838+0000 7f4b21d9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b240c56c0 0x7f4b240c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:47.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.838+0000 7f4b2259c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4b240c52e0 0x7f4b240c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:47.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.838+0000 7f4b22d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4b2415ac30 0x7f4b2415b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58866/0 (socket says 172.21.15.88:58866) 2023-11-27T21:21:47.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.838+0000 7f4b22d9d640 1 -- 172.21.15.88:0/4140807670 learned_addr learned my addr 172.21.15.88:0/4140807670 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:47.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.840+0000 7f4b22d9d640 1 -- 172.21.15.88:0/4140807670 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b240c56c0 msgr2=0x7f4b240c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:21:47.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.840+0000 7f4b22d9d640 1 --2- 172.21.15.88:0/4140807670 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b240c56c0 0x7f4b240c8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:47.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.840+0000 7f4b22d9d640 1 -- 172.21.15.88:0/4140807670 >> v2:172.21.15.167:3300/0 conn(0x7f4b240c52e0 msgr2=0x7f4b240c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:21:47.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.840+0000 7f4b22d9d640 1 --2- 172.21.15.88:0/4140807670 >> v2:172.21.15.167:3300/0 conn(0x7f4b240c52e0 0x7f4b240c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:47.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.840+0000 7f4b22d9d640 1 -- 172.21.15.88:0/4140807670 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b241574c0 con 0x7f4b2415ac30 2023-11-27T21:21:47.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.842+0000 7f4b22d9d640 1 --2- 172.21.15.88:0/4140807670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b2415ac30 0x7f4b2415b0c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4b24070e20 tx=0x7f4b1c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adcee9b09f679dfe server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:47.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.845+0000 7f4b2159a640 1 -- 172.21.15.88:0/4140807670 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c030840 con 0x7f4b2415ac30 2023-11-27T21:21:47.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.845+0000 7f4b2159a640 1 -- 172.21.15.88:0/4140807670 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1c0309a0 con 0x7f4b2415ac30 2023-11-27T21:21:47.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.845+0000 7f4b2159a640 1 -- 172.21.15.88:0/4140807670 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c030d30 con 0x7f4b2415ac30 2023-11-27T21:21:47.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.846+0000 7f4b28e9b640 1 -- 172.21.15.88:0/4140807670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b2415ac30 msgr2=0x7f4b2415b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:47.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.846+0000 7f4b28e9b640 1 --2- 172.21.15.88:0/4140807670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b2415ac30 0x7f4b2415b0c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4b24070e20 tx=0x7f4b1c02b980 comp rx=0 tx=0).stop 2023-11-27T21:21:47.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.846+0000 7f4b28e9b640 1 -- 172.21.15.88:0/4140807670 shutdown_connections 2023-11-27T21:21:47.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.846+0000 7f4b28e9b640 1 --2- 172.21.15.88:0/4140807670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b2415ac30 0x7f4b2415b0c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:47.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.846+0000 7f4b28e9b640 1 --2- 172.21.15.88:0/4140807670 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b240c56c0 0x7f4b240c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:47.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.846+0000 7f4b28e9b640 1 --2- 172.21.15.88:0/4140807670 >> v2:172.21.15.167:3300/0 conn(0x7f4b240c52e0 0x7f4b240c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:47.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.846+0000 7f4b28e9b640 1 -- 172.21.15.88:0/4140807670 >> 172.21.15.88:0/4140807670 conn(0x7f4b2406f6d0 msgr2=0x7f4b2406fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:47.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.846+0000 7f4b28e9b640 1 -- 172.21.15.88:0/4140807670 shutdown_connections 2023-11-27T21:21:47.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.846+0000 7f4b28e9b640 1 -- 172.21.15.88:0/4140807670 wait complete. 2023-11-27T21:21:47.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.848+0000 7f4b28e9b640 1 Processor -- start 2023-11-27T21:21:47.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.848+0000 7f4b28e9b640 1 -- start start 2023-11-27T21:21:47.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.848+0000 7f4b28e9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b240c52e0 0x7f4b2414d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:47.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.848+0000 7f4b28e9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b240c56c0 0x7f4b2414c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:47.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.848+0000 7f4b28e9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b2415ac30 0x7f4b2414caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:47.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.848+0000 7f4b28e9b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b240cbbc0 con 0x7f4b240c56c0 2023-11-27T21:21:47.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.848+0000 7f4b28e9b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b241edd00 con 0x7f4b2415ac30 2023-11-27T21:21:47.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.848+0000 7f4b28e9b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2414b7a0 con 0x7f4b240c52e0 2023-11-27T21:21:47.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.849+0000 7f4b21d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b240c56c0 0x7f4b2414c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:47.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.849+0000 7f4b22d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b2415ac30 0x7f4b2414caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:47.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.849+0000 7f4b2259c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b240c52e0 0x7f4b2414d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:47.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.849+0000 7f4b21d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b240c56c0 0x7f4b2414c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58870/0 (socket says 172.21.15.88:58870) 2023-11-27T21:21:47.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.849+0000 7f4b21d9b640 1 -- 172.21.15.88:0/998519882 learned_addr learned my addr 172.21.15.88:0/998519882 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:47.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.853+0000 7f4b21d9b640 1 -- 172.21.15.88:0/998519882 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b240c52e0 msgr2=0x7f4b2414d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:47.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.853+0000 7f4b21d9b640 1 --2- 172.21.15.88:0/998519882 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b240c52e0 0x7f4b2414d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:47.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.853+0000 7f4b21d9b640 1 -- 172.21.15.88:0/998519882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b2415ac30 msgr2=0x7f4b2414caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:47.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.853+0000 7f4b21d9b640 1 --2- 172.21.15.88:0/998519882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b2415ac30 0x7f4b2414caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:47.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.853+0000 7f4b21d9b640 1 -- 172.21.15.88:0/998519882 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c0094d0 con 0x7f4b240c56c0 2023-11-27T21:21:47.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.855+0000 7f4b21d9b640 1 --2- 172.21.15.88:0/998519882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b240c56c0 0x7f4b2414c560 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4b1800e9b0 tx=0x7f4b1800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:47.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.858+0000 7f4b12ffd640 1 -- 172.21.15.88:0/998519882 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b18009670 con 0x7f4b240c56c0 2023-11-27T21:21:47.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.858+0000 7f4b12ffd640 1 -- 172.21.15.88:0/998519882 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1800c9a0 con 0x7f4b240c56c0 2023-11-27T21:21:47.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.858+0000 7f4b12ffd640 1 -- 172.21.15.88:0/998519882 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1800cd50 con 0x7f4b240c56c0 2023-11-27T21:21:47.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.858+0000 7f4b28e9b640 1 -- 172.21.15.88:0/998519882 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2414ba80 con 0x7f4b240c56c0 2023-11-27T21:21:47.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.858+0000 7f4b28e9b640 1 -- 172.21.15.88:0/998519882 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2414c040 con 0x7f4b240c56c0 2023-11-27T21:21:47.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.859+0000 7f4b28e9b640 1 -- 172.21.15.88:0/998519882 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b2414c200 con 0x7f4b240c56c0 2023-11-27T21:21:47.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.877+0000 7f4b12ffd640 1 -- 172.21.15.88:0/998519882 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4b18013470 con 0x7f4b240c56c0 2023-11-27T21:21:47.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.878+0000 7f4b12ffd640 1 --2- 172.21.15.88:0/998519882 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4b0406b1c0 0x7f4b0406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:47.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.878+0000 7f4b2259c640 1 --2- 172.21.15.88:0/998519882 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4b0406b1c0 0x7f4b0406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:47.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.878+0000 7f4b2259c640 1 --2- 172.21.15.88:0/998519882 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4b0406b1c0 0x7f4b0406d680 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4b14011360 tx=0x7f4b1400d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:47.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:47.880+0000 7f4b12ffd640 1 -- 172.21.15.88:0/998519882 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4b18058ee0 con 0x7f4b240c56c0 2023-11-27T21:21:48.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.111+0000 7f4b12ffd640 1 -- 172.21.15.88:0/998519882 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4b18055220 con 0x7f4b240c56c0 2023-11-27T21:21:48.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.313+0000 7f4b28e9b640 1 -- 172.21.15.88:0/998519882 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4b2406eda0 con 0x7f4b240c56c0 2023-11-27T21:21:48.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.328+0000 7f4b12ffd640 1 -- 172.21.15.88:0/998519882 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4b180170a0 con 0x7f4b240c56c0 2023-11-27T21:21:48.330 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-27T21:21:48.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.331+0000 7f4b28e9b640 1 -- 172.21.15.88:0/998519882 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4b0406b1c0 msgr2=0x7f4b0406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:48.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.331+0000 7f4b28e9b640 1 --2- 172.21.15.88:0/998519882 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4b0406b1c0 0x7f4b0406d680 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4b14011360 tx=0x7f4b1400d040 comp rx=0 tx=0).stop 2023-11-27T21:21:48.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.331+0000 7f4b28e9b640 1 -- 172.21.15.88:0/998519882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b240c56c0 msgr2=0x7f4b2414c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:48.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.331+0000 7f4b28e9b640 1 --2- 172.21.15.88:0/998519882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b240c56c0 0x7f4b2414c560 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4b1800e9b0 tx=0x7f4b1800ee70 comp rx=0 tx=0).stop 2023-11-27T21:21:48.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.331+0000 7f4b28e9b640 1 -- 172.21.15.88:0/998519882 shutdown_connections 2023-11-27T21:21:48.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.331+0000 7f4b28e9b640 1 --2- 172.21.15.88:0/998519882 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f4b0406b1c0 0x7f4b0406d680 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:48.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.331+0000 7f4b28e9b640 1 --2- 172.21.15.88:0/998519882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b2415ac30 0x7f4b2414caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:48.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.331+0000 7f4b28e9b640 1 --2- 172.21.15.88:0/998519882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b240c56c0 0x7f4b2414c560 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:48.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.331+0000 7f4b28e9b640 1 --2- 172.21.15.88:0/998519882 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b240c52e0 0x7f4b2414d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:48.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.331+0000 7f4b28e9b640 1 -- 172.21.15.88:0/998519882 >> 172.21.15.88:0/998519882 conn(0x7f4b2406f6d0 msgr2=0x7f4b240c8010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:48.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.331+0000 7f4b28e9b640 1 -- 172.21.15.88:0/998519882 shutdown_connections 2023-11-27T21:21:48.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.331+0000 7f4b28e9b640 1 -- 172.21.15.88:0/998519882 wait complete. 2023-11-27T21:21:48.345 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T21:21:48.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.445+0000 7f3b7f03d640 1 Processor -- start 2023-11-27T21:21:48.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.445+0000 7f3b7f03d640 1 -- start start 2023-11-27T21:21:48.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.445+0000 7f3b7f03d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3b781538d0 0x7f3b7815a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:48.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.445+0000 7f3b7f03d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b7806ba50 0x7f3b7806bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:48.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.445+0000 7f3b7f03d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b780c7640 con 0x7f3b780c8ee0 2023-11-27T21:21:48.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.446+0000 7f3b7f03d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b7806d130 con 0x7f3b781538d0 2023-11-27T21:21:48.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.446+0000 7f3b7f03d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7806b5c0 con 0x7f3b7806ba50 2023-11-27T21:21:48.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.446+0000 7f3b7cdd9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3b781538d0 0x7f3b7815a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:48.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.446+0000 7f3b7d5da640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b7806ba50 0x7f3b7806bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:48.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.446+0000 7f3b77fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3b780c8ee0 0x7f3b7806e840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43632/0 (socket says 172.21.15.88:43632) 2023-11-27T21:21:48.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.446+0000 7f3b77fff640 1 -- 172.21.15.88:0/1515731815 learned_addr learned my addr 172.21.15.88:0/1515731815 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:21:48.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.448+0000 7f3b777fe640 1 -- 172.21.15.88:0/1515731815 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376611422 0 0) 0x7f3b780c7640 con 0x7f3b780c8ee0 2023-11-27T21:21:48.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.448+0000 7f3b777fe640 1 -- 172.21.15.88:0/1515731815 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b68003520 con 0x7f3b780c8ee0 2023-11-27T21:21:48.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.449+0000 7f3b7cdd9640 1 -- 172.21.15.88:0/1515731815 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b7806ba50 msgr2=0x7f3b7806bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:21:48.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.449+0000 7f3b7cdd9640 1 --2- 172.21.15.88:0/1515731815 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b7806ba50 0x7f3b7806bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:48.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.449+0000 7f3b7cdd9640 1 -- 172.21.15.88:0/1515731815 >> v1:172.21.15.88:6789/0 conn(0x7f3b780c8ee0 legacy=0x7f3b7806e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:48.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.449+0000 7f3b7cdd9640 1 -- 172.21.15.88:0/1515731815 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7806c400 con 0x7f3b781538d0 2023-11-27T21:21:48.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.451+0000 7f3b7cdd9640 1 --2- 172.21.15.88:0/1515731815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b781538d0 0x7f3b7815a0c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c0097a0 tx=0x7f3b6c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9b9ea12928890ab server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:48.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.454+0000 7f3b777fe640 1 -- 172.21.15.88:0/1515731815 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c02e070 con 0x7f3b781538d0 2023-11-27T21:21:48.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.454+0000 7f3b777fe640 1 -- 172.21.15.88:0/1515731815 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6c0315a0 con 0x7f3b781538d0 2023-11-27T21:21:48.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.454+0000 7f3b777fe640 1 -- 172.21.15.88:0/1515731815 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c031930 con 0x7f3b781538d0 2023-11-27T21:21:48.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.454+0000 7f3b7f03d640 1 -- 172.21.15.88:0/1515731815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b781538d0 msgr2=0x7f3b7815a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:48.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.454+0000 7f3b7f03d640 1 --2- 172.21.15.88:0/1515731815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b781538d0 0x7f3b7815a0c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c0097a0 tx=0x7f3b6c02b840 comp rx=0 tx=0).stop 2023-11-27T21:21:48.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.455+0000 7f3b7f03d640 1 -- 172.21.15.88:0/1515731815 shutdown_connections 2023-11-27T21:21:48.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.455+0000 7f3b7f03d640 1 --2- 172.21.15.88:0/1515731815 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b7806ba50 0x7f3b7806bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:48.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.455+0000 7f3b7f03d640 1 --2- 172.21.15.88:0/1515731815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b781538d0 0x7f3b7815a0c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:48.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.455+0000 7f3b7f03d640 1 -- 172.21.15.88:0/1515731815 >> 172.21.15.88:0/1515731815 conn(0x7f3b78060f20 msgr2=0x7f3b78061300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:48.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.455+0000 7f3b7f03d640 1 -- 172.21.15.88:0/1515731815 shutdown_connections 2023-11-27T21:21:48.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.455+0000 7f3b7f03d640 1 -- 172.21.15.88:0/1515731815 wait complete. 2023-11-27T21:21:48.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.456+0000 7f3b7f03d640 1 Processor -- start 2023-11-27T21:21:48.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.456+0000 7f3b7f03d640 1 -- start start 2023-11-27T21:21:48.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.456+0000 7f3b7f03d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b7806ba50 0x7f3b780c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:48.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.456+0000 7f3b7f03d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b780c8ee0 0x7f3b78159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:48.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.456+0000 7f3b7f03d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b781538d0 0x7f3b780c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:48.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.456+0000 7f3b7f03d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b78158ac0 con 0x7f3b781538d0 2023-11-27T21:21:48.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.456+0000 7f3b7f03d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b781eef90 con 0x7f3b780c8ee0 2023-11-27T21:21:48.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.457+0000 7f3b7f03d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7815a090 con 0x7f3b7806ba50 2023-11-27T21:21:48.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.457+0000 7f3b7d5da640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b781538d0 0x7f3b780c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:48.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.457+0000 7f3b77fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b780c8ee0 0x7f3b78159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:48.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.457+0000 7f3b7cdd9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b7806ba50 0x7f3b780c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:48.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.457+0000 7f3b7d5da640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b781538d0 0x7f3b780c5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58882/0 (socket says 172.21.15.88:58882) 2023-11-27T21:21:48.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.457+0000 7f3b77fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b780c8ee0 0x7f3b78159650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:37014/0 (socket says 172.21.15.88:37014) 2023-11-27T21:21:48.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.457+0000 7f3b7d5da640 1 -- 172.21.15.88:0/3022821150 learned_addr learned my addr 172.21.15.88:0/3022821150 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:48.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.460+0000 7f3b77fff640 1 -- 172.21.15.88:0/3022821150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b7806ba50 msgr2=0x7f3b780c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:48.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.460+0000 7f3b77fff640 1 --2- 172.21.15.88:0/3022821150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b7806ba50 0x7f3b780c4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:48.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.460+0000 7f3b77fff640 1 -- 172.21.15.88:0/3022821150 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b781538d0 msgr2=0x7f3b780c5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:48.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.460+0000 7f3b77fff640 1 --2- 172.21.15.88:0/3022821150 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b781538d0 0x7f3b780c5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:48.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.461+0000 7f3b77fff640 1 -- 172.21.15.88:0/3022821150 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c009400 con 0x7f3b780c8ee0 2023-11-27T21:21:48.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.463+0000 7f3b77fff640 1 --2- 172.21.15.88:0/3022821150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b780c8ee0 0x7f3b78159650 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400c390 tx=0x7f3b64001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:48.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.466+0000 7f3b757fa640 1 -- 172.21.15.88:0/3022821150 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b64005ce0 con 0x7f3b780c8ee0 2023-11-27T21:21:48.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.466+0000 7f3b757fa640 1 -- 172.21.15.88:0/3022821150 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b64005e40 con 0x7f3b780c8ee0 2023-11-27T21:21:48.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.466+0000 7f3b7f03d640 1 -- 172.21.15.88:0/3022821150 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b781ef210 con 0x7f3b780c8ee0 2023-11-27T21:21:48.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.466+0000 7f3b757fa640 1 -- 172.21.15.88:0/3022821150 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b640072f0 con 0x7f3b780c8ee0 2023-11-27T21:21:48.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.466+0000 7f3b7f03d640 1 -- 172.21.15.88:0/3022821150 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b781ef7d0 con 0x7f3b780c8ee0 2023-11-27T21:21:48.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.467+0000 7f3b7f03d640 1 -- 172.21.15.88:0/3022821150 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b78067470 con 0x7f3b780c8ee0 2023-11-27T21:21:48.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.486+0000 7f3b757fa640 1 -- 172.21.15.88:0/3022821150 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3b64007510 con 0x7f3b780c8ee0 2023-11-27T21:21:48.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.486+0000 7f3b757fa640 1 --2- 172.21.15.88:0/3022821150 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3b5c06b210 0x7f3b5c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:48.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.486+0000 7f3b7cdd9640 1 --2- 172.21.15.88:0/3022821150 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3b5c06b210 0x7f3b5c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:48.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.486+0000 7f3b7cdd9640 1 --2- 172.21.15.88:0/3022821150 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3b5c06b210 0x7f3b5c06d6d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c036000 tx=0x7f3b6c03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:48.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.721+0000 7f3b757fa640 1 -- 172.21.15.88:0/3022821150 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3b64007e20 con 0x7f3b780c8ee0 2023-11-27T21:21:48.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.732+0000 7f3b757fa640 1 -- 172.21.15.88:0/3022821150 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3b640540f0 con 0x7f3b780c8ee0 2023-11-27T21:21:48.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.912+0000 7f3b7f03d640 1 -- 172.21.15.88:0/3022821150 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3b78157060 con 0x7f3b780c8ee0 2023-11-27T21:21:48.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.916+0000 7f3b757fa640 1 -- 172.21.15.88:0/3022821150 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3b64017070 con 0x7f3b780c8ee0 2023-11-27T21:21:48.918 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-11-27T21:21:48.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.918+0000 7f3b7f03d640 1 -- 172.21.15.88:0/3022821150 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3b5c06b210 msgr2=0x7f3b5c06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:48.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.918+0000 7f3b7f03d640 1 --2- 172.21.15.88:0/3022821150 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3b5c06b210 0x7f3b5c06d6d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c036000 tx=0x7f3b6c03d040 comp rx=0 tx=0).stop 2023-11-27T21:21:48.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.918+0000 7f3b7f03d640 1 -- 172.21.15.88:0/3022821150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b780c8ee0 msgr2=0x7f3b78159650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:48.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.918+0000 7f3b7f03d640 1 --2- 172.21.15.88:0/3022821150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b780c8ee0 0x7f3b78159650 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400c390 tx=0x7f3b64001e70 comp rx=0 tx=0).stop 2023-11-27T21:21:48.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.918+0000 7f3b7f03d640 1 -- 172.21.15.88:0/3022821150 shutdown_connections 2023-11-27T21:21:48.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.918+0000 7f3b7f03d640 1 --2- 172.21.15.88:0/3022821150 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f3b5c06b210 0x7f3b5c06d6d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:48.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.918+0000 7f3b7f03d640 1 --2- 172.21.15.88:0/3022821150 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b781538d0 0x7f3b780c5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:48.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.918+0000 7f3b7f03d640 1 --2- 172.21.15.88:0/3022821150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b780c8ee0 0x7f3b78159650 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:48.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.918+0000 7f3b7f03d640 1 --2- 172.21.15.88:0/3022821150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b7806ba50 0x7f3b780c4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:48.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.918+0000 7f3b7f03d640 1 -- 172.21.15.88:0/3022821150 >> 172.21.15.88:0/3022821150 conn(0x7f3b78060f20 msgr2=0x7f3b78151db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:48.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.918+0000 7f3b7f03d640 1 -- 172.21.15.88:0/3022821150 shutdown_connections 2023-11-27T21:21:48.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:48.918+0000 7f3b7f03d640 1 -- 172.21.15.88:0/3022821150 wait complete. 2023-11-27T21:21:48.931 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi088.front.sepia.ceph.com... 2023-11-27T21:21:48.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T21:21:48.931 DEBUG:teuthology.orchestra.run.smithi088:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-27T21:21:48.958 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T21:21:48.981 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:ceph-fuse[99912]: fuse finished with error 0 and tester_r 0 2023-11-27T21:21:49.714 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:==00:00:26:25.987 99912== 2023-11-27T21:21:49.714 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:==00:00:26:25.987 99912== Exit program on first error (--exit-on-first-error=yes) 2023-11-27T21:21:49.783 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:daemon-helper: command failed with exit status 42 2023-11-27T21:21:55.061 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-11-27T21:21:55.061 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2023-11-27T21:21:55.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T21:21:55.061 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-27T21:21:55.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T21:21:55.080 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-11-27T21:21:55.140 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-27T21:21:55.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T21:21:55.141 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T21:21:55.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T21:21:55.214 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2023-11-27T21:21:55.329 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-27T21:21:55.339 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-27T21:21:55.339 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T21:21:55.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.449+0000 7efe4fd24640 1 Processor -- start 2023-11-27T21:21:55.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.449+0000 7efe4fd24640 1 -- start start 2023-11-27T21:21:55.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.450+0000 7efe4fd24640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efe480c46c0 0x7efe480c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:55.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.450+0000 7efe4fd24640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe480c4aa0 0x7efe4814fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:55.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.450+0000 7efe4fd24640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe480c76f0 con 0x7efe48150290 2023-11-27T21:21:55.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.450+0000 7efe4fd24640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe480c2bc0 con 0x7efe480c46c0 2023-11-27T21:21:55.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.450+0000 7efe4fd24640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe480c6dc0 con 0x7efe480c4aa0 2023-11-27T21:21:55.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.464+0000 7efe4d2bf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe480c4aa0 0x7efe4814fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:55.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.464+0000 7efe4e2c1640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7efe48150290 0x7efe480c1ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:59176/0 (socket says 172.21.15.88:59176) 2023-11-27T21:21:55.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.464+0000 7efe4e2c1640 1 -- 172.21.15.88:0/1691921367 learned_addr learned my addr 172.21.15.88:0/1691921367 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:21:55.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.464+0000 7efe4dac0640 1 --2- 172.21.15.88:0/1691921367 >> v2:172.21.15.167:3300/0 conn(0x7efe480c46c0 0x7efe480c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:55.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.470+0000 7efe4d2bf640 1 -- 172.21.15.88:0/1691921367 >> v2:172.21.15.167:3300/0 conn(0x7efe480c46c0 msgr2=0x7efe480c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:21:55.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.470+0000 7efe4d2bf640 1 --2- 172.21.15.88:0/1691921367 >> v2:172.21.15.167:3300/0 conn(0x7efe480c46c0 0x7efe480c53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:55.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.470+0000 7efe4d2bf640 1 -- 172.21.15.88:0/1691921367 >> v1:172.21.15.167:6789/0 conn(0x7efe48150290 legacy=0x7efe480c1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:55.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.470+0000 7efe4d2bf640 1 -- 172.21.15.88:0/1691921367 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe480c70a0 con 0x7efe480c4aa0 2023-11-27T21:21:55.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.472+0000 7efe4d2bf640 1 --2- 172.21.15.88:0/1691921367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe480c4aa0 0x7efe4814fd50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efe380097a0 tx=0x7efe3802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a19fa37f68daaac server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:55.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.476+0000 7efe4cabe640 1 -- 172.21.15.88:0/1691921367 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe38031830 con 0x7efe480c4aa0 2023-11-27T21:21:55.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.477+0000 7efe4cabe640 1 -- 172.21.15.88:0/1691921367 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe38031990 con 0x7efe480c4aa0 2023-11-27T21:21:55.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.477+0000 7efe4cabe640 1 -- 172.21.15.88:0/1691921367 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe38031d20 con 0x7efe480c4aa0 2023-11-27T21:21:55.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.477+0000 7efe4fd24640 1 -- 172.21.15.88:0/1691921367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe480c4aa0 msgr2=0x7efe4814fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:55.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.477+0000 7efe4fd24640 1 --2- 172.21.15.88:0/1691921367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe480c4aa0 0x7efe4814fd50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efe380097a0 tx=0x7efe3802b8d0 comp rx=0 tx=0).stop 2023-11-27T21:21:55.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.477+0000 7efe4fd24640 1 -- 172.21.15.88:0/1691921367 shutdown_connections 2023-11-27T21:21:55.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.477+0000 7efe4fd24640 1 --2- 172.21.15.88:0/1691921367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe480c4aa0 0x7efe4814fd50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:55.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.477+0000 7efe4fd24640 1 --2- 172.21.15.88:0/1691921367 >> v2:172.21.15.167:3300/0 conn(0x7efe480c46c0 0x7efe480c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:55.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.477+0000 7efe4fd24640 1 -- 172.21.15.88:0/1691921367 >> 172.21.15.88:0/1691921367 conn(0x7efe4806c5f0 msgr2=0x7efe4806c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:55.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.477+0000 7efe4fd24640 1 -- 172.21.15.88:0/1691921367 shutdown_connections 2023-11-27T21:21:55.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.477+0000 7efe4fd24640 1 -- 172.21.15.88:0/1691921367 wait complete. 2023-11-27T21:21:55.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.479+0000 7efe4fd24640 1 Processor -- start 2023-11-27T21:21:55.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.479+0000 7efe4fd24640 1 -- start start 2023-11-27T21:21:55.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.479+0000 7efe4fd24640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe480c46c0 0x7efe480c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:55.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.479+0000 7efe4fd24640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe480c4aa0 0x7efe481ed060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:55.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.479+0000 7efe4fd24640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe48150290 0x7efe481ed5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:55.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.479+0000 7efe4fd24640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe481509a0 con 0x7efe48150290 2023-11-27T21:21:55.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.479+0000 7efe4fd24640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe48151730 con 0x7efe480c4aa0 2023-11-27T21:21:55.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.479+0000 7efe4fd24640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe48150bb0 con 0x7efe480c46c0 2023-11-27T21:21:55.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.482+0000 7efe4d2bf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe480c4aa0 0x7efe481ed060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:55.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.482+0000 7efe4d2bf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe480c4aa0 0x7efe481ed060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:51562/0 (socket says 172.21.15.88:51562) 2023-11-27T21:21:55.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.482+0000 7efe4d2bf640 1 -- 172.21.15.88:0/754752039 learned_addr learned my addr 172.21.15.88:0/754752039 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:55.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.485+0000 7efe4dac0640 1 --2- 172.21.15.88:0/754752039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe480c46c0 0x7efe480c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:55.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.522+0000 7efe4e2c1640 1 --2- 172.21.15.88:0/754752039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe48150290 0x7efe481ed5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:55.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.526+0000 7efe4e2c1640 1 -- 172.21.15.88:0/754752039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe480c46c0 msgr2=0x7efe480c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:55.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.526+0000 7efe4e2c1640 1 --2- 172.21.15.88:0/754752039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe480c46c0 0x7efe480c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:55.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.526+0000 7efe4e2c1640 1 -- 172.21.15.88:0/754752039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe480c4aa0 msgr2=0x7efe481ed060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:55.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.526+0000 7efe4e2c1640 1 --2- 172.21.15.88:0/754752039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe480c4aa0 0x7efe481ed060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:55.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.526+0000 7efe4e2c1640 1 -- 172.21.15.88:0/754752039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe38009400 con 0x7efe48150290 2023-11-27T21:21:55.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.528+0000 7efe4e2c1640 1 --2- 172.21.15.88:0/754752039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe48150290 0x7efe481ed5a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efe4000caa0 tx=0x7efe4000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:55.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.532+0000 7efe3e7fc640 1 -- 172.21.15.88:0/754752039 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4000aae0 con 0x7efe48150290 2023-11-27T21:21:55.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.532+0000 7efe3e7fc640 1 -- 172.21.15.88:0/754752039 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4000ac40 con 0x7efe48150290 2023-11-27T21:21:55.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.532+0000 7efe3e7fc640 1 -- 172.21.15.88:0/754752039 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe40012400 con 0x7efe48150290 2023-11-27T21:21:55.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.532+0000 7efe4fd24640 1 -- 172.21.15.88:0/754752039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe48150e90 con 0x7efe48150290 2023-11-27T21:21:55.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.532+0000 7efe4fd24640 1 -- 172.21.15.88:0/754752039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe48151450 con 0x7efe48150290 2023-11-27T21:21:55.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.533+0000 7efe4fd24640 1 -- 172.21.15.88:0/754752039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe48067470 con 0x7efe48150290 2023-11-27T21:21:55.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.556+0000 7efe3e7fc640 1 -- 172.21.15.88:0/754752039 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7efe40012560 con 0x7efe48150290 2023-11-27T21:21:55.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.556+0000 7efe3e7fc640 1 --2- 172.21.15.88:0/754752039 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7efe2c06b210 0x7efe2c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:55.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.556+0000 7efe4dac0640 1 --2- 172.21.15.88:0/754752039 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7efe2c06b210 0x7efe2c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:55.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.556+0000 7efe4dac0640 1 --2- 172.21.15.88:0/754752039 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7efe2c06b210 0x7efe2c06d6d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efe44009ad0 tx=0x7efe44008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:55.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.558+0000 7efe3e7fc640 1 -- 172.21.15.88:0/754752039 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efe40058aa0 con 0x7efe48150290 2023-11-27T21:21:55.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.797+0000 7efe3e7fc640 1 -- 172.21.15.88:0/754752039 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7efe40054de0 con 0x7efe48150290 2023-11-27T21:21:55.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.962+0000 7efe4fd24640 1 -- 172.21.15.88:0/754752039 --> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efe480c2e80 con 0x7efe2c06b210 2023-11-27T21:21:55.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.971+0000 7efe3e7fc640 1 -- 172.21.15.88:0/754752039 <== mgr.4105 v2:172.21.15.88:6800/352455703 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371094 (secure 0 0 0) 0x7efe440119a0 con 0x7efe2c06b210 2023-11-27T21:21:55.977 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T21:21:55.979 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-11-27T21:21:55.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.974+0000 7efe4fd24640 1 -- 172.21.15.88:0/754752039 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7efe2c06b210 msgr2=0x7efe2c06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:55.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.974+0000 7efe4fd24640 1 --2- 172.21.15.88:0/754752039 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7efe2c06b210 0x7efe2c06d6d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efe44009ad0 tx=0x7efe44008040 comp rx=0 tx=0).stop 2023-11-27T21:21:55.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.974+0000 7efe4fd24640 1 -- 172.21.15.88:0/754752039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe48150290 msgr2=0x7efe481ed5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:55.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.974+0000 7efe4fd24640 1 --2- 172.21.15.88:0/754752039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe48150290 0x7efe481ed5a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efe4000caa0 tx=0x7efe4000cf60 comp rx=0 tx=0).stop 2023-11-27T21:21:55.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.974+0000 7efe4fd24640 1 -- 172.21.15.88:0/754752039 shutdown_connections 2023-11-27T21:21:55.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.974+0000 7efe4fd24640 1 --2- 172.21.15.88:0/754752039 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7efe2c06b210 0x7efe2c06d6d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:55.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.974+0000 7efe4fd24640 1 --2- 172.21.15.88:0/754752039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe48150290 0x7efe481ed5a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:55.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.974+0000 7efe4fd24640 1 --2- 172.21.15.88:0/754752039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe480c4aa0 0x7efe481ed060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:55.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.974+0000 7efe4fd24640 1 --2- 172.21.15.88:0/754752039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe480c46c0 0x7efe480c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:55.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.974+0000 7efe4fd24640 1 -- 172.21.15.88:0/754752039 >> 172.21.15.88:0/754752039 conn(0x7efe4806c5f0 msgr2=0x7efe48156270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:55.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.974+0000 7efe4fd24640 1 -- 172.21.15.88:0/754752039 shutdown_connections 2023-11-27T21:21:55.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:55.974+0000 7efe4fd24640 1 -- 172.21.15.88:0/754752039 wait complete. 2023-11-27T21:21:55.988 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":856,"stamp":"2023-11-27T21:21:55.265714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":44862470,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":1793,"num_read_kb":1913,"num_write":21035,"num_write_kb":386609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25286,"ondisk_log_size":25286,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":563072,"kb_used_data":90176,"kb_used_omap":12,"kb_used_meta":472819,"kb_avail":754411648,"statfs":{"total":773094113280,"available":772517527552,"internally_reserved":0,"allocated":92340224,"data_stored":90685252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":484167217},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,3,5,48,9,32,9,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":65,"apply_latency_ms":65,"commit_latency_ns":65000000,"apply_latency_ns":65000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16384,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":38,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003000"},"pg_stats":[{"pgid":"2.1f","version":"28'332","reported_seq":363,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.011175+0000","last_change":"2023-11-27T20:54:26.222003+0000","last_active":"2023-11-27T21:21:49.011175+0000","last_peered":"2023-11-27T21:21:49.011175+0000","last_clean":"2023-11-27T21:21:49.011175+0000","last_became_active":"2023-11-27T20:54:26.221715+0000","last_became_peered":"2023-11-27T20:54:26.221715+0000","last_unstale":"2023-11-27T21:21:49.011175+0000","last_undegraded":"2023-11-27T21:21:49.011175+0000","last_fullsized":"2023-11-27T21:21:49.011175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:36:45.301515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922212,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":1068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"28'71","reported_seq":101,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.476594+0000","last_change":"2023-11-27T20:54:27.508401+0000","last_active":"2023-11-27T21:21:49.476594+0000","last_peered":"2023-11-27T21:21:49.476594+0000","last_clean":"2023-11-27T21:21:49.476594+0000","last_became_active":"2023-11-27T20:54:27.508003+0000","last_became_peered":"2023-11-27T20:54:27.508003+0000","last_unstale":"2023-11-27T21:21:49.476594+0000","last_undegraded":"2023-11-27T21:21:49.476594+0000","last_fullsized":"2023-11-27T21:21:49.476594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:11:42.954310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"28'159","reported_seq":185,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.951498+0000","last_change":"2023-11-27T20:54:31.837226+0000","last_active":"2023-11-27T21:21:12.951498+0000","last_peered":"2023-11-27T21:21:12.951498+0000","last_clean":"2023-11-27T21:21:12.951498+0000","last_became_active":"2023-11-27T20:54:31.836803+0000","last_became_peered":"2023-11-27T20:54:31.836803+0000","last_unstale":"2023-11-27T21:21:12.951498+0000","last_undegraded":"2023-11-27T21:21:12.951498+0000","last_fullsized":"2023-11-27T21:21:12.951498+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:06.363326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":7710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'738","reported_seq":769,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:24.329906+0000","last_change":"2023-11-27T20:54:26.227906+0000","last_active":"2023-11-27T21:21:24.329906+0000","last_peered":"2023-11-27T21:21:24.329906+0000","last_clean":"2023-11-27T21:21:24.329906+0000","last_became_active":"2023-11-27T20:54:26.227620+0000","last_became_peered":"2023-11-27T20:54:26.227620+0000","last_unstale":"2023-11-27T21:21:24.329906+0000","last_undegraded":"2023-11-27T21:21:24.329906+0000","last_fullsized":"2023-11-27T21:21:24.329906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:35.560769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":733,"num_write_kb":4484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"28'77","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.476122+0000","last_change":"2023-11-27T20:54:27.507740+0000","last_active":"2023-11-27T21:21:49.476122+0000","last_peered":"2023-11-27T21:21:49.476122+0000","last_clean":"2023-11-27T21:21:49.476122+0000","last_became_active":"2023-11-27T20:54:27.507460+0000","last_became_peered":"2023-11-27T20:54:27.507460+0000","last_unstale":"2023-11-27T21:21:49.476122+0000","last_undegraded":"2023-11-27T21:21:49.476122+0000","last_fullsized":"2023-11-27T21:21:49.476122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:24:30.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"28'166","reported_seq":201,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:09.269897+0000","last_change":"2023-11-27T20:55:00.593902+0000","last_active":"2023-11-27T21:21:09.269897+0000","last_peered":"2023-11-27T21:21:09.269897+0000","last_clean":"2023-11-27T21:21:09.269897+0000","last_became_active":"2023-11-27T20:55:00.593543+0000","last_became_peered":"2023-11-27T20:55:00.593543+0000","last_unstale":"2023-11-27T21:21:09.269897+0000","last_undegraded":"2023-11-27T21:21:09.269897+0000","last_fullsized":"2023-11-27T21:21:09.269897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:57:38.465675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":12743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"28'180","reported_seq":208,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:36.501028+0000","last_change":"2023-11-27T20:54:26.226645+0000","last_active":"2023-11-27T21:21:36.501028+0000","last_peered":"2023-11-27T21:21:36.501028+0000","last_clean":"2023-11-27T21:21:36.501028+0000","last_became_active":"2023-11-27T20:54:26.226407+0000","last_became_peered":"2023-11-27T20:54:26.226407+0000","last_unstale":"2023-11-27T21:21:36.501028+0000","last_undegraded":"2023-11-27T21:21:36.501028+0000","last_fullsized":"2023-11-27T21:21:36.501028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:32:19.691350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'78","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.391101+0000","last_change":"2023-11-27T20:54:27.512803+0000","last_active":"2023-11-27T21:21:49.391101+0000","last_peered":"2023-11-27T21:21:49.391101+0000","last_clean":"2023-11-27T21:21:49.391101+0000","last_became_active":"2023-11-27T20:54:27.512548+0000","last_became_peered":"2023-11-27T20:54:27.512548+0000","last_unstale":"2023-11-27T21:21:49.391101+0000","last_undegraded":"2023-11-27T21:21:49.391101+0000","last_fullsized":"2023-11-27T21:21:49.391101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:36.652979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"28'164","reported_seq":189,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:11.314014+0000","last_change":"2023-11-27T20:54:31.828391+0000","last_active":"2023-11-27T21:21:11.314014+0000","last_peered":"2023-11-27T21:21:11.314014+0000","last_clean":"2023-11-27T21:21:11.314014+0000","last_became_active":"2023-11-27T20:54:31.828045+0000","last_became_peered":"2023-11-27T20:54:31.828045+0000","last_unstale":"2023-11-27T21:21:11.314014+0000","last_undegraded":"2023-11-27T21:21:11.314014+0000","last_fullsized":"2023-11-27T21:21:11.314014+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:58.308604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":12089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"28'9","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:33.519716+0000","last_change":"2023-11-27T20:54:26.226762+0000","last_active":"2023-11-27T21:21:33.519716+0000","last_peered":"2023-11-27T21:21:33.519716+0000","last_clean":"2023-11-27T21:21:33.519716+0000","last_became_active":"2023-11-27T20:54:26.226522+0000","last_became_peered":"2023-11-27T20:54:26.226522+0000","last_unstale":"2023-11-27T21:21:33.519716+0000","last_undegraded":"2023-11-27T21:21:33.519716+0000","last_fullsized":"2023-11-27T21:21:33.519716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:31.269905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"28'85","reported_seq":119,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.446167+0000","last_change":"2023-11-27T20:55:00.790042+0000","last_active":"2023-11-27T21:21:49.446167+0000","last_peered":"2023-11-27T21:21:49.446167+0000","last_clean":"2023-11-27T21:21:49.446167+0000","last_became_active":"2023-11-27T20:55:00.789772+0000","last_became_peered":"2023-11-27T20:55:00.789772+0000","last_unstale":"2023-11-27T21:21:49.446167+0000","last_undegraded":"2023-11-27T21:21:49.446167+0000","last_fullsized":"2023-11-27T21:21:49.446167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:51:32.237462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"28'169","reported_seq":194,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:07.313840+0000","last_change":"2023-11-27T20:54:31.828759+0000","last_active":"2023-11-27T21:21:07.313840+0000","last_peered":"2023-11-27T21:21:07.313840+0000","last_clean":"2023-11-27T21:21:07.313840+0000","last_became_active":"2023-11-27T20:54:31.828371+0000","last_became_peered":"2023-11-27T20:54:31.828371+0000","last_unstale":"2023-11-27T21:21:07.313840+0000","last_undegraded":"2023-11-27T21:21:07.313840+0000","last_fullsized":"2023-11-27T21:21:07.313840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:40.986177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":6774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"28'74","reported_seq":103,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.445340+0000","last_change":"2023-11-27T20:54:27.498572+0000","last_active":"2023-11-27T21:21:49.445340+0000","last_peered":"2023-11-27T21:21:49.445340+0000","last_clean":"2023-11-27T21:21:49.445340+0000","last_became_active":"2023-11-27T20:54:27.498279+0000","last_became_peered":"2023-11-27T20:54:27.498279+0000","last_unstale":"2023-11-27T21:21:49.445340+0000","last_undegraded":"2023-11-27T21:21:49.445340+0000","last_fullsized":"2023-11-27T21:21:49.445340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:23:57.929109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'1121","reported_seq":1151,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:35.299616+0000","last_change":"2023-11-27T20:54:26.227734+0000","last_active":"2023-11-27T21:21:35.299616+0000","last_peered":"2023-11-27T21:21:35.299616+0000","last_clean":"2023-11-27T21:21:35.299616+0000","last_became_active":"2023-11-27T20:54:26.227503+0000","last_became_peered":"2023-11-27T20:54:26.227503+0000","last_unstale":"2023-11-27T21:21:35.299616+0000","last_undegraded":"2023-11-27T21:21:35.299616+0000","last_fullsized":"2023-11-27T21:21:35.299616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1121,"log_dups_size":0,"ondisk_log_size":1121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:08.206775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1114,"num_write_kb":4562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"28'173","reported_seq":200,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:15.784237+0000","last_change":"2023-11-27T20:54:31.827976+0000","last_active":"2023-11-27T21:21:15.784237+0000","last_peered":"2023-11-27T21:21:15.784237+0000","last_clean":"2023-11-27T21:21:15.784237+0000","last_became_active":"2023-11-27T20:54:31.827631+0000","last_became_peered":"2023-11-27T20:54:31.827631+0000","last_unstale":"2023-11-27T21:21:15.784237+0000","last_undegraded":"2023-11-27T21:21:15.784237+0000","last_fullsized":"2023-11-27T21:21:15.784237+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:58:58.404897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":8292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"28'70","reported_seq":98,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.390638+0000","last_change":"2023-11-27T20:54:27.510917+0000","last_active":"2023-11-27T21:21:49.390638+0000","last_peered":"2023-11-27T21:21:49.390638+0000","last_clean":"2023-11-27T21:21:49.390638+0000","last_became_active":"2023-11-27T20:54:27.510668+0000","last_became_peered":"2023-11-27T20:54:27.510668+0000","last_unstale":"2023-11-27T21:21:49.390638+0000","last_undegraded":"2023-11-27T21:21:49.390638+0000","last_fullsized":"2023-11-27T21:21:49.390638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:27:15.390631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'447","reported_seq":477,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:42.292239+0000","last_change":"2023-11-27T20:54:26.231461+0000","last_active":"2023-11-27T21:21:42.292239+0000","last_peered":"2023-11-27T21:21:42.292239+0000","last_clean":"2023-11-27T21:21:42.292239+0000","last_became_active":"2023-11-27T20:54:26.231081+0000","last_became_peered":"2023-11-27T20:54:26.231081+0000","last_unstale":"2023-11-27T21:21:42.292239+0000","last_undegraded":"2023-11-27T21:21:42.292239+0000","last_fullsized":"2023-11-27T21:21:42.292239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:35.560769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"28'191","reported_seq":218,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:16.059056+0000","last_change":"2023-11-27T20:54:31.817058+0000","last_active":"2023-11-27T21:21:16.059056+0000","last_peered":"2023-11-27T21:21:16.059056+0000","last_clean":"2023-11-27T21:21:16.059056+0000","last_became_active":"2023-11-27T20:54:31.816700+0000","last_became_peered":"2023-11-27T20:54:31.816700+0000","last_unstale":"2023-11-27T21:21:16.059056+0000","last_undegraded":"2023-11-27T21:21:16.059056+0000","last_fullsized":"2023-11-27T21:21:16.059056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:02.384459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":12458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"28'73","reported_seq":102,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.481340+0000","last_change":"2023-11-27T20:54:27.510195+0000","last_active":"2023-11-27T21:21:49.481340+0000","last_peered":"2023-11-27T21:21:49.481340+0000","last_clean":"2023-11-27T21:21:49.481340+0000","last_became_active":"2023-11-27T20:54:27.509961+0000","last_became_peered":"2023-11-27T20:54:27.509961+0000","last_unstale":"2023-11-27T21:21:49.481340+0000","last_undegraded":"2023-11-27T21:21:49.481340+0000","last_fullsized":"2023-11-27T21:21:49.481340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:15:47.196613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'335","reported_seq":365,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:36.505451+0000","last_change":"2023-11-27T20:54:26.223978+0000","last_active":"2023-11-27T21:21:36.505451+0000","last_peered":"2023-11-27T21:21:36.505451+0000","last_clean":"2023-11-27T21:21:36.505451+0000","last_became_active":"2023-11-27T20:54:26.223717+0000","last_became_peered":"2023-11-27T20:54:26.223717+0000","last_unstale":"2023-11-27T21:21:36.505451+0000","last_undegraded":"2023-11-27T21:21:36.505451+0000","last_fullsized":"2023-11-27T21:21:36.505451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:19:35.269523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":333,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'146","reported_seq":173,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.963929+0000","last_change":"2023-11-27T20:54:31.836718+0000","last_active":"2023-11-27T21:21:12.963929+0000","last_peered":"2023-11-27T21:21:12.963929+0000","last_clean":"2023-11-27T21:21:12.963929+0000","last_became_active":"2023-11-27T20:54:31.836346+0000","last_became_peered":"2023-11-27T20:54:31.836346+0000","last_unstale":"2023-11-27T21:21:12.963929+0000","last_undegraded":"2023-11-27T21:21:12.963929+0000","last_fullsized":"2023-11-27T21:21:12.963929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:29:03.931226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":6504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'66","reported_seq":95,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.501577+0000","last_change":"2023-11-27T20:54:27.493578+0000","last_active":"2023-11-27T21:21:49.501577+0000","last_peered":"2023-11-27T21:21:49.501577+0000","last_clean":"2023-11-27T21:21:49.501577+0000","last_became_active":"2023-11-27T20:54:27.493327+0000","last_became_peered":"2023-11-27T20:54:27.493327+0000","last_unstale":"2023-11-27T21:21:49.501577+0000","last_undegraded":"2023-11-27T21:21:49.501577+0000","last_fullsized":"2023-11-27T21:21:49.501577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:48:56.464995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"28'7","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:35.299412+0000","last_change":"2023-11-27T20:54:26.227383+0000","last_active":"2023-11-27T21:21:35.299412+0000","last_peered":"2023-11-27T21:21:35.299412+0000","last_clean":"2023-11-27T21:21:35.299412+0000","last_became_active":"2023-11-27T20:54:26.227120+0000","last_became_peered":"2023-11-27T20:54:26.227120+0000","last_unstale":"2023-11-27T21:21:35.299412+0000","last_undegraded":"2023-11-27T21:21:35.299412+0000","last_fullsized":"2023-11-27T21:21:35.299412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:20.644474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'197","reported_seq":233,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:13.022761+0000","last_change":"2023-11-27T20:55:01.286453+0000","last_active":"2023-11-27T21:21:13.022761+0000","last_peered":"2023-11-27T21:21:13.022761+0000","last_clean":"2023-11-27T21:21:13.022761+0000","last_became_active":"2023-11-27T20:55:01.286057+0000","last_became_peered":"2023-11-27T20:55:01.286057+0000","last_unstale":"2023-11-27T21:21:13.022761+0000","last_undegraded":"2023-11-27T21:21:13.022761+0000","last_fullsized":"2023-11-27T21:21:13.022761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:17.334107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":17829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5,7],"acting":[2,1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"28'63","reported_seq":92,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.481101+0000","last_change":"2023-11-27T20:54:27.510815+0000","last_active":"2023-11-27T21:21:49.481101+0000","last_peered":"2023-11-27T21:21:49.481101+0000","last_clean":"2023-11-27T21:21:49.481101+0000","last_became_active":"2023-11-27T20:54:27.510573+0000","last_became_peered":"2023-11-27T20:54:27.510573+0000","last_unstale":"2023-11-27T21:21:49.481101+0000","last_undegraded":"2023-11-27T21:21:49.481101+0000","last_fullsized":"2023-11-27T21:21:49.481101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:44:21.573980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'13","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:36.499632+0000","last_change":"2023-11-27T20:54:26.224703+0000","last_active":"2023-11-27T21:21:36.499632+0000","last_peered":"2023-11-27T21:21:36.499632+0000","last_clean":"2023-11-27T21:21:36.499632+0000","last_became_active":"2023-11-27T20:54:26.224412+0000","last_became_peered":"2023-11-27T20:54:26.224412+0000","last_unstale":"2023-11-27T21:21:36.499632+0000","last_undegraded":"2023-11-27T21:21:36.499632+0000","last_fullsized":"2023-11-27T21:21:36.499632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:02.889092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'174","reported_seq":202,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.959471+0000","last_change":"2023-11-27T20:54:31.819739+0000","last_active":"2023-11-27T21:21:12.959471+0000","last_peered":"2023-11-27T21:21:12.959471+0000","last_clean":"2023-11-27T21:21:12.959471+0000","last_became_active":"2023-11-27T20:54:31.819371+0000","last_became_peered":"2023-11-27T20:54:31.819371+0000","last_unstale":"2023-11-27T21:21:12.959471+0000","last_undegraded":"2023-11-27T21:21:12.959471+0000","last_fullsized":"2023-11-27T21:21:12.959471+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:35.147110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":8398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"28'71","reported_seq":100,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.480758+0000","last_change":"2023-11-27T20:54:27.500858+0000","last_active":"2023-11-27T21:21:49.480758+0000","last_peered":"2023-11-27T21:21:49.480758+0000","last_clean":"2023-11-27T21:21:49.480758+0000","last_became_active":"2023-11-27T20:54:27.500455+0000","last_became_peered":"2023-11-27T20:54:27.500455+0000","last_unstale":"2023-11-27T21:21:49.480758+0000","last_undegraded":"2023-11-27T21:21:49.480758+0000","last_fullsized":"2023-11-27T21:21:49.480758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:12:05.775037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'160","reported_seq":190,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:41.647576+0000","last_change":"2023-11-27T20:54:26.223401+0000","last_active":"2023-11-27T21:21:41.647576+0000","last_peered":"2023-11-27T21:21:41.647576+0000","last_clean":"2023-11-27T21:21:41.647576+0000","last_became_active":"2023-11-27T20:54:26.222981+0000","last_became_peered":"2023-11-27T20:54:26.222981+0000","last_unstale":"2023-11-27T21:21:41.647576+0000","last_undegraded":"2023-11-27T21:21:41.647576+0000","last_fullsized":"2023-11-27T21:21:41.647576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:43:11.830626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":391,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"28'157","reported_seq":185,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.779032+0000","last_change":"2023-11-27T20:54:31.814118+0000","last_active":"2023-11-27T21:21:12.779032+0000","last_peered":"2023-11-27T21:21:12.779032+0000","last_clean":"2023-11-27T21:21:12.779032+0000","last_became_active":"2023-11-27T20:54:31.813765+0000","last_became_peered":"2023-11-27T20:54:31.813765+0000","last_unstale":"2023-11-27T21:21:12.779032+0000","last_undegraded":"2023-11-27T21:21:12.779032+0000","last_fullsized":"2023-11-27T21:21:12.779032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:28:56.396805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":11921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"28'78","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.415446+0000","last_change":"2023-11-27T20:54:27.506449+0000","last_active":"2023-11-27T21:21:49.415446+0000","last_peered":"2023-11-27T21:21:49.415446+0000","last_clean":"2023-11-27T21:21:49.415446+0000","last_became_active":"2023-11-27T20:54:27.506210+0000","last_became_peered":"2023-11-27T20:54:27.506210+0000","last_unstale":"2023-11-27T21:21:49.415446+0000","last_undegraded":"2023-11-27T21:21:49.415446+0000","last_fullsized":"2023-11-27T21:21:49.415446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:32:20.783560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'245","reported_seq":276,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:40.084015+0000","last_change":"2023-11-27T20:54:26.220043+0000","last_active":"2023-11-27T21:21:40.084015+0000","last_peered":"2023-11-27T21:21:40.084015+0000","last_clean":"2023-11-27T21:21:40.084015+0000","last_became_active":"2023-11-27T20:54:26.219775+0000","last_became_peered":"2023-11-27T20:54:26.219775+0000","last_unstale":"2023-11-27T21:21:40.084015+0000","last_undegraded":"2023-11-27T21:21:40.084015+0000","last_fullsized":"2023-11-27T21:21:40.084015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:33.812297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"28'177","reported_seq":205,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:11.896181+0000","last_change":"2023-11-27T20:54:31.825960+0000","last_active":"2023-11-27T21:21:11.896181+0000","last_peered":"2023-11-27T21:21:11.896181+0000","last_clean":"2023-11-27T21:21:11.896181+0000","last_became_active":"2023-11-27T20:54:31.825591+0000","last_became_peered":"2023-11-27T20:54:31.825591+0000","last_unstale":"2023-11-27T21:21:11.896181+0000","last_undegraded":"2023-11-27T21:21:11.896181+0000","last_fullsized":"2023-11-27T21:21:11.896181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:24:35.498899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":8135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"28'65","reported_seq":95,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.526249+0000","last_change":"2023-11-27T20:54:27.500927+0000","last_active":"2023-11-27T21:21:49.526249+0000","last_peered":"2023-11-27T21:21:49.526249+0000","last_clean":"2023-11-27T21:21:49.526249+0000","last_became_active":"2023-11-27T20:54:27.500677+0000","last_became_peered":"2023-11-27T20:54:27.500677+0000","last_unstale":"2023-11-27T21:21:49.526249+0000","last_undegraded":"2023-11-27T21:21:49.526249+0000","last_fullsized":"2023-11-27T21:21:49.526249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:56.708375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"28'6","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:36.500820+0000","last_change":"2023-11-27T20:54:26.227877+0000","last_active":"2023-11-27T21:21:36.500820+0000","last_peered":"2023-11-27T21:21:36.500820+0000","last_clean":"2023-11-27T21:21:36.500820+0000","last_became_active":"2023-11-27T20:54:26.227605+0000","last_became_peered":"2023-11-27T20:54:26.227605+0000","last_unstale":"2023-11-27T21:21:36.500820+0000","last_undegraded":"2023-11-27T21:21:36.500820+0000","last_fullsized":"2023-11-27T21:21:36.500820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:40.031252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"28'178","reported_seq":206,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:15.791510+0000","last_change":"2023-11-27T20:54:31.826732+0000","last_active":"2023-11-27T21:21:15.791510+0000","last_peered":"2023-11-27T21:21:15.791510+0000","last_clean":"2023-11-27T21:21:15.791510+0000","last_became_active":"2023-11-27T20:54:31.826406+0000","last_became_peered":"2023-11-27T20:54:31.826406+0000","last_unstale":"2023-11-27T21:21:15.791510+0000","last_undegraded":"2023-11-27T21:21:15.791510+0000","last_fullsized":"2023-11-27T21:21:15.791510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:54.926925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":6957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"28'85","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.489365+0000","last_change":"2023-11-27T20:54:27.517007+0000","last_active":"2023-11-27T21:21:49.489365+0000","last_peered":"2023-11-27T21:21:49.489365+0000","last_clean":"2023-11-27T21:21:49.489365+0000","last_became_active":"2023-11-27T20:54:27.516686+0000","last_became_peered":"2023-11-27T20:54:27.516686+0000","last_unstale":"2023-11-27T21:21:49.489365+0000","last_undegraded":"2023-11-27T21:21:49.489365+0000","last_fullsized":"2023-11-27T21:21:49.489365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:50.369518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'915","reported_seq":946,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.016379+0000","last_change":"2023-11-27T20:54:26.230192+0000","last_active":"2023-11-27T21:21:49.016379+0000","last_peered":"2023-11-27T21:21:49.016379+0000","last_clean":"2023-11-27T21:21:49.016379+0000","last_became_active":"2023-11-27T20:54:26.229985+0000","last_became_peered":"2023-11-27T20:54:26.229985+0000","last_unstale":"2023-11-27T21:21:49.016379+0000","last_undegraded":"2023-11-27T21:21:49.016379+0000","last_fullsized":"2023-11-27T21:21:49.016379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:58:59.280763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206463,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":911,"num_write_kb":4580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"28'139","reported_seq":163,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:13.022778+0000","last_change":"2023-11-27T20:55:00.588512+0000","last_active":"2023-11-27T21:21:13.022778+0000","last_peered":"2023-11-27T21:21:13.022778+0000","last_clean":"2023-11-27T21:21:13.022778+0000","last_became_active":"2023-11-27T20:55:00.588018+0000","last_became_peered":"2023-11-27T20:55:00.588018+0000","last_unstale":"2023-11-27T21:21:13.022778+0000","last_undegraded":"2023-11-27T21:21:13.022778+0000","last_fullsized":"2023-11-27T21:21:13.022778+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:06.015093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":13169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,0,3],"acting":[2,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'77","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.482999+0000","last_change":"2023-11-27T20:54:27.513378+0000","last_active":"2023-11-27T21:21:49.482999+0000","last_peered":"2023-11-27T21:21:49.482999+0000","last_clean":"2023-11-27T21:21:49.482999+0000","last_became_active":"2023-11-27T20:54:27.512093+0000","last_became_peered":"2023-11-27T20:54:27.512093+0000","last_unstale":"2023-11-27T21:21:49.482999+0000","last_undegraded":"2023-11-27T21:21:49.482999+0000","last_fullsized":"2023-11-27T21:21:49.482999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:24:36.921232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'270","reported_seq":470,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:44.209461+0000","last_change":"2023-11-27T20:54:26.230913+0000","last_active":"2023-11-27T21:21:44.209461+0000","last_peered":"2023-11-27T21:21:44.209461+0000","last_clean":"2023-11-27T21:21:44.209461+0000","last_became_active":"2023-11-27T20:54:26.230548+0000","last_became_peered":"2023-11-27T20:54:26.230548+0000","last_unstale":"2023-11-27T21:21:44.209461+0000","last_undegraded":"2023-11-27T21:21:44.209461+0000","last_fullsized":"2023-11-27T21:21:44.209461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:42:11.153092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28446,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":170,"num_read_kb":173,"num_write":266,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"28'141","reported_seq":177,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.292190+0000","last_change":"2023-11-27T20:55:00.595104+0000","last_active":"2023-11-27T21:21:12.292190+0000","last_peered":"2023-11-27T21:21:12.292190+0000","last_clean":"2023-11-27T21:21:12.292190+0000","last_became_active":"2023-11-27T20:55:00.594705+0000","last_became_peered":"2023-11-27T20:55:00.594705+0000","last_unstale":"2023-11-27T21:21:12.292190+0000","last_undegraded":"2023-11-27T21:21:12.292190+0000","last_fullsized":"2023-11-27T21:21:12.292190+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:06.015093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":12035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"28'77","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.424310+0000","last_change":"2023-11-27T20:54:27.503689+0000","last_active":"2023-11-27T21:21:49.424310+0000","last_peered":"2023-11-27T21:21:49.424310+0000","last_clean":"2023-11-27T21:21:49.424310+0000","last_became_active":"2023-11-27T20:54:27.502941+0000","last_became_peered":"2023-11-27T20:54:27.502941+0000","last_unstale":"2023-11-27T21:21:49.424310+0000","last_undegraded":"2023-11-27T21:21:49.424310+0000","last_fullsized":"2023-11-27T21:21:49.424310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:59:41.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'11","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:40.287864+0000","last_change":"2023-11-27T20:54:26.214419+0000","last_active":"2023-11-27T21:21:40.287864+0000","last_peered":"2023-11-27T21:21:40.287864+0000","last_clean":"2023-11-27T21:21:40.287864+0000","last_became_active":"2023-11-27T20:54:26.214166+0000","last_became_peered":"2023-11-27T20:54:26.214166+0000","last_unstale":"2023-11-27T21:21:40.287864+0000","last_undegraded":"2023-11-27T21:21:40.287864+0000","last_fullsized":"2023-11-27T21:21:40.287864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:44:20.481769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"28'132","reported_seq":159,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:14.318094+0000","last_change":"2023-11-27T20:54:31.832551+0000","last_active":"2023-11-27T21:21:14.318094+0000","last_peered":"2023-11-27T21:21:14.318094+0000","last_clean":"2023-11-27T21:21:14.318094+0000","last_became_active":"2023-11-27T20:54:31.832196+0000","last_became_peered":"2023-11-27T20:54:31.832196+0000","last_unstale":"2023-11-27T21:21:14.318094+0000","last_undegraded":"2023-11-27T21:21:14.318094+0000","last_fullsized":"2023-11-27T21:21:14.318094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:26:46.712422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":8461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'69","reported_seq":99,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.481057+0000","last_change":"2023-11-27T20:54:27.433404+0000","last_active":"2023-11-27T21:21:49.481057+0000","last_peered":"2023-11-27T21:21:49.481057+0000","last_clean":"2023-11-27T21:21:49.481057+0000","last_became_active":"2023-11-27T20:54:27.433161+0000","last_became_peered":"2023-11-27T20:54:27.433161+0000","last_unstale":"2023-11-27T21:21:49.481057+0000","last_undegraded":"2023-11-27T21:21:49.481057+0000","last_fullsized":"2023-11-27T21:21:49.481057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:09.298985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'8","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:26.067458+0000","last_change":"2023-11-27T20:54:26.227451+0000","last_active":"2023-11-27T21:21:26.067458+0000","last_peered":"2023-11-27T21:21:26.067458+0000","last_clean":"2023-11-27T21:21:26.067458+0000","last_became_active":"2023-11-27T20:54:26.227133+0000","last_became_peered":"2023-11-27T20:54:26.227133+0000","last_unstale":"2023-11-27T21:21:26.067458+0000","last_undegraded":"2023-11-27T21:21:26.067458+0000","last_fullsized":"2023-11-27T21:21:26.067458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:58.281608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:18:14.202215+0000","last_change":"2023-11-27T20:54:11.452973+0000","last_active":"2023-11-27T21:18:14.202215+0000","last_peered":"2023-11-27T21:18:14.202215+0000","last_clean":"2023-11-27T21:18:14.202215+0000","last_became_active":"2023-11-27T20:54:11.452181+0000","last_became_peered":"2023-11-27T20:54:11.452181+0000","last_unstale":"2023-11-27T21:18:14.202215+0000","last_undegraded":"2023-11-27T21:18:14.202215+0000","last_fullsized":"2023-11-27T21:18:14.202215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:09.564478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:09.564478+0000","last_clean_scrub_stamp":"2023-11-27T20:54:09.564478+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:07.792065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'171","reported_seq":199,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.805300+0000","last_change":"2023-11-27T20:54:31.818408+0000","last_active":"2023-11-27T21:21:12.805300+0000","last_peered":"2023-11-27T21:21:12.805300+0000","last_clean":"2023-11-27T21:21:12.805300+0000","last_became_active":"2023-11-27T20:54:31.818048+0000","last_became_peered":"2023-11-27T20:54:31.818048+0000","last_unstale":"2023-11-27T21:21:12.805300+0000","last_undegraded":"2023-11-27T21:21:12.805300+0000","last_fullsized":"2023-11-27T21:21:12.805300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:48:53.892148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":10034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"28'75","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.445353+0000","last_change":"2023-11-27T20:54:27.493626+0000","last_active":"2023-11-27T21:21:49.445353+0000","last_peered":"2023-11-27T21:21:49.445353+0000","last_clean":"2023-11-27T21:21:49.445353+0000","last_became_active":"2023-11-27T20:54:27.493256+0000","last_became_peered":"2023-11-27T20:54:27.493256+0000","last_unstale":"2023-11-27T21:21:49.445353+0000","last_undegraded":"2023-11-27T21:21:49.445353+0000","last_fullsized":"2023-11-27T21:21:49.445353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:40:57.665118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'1018","reported_seq":1048,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:26.066735+0000","last_change":"2023-11-27T20:54:26.230079+0000","last_active":"2023-11-27T21:21:26.066735+0000","last_peered":"2023-11-27T21:21:26.066735+0000","last_clean":"2023-11-27T21:21:26.066735+0000","last_became_active":"2023-11-27T20:54:26.229796+0000","last_became_peered":"2023-11-27T20:54:26.229796+0000","last_unstale":"2023-11-27T21:21:26.066735+0000","last_undegraded":"2023-11-27T21:21:26.066735+0000","last_fullsized":"2023-11-27T21:21:26.066735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1018,"log_dups_size":0,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:55.616164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1013,"num_write_kb":4611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'180","reported_seq":207,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:10.821878+0000","last_change":"2023-11-27T20:54:31.825472+0000","last_active":"2023-11-27T21:21:10.821878+0000","last_peered":"2023-11-27T21:21:10.821878+0000","last_clean":"2023-11-27T21:21:10.821878+0000","last_became_active":"2023-11-27T20:54:31.825080+0000","last_became_peered":"2023-11-27T20:54:31.825080+0000","last_unstale":"2023-11-27T21:21:10.821878+0000","last_undegraded":"2023-11-27T21:21:10.821878+0000","last_fullsized":"2023-11-27T21:21:10.821878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:56:07.208945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":9643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'78","reported_seq":99,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.490397+0000","last_change":"2023-11-27T20:55:00.593751+0000","last_active":"2023-11-27T21:21:49.490397+0000","last_peered":"2023-11-27T21:21:49.490397+0000","last_clean":"2023-11-27T21:21:49.490397+0000","last_became_active":"2023-11-27T20:55:00.593249+0000","last_became_peered":"2023-11-27T20:55:00.593249+0000","last_unstale":"2023-11-27T21:21:49.490397+0000","last_undegraded":"2023-11-27T21:21:49.490397+0000","last_fullsized":"2023-11-27T21:21:49.490397+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:10.486151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"28'436","reported_seq":466,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.016200+0000","last_change":"2023-11-27T20:54:26.226148+0000","last_active":"2023-11-27T21:21:49.016200+0000","last_peered":"2023-11-27T21:21:49.016200+0000","last_clean":"2023-11-27T21:21:49.016200+0000","last_became_active":"2023-11-27T20:54:26.225886+0000","last_became_peered":"2023-11-27T20:54:26.225886+0000","last_unstale":"2023-11-27T21:21:49.016200+0000","last_undegraded":"2023-11-27T21:21:49.016200+0000","last_fullsized":"2023-11-27T21:21:49.016200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:32:19.691350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2473984,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":2660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"28'169","reported_seq":196,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:14.309237+0000","last_change":"2023-11-27T20:54:31.828729+0000","last_active":"2023-11-27T21:21:14.309237+0000","last_peered":"2023-11-27T21:21:14.309237+0000","last_clean":"2023-11-27T21:21:14.309237+0000","last_became_active":"2023-11-27T20:54:31.828368+0000","last_became_peered":"2023-11-27T20:54:31.828368+0000","last_unstale":"2023-11-27T21:21:14.309237+0000","last_undegraded":"2023-11-27T21:21:14.309237+0000","last_fullsized":"2023-11-27T21:21:14.309237+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:02.384459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":8527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"28'75","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.492569+0000","last_change":"2023-11-27T20:54:27.515800+0000","last_active":"2023-11-27T21:21:49.492569+0000","last_peered":"2023-11-27T21:21:49.492569+0000","last_clean":"2023-11-27T21:21:49.492569+0000","last_became_active":"2023-11-27T20:54:27.515416+0000","last_became_peered":"2023-11-27T20:54:27.515416+0000","last_unstale":"2023-11-27T21:21:49.492569+0000","last_undegraded":"2023-11-27T21:21:49.492569+0000","last_fullsized":"2023-11-27T21:21:49.492569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:03:00.166936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"28'8","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:27.856575+0000","last_change":"2023-11-27T20:54:26.224880+0000","last_active":"2023-11-27T21:21:27.856575+0000","last_peered":"2023-11-27T21:21:27.856575+0000","last_clean":"2023-11-27T21:21:27.856575+0000","last_became_active":"2023-11-27T20:54:26.224604+0000","last_became_peered":"2023-11-27T20:54:26.224604+0000","last_unstale":"2023-11-27T21:21:27.856575+0000","last_undegraded":"2023-11-27T21:21:27.856575+0000","last_fullsized":"2023-11-27T21:21:27.856575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:15:45.927622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"28'149","reported_seq":176,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:10.315785+0000","last_change":"2023-11-27T20:54:31.819648+0000","last_active":"2023-11-27T21:21:10.315785+0000","last_peered":"2023-11-27T21:21:10.315785+0000","last_clean":"2023-11-27T21:21:10.315785+0000","last_became_active":"2023-11-27T20:54:31.819294+0000","last_became_peered":"2023-11-27T20:54:31.819294+0000","last_unstale":"2023-11-27T21:21:10.315785+0000","last_undegraded":"2023-11-27T21:21:10.315785+0000","last_fullsized":"2023-11-27T21:21:10.315785+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:15.043559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"28'77","reported_seq":106,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.528436+0000","last_change":"2023-11-27T20:54:27.512925+0000","last_active":"2023-11-27T21:21:49.528436+0000","last_peered":"2023-11-27T21:21:49.528436+0000","last_clean":"2023-11-27T21:21:49.528436+0000","last_became_active":"2023-11-27T20:54:27.512663+0000","last_became_peered":"2023-11-27T20:54:27.512663+0000","last_unstale":"2023-11-27T21:21:49.528436+0000","last_undegraded":"2023-11-27T21:21:49.528436+0000","last_fullsized":"2023-11-27T21:21:49.528436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:41.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"28'239","reported_seq":269,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:36.186311+0000","last_change":"2023-11-27T20:54:26.225344+0000","last_active":"2023-11-27T21:21:36.186311+0000","last_peered":"2023-11-27T21:21:36.186311+0000","last_clean":"2023-11-27T21:21:36.186311+0000","last_became_active":"2023-11-27T20:54:26.225056+0000","last_became_peered":"2023-11-27T20:54:26.225056+0000","last_unstale":"2023-11-27T21:21:36.186311+0000","last_undegraded":"2023-11-27T21:21:36.186311+0000","last_fullsized":"2023-11-27T21:21:36.186311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:39.965666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"28'126","reported_seq":153,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:11.958197+0000","last_change":"2023-11-27T20:54:31.827590+0000","last_active":"2023-11-27T21:21:11.958197+0000","last_peered":"2023-11-27T21:21:11.958197+0000","last_clean":"2023-11-27T21:21:11.958197+0000","last_became_active":"2023-11-27T20:54:31.827175+0000","last_became_peered":"2023-11-27T20:54:31.827175+0000","last_unstale":"2023-11-27T21:21:11.958197+0000","last_undegraded":"2023-11-27T21:21:11.958197+0000","last_fullsized":"2023-11-27T21:21:11.958197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:07:26.372924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":7629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"28'69","reported_seq":97,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.444328+0000","last_change":"2023-11-27T20:54:27.498488+0000","last_active":"2023-11-27T21:21:49.444328+0000","last_peered":"2023-11-27T21:21:49.444328+0000","last_clean":"2023-11-27T21:21:49.444328+0000","last_became_active":"2023-11-27T20:54:27.498225+0000","last_became_peered":"2023-11-27T20:54:27.498225+0000","last_unstale":"2023-11-27T21:21:49.444328+0000","last_undegraded":"2023-11-27T21:21:49.444328+0000","last_fullsized":"2023-11-27T21:21:49.444328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:20:24.928142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'1029","reported_seq":1058,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.015885+0000","last_change":"2023-11-27T20:54:26.225580+0000","last_active":"2023-11-27T21:21:49.015885+0000","last_peered":"2023-11-27T21:21:49.015885+0000","last_clean":"2023-11-27T21:21:49.015885+0000","last_became_active":"2023-11-27T20:54:26.225333+0000","last_became_peered":"2023-11-27T20:54:26.225333+0000","last_unstale":"2023-11-27T21:21:49.015885+0000","last_undegraded":"2023-11-27T21:21:49.015885+0000","last_fullsized":"2023-11-27T21:21:49.015885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1029,"log_dups_size":0,"ondisk_log_size":1029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:46:01.797509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3313963,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1025,"num_write_kb":3921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"28'159","reported_seq":185,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:11.889011+0000","last_change":"2023-11-27T20:54:31.836029+0000","last_active":"2023-11-27T21:21:11.889011+0000","last_peered":"2023-11-27T21:21:11.889011+0000","last_clean":"2023-11-27T21:21:11.889011+0000","last_became_active":"2023-11-27T20:54:31.835629+0000","last_became_peered":"2023-11-27T20:54:31.835629+0000","last_unstale":"2023-11-27T21:21:11.889011+0000","last_undegraded":"2023-11-27T21:21:11.889011+0000","last_fullsized":"2023-11-27T21:21:11.889011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:06.015093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":12674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'64","reported_seq":91,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.430617+0000","last_change":"2023-11-27T20:54:27.511034+0000","last_active":"2023-11-27T21:21:49.430617+0000","last_peered":"2023-11-27T21:21:49.430617+0000","last_clean":"2023-11-27T21:21:49.430617+0000","last_became_active":"2023-11-27T20:54:27.510775+0000","last_became_peered":"2023-11-27T20:54:27.510775+0000","last_unstale":"2023-11-27T21:21:49.430617+0000","last_undegraded":"2023-11-27T21:21:49.430617+0000","last_fullsized":"2023-11-27T21:21:49.430617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:56.708375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"28'1188","reported_seq":1217,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:20:09.292900+0000","last_change":"2023-11-27T20:54:26.227007+0000","last_active":"2023-11-27T21:20:09.292900+0000","last_peered":"2023-11-27T21:20:09.292900+0000","last_clean":"2023-11-27T21:20:09.292900+0000","last_became_active":"2023-11-27T20:54:26.226745+0000","last_became_peered":"2023-11-27T20:54:26.226745+0000","last_unstale":"2023-11-27T21:20:09.292900+0000","last_undegraded":"2023-11-27T21:20:09.292900+0000","last_fullsized":"2023-11-27T21:20:09.292900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1188,"log_dups_size":0,"ondisk_log_size":1188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:41:46.312385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":4695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"28'169","reported_seq":195,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:10.950189+0000","last_change":"2023-11-27T20:54:31.831969+0000","last_active":"2023-11-27T21:21:10.950189+0000","last_peered":"2023-11-27T21:21:10.950189+0000","last_clean":"2023-11-27T21:21:10.950189+0000","last_became_active":"2023-11-27T20:54:31.831620+0000","last_became_peered":"2023-11-27T20:54:31.831620+0000","last_unstale":"2023-11-27T21:21:10.950189+0000","last_undegraded":"2023-11-27T21:21:10.950189+0000","last_fullsized":"2023-11-27T21:21:10.950189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:57:38.465675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":13064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'85","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.445927+0000","last_change":"2023-11-27T20:54:27.515785+0000","last_active":"2023-11-27T21:21:49.445927+0000","last_peered":"2023-11-27T21:21:49.445927+0000","last_clean":"2023-11-27T21:21:49.445927+0000","last_became_active":"2023-11-27T20:54:27.515524+0000","last_became_peered":"2023-11-27T20:54:27.515524+0000","last_unstale":"2023-11-27T21:21:49.445927+0000","last_undegraded":"2023-11-27T21:21:49.445927+0000","last_fullsized":"2023-11-27T21:21:49.445927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:40:33.267986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'242","reported_seq":271,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:42.288454+0000","last_change":"2023-11-27T20:54:26.225975+0000","last_active":"2023-11-27T21:21:42.288454+0000","last_peered":"2023-11-27T21:21:42.288454+0000","last_clean":"2023-11-27T21:21:42.288454+0000","last_became_active":"2023-11-27T20:54:26.225691+0000","last_became_peered":"2023-11-27T20:54:26.225691+0000","last_unstale":"2023-11-27T21:21:42.288454+0000","last_undegraded":"2023-11-27T21:21:42.288454+0000","last_fullsized":"2023-11-27T21:21:42.288454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:25.427192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":236,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"28'150","reported_seq":176,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.291749+0000","last_change":"2023-11-27T20:54:31.827058+0000","last_active":"2023-11-27T21:21:12.291749+0000","last_peered":"2023-11-27T21:21:12.291749+0000","last_clean":"2023-11-27T21:21:12.291749+0000","last_became_active":"2023-11-27T20:54:31.826669+0000","last_became_peered":"2023-11-27T20:54:31.826669+0000","last_unstale":"2023-11-27T21:21:12.291749+0000","last_undegraded":"2023-11-27T21:21:12.291749+0000","last_fullsized":"2023-11-27T21:21:12.291749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:40.986177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":7432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"28'77","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.398536+0000","last_change":"2023-11-27T20:54:27.503066+0000","last_active":"2023-11-27T21:21:49.398536+0000","last_peered":"2023-11-27T21:21:49.398536+0000","last_clean":"2023-11-27T21:21:49.398536+0000","last_became_active":"2023-11-27T20:54:27.502677+0000","last_became_peered":"2023-11-27T20:54:27.502677+0000","last_unstale":"2023-11-27T21:21:49.398536+0000","last_undegraded":"2023-11-27T21:21:49.398536+0000","last_fullsized":"2023-11-27T21:21:49.398536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:41.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'326","reported_seq":668,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:42.283413+0000","last_change":"2023-11-27T20:54:26.228175+0000","last_active":"2023-11-27T21:21:42.283413+0000","last_peered":"2023-11-27T21:21:42.283413+0000","last_clean":"2023-11-27T21:21:42.283413+0000","last_became_active":"2023-11-27T20:54:26.227911+0000","last_became_peered":"2023-11-27T20:54:26.227911+0000","last_unstale":"2023-11-27T21:21:42.283413+0000","last_undegraded":"2023-11-27T21:21:42.283413+0000","last_fullsized":"2023-11-27T21:21:42.283413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:57.995466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53552,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":314,"num_read_kb":325,"num_write":327,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'174","reported_seq":200,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:09.987996+0000","last_change":"2023-11-27T20:54:31.828136+0000","last_active":"2023-11-27T21:21:09.987996+0000","last_peered":"2023-11-27T21:21:09.987996+0000","last_clean":"2023-11-27T21:21:09.987996+0000","last_became_active":"2023-11-27T20:54:31.827785+0000","last_became_peered":"2023-11-27T20:54:31.827785+0000","last_unstale":"2023-11-27T21:21:09.987996+0000","last_undegraded":"2023-11-27T21:21:09.987996+0000","last_fullsized":"2023-11-27T21:21:09.987996+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:28:18.206490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":11290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'75","reported_seq":103,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.490363+0000","last_change":"2023-11-27T20:54:27.514185+0000","last_active":"2023-11-27T21:21:49.490363+0000","last_peered":"2023-11-27T21:21:49.490363+0000","last_clean":"2023-11-27T21:21:49.490363+0000","last_became_active":"2023-11-27T20:54:27.513655+0000","last_became_peered":"2023-11-27T20:54:27.513655+0000","last_unstale":"2023-11-27T21:21:49.490363+0000","last_undegraded":"2023-11-27T21:21:49.490363+0000","last_fullsized":"2023-11-27T21:21:49.490363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:52.629755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'1482","reported_seq":1511,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:32.579507+0000","last_change":"2023-11-27T20:54:26.230827+0000","last_active":"2023-11-27T21:21:32.579507+0000","last_peered":"2023-11-27T21:21:32.579507+0000","last_clean":"2023-11-27T21:21:32.579507+0000","last_became_active":"2023-11-27T20:54:26.230570+0000","last_became_peered":"2023-11-27T20:54:26.230570+0000","last_unstale":"2023-11-27T21:21:32.579507+0000","last_undegraded":"2023-11-27T21:21:32.579507+0000","last_fullsized":"2023-11-27T21:21:32.579507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1482,"log_dups_size":0,"ondisk_log_size":1482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:42:04.480038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1482,"num_write_kb":4539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"28'155","reported_seq":181,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.855294+0000","last_change":"2023-11-27T20:54:31.828482+0000","last_active":"2023-11-27T21:21:12.855294+0000","last_peered":"2023-11-27T21:21:12.855294+0000","last_clean":"2023-11-27T21:21:12.855294+0000","last_became_active":"2023-11-27T20:54:31.827872+0000","last_became_peered":"2023-11-27T20:54:31.827872+0000","last_unstale":"2023-11-27T21:21:12.855294+0000","last_undegraded":"2023-11-27T21:21:12.855294+0000","last_fullsized":"2023-11-27T21:21:12.855294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:32:35.015914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":8855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'67","reported_seq":95,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.446147+0000","last_change":"2023-11-27T20:54:27.493526+0000","last_active":"2023-11-27T21:21:49.446147+0000","last_peered":"2023-11-27T21:21:49.446147+0000","last_clean":"2023-11-27T21:21:49.446147+0000","last_became_active":"2023-11-27T20:54:27.493257+0000","last_became_peered":"2023-11-27T20:54:27.493257+0000","last_unstale":"2023-11-27T21:21:49.446147+0000","last_undegraded":"2023-11-27T21:21:49.446147+0000","last_fullsized":"2023-11-27T21:21:49.446147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:04.222900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'149","reported_seq":177,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:42.291396+0000","last_change":"2023-11-27T20:54:26.231237+0000","last_active":"2023-11-27T21:21:42.291396+0000","last_peered":"2023-11-27T21:21:42.291396+0000","last_clean":"2023-11-27T21:21:42.291396+0000","last_became_active":"2023-11-27T20:54:26.230963+0000","last_became_peered":"2023-11-27T20:54:26.230963+0000","last_unstale":"2023-11-27T21:21:42.291396+0000","last_undegraded":"2023-11-27T21:21:42.291396+0000","last_fullsized":"2023-11-27T21:21:42.291396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:11:24.730507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"28'195","reported_seq":225,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:16.055228+0000","last_change":"2023-11-27T20:54:31.825391+0000","last_active":"2023-11-27T21:21:16.055228+0000","last_peered":"2023-11-27T21:21:16.055228+0000","last_clean":"2023-11-27T21:21:16.055228+0000","last_became_active":"2023-11-27T20:54:31.825038+0000","last_became_peered":"2023-11-27T20:54:31.825038+0000","last_unstale":"2023-11-27T21:21:16.055228+0000","last_undegraded":"2023-11-27T21:21:16.055228+0000","last_fullsized":"2023-11-27T21:21:16.055228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:11:47.511718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":102,"num_write":164,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"28'89","reported_seq":117,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.489472+0000","last_change":"2023-11-27T20:54:27.508226+0000","last_active":"2023-11-27T21:21:49.489472+0000","last_peered":"2023-11-27T21:21:49.489472+0000","last_clean":"2023-11-27T21:21:49.489472+0000","last_became_active":"2023-11-27T20:54:27.507805+0000","last_became_peered":"2023-11-27T20:54:27.507805+0000","last_unstale":"2023-11-27T21:21:49.489472+0000","last_undegraded":"2023-11-27T21:21:49.489472+0000","last_fullsized":"2023-11-27T21:21:49.489472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:43:42.137077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'328","reported_seq":675,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:40.082191+0000","last_change":"2023-11-27T20:54:26.226915+0000","last_active":"2023-11-27T21:21:40.082191+0000","last_peered":"2023-11-27T21:21:40.082191+0000","last_clean":"2023-11-27T21:21:40.082191+0000","last_became_active":"2023-11-27T20:54:26.226679+0000","last_became_peered":"2023-11-27T20:54:26.226679+0000","last_unstale":"2023-11-27T21:21:40.082191+0000","last_undegraded":"2023-11-27T21:21:40.082191+0000","last_fullsized":"2023-11-27T21:21:40.082191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:05:08.792958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53032,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":318,"num_read_kb":327,"num_write":324,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"28'159","reported_seq":185,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:15.790221+0000","last_change":"2023-11-27T20:54:31.834934+0000","last_active":"2023-11-27T21:21:15.790221+0000","last_peered":"2023-11-27T21:21:15.790221+0000","last_clean":"2023-11-27T21:21:15.790221+0000","last_became_active":"2023-11-27T20:54:31.834569+0000","last_became_peered":"2023-11-27T20:54:31.834569+0000","last_unstale":"2023-11-27T21:21:15.790221+0000","last_undegraded":"2023-11-27T21:21:15.790221+0000","last_fullsized":"2023-11-27T21:21:15.790221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:15:51.754021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":7865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'79","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.528002+0000","last_change":"2023-11-27T20:54:27.498841+0000","last_active":"2023-11-27T21:21:49.528002+0000","last_peered":"2023-11-27T21:21:49.528002+0000","last_clean":"2023-11-27T21:21:49.528002+0000","last_became_active":"2023-11-27T20:54:27.498535+0000","last_became_peered":"2023-11-27T20:54:27.498535+0000","last_unstale":"2023-11-27T21:21:49.528002+0000","last_undegraded":"2023-11-27T21:21:49.528002+0000","last_fullsized":"2023-11-27T21:21:49.528002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:21.736684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'176","reported_seq":204,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:36.147269+0000","last_change":"2023-11-27T20:54:26.228140+0000","last_active":"2023-11-27T21:21:36.147269+0000","last_peered":"2023-11-27T21:21:36.147269+0000","last_clean":"2023-11-27T21:21:36.147269+0000","last_became_active":"2023-11-27T20:54:26.227878+0000","last_became_peered":"2023-11-27T20:54:26.227878+0000","last_unstale":"2023-11-27T21:21:36.147269+0000","last_undegraded":"2023-11-27T21:21:36.147269+0000","last_fullsized":"2023-11-27T21:21:36.147269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:21:36.965668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'104","reported_seq":130,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:14.321452+0000","last_change":"2023-11-27T20:54:31.825264+0000","last_active":"2023-11-27T21:21:14.321452+0000","last_peered":"2023-11-27T21:21:14.321452+0000","last_clean":"2023-11-27T21:21:14.321452+0000","last_became_active":"2023-11-27T20:54:31.824914+0000","last_became_peered":"2023-11-27T20:54:31.824914+0000","last_unstale":"2023-11-27T21:21:14.321452+0000","last_undegraded":"2023-11-27T21:21:14.321452+0000","last_fullsized":"2023-11-27T21:21:14.321452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:49:01.022403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":7715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"28'152","reported_seq":180,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:10.946992+0000","last_change":"2023-11-27T20:54:31.828359+0000","last_active":"2023-11-27T21:21:10.946992+0000","last_peered":"2023-11-27T21:21:10.946992+0000","last_clean":"2023-11-27T21:21:10.946992+0000","last_became_active":"2023-11-27T20:54:31.827971+0000","last_became_peered":"2023-11-27T20:54:31.827971+0000","last_unstale":"2023-11-27T21:21:10.946992+0000","last_undegraded":"2023-11-27T21:21:10.946992+0000","last_fullsized":"2023-11-27T21:21:10.946992+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:02.858386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":9456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"28'80","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.492929+0000","last_change":"2023-11-27T20:54:27.434914+0000","last_active":"2023-11-27T21:21:49.492929+0000","last_peered":"2023-11-27T21:21:49.492929+0000","last_clean":"2023-11-27T21:21:49.492929+0000","last_became_active":"2023-11-27T20:54:27.434635+0000","last_became_peered":"2023-11-27T20:54:27.434635+0000","last_unstale":"2023-11-27T21:21:49.492929+0000","last_undegraded":"2023-11-27T21:21:49.492929+0000","last_fullsized":"2023-11-27T21:21:49.492929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:59.373818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'6","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:18.070088+0000","last_change":"2023-11-27T20:54:26.224770+0000","last_active":"2023-11-27T21:21:18.070088+0000","last_peered":"2023-11-27T21:21:18.070088+0000","last_clean":"2023-11-27T21:21:18.070088+0000","last_became_active":"2023-11-27T20:54:26.224502+0000","last_became_peered":"2023-11-27T20:54:26.224502+0000","last_unstale":"2023-11-27T21:21:18.070088+0000","last_undegraded":"2023-11-27T21:21:18.070088+0000","last_fullsized":"2023-11-27T21:21:18.070088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:51:28.157451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"28'177","reported_seq":205,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:10.947037+0000","last_change":"2023-11-27T20:54:31.827147+0000","last_active":"2023-11-27T21:21:10.947037+0000","last_peered":"2023-11-27T21:21:10.947037+0000","last_clean":"2023-11-27T21:21:10.947037+0000","last_became_active":"2023-11-27T20:54:31.826790+0000","last_became_peered":"2023-11-27T20:54:31.826790+0000","last_unstale":"2023-11-27T21:21:10.947037+0000","last_undegraded":"2023-11-27T21:21:10.947037+0000","last_fullsized":"2023-11-27T21:21:10.947037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:11:33.954256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":15468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'77","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.483070+0000","last_change":"2023-11-27T20:54:27.507947+0000","last_active":"2023-11-27T21:21:49.483070+0000","last_peered":"2023-11-27T21:21:49.483070+0000","last_clean":"2023-11-27T21:21:49.483070+0000","last_became_active":"2023-11-27T20:54:27.507698+0000","last_became_peered":"2023-11-27T20:54:27.507698+0000","last_unstale":"2023-11-27T21:21:49.483070+0000","last_undegraded":"2023-11-27T21:21:49.483070+0000","last_fullsized":"2023-11-27T21:21:49.483070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:50.369518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'422","reported_seq":864,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:36.493048+0000","last_change":"2023-11-27T20:54:26.230417+0000","last_active":"2023-11-27T21:21:36.493048+0000","last_peered":"2023-11-27T21:21:36.493048+0000","last_clean":"2023-11-27T21:21:36.493048+0000","last_became_active":"2023-11-27T20:54:26.229725+0000","last_became_peered":"2023-11-27T20:54:26.229725+0000","last_unstale":"2023-11-27T21:21:36.493048+0000","last_undegraded":"2023-11-27T21:21:36.493048+0000","last_fullsized":"2023-11-27T21:21:36.493048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:01.075715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":413,"num_read_kb":420,"num_write":418,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'469","reported_seq":955,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:27.071063+0000","last_change":"2023-11-27T20:54:26.221975+0000","last_active":"2023-11-27T21:21:27.071063+0000","last_peered":"2023-11-27T21:21:27.071063+0000","last_clean":"2023-11-27T21:21:27.071063+0000","last_became_active":"2023-11-27T20:54:26.221715+0000","last_became_peered":"2023-11-27T20:54:26.221715+0000","last_unstale":"2023-11-27T21:21:27.071063+0000","last_undegraded":"2023-11-27T21:21:27.071063+0000","last_fullsized":"2023-11-27T21:21:27.071063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:15.156440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70496,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":458,"num_read_kb":466,"num_write":467,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'78","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.503170+0000","last_change":"2023-11-27T20:54:27.517213+0000","last_active":"2023-11-27T21:21:49.503170+0000","last_peered":"2023-11-27T21:21:49.503170+0000","last_clean":"2023-11-27T21:21:49.503170+0000","last_became_active":"2023-11-27T20:54:27.516887+0000","last_became_peered":"2023-11-27T20:54:27.516887+0000","last_unstale":"2023-11-27T21:21:49.503170+0000","last_undegraded":"2023-11-27T21:21:49.503170+0000","last_fullsized":"2023-11-27T21:21:49.503170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:51:29.249661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'144","reported_seq":169,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:07.511751+0000","last_change":"2023-11-27T20:54:31.827740+0000","last_active":"2023-11-27T21:21:07.511751+0000","last_peered":"2023-11-27T21:21:07.511751+0000","last_clean":"2023-11-27T21:21:07.511751+0000","last_became_active":"2023-11-27T20:54:31.827395+0000","last_became_peered":"2023-11-27T20:54:31.827395+0000","last_unstale":"2023-11-27T21:21:07.511751+0000","last_undegraded":"2023-11-27T21:21:07.511751+0000","last_fullsized":"2023-11-27T21:21:07.511751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:20:29.485550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":4976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'2868","reported_seq":2896,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.016313+0000","last_change":"2023-11-27T20:54:26.227971+0000","last_active":"2023-11-27T21:21:49.016313+0000","last_peered":"2023-11-27T21:21:49.016313+0000","last_clean":"2023-11-27T21:21:49.016313+0000","last_became_active":"2023-11-27T20:54:26.227713+0000","last_became_peered":"2023-11-27T20:54:26.227713+0000","last_unstale":"2023-11-27T21:21:49.016313+0000","last_undegraded":"2023-11-27T21:21:49.016313+0000","last_fullsized":"2023-11-27T21:21:49.016313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2868,"log_dups_size":0,"ondisk_log_size":2868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:39.965666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12113008,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2860,"num_write_kb":13160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"28'94","reported_seq":120,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.425483+0000","last_change":"2023-11-27T20:54:27.506394+0000","last_active":"2023-11-27T21:21:49.425483+0000","last_peered":"2023-11-27T21:21:49.425483+0000","last_clean":"2023-11-27T21:21:49.425483+0000","last_became_active":"2023-11-27T20:54:27.506119+0000","last_became_peered":"2023-11-27T20:54:27.506119+0000","last_unstale":"2023-11-27T21:21:49.425483+0000","last_undegraded":"2023-11-27T21:21:49.425483+0000","last_fullsized":"2023-11-27T21:21:49.425483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:21.736684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"28'135","reported_seq":160,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.951210+0000","last_change":"2023-11-27T20:54:31.833185+0000","last_active":"2023-11-27T21:21:12.951210+0000","last_peered":"2023-11-27T21:21:12.951210+0000","last_clean":"2023-11-27T21:21:12.951210+0000","last_became_active":"2023-11-27T20:54:31.832813+0000","last_became_peered":"2023-11-27T20:54:31.832813+0000","last_unstale":"2023-11-27T21:21:12.951210+0000","last_undegraded":"2023-11-27T21:21:12.951210+0000","last_fullsized":"2023-11-27T21:21:12.951210+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:13.856393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'74","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.526599+0000","last_change":"2023-11-27T20:54:27.500687+0000","last_active":"2023-11-27T21:21:49.526599+0000","last_peered":"2023-11-27T21:21:49.526599+0000","last_clean":"2023-11-27T21:21:49.526599+0000","last_became_active":"2023-11-27T20:54:27.500394+0000","last_became_peered":"2023-11-27T20:54:27.500394+0000","last_unstale":"2023-11-27T21:21:49.526599+0000","last_undegraded":"2023-11-27T21:21:49.526599+0000","last_fullsized":"2023-11-27T21:21:49.526599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:15:32.173306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"28'91","reported_seq":120,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.393968+0000","last_change":"2023-11-27T20:54:27.515441+0000","last_active":"2023-11-27T21:21:49.393968+0000","last_peered":"2023-11-27T21:21:49.393968+0000","last_clean":"2023-11-27T21:21:49.393968+0000","last_became_active":"2023-11-27T20:54:27.515173+0000","last_became_peered":"2023-11-27T20:54:27.515173+0000","last_unstale":"2023-11-27T21:21:49.393968+0000","last_undegraded":"2023-11-27T21:21:49.393968+0000","last_fullsized":"2023-11-27T21:21:49.393968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:19:36.361734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"28'79","reported_seq":109,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.498624+0000","last_change":"2023-11-27T20:54:27.506358+0000","last_active":"2023-11-27T21:21:49.498624+0000","last_peered":"2023-11-27T21:21:49.498624+0000","last_clean":"2023-11-27T21:21:49.498624+0000","last_became_active":"2023-11-27T20:54:27.506112+0000","last_became_peered":"2023-11-27T20:54:27.506112+0000","last_unstale":"2023-11-27T21:21:49.498624+0000","last_undegraded":"2023-11-27T21:21:49.498624+0000","last_fullsized":"2023-11-27T21:21:49.498624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:58.300979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'73","reported_seq":103,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.477477+0000","last_change":"2023-11-27T20:54:27.510776+0000","last_active":"2023-11-27T21:21:49.477477+0000","last_peered":"2023-11-27T21:21:49.477477+0000","last_clean":"2023-11-27T21:21:49.477477+0000","last_became_active":"2023-11-27T20:54:27.510532+0000","last_became_peered":"2023-11-27T20:54:27.510532+0000","last_unstale":"2023-11-27T21:21:49.477477+0000","last_undegraded":"2023-11-27T21:21:49.477477+0000","last_fullsized":"2023-11-27T21:21:49.477477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:36.428770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"28'58","reported_seq":87,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.400922+0000","last_change":"2023-11-27T20:54:27.513775+0000","last_active":"2023-11-27T21:21:49.400922+0000","last_peered":"2023-11-27T21:21:49.400922+0000","last_clean":"2023-11-27T21:21:49.400922+0000","last_became_active":"2023-11-27T20:54:27.513517+0000","last_became_peered":"2023-11-27T20:54:27.513517+0000","last_unstale":"2023-11-27T21:21:49.400922+0000","last_undegraded":"2023-11-27T21:21:49.400922+0000","last_fullsized":"2023-11-27T21:21:49.400922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:07:21.815516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'78","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.397802+0000","last_change":"2023-11-27T20:54:27.511798+0000","last_active":"2023-11-27T21:21:49.397802+0000","last_peered":"2023-11-27T21:21:49.397802+0000","last_clean":"2023-11-27T21:21:49.397802+0000","last_became_active":"2023-11-27T20:54:27.511559+0000","last_became_peered":"2023-11-27T20:54:27.511559+0000","last_unstale":"2023-11-27T21:21:49.397802+0000","last_undegraded":"2023-11-27T21:21:49.397802+0000","last_fullsized":"2023-11-27T21:21:49.397802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:41.057877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"28'75","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.527495+0000","last_change":"2023-11-27T20:54:27.499585+0000","last_active":"2023-11-27T21:21:49.527495+0000","last_peered":"2023-11-27T21:21:49.527495+0000","last_clean":"2023-11-27T21:21:49.527495+0000","last_became_active":"2023-11-27T20:54:27.499323+0000","last_became_peered":"2023-11-27T20:54:27.499323+0000","last_unstale":"2023-11-27T21:21:49.527495+0000","last_undegraded":"2023-11-27T21:21:49.527495+0000","last_fullsized":"2023-11-27T21:21:49.527495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:59:41.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"28'64","reported_seq":93,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.458062+0000","last_change":"2023-11-27T20:54:27.508846+0000","last_active":"2023-11-27T21:21:49.458062+0000","last_peered":"2023-11-27T21:21:49.458062+0000","last_clean":"2023-11-27T21:21:49.458062+0000","last_became_active":"2023-11-27T20:54:27.508615+0000","last_became_peered":"2023-11-27T20:54:27.508615+0000","last_unstale":"2023-11-27T21:21:49.458062+0000","last_undegraded":"2023-11-27T21:21:49.458062+0000","last_fullsized":"2023-11-27T21:21:49.458062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:53.751196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'78","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.498024+0000","last_change":"2023-11-27T20:54:27.510920+0000","last_active":"2023-11-27T21:21:49.498024+0000","last_peered":"2023-11-27T21:21:49.498024+0000","last_clean":"2023-11-27T21:21:49.498024+0000","last_became_active":"2023-11-27T20:54:27.510647+0000","last_became_peered":"2023-11-27T20:54:27.510647+0000","last_unstale":"2023-11-27T21:21:49.498024+0000","last_undegraded":"2023-11-27T21:21:49.498024+0000","last_fullsized":"2023-11-27T21:21:49.498024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:32:30.458506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"28'92","reported_seq":121,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.477139+0000","last_change":"2023-11-27T20:54:27.508596+0000","last_active":"2023-11-27T21:21:49.477139+0000","last_peered":"2023-11-27T21:21:49.477139+0000","last_clean":"2023-11-27T21:21:49.477139+0000","last_became_active":"2023-11-27T20:54:27.508360+0000","last_became_peered":"2023-11-27T20:54:27.508360+0000","last_unstale":"2023-11-27T21:21:49.477139+0000","last_undegraded":"2023-11-27T21:21:49.477139+0000","last_fullsized":"2023-11-27T21:21:49.477139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:58.794639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"28'87","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.391357+0000","last_change":"2023-11-27T20:54:27.513374+0000","last_active":"2023-11-27T21:21:49.391357+0000","last_peered":"2023-11-27T21:21:49.391357+0000","last_clean":"2023-11-27T21:21:49.391357+0000","last_became_active":"2023-11-27T20:54:27.513105+0000","last_became_peered":"2023-11-27T20:54:27.513105+0000","last_unstale":"2023-11-27T21:21:49.391357+0000","last_undegraded":"2023-11-27T21:21:49.391357+0000","last_fullsized":"2023-11-27T21:21:49.391357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:59:41.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"28'77","reported_seq":106,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.504502+0000","last_change":"2023-11-27T20:54:27.433370+0000","last_active":"2023-11-27T21:21:49.504502+0000","last_peered":"2023-11-27T21:21:49.504502+0000","last_clean":"2023-11-27T21:21:49.504502+0000","last_became_active":"2023-11-27T20:54:27.433179+0000","last_became_peered":"2023-11-27T20:54:27.433179+0000","last_unstale":"2023-11-27T21:21:49.504502+0000","last_undegraded":"2023-11-27T21:21:49.504502+0000","last_fullsized":"2023-11-27T21:21:49.504502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:01.805918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'75","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.488661+0000","last_change":"2023-11-27T20:54:27.515324+0000","last_active":"2023-11-27T21:21:49.488661+0000","last_peered":"2023-11-27T21:21:49.488661+0000","last_clean":"2023-11-27T21:21:49.488661+0000","last_became_active":"2023-11-27T20:54:27.515068+0000","last_became_peered":"2023-11-27T20:54:27.515068+0000","last_unstale":"2023-11-27T21:21:49.488661+0000","last_undegraded":"2023-11-27T21:21:49.488661+0000","last_fullsized":"2023-11-27T21:21:49.488661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:11:42.954310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"28'86","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.500364+0000","last_change":"2023-11-27T20:54:27.498621+0000","last_active":"2023-11-27T21:21:49.500364+0000","last_peered":"2023-11-27T21:21:49.500364+0000","last_clean":"2023-11-27T21:21:49.500364+0000","last_became_active":"2023-11-27T20:54:27.498306+0000","last_became_peered":"2023-11-27T20:54:27.498306+0000","last_unstale":"2023-11-27T21:21:49.500364+0000","last_undegraded":"2023-11-27T21:21:49.500364+0000","last_fullsized":"2023-11-27T21:21:49.500364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:20:24.529896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'91","reported_seq":118,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.405687+0000","last_change":"2023-11-27T20:54:27.513134+0000","last_active":"2023-11-27T21:21:49.405687+0000","last_peered":"2023-11-27T21:21:49.405687+0000","last_clean":"2023-11-27T21:21:49.405687+0000","last_became_active":"2023-11-27T20:54:27.512897+0000","last_became_peered":"2023-11-27T20:54:27.512897+0000","last_unstale":"2023-11-27T21:21:49.405687+0000","last_undegraded":"2023-11-27T21:21:49.405687+0000","last_fullsized":"2023-11-27T21:21:49.405687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:13:40.877792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"28'67","reported_seq":95,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.444605+0000","last_change":"2023-11-27T20:54:27.515196+0000","last_active":"2023-11-27T21:21:49.444605+0000","last_peered":"2023-11-27T21:21:49.444605+0000","last_clean":"2023-11-27T21:21:49.444605+0000","last_became_active":"2023-11-27T20:54:27.514946+0000","last_became_peered":"2023-11-27T20:54:27.514946+0000","last_unstale":"2023-11-27T21:21:49.444605+0000","last_undegraded":"2023-11-27T21:21:49.444605+0000","last_fullsized":"2023-11-27T21:21:49.444605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:06:07.940123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"28'80","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.442976+0000","last_change":"2023-11-27T20:54:27.493565+0000","last_active":"2023-11-27T21:21:49.442976+0000","last_peered":"2023-11-27T21:21:49.442976+0000","last_clean":"2023-11-27T21:21:49.442976+0000","last_became_active":"2023-11-27T20:54:27.493297+0000","last_became_peered":"2023-11-27T20:54:27.493297+0000","last_unstale":"2023-11-27T21:21:49.442976+0000","last_undegraded":"2023-11-27T21:21:49.442976+0000","last_fullsized":"2023-11-27T21:21:49.442976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:28:51.839397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"28'75","reported_seq":103,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.495955+0000","last_change":"2023-11-27T20:54:27.512910+0000","last_active":"2023-11-27T21:21:49.495955+0000","last_peered":"2023-11-27T21:21:49.495955+0000","last_clean":"2023-11-27T21:21:49.495955+0000","last_became_active":"2023-11-27T20:54:27.512662+0000","last_became_peered":"2023-11-27T20:54:27.512662+0000","last_unstale":"2023-11-27T21:21:49.495955+0000","last_undegraded":"2023-11-27T21:21:49.495955+0000","last_fullsized":"2023-11-27T21:21:49.495955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:52.629755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'70","reported_seq":98,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.398075+0000","last_change":"2023-11-27T20:54:27.512406+0000","last_active":"2023-11-27T21:21:49.398075+0000","last_peered":"2023-11-27T21:21:49.398075+0000","last_clean":"2023-11-27T21:21:49.398075+0000","last_became_active":"2023-11-27T20:54:27.512124+0000","last_became_peered":"2023-11-27T20:54:27.512124+0000","last_unstale":"2023-11-27T21:21:49.398075+0000","last_undegraded":"2023-11-27T21:21:49.398075+0000","last_fullsized":"2023-11-27T21:21:49.398075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:21.736684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"28'82","reported_seq":110,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.401709+0000","last_change":"2023-11-27T20:54:27.517262+0000","last_active":"2023-11-27T21:21:49.401709+0000","last_peered":"2023-11-27T21:21:49.401709+0000","last_clean":"2023-11-27T21:21:49.401709+0000","last_became_active":"2023-11-27T20:54:27.516907+0000","last_became_peered":"2023-11-27T20:54:27.516907+0000","last_unstale":"2023-11-27T21:21:49.401709+0000","last_undegraded":"2023-11-27T21:21:49.401709+0000","last_fullsized":"2023-11-27T21:21:49.401709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:05:09.885169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'68","reported_seq":96,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.492400+0000","last_change":"2023-11-27T20:54:27.515432+0000","last_active":"2023-11-27T21:21:49.492400+0000","last_peered":"2023-11-27T21:21:49.492400+0000","last_clean":"2023-11-27T21:21:49.492400+0000","last_became_active":"2023-11-27T20:54:27.515182+0000","last_became_peered":"2023-11-27T20:54:27.515182+0000","last_unstale":"2023-11-27T21:21:49.492400+0000","last_undegraded":"2023-11-27T21:21:49.492400+0000","last_fullsized":"2023-11-27T21:21:49.492400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:36.428770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'79","reported_seq":100,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.439014+0000","last_change":"2023-11-27T20:55:00.588607+0000","last_active":"2023-11-27T21:21:49.439014+0000","last_peered":"2023-11-27T21:21:49.439014+0000","last_clean":"2023-11-27T21:21:49.439014+0000","last_became_active":"2023-11-27T20:55:00.588298+0000","last_became_peered":"2023-11-27T20:55:00.588298+0000","last_unstale":"2023-11-27T21:21:49.439014+0000","last_undegraded":"2023-11-27T21:21:49.439014+0000","last_fullsized":"2023-11-27T21:21:49.439014+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:32:30.458506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'77","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.493919+0000","last_change":"2023-11-27T20:54:27.512956+0000","last_active":"2023-11-27T21:21:49.493919+0000","last_peered":"2023-11-27T21:21:49.493919+0000","last_clean":"2023-11-27T21:21:49.493919+0000","last_became_active":"2023-11-27T20:54:27.512692+0000","last_became_peered":"2023-11-27T20:54:27.512692+0000","last_unstale":"2023-11-27T21:21:49.493919+0000","last_undegraded":"2023-11-27T21:21:49.493919+0000","last_fullsized":"2023-11-27T21:21:49.493919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:53.751196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"28'75","reported_seq":102,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.398697+0000","last_change":"2023-11-27T20:54:27.499043+0000","last_active":"2023-11-27T21:21:49.398697+0000","last_peered":"2023-11-27T21:21:49.398697+0000","last_clean":"2023-11-27T21:21:49.398697+0000","last_became_active":"2023-11-27T20:54:27.498790+0000","last_became_peered":"2023-11-27T20:54:27.498790+0000","last_unstale":"2023-11-27T21:21:49.398697+0000","last_undegraded":"2023-11-27T21:21:49.398697+0000","last_fullsized":"2023-11-27T21:21:49.398697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:41.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"28'85","reported_seq":112,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.495571+0000","last_change":"2023-11-27T20:54:27.513089+0000","last_active":"2023-11-27T21:21:49.495571+0000","last_peered":"2023-11-27T21:21:49.495571+0000","last_clean":"2023-11-27T21:21:49.495571+0000","last_became_active":"2023-11-27T20:54:27.512777+0000","last_became_peered":"2023-11-27T20:54:27.512777+0000","last_unstale":"2023-11-27T21:21:49.495571+0000","last_undegraded":"2023-11-27T21:21:49.495571+0000","last_fullsized":"2023-11-27T21:21:49.495571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:32.362116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'65","reported_seq":92,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.496083+0000","last_change":"2023-11-27T20:54:27.512691+0000","last_active":"2023-11-27T21:21:49.496083+0000","last_peered":"2023-11-27T21:21:49.496083+0000","last_clean":"2023-11-27T21:21:49.496083+0000","last_became_active":"2023-11-27T20:54:27.512433+0000","last_became_peered":"2023-11-27T20:54:27.512433+0000","last_unstale":"2023-11-27T21:21:49.496083+0000","last_undegraded":"2023-11-27T21:21:49.496083+0000","last_fullsized":"2023-11-27T21:21:49.496083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:30.589702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'62","reported_seq":89,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.526396+0000","last_change":"2023-11-27T20:54:27.432322+0000","last_active":"2023-11-27T21:21:49.526396+0000","last_peered":"2023-11-27T21:21:49.526396+0000","last_clean":"2023-11-27T21:21:49.526396+0000","last_became_active":"2023-11-27T20:54:27.432152+0000","last_became_peered":"2023-11-27T20:54:27.432152+0000","last_unstale":"2023-11-27T21:21:49.526396+0000","last_undegraded":"2023-11-27T21:21:49.526396+0000","last_fullsized":"2023-11-27T21:21:49.526396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:02.167926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'69","reported_seq":96,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.497091+0000","last_change":"2023-11-27T20:54:27.516081+0000","last_active":"2023-11-27T21:21:49.497091+0000","last_peered":"2023-11-27T21:21:49.497091+0000","last_clean":"2023-11-27T21:21:49.497091+0000","last_became_active":"2023-11-27T20:54:27.515801+0000","last_became_peered":"2023-11-27T20:54:27.515801+0000","last_unstale":"2023-11-27T21:21:49.497091+0000","last_undegraded":"2023-11-27T21:21:49.497091+0000","last_fullsized":"2023-11-27T21:21:49.497091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:24:30.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'75","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.527386+0000","last_change":"2023-11-27T20:54:27.432375+0000","last_active":"2023-11-27T21:21:49.527386+0000","last_peered":"2023-11-27T21:21:49.527386+0000","last_clean":"2023-11-27T21:21:49.527386+0000","last_became_active":"2023-11-27T20:54:27.432160+0000","last_became_peered":"2023-11-27T20:54:27.432160+0000","last_unstale":"2023-11-27T21:21:49.527386+0000","last_undegraded":"2023-11-27T21:21:49.527386+0000","last_fullsized":"2023-11-27T21:21:49.527386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:36.652979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'77","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.495280+0000","last_change":"2023-11-27T20:54:27.505374+0000","last_active":"2023-11-27T21:21:49.495280+0000","last_peered":"2023-11-27T21:21:49.495280+0000","last_clean":"2023-11-27T21:21:49.495280+0000","last_became_active":"2023-11-27T20:54:27.505122+0000","last_became_peered":"2023-11-27T20:54:27.505122+0000","last_unstale":"2023-11-27T21:21:49.495280+0000","last_undegraded":"2023-11-27T21:21:49.495280+0000","last_fullsized":"2023-11-27T21:21:49.495280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:30.589702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"28'74","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.476666+0000","last_change":"2023-11-27T20:54:27.505531+0000","last_active":"2023-11-27T21:21:49.476666+0000","last_peered":"2023-11-27T21:21:49.476666+0000","last_clean":"2023-11-27T21:21:49.476666+0000","last_became_active":"2023-11-27T20:54:27.505236+0000","last_became_peered":"2023-11-27T20:54:27.505236+0000","last_unstale":"2023-11-27T21:21:49.476666+0000","last_undegraded":"2023-11-27T21:21:49.476666+0000","last_fullsized":"2023-11-27T21:21:49.476666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:56:02.651538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"28'79","reported_seq":109,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.494913+0000","last_change":"2023-11-27T20:54:27.515185+0000","last_active":"2023-11-27T21:21:49.494913+0000","last_peered":"2023-11-27T21:21:49.494913+0000","last_clean":"2023-11-27T21:21:49.494913+0000","last_became_active":"2023-11-27T20:54:27.514846+0000","last_became_peered":"2023-11-27T20:54:27.514846+0000","last_unstale":"2023-11-27T21:21:49.494913+0000","last_undegraded":"2023-11-27T21:21:49.494913+0000","last_fullsized":"2023-11-27T21:21:49.494913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:43:42.137077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":102,"num_write":4200,"num_write_kb":332069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5131,"ondisk_log_size":5131,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4855,"ondisk_log_size":4855,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":44272102,"num_objects":111,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":1673,"num_read_kb":1711,"num_write":16676,"num_write_kb":52124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":88793088,"data_stored":88544204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15183,"ondisk_log_size":15183,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509777,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95988,"kb_used_data":20396,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94275852,"statfs":{"total":96636764160,"available":96538472448,"internally_reserved":0,"allocated":20885504,"data_stored":20696148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.40200000000000002,"15min":0.40699999999999997},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.19900000000000001},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.95599999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46500000000000002,"15min":0.46400000000000002},"min":{"1min":0.30199999999999999,"5min":0.27500000000000002,"15min":0.24199999999999999},"max":{"1min":0.56399999999999995,"5min":0.58899999999999997,"15min":1.1819999999999999},"last":0.504}]},{"osd":1,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.42899999999999999,"15min":0.432},"min":{"1min":0.27100000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.78300000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.40200000000000002,"15min":0.40600000000000003},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.247},"max":{"1min":0.59599999999999997,"5min":0.59899999999999998,"15min":1.2250000000000001},"last":0.46800000000000003}]},{"osd":2,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41599999999999998,"15min":0.40999999999999998},"min":{"1min":0.30399999999999999,"5min":0.27700000000000002,"15min":0.21199999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":1.2549999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.436,"15min":0.436},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.23899999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":1.2450000000000001},"last":0.44500000000000001}]},{"osd":3,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.438},"min":{"1min":0.307,"5min":0.307,"15min":0.26800000000000002},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.87},"last":0.436},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.45600000000000002,"15min":0.44400000000000001},"min":{"1min":0.39100000000000001,"5min":0.34699999999999998,"15min":0.307},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":1.2090000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.41199999999999998,"15min":0.39700000000000002},"min":{"1min":0.25900000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.80600000000000005},"last":0.376},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.42699999999999999,"15min":0.41899999999999998},"min":{"1min":0.29499999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.64900000000000002,"5min":0.68100000000000005,"15min":0.92800000000000005},"last":0.35499999999999998}]},{"osd":5,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.41799999999999998,"15min":0.40400000000000003},"min":{"1min":0.33000000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.47899999999999998,"15min":0.45900000000000002},"min":{"1min":0.33900000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.77600000000000002},"last":0.29499999999999998}]},{"osd":7,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47199999999999998,"15min":0.46700000000000003},"min":{"1min":0.371,"5min":0.26600000000000001,"15min":0.249},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.95599999999999996},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.46600000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28199999999999997},"max":{"1min":0.79400000000000004,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.40799999999999997}]}]},{"osd":5,"up_from":15,"seq":64424509777,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94852,"kb_used_data":19260,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94276988,"statfs":{"total":96636764160,"available":96539635712,"internally_reserved":0,"allocated":19722240,"data_stored":19520171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.41199999999999998,"15min":0.40600000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.216},"max":{"1min":0.57799999999999996,"5min":1.331,"15min":1.331},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42199999999999999,"15min":0.41799999999999998},"min":{"1min":0.318,"5min":0.27900000000000003,"15min":0.222},"max":{"1min":0.49199999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.54300000000000004}]},{"osd":1,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41399999999999998,"15min":0.42399999999999999},"min":{"1min":0.307,"5min":0.224,"15min":0.221},"max":{"1min":0.56100000000000005,"5min":0.624,"15min":0.95999999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42399999999999999,"15min":0.41599999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.28599999999999998},"max":{"1min":0.59399999999999997,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.435}]},{"osd":2,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42299999999999999,"15min":0.42999999999999999},"min":{"1min":0.309,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.94599999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.438,"15min":0.42799999999999999},"min":{"1min":0.33600000000000002,"5min":0.30599999999999999,"15min":0.29899999999999999},"max":{"1min":0.61599999999999999,"5min":1.359,"15min":1.359},"last":0.59799999999999998}]},{"osd":3,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.45500000000000002,"15min":0.45000000000000001},"min":{"1min":0.35999999999999999,"5min":0.32500000000000001,"15min":0.28899999999999998},"max":{"1min":0.59099999999999997,"5min":0.64500000000000002,"15min":0.93300000000000005},"last":0.63},{"interface":"front","average":{"1min":0.432,"5min":0.47599999999999998,"15min":0.46000000000000002},"min":{"1min":0.34000000000000002,"5min":0.32600000000000001,"15min":0.30199999999999999},"max":{"1min":0.54800000000000004,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":0.47499999999999998}]},{"osd":4,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.38400000000000001,"15min":0.379},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23100000000000001},"max":{"1min":0.65800000000000003,"5min":0.66300000000000003,"15min":0.69199999999999995},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.40400000000000003,"15min":0.40300000000000002},"min":{"1min":0.29899999999999999,"5min":0.255,"15min":0.23200000000000001},"max":{"1min":0.61499999999999999,"5min":0.66800000000000004,"15min":0.70299999999999996},"last":0.375}]},{"osd":6,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.41099999999999998,"15min":0.40400000000000003},"min":{"1min":0.28299999999999997,"5min":0.27100000000000002,"15min":0.246},"max":{"1min":0.67600000000000005,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42899999999999999,"15min":0.42799999999999999},"min":{"1min":0.315,"5min":0.27100000000000002,"15min":0.23300000000000001},"max":{"1min":0.68600000000000005,"5min":0.69299999999999995,"15min":0.70399999999999996},"last":0.34499999999999997}]},{"osd":7,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.46400000000000002,"15min":0.45800000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.24199999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.311},{"interface":"front","average":{"1min":0.495,"5min":0.49399999999999999,"15min":0.49099999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.751},"last":0.39600000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509778,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53560,"kb_used_data":8496,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318280,"statfs":{"total":96636764160,"available":96581918720,"internally_reserved":0,"allocated":8699904,"data_stored":8509387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32000000000000001,"15min":0.30399999999999999},"min":{"1min":0.25,"5min":0.19600000000000001,"15min":0.17899999999999999},"max":{"1min":0.44900000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.316},"min":{"1min":0.26100000000000001,"5min":0.20200000000000001,"15min":0.17299999999999999},"max":{"1min":0.438,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.45800000000000002}]},{"osd":1,"last update":"Mon Nov 27 21:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.35899999999999999,"15min":0.34200000000000003},"min":{"1min":0.27000000000000002,"5min":0.20599999999999999,"15min":0.192},"max":{"1min":0.59299999999999997,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.36499999999999999,"15min":0.34799999999999998},"min":{"1min":0.27700000000000002,"5min":0.22900000000000001,"15min":0.20899999999999999},"max":{"1min":0.53900000000000003,"5min":0.751,"15min":0.751},"last":0.51800000000000002}]},{"osd":3,"last update":"Mon Nov 27 21:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.35899999999999999,"15min":0.34499999999999997},"min":{"1min":0.26000000000000001,"5min":0.22500000000000001,"15min":0.224},"max":{"1min":0.53200000000000003,"5min":0.55700000000000005,"15min":0.66200000000000003},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42599999999999999,"15min":0.38700000000000001},"min":{"1min":0.317,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":0.59199999999999997,"5min":0.62,"15min":0.63700000000000001},"last":0.56299999999999994}]},{"osd":4,"last update":"Mon Nov 27 21:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.49399999999999999,"15min":0.48199999999999998},"min":{"1min":0.42199999999999999,"5min":0.313,"15min":0.28199999999999997},"max":{"1min":0.59299999999999997,"5min":0.71299999999999997,"15min":0.879},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.48999999999999999,"15min":0.48399999999999999},"min":{"1min":0.40600000000000003,"5min":0.35799999999999998,"15min":0.311},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.83299999999999996},"last":0.57899999999999996}]},{"osd":5,"last update":"Mon Nov 27 21:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47299999999999998,"15min":0.47599999999999998},"min":{"1min":0.36399999999999999,"5min":0.32300000000000001,"15min":0.30399999999999999},"max":{"1min":0.628,"5min":0.69099999999999995,"15min":0.83199999999999996},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52500000000000002,"15min":0.5},"min":{"1min":0.35299999999999998,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.71099999999999997,"5min":0.77200000000000002,"15min":0.84099999999999997},"last":0.68799999999999994}]},{"osd":6,"last update":"Mon Nov 27 21:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51600000000000001,"15min":0.502},"min":{"1min":0.39100000000000001,"5min":0.372,"15min":0.34000000000000002},"max":{"1min":0.80700000000000005,"5min":0.81399999999999995,"15min":0.90900000000000003},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.503,"15min":0.496},"min":{"1min":0.40899999999999997,"5min":0.34999999999999998,"15min":0.316},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.76900000000000002},"last":0.753}]},{"osd":7,"last update":"Mon Nov 27 21:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53600000000000003,"15min":0.52300000000000002},"min":{"1min":0.39700000000000002,"5min":0.39300000000000002,"15min":0.36399999999999999},"max":{"1min":0.77000000000000002,"5min":0.79100000000000004,"15min":0.85799999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.43099999999999999,"5min":0.36099999999999999,"15min":0.34000000000000002},"max":{"1min":0.64300000000000002,"5min":0.73999999999999999,"15min":0.92400000000000004},"last":0.77000000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509778,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42852,"kb_used_data":3356,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94328988,"statfs":{"total":96636764160,"available":96592883712,"internally_reserved":0,"allocated":3436544,"data_stored":3238767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30599999999999999,"15min":0.307},"min":{"1min":0.214,"5min":0.20599999999999999,"15min":0.17000000000000001},"max":{"1min":0.47899999999999998,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.311,"5min":0.311,"15min":0.30499999999999999},"min":{"1min":0.222,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.37}]},{"osd":2,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.33000000000000002,"15min":0.309},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.188},"max":{"1min":0.54600000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.33800000000000002,"15min":0.34000000000000002},"min":{"1min":0.25900000000000001,"5min":0.22600000000000001,"15min":0.20499999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.40300000000000002}]},{"osd":3,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.37,"15min":0.36599999999999999},"min":{"1min":0.27500000000000002,"5min":0.23899999999999999,"15min":0.23300000000000001},"max":{"1min":0.441,"5min":0.626,"15min":0.68200000000000005},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.377,"15min":0.36499999999999999},"min":{"1min":0.26800000000000002,"5min":0.24399999999999999,"15min":0.22600000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.27700000000000002}]},{"osd":4,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45300000000000001,"15min":0.46999999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.26600000000000001},"max":{"1min":0.60299999999999998,"5min":0.70599999999999996,"15min":1.4510000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.47899999999999998,"15min":0.48399999999999999},"min":{"1min":0.34300000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.61799999999999999,"5min":0.84199999999999997,"15min":0.89900000000000002},"last":0.56399999999999995}]},{"osd":5,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.35399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.64300000000000002,"5min":0.81799999999999995,"15min":0.82199999999999995},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.46999999999999997,"15min":0.49099999999999999},"min":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.29999999999999999},"max":{"1min":0.67600000000000005,"5min":0.70999999999999996,"15min":1.4119999999999999},"last":0.629}]},{"osd":6,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.38200000000000001,"5min":0.36499999999999999,"15min":0.33600000000000002},"max":{"1min":0.72199999999999998,"5min":0.79800000000000004,"15min":0.92800000000000005},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.503,"15min":0.51700000000000002},"min":{"1min":0.36199999999999999,"5min":0.35899999999999999,"15min":0.34499999999999997},"max":{"1min":0.60299999999999998,"5min":0.86399999999999999,"15min":1.4239999999999999},"last":0.64300000000000002}]},{"osd":7,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.51900000000000002,"15min":0.52400000000000002},"min":{"1min":0.39900000000000002,"5min":0.371,"15min":0.33200000000000002},"max":{"1min":0.67600000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.51100000000000001,"15min":0.51600000000000001},"min":{"1min":0.39000000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.64200000000000002,"5min":0.83099999999999996,"15min":1.4399999999999999},"last":0.57699999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509777,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76024,"kb_used_data":8752,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94295816,"statfs":{"total":96636764160,"available":96558915584,"internally_reserved":0,"allocated":8962048,"data_stored":8748777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.315,"15min":0.309},"min":{"1min":0.24199999999999999,"5min":0.20100000000000001,"15min":0.186},"max":{"1min":0.44800000000000001,"5min":0.54600000000000004,"15min":0.57799999999999996},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.28799999999999998,"5min":0.31,"15min":0.311},"min":{"1min":0.219,"5min":0.219,"15min":0.19},"max":{"1min":0.42299999999999999,"5min":0.503,"15min":0.69699999999999995},"last":0.311}]},{"osd":2,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.34399999999999997,"15min":0.34100000000000003},"min":{"1min":0.223,"5min":0.223,"15min":0.189},"max":{"1min":0.48699999999999999,"5min":0.54300000000000004,"15min":0.59299999999999997},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.315,"5min":0.34999999999999998,"15min":0.34200000000000003},"min":{"1min":0.25900000000000001,"5min":0.223,"15min":0.19900000000000001},"max":{"1min":0.40100000000000002,"5min":0.55500000000000005,"15min":0.66900000000000004},"last":0.34699999999999998}]},{"osd":3,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.36099999999999999,"15min":0.34699999999999998},"min":{"1min":0.25600000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.44900000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39400000000000002,"15min":0.38100000000000001},"min":{"1min":0.25800000000000001,"5min":0.253,"15min":0.21099999999999999},"max":{"1min":0.58399999999999996,"5min":0.59699999999999998,"15min":0.61599999999999999},"last":0.36499999999999999}]},{"osd":4,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.44800000000000001,"15min":0.45900000000000002},"min":{"1min":0.32300000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":1.3009999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46899999999999997,"15min":0.47399999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.27200000000000002},"max":{"1min":0.56599999999999995,"5min":0.71199999999999997,"15min":1.1220000000000001},"last":0.44600000000000001}]},{"osd":5,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.50700000000000001,"15min":0.5},"min":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.32700000000000001},"max":{"1min":0.58499999999999996,"5min":0.81499999999999995,"15min":1.1930000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46600000000000003,"15min":0.46700000000000003},"min":{"1min":0.36099999999999999,"5min":0.35099999999999998,"15min":0.317},"max":{"1min":0.63700000000000001,"5min":0.753,"15min":1.3180000000000001},"last":0.45800000000000002}]},{"osd":6,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.31900000000000001},"max":{"1min":0.73099999999999998,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.505,"5min":0.52500000000000002,"15min":0.52200000000000002},"min":{"1min":0.41599999999999998,"5min":0.36799999999999999,"15min":0.34499999999999997},"max":{"1min":0.60899999999999999,"5min":0.85699999999999998,"15min":1.282},"last":0.46899999999999997}]},{"osd":7,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.33500000000000002},"max":{"1min":0.65200000000000002,"5min":0.89300000000000002,"15min":1.171},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48899999999999999,"15min":0.498},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":1.2589999999999999},"last":0.50900000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542482,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52808,"kb_used_data":7744,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94319032,"statfs":{"total":96636764160,"available":96582688768,"internally_reserved":0,"allocated":7929856,"data_stored":7711066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":46135755},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:21:01 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.39400000000000002,"15min":0.39900000000000002},"min":{"1min":0.26100000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.61499999999999999,"5min":0.63300000000000001,"15min":0.82899999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41499999999999998,"15min":0.42799999999999999},"min":{"1min":0.27000000000000002,"5min":0.26200000000000001,"15min":0.22900000000000001},"max":{"1min":0.48699999999999999,"5min":0.57599999999999996,"15min":0.61399999999999999},"last":0.46400000000000002}]},{"osd":1,"last update":"Mon Nov 27 21:21:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42399999999999999,"15min":0.432},"min":{"1min":0.26800000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.88500000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.373,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.59099999999999997,"5min":0.59199999999999997,"15min":0.873},"last":0.47799999999999998}]},{"osd":2,"last update":"Mon Nov 27 21:21:01 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.41999999999999998,"15min":0.435},"min":{"1min":0.34699999999999998,"5min":0.29399999999999998,"15min":0.27000000000000002},"max":{"1min":0.56699999999999995,"5min":0.65300000000000002,"15min":0.79700000000000004},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.41399999999999998,"15min":0.41999999999999998},"min":{"1min":0.29599999999999999,"5min":0.27000000000000002,"15min":0.247},"max":{"1min":0.496,"5min":0.55200000000000005,"15min":0.68700000000000006},"last":0.501}]},{"osd":3,"last update":"Mon Nov 27 21:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.442,"15min":0.44900000000000001},"min":{"1min":0.29599999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.77100000000000002},"last":0.432},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.45900000000000002,"15min":0.45100000000000001},"min":{"1min":0.36799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.90200000000000002},"last":0.51300000000000001}]},{"osd":4,"last update":"Mon Nov 27 21:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.39800000000000002,"15min":0.40200000000000002},"min":{"1min":0.30099999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.55300000000000005,"5min":0.59199999999999997,"15min":0.70099999999999996},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.41499999999999998,"15min":0.42199999999999999},"min":{"1min":0.307,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.745},"last":0.30499999999999999}]},{"osd":5,"last update":"Mon Nov 27 21:21:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.45200000000000001,"15min":0.44400000000000001},"min":{"1min":0.30499999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.438,"15min":0.44600000000000001},"min":{"1min":0.32400000000000001,"5min":0.26400000000000001,"15min":0.248},"max":{"1min":0.70299999999999996,"5min":0.71499999999999997,"15min":0.77700000000000002},"last":0.379}]},{"osd":6,"last update":"Mon Nov 27 21:21:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45700000000000002,"15min":0.46000000000000002},"min":{"1min":0.35499999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52600000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.496,"15min":0.499},"min":{"1min":0.35799999999999998,"5min":0.29099999999999998,"15min":0.28100000000000003},"max":{"1min":0.751,"5min":0.751,"15min":0.84999999999999998},"last":0.39600000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542482,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57800,"kb_used_data":8576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94314040,"statfs":{"total":96636764160,"available":96577576960,"internally_reserved":0,"allocated":8781824,"data_stored":8552244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,3,5,48,9,32,9,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41499999999999998,"15min":0.40600000000000003},"min":{"1min":0.27900000000000003,"5min":0.248,"15min":0.20200000000000001},"max":{"1min":0.58599999999999997,"5min":0.59299999999999997,"15min":0.66100000000000003},"last":1.446},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44700000000000001,"15min":0.435},"min":{"1min":0.29399999999999998,"5min":0.28299999999999997,"15min":0.24099999999999999},"max":{"1min":0.60499999999999998,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":3.948}]},{"osd":1,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.41499999999999998,"15min":0.41699999999999998},"min":{"1min":0.309,"5min":0.30199999999999999,"15min":0.24099999999999999},"max":{"1min":0.52800000000000002,"5min":0.626,"15min":0.65100000000000002},"last":5.0410000000000004},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42599999999999999,"15min":0.41599999999999998},"min":{"1min":0.33800000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.50600000000000001,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":1.181}]},{"osd":2,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.42599999999999999,"15min":0.42699999999999999},"min":{"1min":0.34000000000000002,"5min":0.29499999999999998,"15min":0.26100000000000001},"max":{"1min":0.622,"5min":0.64300000000000002,"15min":0.745},"last":1.5089999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.441,"15min":0.44600000000000001},"min":{"1min":0.307,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":0.51700000000000002,"5min":0.65200000000000002,"15min":0.78100000000000003},"last":4.008}]},{"osd":3,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.47799999999999998,"15min":0.46800000000000003},"min":{"1min":0.38800000000000001,"5min":0.318,"15min":0.29899999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.79200000000000004},"last":1.532},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46200000000000002,"15min":0.45500000000000002},"min":{"1min":0.35799999999999998,"5min":0.32600000000000001,"15min":0.28499999999999998},"max":{"1min":0.55100000000000005,"5min":0.63400000000000001,"15min":0.68500000000000005},"last":10.747999999999999}]},{"osd":5,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41499999999999998,"15min":0.39400000000000002},"min":{"1min":0.26300000000000001,"5min":0.23100000000000001,"15min":0.221},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":20.847999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40799999999999997,"15min":0.41199999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23100000000000001},"max":{"1min":0.55400000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":5.0800000000000001}]},{"osd":6,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.42999999999999999,"15min":0.41799999999999998},"min":{"1min":0.29899999999999999,"5min":0.26800000000000002,"15min":0.24399999999999999},"max":{"1min":0.60599999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.48999999999999999,"15min":0.46800000000000003},"min":{"1min":0.35099999999999998,"5min":0.28100000000000003,"15min":0.27400000000000002},"max":{"1min":0.66000000000000003,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":1.478}]},{"osd":7,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46200000000000002,"15min":0.45500000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.64300000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":1.113},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.434,"5min":0.35199999999999998,"15min":0.33400000000000002},"max":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":3.4649999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542482,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89188,"kb_used_data":13596,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94282652,"statfs":{"total":96636764160,"available":96545435648,"internally_reserved":0,"allocated":13922304,"data_stored":13708692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.311,"15min":0.312},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.47899999999999998,"5min":0.52400000000000002,"15min":0.56499999999999995},"last":0.254},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.31,"15min":0.307},"min":{"1min":0.21099999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.56999999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.29099999999999998}]},{"osd":1,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.29499999999999998,"5min":0.30099999999999999,"15min":0.309},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.39300000000000002,"5min":0.45800000000000002,"15min":1.0249999999999999},"last":0.317},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.35899999999999999,"15min":0.34999999999999998},"min":{"1min":0.23999999999999999,"5min":0.23000000000000001,"15min":0.21199999999999999},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":1.0069999999999999},"last":0.33400000000000002}]},{"osd":2,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36699999999999999,"15min":0.36799999999999999},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.22600000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":1.046},"last":0.377},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.371},"min":{"1min":0.27700000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.59899999999999998,"5min":0.623,"15min":0.69999999999999996},"last":0.35799999999999998}]},{"osd":4,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45200000000000001,"15min":0.46200000000000002},"min":{"1min":0.35099999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.59099999999999997,"5min":0.69799999999999995,"15min":0.93799999999999994},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.47599999999999998,"15min":0.48399999999999999},"min":{"1min":0.39400000000000002,"5min":0.34499999999999997,"15min":0.314},"max":{"1min":0.65900000000000003,"5min":0.71199999999999997,"15min":0.73999999999999999},"last":0.47899999999999998}]},{"osd":5,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48399999999999999,"15min":0.48599999999999999},"min":{"1min":0.42099999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.71499999999999997,"5min":0.75,"15min":0.75},"last":0.505},{"interface":"front","average":{"1min":0.502,"5min":0.495,"15min":0.50600000000000001},"min":{"1min":0.373,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67900000000000005,"5min":0.78600000000000003,"15min":1.071},"last":0.46899999999999997}]},{"osd":6,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.495,"15min":0.504},"min":{"1min":0.39100000000000001,"5min":0.36599999999999999,"15min":0.311},"max":{"1min":0.61299999999999999,"5min":0.65400000000000003,"15min":0.97899999999999998},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.49199999999999999,"15min":0.5},"min":{"1min":0.35999999999999999,"5min":0.35599999999999998,"15min":0.314},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.46000000000000002}]},{"osd":7,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51500000000000001,"15min":0.52200000000000002},"min":{"1min":0.40699999999999997,"5min":0.36099999999999999,"15min":0.35999999999999999},"max":{"1min":0.66800000000000004,"5min":0.75800000000000001,"15min":1.0900000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51900000000000002,"15min":0.52200000000000002},"min":{"1min":0.42199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68999999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.51700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8667136,"data_stored":8628738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2547712,"data_stored":2528360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13627392,"data_stored":13588653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8486912,"data_stored":8432205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18833408,"data_stored":18809764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20590592,"data_stored":20576109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7634944,"data_stored":7591027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T21:21:55.994 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T21:21:56.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.127+0000 7fcec38a2640 1 Processor -- start 2023-11-27T21:21:56.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.127+0000 7fcec38a2640 1 -- start start 2023-11-27T21:21:56.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.127+0000 7fcec38a2640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcebc0c46c0 0x7fcebc0c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:56.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.128+0000 7fcec38a2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcebc150460 0x7fcebc0c1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:56.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.128+0000 7fcec38a2640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcebc0c76f0 con 0x7fcebc0c4aa0 2023-11-27T21:21:56.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.128+0000 7fcec38a2640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcebc0c2bc0 con 0x7fcebc0c46c0 2023-11-27T21:21:56.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.128+0000 7fcec38a2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc0c6dc0 con 0x7fcebc150460 2023-11-27T21:21:56.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.164+0000 7fcec0e3d640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fcebc0c4aa0 0x7fcebc14fd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:59184/0 (socket says 172.21.15.88:59184) 2023-11-27T21:21:56.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.164+0000 7fcec163e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcebc0c46c0 0x7fcebc0c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:56.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.164+0000 7fcec0e3d640 1 -- 172.21.15.88:0/2117650510 learned_addr learned my addr 172.21.15.88:0/2117650510 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:21:56.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.165+0000 7fcec1e3f640 1 --2- 172.21.15.88:0/2117650510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcebc150460 0x7fcebc0c1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:56.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.168+0000 7fcec1e3f640 1 -- 172.21.15.88:0/2117650510 >> v2:172.21.15.167:3300/0 conn(0x7fcebc0c46c0 msgr2=0x7fcebc0c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:21:56.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.168+0000 7fcec1e3f640 1 --2- 172.21.15.88:0/2117650510 >> v2:172.21.15.167:3300/0 conn(0x7fcebc0c46c0 0x7fcebc0c53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:56.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.168+0000 7fcec1e3f640 1 -- 172.21.15.88:0/2117650510 >> v1:172.21.15.167:6789/0 conn(0x7fcebc0c4aa0 legacy=0x7fcebc14fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:56.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.168+0000 7fcec1e3f640 1 -- 172.21.15.88:0/2117650510 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc0c70a0 con 0x7fcebc150460 2023-11-27T21:21:56.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.170+0000 7fcec1e3f640 1 --2- 172.21.15.88:0/2117650510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcebc150460 0x7fcebc0c1ec0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fceac009d90 tx=0x7fceac02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=498bfb89e42fa5ee server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:56.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.175+0000 7fcebbfff640 1 -- 172.21.15.88:0/2117650510 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac02cc50 con 0x7fcebc150460 2023-11-27T21:21:56.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.175+0000 7fcebbfff640 1 -- 172.21.15.88:0/2117650510 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac02cdb0 con 0x7fcebc150460 2023-11-27T21:21:56.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.175+0000 7fcebbfff640 1 -- 172.21.15.88:0/2117650510 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac034660 con 0x7fcebc150460 2023-11-27T21:21:56.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.175+0000 7fcec38a2640 1 -- 172.21.15.88:0/2117650510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcebc150460 msgr2=0x7fcebc0c1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:56.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.175+0000 7fcec38a2640 1 --2- 172.21.15.88:0/2117650510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcebc150460 0x7fcebc0c1ec0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fceac009d90 tx=0x7fceac02bea0 comp rx=0 tx=0).stop 2023-11-27T21:21:56.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.175+0000 7fcec38a2640 1 -- 172.21.15.88:0/2117650510 shutdown_connections 2023-11-27T21:21:56.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.175+0000 7fcec38a2640 1 --2- 172.21.15.88:0/2117650510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcebc150460 0x7fcebc0c1ec0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:56.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.175+0000 7fcec38a2640 1 --2- 172.21.15.88:0/2117650510 >> v2:172.21.15.167:3300/0 conn(0x7fcebc0c46c0 0x7fcebc0c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:56.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.175+0000 7fcec38a2640 1 -- 172.21.15.88:0/2117650510 >> 172.21.15.88:0/2117650510 conn(0x7fcebc06c5f0 msgr2=0x7fcebc06c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:56.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.175+0000 7fcec38a2640 1 -- 172.21.15.88:0/2117650510 shutdown_connections 2023-11-27T21:21:56.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.175+0000 7fcec38a2640 1 -- 172.21.15.88:0/2117650510 wait complete. 2023-11-27T21:21:56.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.177+0000 7fcec38a2640 1 Processor -- start 2023-11-27T21:21:56.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.177+0000 7fcec38a2640 1 -- start start 2023-11-27T21:21:56.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.177+0000 7fcec38a2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcebc0c46c0 0x7fcebc1eac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:56.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.177+0000 7fcec38a2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcebc0c4aa0 0x7fcebc14e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:56.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.177+0000 7fcec38a2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcebc150460 0x7fcebc1411f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:56.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.177+0000 7fcec38a2640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc15a560 con 0x7fcebc0c4aa0 2023-11-27T21:21:56.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.177+0000 7fcec38a2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc15a080 con 0x7fcebc150460 2023-11-27T21:21:56.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.177+0000 7fcec38a2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc1ee9f0 con 0x7fcebc0c46c0 2023-11-27T21:21:56.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.178+0000 7fcec0e3d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcebc0c4aa0 0x7fcebc14e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:56.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.178+0000 7fcec1e3f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcebc150460 0x7fcebc1411f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:56.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.178+0000 7fcec163e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcebc0c46c0 0x7fcebc1eac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:56.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.178+0000 7fcec1e3f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcebc150460 0x7fcebc1411f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:51588/0 (socket says 172.21.15.88:51588) 2023-11-27T21:21:56.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.178+0000 7fcec1e3f640 1 -- 172.21.15.88:0/3373582144 learned_addr learned my addr 172.21.15.88:0/3373582144 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:56.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.181+0000 7fcec0e3d640 1 -- 172.21.15.88:0/3373582144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcebc0c46c0 msgr2=0x7fcebc1eac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:56.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.182+0000 7fcec0e3d640 1 --2- 172.21.15.88:0/3373582144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcebc0c46c0 0x7fcebc1eac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:56.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.182+0000 7fcec0e3d640 1 -- 172.21.15.88:0/3373582144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcebc150460 msgr2=0x7fcebc1411f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:56.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.182+0000 7fcec0e3d640 1 --2- 172.21.15.88:0/3373582144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcebc150460 0x7fcebc1411f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:56.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.182+0000 7fcec0e3d640 1 -- 172.21.15.88:0/3373582144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac009a70 con 0x7fcebc0c4aa0 2023-11-27T21:21:56.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.184+0000 7fcec0e3d640 1 --2- 172.21.15.88:0/3373582144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcebc0c4aa0 0x7fcebc14e840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0c4eb0 tx=0x7fceb000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:56.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.187+0000 7fceb9ffb640 1 -- 172.21.15.88:0/3373582144 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb0005ce0 con 0x7fcebc0c4aa0 2023-11-27T21:21:56.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.187+0000 7fceb9ffb640 1 -- 172.21.15.88:0/3373582144 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb0005e40 con 0x7fcebc0c4aa0 2023-11-27T21:21:56.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.187+0000 7fceb9ffb640 1 -- 172.21.15.88:0/3373582144 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb0007310 con 0x7fcebc0c4aa0 2023-11-27T21:21:56.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.187+0000 7fcec38a2640 1 -- 172.21.15.88:0/3373582144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcebc15a280 con 0x7fcebc0c4aa0 2023-11-27T21:21:56.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.187+0000 7fcec38a2640 1 -- 172.21.15.88:0/3373582144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcebc1ee680 con 0x7fcebc0c4aa0 2023-11-27T21:21:56.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.188+0000 7fcec38a2640 1 -- 172.21.15.88:0/3373582144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcebc1ee200 con 0x7fcebc0c4aa0 2023-11-27T21:21:56.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.430+0000 7fceb9ffb640 1 -- 172.21.15.88:0/3373582144 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fceb0007470 con 0x7fcebc0c4aa0 2023-11-27T21:21:56.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.430+0000 7fceb9ffb640 1 --2- 172.21.15.88:0/3373582144 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fcea806b210 0x7fcea806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:56.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.430+0000 7fcec163e640 1 --2- 172.21.15.88:0/3373582144 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fcea806b210 0x7fcea806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:56.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.431+0000 7fcec163e640 1 --2- 172.21.15.88:0/3373582144 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fcea806b210 0x7fcea806d6d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009b40 tx=0x7fceb4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:56.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.444+0000 7fceb9ffb640 1 -- 172.21.15.88:0/3373582144 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fceb0013e70 con 0x7fcebc0c4aa0 2023-11-27T21:21:56.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.444+0000 7fceb9ffb640 1 -- 172.21.15.88:0/3373582144 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fceb0054230 con 0x7fcebc0c4aa0 2023-11-27T21:21:56.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.613+0000 7fcec38a2640 1 -- 172.21.15.88:0/3373582144 --> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcebc0c5900 con 0x7fcea806b210 2023-11-27T21:21:56.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.622+0000 7fceb9ffb640 1 -- 172.21.15.88:0/3373582144 <== mgr.4105 v2:172.21.15.88:6800/352455703 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371094 (secure 0 0 0) 0x7fceb4011a60 con 0x7fcea806b210 2023-11-27T21:21:56.628 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T21:21:56.630 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-11-27T21:21:56.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.625+0000 7fcec38a2640 1 -- 172.21.15.88:0/3373582144 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fcea806b210 msgr2=0x7fcea806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:56.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.625+0000 7fcec38a2640 1 --2- 172.21.15.88:0/3373582144 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fcea806b210 0x7fcea806d6d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009b40 tx=0x7fceb4009190 comp rx=0 tx=0).stop 2023-11-27T21:21:56.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.625+0000 7fcec38a2640 1 -- 172.21.15.88:0/3373582144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcebc0c4aa0 msgr2=0x7fcebc14e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:56.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.625+0000 7fcec38a2640 1 --2- 172.21.15.88:0/3373582144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcebc0c4aa0 0x7fcebc14e840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0c4eb0 tx=0x7fceb000c800 comp rx=0 tx=0).stop 2023-11-27T21:21:56.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.625+0000 7fcec38a2640 1 -- 172.21.15.88:0/3373582144 shutdown_connections 2023-11-27T21:21:56.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.625+0000 7fcec38a2640 1 --2- 172.21.15.88:0/3373582144 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fcea806b210 0x7fcea806d6d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:56.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.625+0000 7fcec38a2640 1 --2- 172.21.15.88:0/3373582144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcebc150460 0x7fcebc1411f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:56.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.625+0000 7fcec38a2640 1 --2- 172.21.15.88:0/3373582144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcebc0c4aa0 0x7fcebc14e840 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:56.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.625+0000 7fcec38a2640 1 --2- 172.21.15.88:0/3373582144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcebc0c46c0 0x7fcebc1eac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:56.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.625+0000 7fcec38a2640 1 -- 172.21.15.88:0/3373582144 >> 172.21.15.88:0/3373582144 conn(0x7fcebc06c5f0 msgr2=0x7fcebc06c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:56.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.625+0000 7fcec38a2640 1 -- 172.21.15.88:0/3373582144 shutdown_connections 2023-11-27T21:21:56.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.625+0000 7fcec38a2640 1 -- 172.21.15.88:0/3373582144 wait complete. 2023-11-27T21:21:56.639 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":856,"stamp":"2023-11-27T21:21:55.265714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":44862470,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":1793,"num_read_kb":1913,"num_write":21035,"num_write_kb":386609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25286,"ondisk_log_size":25286,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":563072,"kb_used_data":90176,"kb_used_omap":12,"kb_used_meta":472819,"kb_avail":754411648,"statfs":{"total":773094113280,"available":772517527552,"internally_reserved":0,"allocated":92340224,"data_stored":90685252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":484167217},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,3,5,48,9,32,9,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":65,"apply_latency_ms":65,"commit_latency_ns":65000000,"apply_latency_ns":65000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16384,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":38,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003000"},"pg_stats":[{"pgid":"2.1f","version":"28'332","reported_seq":363,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.011175+0000","last_change":"2023-11-27T20:54:26.222003+0000","last_active":"2023-11-27T21:21:49.011175+0000","last_peered":"2023-11-27T21:21:49.011175+0000","last_clean":"2023-11-27T21:21:49.011175+0000","last_became_active":"2023-11-27T20:54:26.221715+0000","last_became_peered":"2023-11-27T20:54:26.221715+0000","last_unstale":"2023-11-27T21:21:49.011175+0000","last_undegraded":"2023-11-27T21:21:49.011175+0000","last_fullsized":"2023-11-27T21:21:49.011175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:36:45.301515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922212,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":1068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"28'71","reported_seq":101,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.476594+0000","last_change":"2023-11-27T20:54:27.508401+0000","last_active":"2023-11-27T21:21:49.476594+0000","last_peered":"2023-11-27T21:21:49.476594+0000","last_clean":"2023-11-27T21:21:49.476594+0000","last_became_active":"2023-11-27T20:54:27.508003+0000","last_became_peered":"2023-11-27T20:54:27.508003+0000","last_unstale":"2023-11-27T21:21:49.476594+0000","last_undegraded":"2023-11-27T21:21:49.476594+0000","last_fullsized":"2023-11-27T21:21:49.476594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:11:42.954310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"28'159","reported_seq":185,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.951498+0000","last_change":"2023-11-27T20:54:31.837226+0000","last_active":"2023-11-27T21:21:12.951498+0000","last_peered":"2023-11-27T21:21:12.951498+0000","last_clean":"2023-11-27T21:21:12.951498+0000","last_became_active":"2023-11-27T20:54:31.836803+0000","last_became_peered":"2023-11-27T20:54:31.836803+0000","last_unstale":"2023-11-27T21:21:12.951498+0000","last_undegraded":"2023-11-27T21:21:12.951498+0000","last_fullsized":"2023-11-27T21:21:12.951498+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:06.363326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":7710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'738","reported_seq":769,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:24.329906+0000","last_change":"2023-11-27T20:54:26.227906+0000","last_active":"2023-11-27T21:21:24.329906+0000","last_peered":"2023-11-27T21:21:24.329906+0000","last_clean":"2023-11-27T21:21:24.329906+0000","last_became_active":"2023-11-27T20:54:26.227620+0000","last_became_peered":"2023-11-27T20:54:26.227620+0000","last_unstale":"2023-11-27T21:21:24.329906+0000","last_undegraded":"2023-11-27T21:21:24.329906+0000","last_fullsized":"2023-11-27T21:21:24.329906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:35.560769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":733,"num_write_kb":4484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"28'77","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.476122+0000","last_change":"2023-11-27T20:54:27.507740+0000","last_active":"2023-11-27T21:21:49.476122+0000","last_peered":"2023-11-27T21:21:49.476122+0000","last_clean":"2023-11-27T21:21:49.476122+0000","last_became_active":"2023-11-27T20:54:27.507460+0000","last_became_peered":"2023-11-27T20:54:27.507460+0000","last_unstale":"2023-11-27T21:21:49.476122+0000","last_undegraded":"2023-11-27T21:21:49.476122+0000","last_fullsized":"2023-11-27T21:21:49.476122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:24:30.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"28'166","reported_seq":201,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:09.269897+0000","last_change":"2023-11-27T20:55:00.593902+0000","last_active":"2023-11-27T21:21:09.269897+0000","last_peered":"2023-11-27T21:21:09.269897+0000","last_clean":"2023-11-27T21:21:09.269897+0000","last_became_active":"2023-11-27T20:55:00.593543+0000","last_became_peered":"2023-11-27T20:55:00.593543+0000","last_unstale":"2023-11-27T21:21:09.269897+0000","last_undegraded":"2023-11-27T21:21:09.269897+0000","last_fullsized":"2023-11-27T21:21:09.269897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:57:38.465675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":12743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"28'180","reported_seq":208,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:36.501028+0000","last_change":"2023-11-27T20:54:26.226645+0000","last_active":"2023-11-27T21:21:36.501028+0000","last_peered":"2023-11-27T21:21:36.501028+0000","last_clean":"2023-11-27T21:21:36.501028+0000","last_became_active":"2023-11-27T20:54:26.226407+0000","last_became_peered":"2023-11-27T20:54:26.226407+0000","last_unstale":"2023-11-27T21:21:36.501028+0000","last_undegraded":"2023-11-27T21:21:36.501028+0000","last_fullsized":"2023-11-27T21:21:36.501028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:32:19.691350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'78","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.391101+0000","last_change":"2023-11-27T20:54:27.512803+0000","last_active":"2023-11-27T21:21:49.391101+0000","last_peered":"2023-11-27T21:21:49.391101+0000","last_clean":"2023-11-27T21:21:49.391101+0000","last_became_active":"2023-11-27T20:54:27.512548+0000","last_became_peered":"2023-11-27T20:54:27.512548+0000","last_unstale":"2023-11-27T21:21:49.391101+0000","last_undegraded":"2023-11-27T21:21:49.391101+0000","last_fullsized":"2023-11-27T21:21:49.391101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:36.652979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"28'164","reported_seq":189,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:11.314014+0000","last_change":"2023-11-27T20:54:31.828391+0000","last_active":"2023-11-27T21:21:11.314014+0000","last_peered":"2023-11-27T21:21:11.314014+0000","last_clean":"2023-11-27T21:21:11.314014+0000","last_became_active":"2023-11-27T20:54:31.828045+0000","last_became_peered":"2023-11-27T20:54:31.828045+0000","last_unstale":"2023-11-27T21:21:11.314014+0000","last_undegraded":"2023-11-27T21:21:11.314014+0000","last_fullsized":"2023-11-27T21:21:11.314014+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:58.308604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":12089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"28'9","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:33.519716+0000","last_change":"2023-11-27T20:54:26.226762+0000","last_active":"2023-11-27T21:21:33.519716+0000","last_peered":"2023-11-27T21:21:33.519716+0000","last_clean":"2023-11-27T21:21:33.519716+0000","last_became_active":"2023-11-27T20:54:26.226522+0000","last_became_peered":"2023-11-27T20:54:26.226522+0000","last_unstale":"2023-11-27T21:21:33.519716+0000","last_undegraded":"2023-11-27T21:21:33.519716+0000","last_fullsized":"2023-11-27T21:21:33.519716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:31.269905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"28'85","reported_seq":119,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.446167+0000","last_change":"2023-11-27T20:55:00.790042+0000","last_active":"2023-11-27T21:21:49.446167+0000","last_peered":"2023-11-27T21:21:49.446167+0000","last_clean":"2023-11-27T21:21:49.446167+0000","last_became_active":"2023-11-27T20:55:00.789772+0000","last_became_peered":"2023-11-27T20:55:00.789772+0000","last_unstale":"2023-11-27T21:21:49.446167+0000","last_undegraded":"2023-11-27T21:21:49.446167+0000","last_fullsized":"2023-11-27T21:21:49.446167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:51:32.237462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"28'169","reported_seq":194,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:07.313840+0000","last_change":"2023-11-27T20:54:31.828759+0000","last_active":"2023-11-27T21:21:07.313840+0000","last_peered":"2023-11-27T21:21:07.313840+0000","last_clean":"2023-11-27T21:21:07.313840+0000","last_became_active":"2023-11-27T20:54:31.828371+0000","last_became_peered":"2023-11-27T20:54:31.828371+0000","last_unstale":"2023-11-27T21:21:07.313840+0000","last_undegraded":"2023-11-27T21:21:07.313840+0000","last_fullsized":"2023-11-27T21:21:07.313840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:40.986177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":6774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"28'74","reported_seq":103,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.445340+0000","last_change":"2023-11-27T20:54:27.498572+0000","last_active":"2023-11-27T21:21:49.445340+0000","last_peered":"2023-11-27T21:21:49.445340+0000","last_clean":"2023-11-27T21:21:49.445340+0000","last_became_active":"2023-11-27T20:54:27.498279+0000","last_became_peered":"2023-11-27T20:54:27.498279+0000","last_unstale":"2023-11-27T21:21:49.445340+0000","last_undegraded":"2023-11-27T21:21:49.445340+0000","last_fullsized":"2023-11-27T21:21:49.445340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:23:57.929109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'1121","reported_seq":1151,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:35.299616+0000","last_change":"2023-11-27T20:54:26.227734+0000","last_active":"2023-11-27T21:21:35.299616+0000","last_peered":"2023-11-27T21:21:35.299616+0000","last_clean":"2023-11-27T21:21:35.299616+0000","last_became_active":"2023-11-27T20:54:26.227503+0000","last_became_peered":"2023-11-27T20:54:26.227503+0000","last_unstale":"2023-11-27T21:21:35.299616+0000","last_undegraded":"2023-11-27T21:21:35.299616+0000","last_fullsized":"2023-11-27T21:21:35.299616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1121,"log_dups_size":0,"ondisk_log_size":1121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:08.206775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1114,"num_write_kb":4562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"28'173","reported_seq":200,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:15.784237+0000","last_change":"2023-11-27T20:54:31.827976+0000","last_active":"2023-11-27T21:21:15.784237+0000","last_peered":"2023-11-27T21:21:15.784237+0000","last_clean":"2023-11-27T21:21:15.784237+0000","last_became_active":"2023-11-27T20:54:31.827631+0000","last_became_peered":"2023-11-27T20:54:31.827631+0000","last_unstale":"2023-11-27T21:21:15.784237+0000","last_undegraded":"2023-11-27T21:21:15.784237+0000","last_fullsized":"2023-11-27T21:21:15.784237+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:58:58.404897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":8292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"28'70","reported_seq":98,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.390638+0000","last_change":"2023-11-27T20:54:27.510917+0000","last_active":"2023-11-27T21:21:49.390638+0000","last_peered":"2023-11-27T21:21:49.390638+0000","last_clean":"2023-11-27T21:21:49.390638+0000","last_became_active":"2023-11-27T20:54:27.510668+0000","last_became_peered":"2023-11-27T20:54:27.510668+0000","last_unstale":"2023-11-27T21:21:49.390638+0000","last_undegraded":"2023-11-27T21:21:49.390638+0000","last_fullsized":"2023-11-27T21:21:49.390638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:27:15.390631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'447","reported_seq":477,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:42.292239+0000","last_change":"2023-11-27T20:54:26.231461+0000","last_active":"2023-11-27T21:21:42.292239+0000","last_peered":"2023-11-27T21:21:42.292239+0000","last_clean":"2023-11-27T21:21:42.292239+0000","last_became_active":"2023-11-27T20:54:26.231081+0000","last_became_peered":"2023-11-27T20:54:26.231081+0000","last_unstale":"2023-11-27T21:21:42.292239+0000","last_undegraded":"2023-11-27T21:21:42.292239+0000","last_fullsized":"2023-11-27T21:21:42.292239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:35.560769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"28'191","reported_seq":218,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:16.059056+0000","last_change":"2023-11-27T20:54:31.817058+0000","last_active":"2023-11-27T21:21:16.059056+0000","last_peered":"2023-11-27T21:21:16.059056+0000","last_clean":"2023-11-27T21:21:16.059056+0000","last_became_active":"2023-11-27T20:54:31.816700+0000","last_became_peered":"2023-11-27T20:54:31.816700+0000","last_unstale":"2023-11-27T21:21:16.059056+0000","last_undegraded":"2023-11-27T21:21:16.059056+0000","last_fullsized":"2023-11-27T21:21:16.059056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:02.384459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":12458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"28'73","reported_seq":102,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.481340+0000","last_change":"2023-11-27T20:54:27.510195+0000","last_active":"2023-11-27T21:21:49.481340+0000","last_peered":"2023-11-27T21:21:49.481340+0000","last_clean":"2023-11-27T21:21:49.481340+0000","last_became_active":"2023-11-27T20:54:27.509961+0000","last_became_peered":"2023-11-27T20:54:27.509961+0000","last_unstale":"2023-11-27T21:21:49.481340+0000","last_undegraded":"2023-11-27T21:21:49.481340+0000","last_fullsized":"2023-11-27T21:21:49.481340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:15:47.196613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'335","reported_seq":365,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:36.505451+0000","last_change":"2023-11-27T20:54:26.223978+0000","last_active":"2023-11-27T21:21:36.505451+0000","last_peered":"2023-11-27T21:21:36.505451+0000","last_clean":"2023-11-27T21:21:36.505451+0000","last_became_active":"2023-11-27T20:54:26.223717+0000","last_became_peered":"2023-11-27T20:54:26.223717+0000","last_unstale":"2023-11-27T21:21:36.505451+0000","last_undegraded":"2023-11-27T21:21:36.505451+0000","last_fullsized":"2023-11-27T21:21:36.505451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:19:35.269523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":333,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'146","reported_seq":173,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.963929+0000","last_change":"2023-11-27T20:54:31.836718+0000","last_active":"2023-11-27T21:21:12.963929+0000","last_peered":"2023-11-27T21:21:12.963929+0000","last_clean":"2023-11-27T21:21:12.963929+0000","last_became_active":"2023-11-27T20:54:31.836346+0000","last_became_peered":"2023-11-27T20:54:31.836346+0000","last_unstale":"2023-11-27T21:21:12.963929+0000","last_undegraded":"2023-11-27T21:21:12.963929+0000","last_fullsized":"2023-11-27T21:21:12.963929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:29:03.931226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":6504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'66","reported_seq":95,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.501577+0000","last_change":"2023-11-27T20:54:27.493578+0000","last_active":"2023-11-27T21:21:49.501577+0000","last_peered":"2023-11-27T21:21:49.501577+0000","last_clean":"2023-11-27T21:21:49.501577+0000","last_became_active":"2023-11-27T20:54:27.493327+0000","last_became_peered":"2023-11-27T20:54:27.493327+0000","last_unstale":"2023-11-27T21:21:49.501577+0000","last_undegraded":"2023-11-27T21:21:49.501577+0000","last_fullsized":"2023-11-27T21:21:49.501577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:48:56.464995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"28'7","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:35.299412+0000","last_change":"2023-11-27T20:54:26.227383+0000","last_active":"2023-11-27T21:21:35.299412+0000","last_peered":"2023-11-27T21:21:35.299412+0000","last_clean":"2023-11-27T21:21:35.299412+0000","last_became_active":"2023-11-27T20:54:26.227120+0000","last_became_peered":"2023-11-27T20:54:26.227120+0000","last_unstale":"2023-11-27T21:21:35.299412+0000","last_undegraded":"2023-11-27T21:21:35.299412+0000","last_fullsized":"2023-11-27T21:21:35.299412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:20.644474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'197","reported_seq":233,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:13.022761+0000","last_change":"2023-11-27T20:55:01.286453+0000","last_active":"2023-11-27T21:21:13.022761+0000","last_peered":"2023-11-27T21:21:13.022761+0000","last_clean":"2023-11-27T21:21:13.022761+0000","last_became_active":"2023-11-27T20:55:01.286057+0000","last_became_peered":"2023-11-27T20:55:01.286057+0000","last_unstale":"2023-11-27T21:21:13.022761+0000","last_undegraded":"2023-11-27T21:21:13.022761+0000","last_fullsized":"2023-11-27T21:21:13.022761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:17.334107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":17829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5,7],"acting":[2,1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"28'63","reported_seq":92,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.481101+0000","last_change":"2023-11-27T20:54:27.510815+0000","last_active":"2023-11-27T21:21:49.481101+0000","last_peered":"2023-11-27T21:21:49.481101+0000","last_clean":"2023-11-27T21:21:49.481101+0000","last_became_active":"2023-11-27T20:54:27.510573+0000","last_became_peered":"2023-11-27T20:54:27.510573+0000","last_unstale":"2023-11-27T21:21:49.481101+0000","last_undegraded":"2023-11-27T21:21:49.481101+0000","last_fullsized":"2023-11-27T21:21:49.481101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:44:21.573980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'13","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:36.499632+0000","last_change":"2023-11-27T20:54:26.224703+0000","last_active":"2023-11-27T21:21:36.499632+0000","last_peered":"2023-11-27T21:21:36.499632+0000","last_clean":"2023-11-27T21:21:36.499632+0000","last_became_active":"2023-11-27T20:54:26.224412+0000","last_became_peered":"2023-11-27T20:54:26.224412+0000","last_unstale":"2023-11-27T21:21:36.499632+0000","last_undegraded":"2023-11-27T21:21:36.499632+0000","last_fullsized":"2023-11-27T21:21:36.499632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:02.889092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'174","reported_seq":202,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.959471+0000","last_change":"2023-11-27T20:54:31.819739+0000","last_active":"2023-11-27T21:21:12.959471+0000","last_peered":"2023-11-27T21:21:12.959471+0000","last_clean":"2023-11-27T21:21:12.959471+0000","last_became_active":"2023-11-27T20:54:31.819371+0000","last_became_peered":"2023-11-27T20:54:31.819371+0000","last_unstale":"2023-11-27T21:21:12.959471+0000","last_undegraded":"2023-11-27T21:21:12.959471+0000","last_fullsized":"2023-11-27T21:21:12.959471+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:35.147110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":8398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"28'71","reported_seq":100,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.480758+0000","last_change":"2023-11-27T20:54:27.500858+0000","last_active":"2023-11-27T21:21:49.480758+0000","last_peered":"2023-11-27T21:21:49.480758+0000","last_clean":"2023-11-27T21:21:49.480758+0000","last_became_active":"2023-11-27T20:54:27.500455+0000","last_became_peered":"2023-11-27T20:54:27.500455+0000","last_unstale":"2023-11-27T21:21:49.480758+0000","last_undegraded":"2023-11-27T21:21:49.480758+0000","last_fullsized":"2023-11-27T21:21:49.480758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:12:05.775037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'160","reported_seq":190,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:41.647576+0000","last_change":"2023-11-27T20:54:26.223401+0000","last_active":"2023-11-27T21:21:41.647576+0000","last_peered":"2023-11-27T21:21:41.647576+0000","last_clean":"2023-11-27T21:21:41.647576+0000","last_became_active":"2023-11-27T20:54:26.222981+0000","last_became_peered":"2023-11-27T20:54:26.222981+0000","last_unstale":"2023-11-27T21:21:41.647576+0000","last_undegraded":"2023-11-27T21:21:41.647576+0000","last_fullsized":"2023-11-27T21:21:41.647576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:43:11.830626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":391,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"28'157","reported_seq":185,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.779032+0000","last_change":"2023-11-27T20:54:31.814118+0000","last_active":"2023-11-27T21:21:12.779032+0000","last_peered":"2023-11-27T21:21:12.779032+0000","last_clean":"2023-11-27T21:21:12.779032+0000","last_became_active":"2023-11-27T20:54:31.813765+0000","last_became_peered":"2023-11-27T20:54:31.813765+0000","last_unstale":"2023-11-27T21:21:12.779032+0000","last_undegraded":"2023-11-27T21:21:12.779032+0000","last_fullsized":"2023-11-27T21:21:12.779032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:28:56.396805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":11921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"28'78","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.415446+0000","last_change":"2023-11-27T20:54:27.506449+0000","last_active":"2023-11-27T21:21:49.415446+0000","last_peered":"2023-11-27T21:21:49.415446+0000","last_clean":"2023-11-27T21:21:49.415446+0000","last_became_active":"2023-11-27T20:54:27.506210+0000","last_became_peered":"2023-11-27T20:54:27.506210+0000","last_unstale":"2023-11-27T21:21:49.415446+0000","last_undegraded":"2023-11-27T21:21:49.415446+0000","last_fullsized":"2023-11-27T21:21:49.415446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:32:20.783560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'245","reported_seq":276,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:40.084015+0000","last_change":"2023-11-27T20:54:26.220043+0000","last_active":"2023-11-27T21:21:40.084015+0000","last_peered":"2023-11-27T21:21:40.084015+0000","last_clean":"2023-11-27T21:21:40.084015+0000","last_became_active":"2023-11-27T20:54:26.219775+0000","last_became_peered":"2023-11-27T20:54:26.219775+0000","last_unstale":"2023-11-27T21:21:40.084015+0000","last_undegraded":"2023-11-27T21:21:40.084015+0000","last_fullsized":"2023-11-27T21:21:40.084015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:33.812297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"28'177","reported_seq":205,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:11.896181+0000","last_change":"2023-11-27T20:54:31.825960+0000","last_active":"2023-11-27T21:21:11.896181+0000","last_peered":"2023-11-27T21:21:11.896181+0000","last_clean":"2023-11-27T21:21:11.896181+0000","last_became_active":"2023-11-27T20:54:31.825591+0000","last_became_peered":"2023-11-27T20:54:31.825591+0000","last_unstale":"2023-11-27T21:21:11.896181+0000","last_undegraded":"2023-11-27T21:21:11.896181+0000","last_fullsized":"2023-11-27T21:21:11.896181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:24:35.498899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":8135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"28'65","reported_seq":95,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.526249+0000","last_change":"2023-11-27T20:54:27.500927+0000","last_active":"2023-11-27T21:21:49.526249+0000","last_peered":"2023-11-27T21:21:49.526249+0000","last_clean":"2023-11-27T21:21:49.526249+0000","last_became_active":"2023-11-27T20:54:27.500677+0000","last_became_peered":"2023-11-27T20:54:27.500677+0000","last_unstale":"2023-11-27T21:21:49.526249+0000","last_undegraded":"2023-11-27T21:21:49.526249+0000","last_fullsized":"2023-11-27T21:21:49.526249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:56.708375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"28'6","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:36.500820+0000","last_change":"2023-11-27T20:54:26.227877+0000","last_active":"2023-11-27T21:21:36.500820+0000","last_peered":"2023-11-27T21:21:36.500820+0000","last_clean":"2023-11-27T21:21:36.500820+0000","last_became_active":"2023-11-27T20:54:26.227605+0000","last_became_peered":"2023-11-27T20:54:26.227605+0000","last_unstale":"2023-11-27T21:21:36.500820+0000","last_undegraded":"2023-11-27T21:21:36.500820+0000","last_fullsized":"2023-11-27T21:21:36.500820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:40.031252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"28'178","reported_seq":206,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:15.791510+0000","last_change":"2023-11-27T20:54:31.826732+0000","last_active":"2023-11-27T21:21:15.791510+0000","last_peered":"2023-11-27T21:21:15.791510+0000","last_clean":"2023-11-27T21:21:15.791510+0000","last_became_active":"2023-11-27T20:54:31.826406+0000","last_became_peered":"2023-11-27T20:54:31.826406+0000","last_unstale":"2023-11-27T21:21:15.791510+0000","last_undegraded":"2023-11-27T21:21:15.791510+0000","last_fullsized":"2023-11-27T21:21:15.791510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:54.926925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":6957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"28'85","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.489365+0000","last_change":"2023-11-27T20:54:27.517007+0000","last_active":"2023-11-27T21:21:49.489365+0000","last_peered":"2023-11-27T21:21:49.489365+0000","last_clean":"2023-11-27T21:21:49.489365+0000","last_became_active":"2023-11-27T20:54:27.516686+0000","last_became_peered":"2023-11-27T20:54:27.516686+0000","last_unstale":"2023-11-27T21:21:49.489365+0000","last_undegraded":"2023-11-27T21:21:49.489365+0000","last_fullsized":"2023-11-27T21:21:49.489365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:50.369518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'915","reported_seq":946,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.016379+0000","last_change":"2023-11-27T20:54:26.230192+0000","last_active":"2023-11-27T21:21:49.016379+0000","last_peered":"2023-11-27T21:21:49.016379+0000","last_clean":"2023-11-27T21:21:49.016379+0000","last_became_active":"2023-11-27T20:54:26.229985+0000","last_became_peered":"2023-11-27T20:54:26.229985+0000","last_unstale":"2023-11-27T21:21:49.016379+0000","last_undegraded":"2023-11-27T21:21:49.016379+0000","last_fullsized":"2023-11-27T21:21:49.016379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:58:59.280763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206463,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":911,"num_write_kb":4580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"28'139","reported_seq":163,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:13.022778+0000","last_change":"2023-11-27T20:55:00.588512+0000","last_active":"2023-11-27T21:21:13.022778+0000","last_peered":"2023-11-27T21:21:13.022778+0000","last_clean":"2023-11-27T21:21:13.022778+0000","last_became_active":"2023-11-27T20:55:00.588018+0000","last_became_peered":"2023-11-27T20:55:00.588018+0000","last_unstale":"2023-11-27T21:21:13.022778+0000","last_undegraded":"2023-11-27T21:21:13.022778+0000","last_fullsized":"2023-11-27T21:21:13.022778+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:06.015093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":13169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,0,3],"acting":[2,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'77","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.482999+0000","last_change":"2023-11-27T20:54:27.513378+0000","last_active":"2023-11-27T21:21:49.482999+0000","last_peered":"2023-11-27T21:21:49.482999+0000","last_clean":"2023-11-27T21:21:49.482999+0000","last_became_active":"2023-11-27T20:54:27.512093+0000","last_became_peered":"2023-11-27T20:54:27.512093+0000","last_unstale":"2023-11-27T21:21:49.482999+0000","last_undegraded":"2023-11-27T21:21:49.482999+0000","last_fullsized":"2023-11-27T21:21:49.482999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:24:36.921232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'270","reported_seq":470,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:44.209461+0000","last_change":"2023-11-27T20:54:26.230913+0000","last_active":"2023-11-27T21:21:44.209461+0000","last_peered":"2023-11-27T21:21:44.209461+0000","last_clean":"2023-11-27T21:21:44.209461+0000","last_became_active":"2023-11-27T20:54:26.230548+0000","last_became_peered":"2023-11-27T20:54:26.230548+0000","last_unstale":"2023-11-27T21:21:44.209461+0000","last_undegraded":"2023-11-27T21:21:44.209461+0000","last_fullsized":"2023-11-27T21:21:44.209461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:42:11.153092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28446,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":170,"num_read_kb":173,"num_write":266,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"28'141","reported_seq":177,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.292190+0000","last_change":"2023-11-27T20:55:00.595104+0000","last_active":"2023-11-27T21:21:12.292190+0000","last_peered":"2023-11-27T21:21:12.292190+0000","last_clean":"2023-11-27T21:21:12.292190+0000","last_became_active":"2023-11-27T20:55:00.594705+0000","last_became_peered":"2023-11-27T20:55:00.594705+0000","last_unstale":"2023-11-27T21:21:12.292190+0000","last_undegraded":"2023-11-27T21:21:12.292190+0000","last_fullsized":"2023-11-27T21:21:12.292190+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:06.015093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":12035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"28'77","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.424310+0000","last_change":"2023-11-27T20:54:27.503689+0000","last_active":"2023-11-27T21:21:49.424310+0000","last_peered":"2023-11-27T21:21:49.424310+0000","last_clean":"2023-11-27T21:21:49.424310+0000","last_became_active":"2023-11-27T20:54:27.502941+0000","last_became_peered":"2023-11-27T20:54:27.502941+0000","last_unstale":"2023-11-27T21:21:49.424310+0000","last_undegraded":"2023-11-27T21:21:49.424310+0000","last_fullsized":"2023-11-27T21:21:49.424310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:59:41.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'11","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:40.287864+0000","last_change":"2023-11-27T20:54:26.214419+0000","last_active":"2023-11-27T21:21:40.287864+0000","last_peered":"2023-11-27T21:21:40.287864+0000","last_clean":"2023-11-27T21:21:40.287864+0000","last_became_active":"2023-11-27T20:54:26.214166+0000","last_became_peered":"2023-11-27T20:54:26.214166+0000","last_unstale":"2023-11-27T21:21:40.287864+0000","last_undegraded":"2023-11-27T21:21:40.287864+0000","last_fullsized":"2023-11-27T21:21:40.287864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:44:20.481769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"28'132","reported_seq":159,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:14.318094+0000","last_change":"2023-11-27T20:54:31.832551+0000","last_active":"2023-11-27T21:21:14.318094+0000","last_peered":"2023-11-27T21:21:14.318094+0000","last_clean":"2023-11-27T21:21:14.318094+0000","last_became_active":"2023-11-27T20:54:31.832196+0000","last_became_peered":"2023-11-27T20:54:31.832196+0000","last_unstale":"2023-11-27T21:21:14.318094+0000","last_undegraded":"2023-11-27T21:21:14.318094+0000","last_fullsized":"2023-11-27T21:21:14.318094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:26:46.712422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":8461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'69","reported_seq":99,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.481057+0000","last_change":"2023-11-27T20:54:27.433404+0000","last_active":"2023-11-27T21:21:49.481057+0000","last_peered":"2023-11-27T21:21:49.481057+0000","last_clean":"2023-11-27T21:21:49.481057+0000","last_became_active":"2023-11-27T20:54:27.433161+0000","last_became_peered":"2023-11-27T20:54:27.433161+0000","last_unstale":"2023-11-27T21:21:49.481057+0000","last_undegraded":"2023-11-27T21:21:49.481057+0000","last_fullsized":"2023-11-27T21:21:49.481057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:09.298985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'8","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:26.067458+0000","last_change":"2023-11-27T20:54:26.227451+0000","last_active":"2023-11-27T21:21:26.067458+0000","last_peered":"2023-11-27T21:21:26.067458+0000","last_clean":"2023-11-27T21:21:26.067458+0000","last_became_active":"2023-11-27T20:54:26.227133+0000","last_became_peered":"2023-11-27T20:54:26.227133+0000","last_unstale":"2023-11-27T21:21:26.067458+0000","last_undegraded":"2023-11-27T21:21:26.067458+0000","last_fullsized":"2023-11-27T21:21:26.067458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:58.281608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:18:14.202215+0000","last_change":"2023-11-27T20:54:11.452973+0000","last_active":"2023-11-27T21:18:14.202215+0000","last_peered":"2023-11-27T21:18:14.202215+0000","last_clean":"2023-11-27T21:18:14.202215+0000","last_became_active":"2023-11-27T20:54:11.452181+0000","last_became_peered":"2023-11-27T20:54:11.452181+0000","last_unstale":"2023-11-27T21:18:14.202215+0000","last_undegraded":"2023-11-27T21:18:14.202215+0000","last_fullsized":"2023-11-27T21:18:14.202215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:09.564478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:09.564478+0000","last_clean_scrub_stamp":"2023-11-27T20:54:09.564478+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:07.792065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'171","reported_seq":199,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.805300+0000","last_change":"2023-11-27T20:54:31.818408+0000","last_active":"2023-11-27T21:21:12.805300+0000","last_peered":"2023-11-27T21:21:12.805300+0000","last_clean":"2023-11-27T21:21:12.805300+0000","last_became_active":"2023-11-27T20:54:31.818048+0000","last_became_peered":"2023-11-27T20:54:31.818048+0000","last_unstale":"2023-11-27T21:21:12.805300+0000","last_undegraded":"2023-11-27T21:21:12.805300+0000","last_fullsized":"2023-11-27T21:21:12.805300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:48:53.892148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":10034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"28'75","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.445353+0000","last_change":"2023-11-27T20:54:27.493626+0000","last_active":"2023-11-27T21:21:49.445353+0000","last_peered":"2023-11-27T21:21:49.445353+0000","last_clean":"2023-11-27T21:21:49.445353+0000","last_became_active":"2023-11-27T20:54:27.493256+0000","last_became_peered":"2023-11-27T20:54:27.493256+0000","last_unstale":"2023-11-27T21:21:49.445353+0000","last_undegraded":"2023-11-27T21:21:49.445353+0000","last_fullsized":"2023-11-27T21:21:49.445353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:40:57.665118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'1018","reported_seq":1048,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:26.066735+0000","last_change":"2023-11-27T20:54:26.230079+0000","last_active":"2023-11-27T21:21:26.066735+0000","last_peered":"2023-11-27T21:21:26.066735+0000","last_clean":"2023-11-27T21:21:26.066735+0000","last_became_active":"2023-11-27T20:54:26.229796+0000","last_became_peered":"2023-11-27T20:54:26.229796+0000","last_unstale":"2023-11-27T21:21:26.066735+0000","last_undegraded":"2023-11-27T21:21:26.066735+0000","last_fullsized":"2023-11-27T21:21:26.066735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1018,"log_dups_size":0,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:55.616164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1013,"num_write_kb":4611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'180","reported_seq":207,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:10.821878+0000","last_change":"2023-11-27T20:54:31.825472+0000","last_active":"2023-11-27T21:21:10.821878+0000","last_peered":"2023-11-27T21:21:10.821878+0000","last_clean":"2023-11-27T21:21:10.821878+0000","last_became_active":"2023-11-27T20:54:31.825080+0000","last_became_peered":"2023-11-27T20:54:31.825080+0000","last_unstale":"2023-11-27T21:21:10.821878+0000","last_undegraded":"2023-11-27T21:21:10.821878+0000","last_fullsized":"2023-11-27T21:21:10.821878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:56:07.208945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":9643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'78","reported_seq":99,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.490397+0000","last_change":"2023-11-27T20:55:00.593751+0000","last_active":"2023-11-27T21:21:49.490397+0000","last_peered":"2023-11-27T21:21:49.490397+0000","last_clean":"2023-11-27T21:21:49.490397+0000","last_became_active":"2023-11-27T20:55:00.593249+0000","last_became_peered":"2023-11-27T20:55:00.593249+0000","last_unstale":"2023-11-27T21:21:49.490397+0000","last_undegraded":"2023-11-27T21:21:49.490397+0000","last_fullsized":"2023-11-27T21:21:49.490397+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:10.486151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"28'436","reported_seq":466,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.016200+0000","last_change":"2023-11-27T20:54:26.226148+0000","last_active":"2023-11-27T21:21:49.016200+0000","last_peered":"2023-11-27T21:21:49.016200+0000","last_clean":"2023-11-27T21:21:49.016200+0000","last_became_active":"2023-11-27T20:54:26.225886+0000","last_became_peered":"2023-11-27T20:54:26.225886+0000","last_unstale":"2023-11-27T21:21:49.016200+0000","last_undegraded":"2023-11-27T21:21:49.016200+0000","last_fullsized":"2023-11-27T21:21:49.016200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:32:19.691350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2473984,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":2660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"28'169","reported_seq":196,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:14.309237+0000","last_change":"2023-11-27T20:54:31.828729+0000","last_active":"2023-11-27T21:21:14.309237+0000","last_peered":"2023-11-27T21:21:14.309237+0000","last_clean":"2023-11-27T21:21:14.309237+0000","last_became_active":"2023-11-27T20:54:31.828368+0000","last_became_peered":"2023-11-27T20:54:31.828368+0000","last_unstale":"2023-11-27T21:21:14.309237+0000","last_undegraded":"2023-11-27T21:21:14.309237+0000","last_fullsized":"2023-11-27T21:21:14.309237+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:02.384459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":8527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"28'75","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.492569+0000","last_change":"2023-11-27T20:54:27.515800+0000","last_active":"2023-11-27T21:21:49.492569+0000","last_peered":"2023-11-27T21:21:49.492569+0000","last_clean":"2023-11-27T21:21:49.492569+0000","last_became_active":"2023-11-27T20:54:27.515416+0000","last_became_peered":"2023-11-27T20:54:27.515416+0000","last_unstale":"2023-11-27T21:21:49.492569+0000","last_undegraded":"2023-11-27T21:21:49.492569+0000","last_fullsized":"2023-11-27T21:21:49.492569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:03:00.166936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"28'8","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:27.856575+0000","last_change":"2023-11-27T20:54:26.224880+0000","last_active":"2023-11-27T21:21:27.856575+0000","last_peered":"2023-11-27T21:21:27.856575+0000","last_clean":"2023-11-27T21:21:27.856575+0000","last_became_active":"2023-11-27T20:54:26.224604+0000","last_became_peered":"2023-11-27T20:54:26.224604+0000","last_unstale":"2023-11-27T21:21:27.856575+0000","last_undegraded":"2023-11-27T21:21:27.856575+0000","last_fullsized":"2023-11-27T21:21:27.856575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:15:45.927622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"28'149","reported_seq":176,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:10.315785+0000","last_change":"2023-11-27T20:54:31.819648+0000","last_active":"2023-11-27T21:21:10.315785+0000","last_peered":"2023-11-27T21:21:10.315785+0000","last_clean":"2023-11-27T21:21:10.315785+0000","last_became_active":"2023-11-27T20:54:31.819294+0000","last_became_peered":"2023-11-27T20:54:31.819294+0000","last_unstale":"2023-11-27T21:21:10.315785+0000","last_undegraded":"2023-11-27T21:21:10.315785+0000","last_fullsized":"2023-11-27T21:21:10.315785+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:15.043559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"28'77","reported_seq":106,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.528436+0000","last_change":"2023-11-27T20:54:27.512925+0000","last_active":"2023-11-27T21:21:49.528436+0000","last_peered":"2023-11-27T21:21:49.528436+0000","last_clean":"2023-11-27T21:21:49.528436+0000","last_became_active":"2023-11-27T20:54:27.512663+0000","last_became_peered":"2023-11-27T20:54:27.512663+0000","last_unstale":"2023-11-27T21:21:49.528436+0000","last_undegraded":"2023-11-27T21:21:49.528436+0000","last_fullsized":"2023-11-27T21:21:49.528436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:41.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"28'239","reported_seq":269,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:36.186311+0000","last_change":"2023-11-27T20:54:26.225344+0000","last_active":"2023-11-27T21:21:36.186311+0000","last_peered":"2023-11-27T21:21:36.186311+0000","last_clean":"2023-11-27T21:21:36.186311+0000","last_became_active":"2023-11-27T20:54:26.225056+0000","last_became_peered":"2023-11-27T20:54:26.225056+0000","last_unstale":"2023-11-27T21:21:36.186311+0000","last_undegraded":"2023-11-27T21:21:36.186311+0000","last_fullsized":"2023-11-27T21:21:36.186311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:39.965666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"28'126","reported_seq":153,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:11.958197+0000","last_change":"2023-11-27T20:54:31.827590+0000","last_active":"2023-11-27T21:21:11.958197+0000","last_peered":"2023-11-27T21:21:11.958197+0000","last_clean":"2023-11-27T21:21:11.958197+0000","last_became_active":"2023-11-27T20:54:31.827175+0000","last_became_peered":"2023-11-27T20:54:31.827175+0000","last_unstale":"2023-11-27T21:21:11.958197+0000","last_undegraded":"2023-11-27T21:21:11.958197+0000","last_fullsized":"2023-11-27T21:21:11.958197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:07:26.372924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":7629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"28'69","reported_seq":97,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.444328+0000","last_change":"2023-11-27T20:54:27.498488+0000","last_active":"2023-11-27T21:21:49.444328+0000","last_peered":"2023-11-27T21:21:49.444328+0000","last_clean":"2023-11-27T21:21:49.444328+0000","last_became_active":"2023-11-27T20:54:27.498225+0000","last_became_peered":"2023-11-27T20:54:27.498225+0000","last_unstale":"2023-11-27T21:21:49.444328+0000","last_undegraded":"2023-11-27T21:21:49.444328+0000","last_fullsized":"2023-11-27T21:21:49.444328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:20:24.928142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'1029","reported_seq":1058,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.015885+0000","last_change":"2023-11-27T20:54:26.225580+0000","last_active":"2023-11-27T21:21:49.015885+0000","last_peered":"2023-11-27T21:21:49.015885+0000","last_clean":"2023-11-27T21:21:49.015885+0000","last_became_active":"2023-11-27T20:54:26.225333+0000","last_became_peered":"2023-11-27T20:54:26.225333+0000","last_unstale":"2023-11-27T21:21:49.015885+0000","last_undegraded":"2023-11-27T21:21:49.015885+0000","last_fullsized":"2023-11-27T21:21:49.015885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1029,"log_dups_size":0,"ondisk_log_size":1029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:46:01.797509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3313963,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1025,"num_write_kb":3921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"28'159","reported_seq":185,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:11.889011+0000","last_change":"2023-11-27T20:54:31.836029+0000","last_active":"2023-11-27T21:21:11.889011+0000","last_peered":"2023-11-27T21:21:11.889011+0000","last_clean":"2023-11-27T21:21:11.889011+0000","last_became_active":"2023-11-27T20:54:31.835629+0000","last_became_peered":"2023-11-27T20:54:31.835629+0000","last_unstale":"2023-11-27T21:21:11.889011+0000","last_undegraded":"2023-11-27T21:21:11.889011+0000","last_fullsized":"2023-11-27T21:21:11.889011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:06.015093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":12674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'64","reported_seq":91,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.430617+0000","last_change":"2023-11-27T20:54:27.511034+0000","last_active":"2023-11-27T21:21:49.430617+0000","last_peered":"2023-11-27T21:21:49.430617+0000","last_clean":"2023-11-27T21:21:49.430617+0000","last_became_active":"2023-11-27T20:54:27.510775+0000","last_became_peered":"2023-11-27T20:54:27.510775+0000","last_unstale":"2023-11-27T21:21:49.430617+0000","last_undegraded":"2023-11-27T21:21:49.430617+0000","last_fullsized":"2023-11-27T21:21:49.430617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:56.708375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"28'1188","reported_seq":1217,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:20:09.292900+0000","last_change":"2023-11-27T20:54:26.227007+0000","last_active":"2023-11-27T21:20:09.292900+0000","last_peered":"2023-11-27T21:20:09.292900+0000","last_clean":"2023-11-27T21:20:09.292900+0000","last_became_active":"2023-11-27T20:54:26.226745+0000","last_became_peered":"2023-11-27T20:54:26.226745+0000","last_unstale":"2023-11-27T21:20:09.292900+0000","last_undegraded":"2023-11-27T21:20:09.292900+0000","last_fullsized":"2023-11-27T21:20:09.292900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1188,"log_dups_size":0,"ondisk_log_size":1188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:41:46.312385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":4695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"28'169","reported_seq":195,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:10.950189+0000","last_change":"2023-11-27T20:54:31.831969+0000","last_active":"2023-11-27T21:21:10.950189+0000","last_peered":"2023-11-27T21:21:10.950189+0000","last_clean":"2023-11-27T21:21:10.950189+0000","last_became_active":"2023-11-27T20:54:31.831620+0000","last_became_peered":"2023-11-27T20:54:31.831620+0000","last_unstale":"2023-11-27T21:21:10.950189+0000","last_undegraded":"2023-11-27T21:21:10.950189+0000","last_fullsized":"2023-11-27T21:21:10.950189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:57:38.465675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":13064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'85","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.445927+0000","last_change":"2023-11-27T20:54:27.515785+0000","last_active":"2023-11-27T21:21:49.445927+0000","last_peered":"2023-11-27T21:21:49.445927+0000","last_clean":"2023-11-27T21:21:49.445927+0000","last_became_active":"2023-11-27T20:54:27.515524+0000","last_became_peered":"2023-11-27T20:54:27.515524+0000","last_unstale":"2023-11-27T21:21:49.445927+0000","last_undegraded":"2023-11-27T21:21:49.445927+0000","last_fullsized":"2023-11-27T21:21:49.445927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:40:33.267986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'242","reported_seq":271,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:42.288454+0000","last_change":"2023-11-27T20:54:26.225975+0000","last_active":"2023-11-27T21:21:42.288454+0000","last_peered":"2023-11-27T21:21:42.288454+0000","last_clean":"2023-11-27T21:21:42.288454+0000","last_became_active":"2023-11-27T20:54:26.225691+0000","last_became_peered":"2023-11-27T20:54:26.225691+0000","last_unstale":"2023-11-27T21:21:42.288454+0000","last_undegraded":"2023-11-27T21:21:42.288454+0000","last_fullsized":"2023-11-27T21:21:42.288454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:25.427192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":236,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"28'150","reported_seq":176,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.291749+0000","last_change":"2023-11-27T20:54:31.827058+0000","last_active":"2023-11-27T21:21:12.291749+0000","last_peered":"2023-11-27T21:21:12.291749+0000","last_clean":"2023-11-27T21:21:12.291749+0000","last_became_active":"2023-11-27T20:54:31.826669+0000","last_became_peered":"2023-11-27T20:54:31.826669+0000","last_unstale":"2023-11-27T21:21:12.291749+0000","last_undegraded":"2023-11-27T21:21:12.291749+0000","last_fullsized":"2023-11-27T21:21:12.291749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:40.986177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":7432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"28'77","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.398536+0000","last_change":"2023-11-27T20:54:27.503066+0000","last_active":"2023-11-27T21:21:49.398536+0000","last_peered":"2023-11-27T21:21:49.398536+0000","last_clean":"2023-11-27T21:21:49.398536+0000","last_became_active":"2023-11-27T20:54:27.502677+0000","last_became_peered":"2023-11-27T20:54:27.502677+0000","last_unstale":"2023-11-27T21:21:49.398536+0000","last_undegraded":"2023-11-27T21:21:49.398536+0000","last_fullsized":"2023-11-27T21:21:49.398536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:41.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'326","reported_seq":668,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:42.283413+0000","last_change":"2023-11-27T20:54:26.228175+0000","last_active":"2023-11-27T21:21:42.283413+0000","last_peered":"2023-11-27T21:21:42.283413+0000","last_clean":"2023-11-27T21:21:42.283413+0000","last_became_active":"2023-11-27T20:54:26.227911+0000","last_became_peered":"2023-11-27T20:54:26.227911+0000","last_unstale":"2023-11-27T21:21:42.283413+0000","last_undegraded":"2023-11-27T21:21:42.283413+0000","last_fullsized":"2023-11-27T21:21:42.283413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:57.995466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53552,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":314,"num_read_kb":325,"num_write":327,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'174","reported_seq":200,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:09.987996+0000","last_change":"2023-11-27T20:54:31.828136+0000","last_active":"2023-11-27T21:21:09.987996+0000","last_peered":"2023-11-27T21:21:09.987996+0000","last_clean":"2023-11-27T21:21:09.987996+0000","last_became_active":"2023-11-27T20:54:31.827785+0000","last_became_peered":"2023-11-27T20:54:31.827785+0000","last_unstale":"2023-11-27T21:21:09.987996+0000","last_undegraded":"2023-11-27T21:21:09.987996+0000","last_fullsized":"2023-11-27T21:21:09.987996+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:28:18.206490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":11290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'75","reported_seq":103,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.490363+0000","last_change":"2023-11-27T20:54:27.514185+0000","last_active":"2023-11-27T21:21:49.490363+0000","last_peered":"2023-11-27T21:21:49.490363+0000","last_clean":"2023-11-27T21:21:49.490363+0000","last_became_active":"2023-11-27T20:54:27.513655+0000","last_became_peered":"2023-11-27T20:54:27.513655+0000","last_unstale":"2023-11-27T21:21:49.490363+0000","last_undegraded":"2023-11-27T21:21:49.490363+0000","last_fullsized":"2023-11-27T21:21:49.490363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:52.629755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'1482","reported_seq":1511,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:32.579507+0000","last_change":"2023-11-27T20:54:26.230827+0000","last_active":"2023-11-27T21:21:32.579507+0000","last_peered":"2023-11-27T21:21:32.579507+0000","last_clean":"2023-11-27T21:21:32.579507+0000","last_became_active":"2023-11-27T20:54:26.230570+0000","last_became_peered":"2023-11-27T20:54:26.230570+0000","last_unstale":"2023-11-27T21:21:32.579507+0000","last_undegraded":"2023-11-27T21:21:32.579507+0000","last_fullsized":"2023-11-27T21:21:32.579507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1482,"log_dups_size":0,"ondisk_log_size":1482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:42:04.480038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1482,"num_write_kb":4539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"28'155","reported_seq":181,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.855294+0000","last_change":"2023-11-27T20:54:31.828482+0000","last_active":"2023-11-27T21:21:12.855294+0000","last_peered":"2023-11-27T21:21:12.855294+0000","last_clean":"2023-11-27T21:21:12.855294+0000","last_became_active":"2023-11-27T20:54:31.827872+0000","last_became_peered":"2023-11-27T20:54:31.827872+0000","last_unstale":"2023-11-27T21:21:12.855294+0000","last_undegraded":"2023-11-27T21:21:12.855294+0000","last_fullsized":"2023-11-27T21:21:12.855294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:32:35.015914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":8855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'67","reported_seq":95,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.446147+0000","last_change":"2023-11-27T20:54:27.493526+0000","last_active":"2023-11-27T21:21:49.446147+0000","last_peered":"2023-11-27T21:21:49.446147+0000","last_clean":"2023-11-27T21:21:49.446147+0000","last_became_active":"2023-11-27T20:54:27.493257+0000","last_became_peered":"2023-11-27T20:54:27.493257+0000","last_unstale":"2023-11-27T21:21:49.446147+0000","last_undegraded":"2023-11-27T21:21:49.446147+0000","last_fullsized":"2023-11-27T21:21:49.446147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:04.222900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'149","reported_seq":177,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:42.291396+0000","last_change":"2023-11-27T20:54:26.231237+0000","last_active":"2023-11-27T21:21:42.291396+0000","last_peered":"2023-11-27T21:21:42.291396+0000","last_clean":"2023-11-27T21:21:42.291396+0000","last_became_active":"2023-11-27T20:54:26.230963+0000","last_became_peered":"2023-11-27T20:54:26.230963+0000","last_unstale":"2023-11-27T21:21:42.291396+0000","last_undegraded":"2023-11-27T21:21:42.291396+0000","last_fullsized":"2023-11-27T21:21:42.291396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:11:24.730507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"28'195","reported_seq":225,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:16.055228+0000","last_change":"2023-11-27T20:54:31.825391+0000","last_active":"2023-11-27T21:21:16.055228+0000","last_peered":"2023-11-27T21:21:16.055228+0000","last_clean":"2023-11-27T21:21:16.055228+0000","last_became_active":"2023-11-27T20:54:31.825038+0000","last_became_peered":"2023-11-27T20:54:31.825038+0000","last_unstale":"2023-11-27T21:21:16.055228+0000","last_undegraded":"2023-11-27T21:21:16.055228+0000","last_fullsized":"2023-11-27T21:21:16.055228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:11:47.511718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":102,"num_write":164,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"28'89","reported_seq":117,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.489472+0000","last_change":"2023-11-27T20:54:27.508226+0000","last_active":"2023-11-27T21:21:49.489472+0000","last_peered":"2023-11-27T21:21:49.489472+0000","last_clean":"2023-11-27T21:21:49.489472+0000","last_became_active":"2023-11-27T20:54:27.507805+0000","last_became_peered":"2023-11-27T20:54:27.507805+0000","last_unstale":"2023-11-27T21:21:49.489472+0000","last_undegraded":"2023-11-27T21:21:49.489472+0000","last_fullsized":"2023-11-27T21:21:49.489472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:43:42.137077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'328","reported_seq":675,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:40.082191+0000","last_change":"2023-11-27T20:54:26.226915+0000","last_active":"2023-11-27T21:21:40.082191+0000","last_peered":"2023-11-27T21:21:40.082191+0000","last_clean":"2023-11-27T21:21:40.082191+0000","last_became_active":"2023-11-27T20:54:26.226679+0000","last_became_peered":"2023-11-27T20:54:26.226679+0000","last_unstale":"2023-11-27T21:21:40.082191+0000","last_undegraded":"2023-11-27T21:21:40.082191+0000","last_fullsized":"2023-11-27T21:21:40.082191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:05:08.792958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53032,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":318,"num_read_kb":327,"num_write":324,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"28'159","reported_seq":185,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:15.790221+0000","last_change":"2023-11-27T20:54:31.834934+0000","last_active":"2023-11-27T21:21:15.790221+0000","last_peered":"2023-11-27T21:21:15.790221+0000","last_clean":"2023-11-27T21:21:15.790221+0000","last_became_active":"2023-11-27T20:54:31.834569+0000","last_became_peered":"2023-11-27T20:54:31.834569+0000","last_unstale":"2023-11-27T21:21:15.790221+0000","last_undegraded":"2023-11-27T21:21:15.790221+0000","last_fullsized":"2023-11-27T21:21:15.790221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:15:51.754021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":7865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'79","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.528002+0000","last_change":"2023-11-27T20:54:27.498841+0000","last_active":"2023-11-27T21:21:49.528002+0000","last_peered":"2023-11-27T21:21:49.528002+0000","last_clean":"2023-11-27T21:21:49.528002+0000","last_became_active":"2023-11-27T20:54:27.498535+0000","last_became_peered":"2023-11-27T20:54:27.498535+0000","last_unstale":"2023-11-27T21:21:49.528002+0000","last_undegraded":"2023-11-27T21:21:49.528002+0000","last_fullsized":"2023-11-27T21:21:49.528002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:21.736684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'176","reported_seq":204,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:36.147269+0000","last_change":"2023-11-27T20:54:26.228140+0000","last_active":"2023-11-27T21:21:36.147269+0000","last_peered":"2023-11-27T21:21:36.147269+0000","last_clean":"2023-11-27T21:21:36.147269+0000","last_became_active":"2023-11-27T20:54:26.227878+0000","last_became_peered":"2023-11-27T20:54:26.227878+0000","last_unstale":"2023-11-27T21:21:36.147269+0000","last_undegraded":"2023-11-27T21:21:36.147269+0000","last_fullsized":"2023-11-27T21:21:36.147269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:21:36.965668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'104","reported_seq":130,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:14.321452+0000","last_change":"2023-11-27T20:54:31.825264+0000","last_active":"2023-11-27T21:21:14.321452+0000","last_peered":"2023-11-27T21:21:14.321452+0000","last_clean":"2023-11-27T21:21:14.321452+0000","last_became_active":"2023-11-27T20:54:31.824914+0000","last_became_peered":"2023-11-27T20:54:31.824914+0000","last_unstale":"2023-11-27T21:21:14.321452+0000","last_undegraded":"2023-11-27T21:21:14.321452+0000","last_fullsized":"2023-11-27T21:21:14.321452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:49:01.022403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":7715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"28'152","reported_seq":180,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:10.946992+0000","last_change":"2023-11-27T20:54:31.828359+0000","last_active":"2023-11-27T21:21:10.946992+0000","last_peered":"2023-11-27T21:21:10.946992+0000","last_clean":"2023-11-27T21:21:10.946992+0000","last_became_active":"2023-11-27T20:54:31.827971+0000","last_became_peered":"2023-11-27T20:54:31.827971+0000","last_unstale":"2023-11-27T21:21:10.946992+0000","last_undegraded":"2023-11-27T21:21:10.946992+0000","last_fullsized":"2023-11-27T21:21:10.946992+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:02.858386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":9456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"28'80","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.492929+0000","last_change":"2023-11-27T20:54:27.434914+0000","last_active":"2023-11-27T21:21:49.492929+0000","last_peered":"2023-11-27T21:21:49.492929+0000","last_clean":"2023-11-27T21:21:49.492929+0000","last_became_active":"2023-11-27T20:54:27.434635+0000","last_became_peered":"2023-11-27T20:54:27.434635+0000","last_unstale":"2023-11-27T21:21:49.492929+0000","last_undegraded":"2023-11-27T21:21:49.492929+0000","last_fullsized":"2023-11-27T21:21:49.492929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:59.373818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'6","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:18.070088+0000","last_change":"2023-11-27T20:54:26.224770+0000","last_active":"2023-11-27T21:21:18.070088+0000","last_peered":"2023-11-27T21:21:18.070088+0000","last_clean":"2023-11-27T21:21:18.070088+0000","last_became_active":"2023-11-27T20:54:26.224502+0000","last_became_peered":"2023-11-27T20:54:26.224502+0000","last_unstale":"2023-11-27T21:21:18.070088+0000","last_undegraded":"2023-11-27T21:21:18.070088+0000","last_fullsized":"2023-11-27T21:21:18.070088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:51:28.157451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"28'177","reported_seq":205,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:10.947037+0000","last_change":"2023-11-27T20:54:31.827147+0000","last_active":"2023-11-27T21:21:10.947037+0000","last_peered":"2023-11-27T21:21:10.947037+0000","last_clean":"2023-11-27T21:21:10.947037+0000","last_became_active":"2023-11-27T20:54:31.826790+0000","last_became_peered":"2023-11-27T20:54:31.826790+0000","last_unstale":"2023-11-27T21:21:10.947037+0000","last_undegraded":"2023-11-27T21:21:10.947037+0000","last_fullsized":"2023-11-27T21:21:10.947037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:11:33.954256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":15468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'77","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.483070+0000","last_change":"2023-11-27T20:54:27.507947+0000","last_active":"2023-11-27T21:21:49.483070+0000","last_peered":"2023-11-27T21:21:49.483070+0000","last_clean":"2023-11-27T21:21:49.483070+0000","last_became_active":"2023-11-27T20:54:27.507698+0000","last_became_peered":"2023-11-27T20:54:27.507698+0000","last_unstale":"2023-11-27T21:21:49.483070+0000","last_undegraded":"2023-11-27T21:21:49.483070+0000","last_fullsized":"2023-11-27T21:21:49.483070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:50.369518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'422","reported_seq":864,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:36.493048+0000","last_change":"2023-11-27T20:54:26.230417+0000","last_active":"2023-11-27T21:21:36.493048+0000","last_peered":"2023-11-27T21:21:36.493048+0000","last_clean":"2023-11-27T21:21:36.493048+0000","last_became_active":"2023-11-27T20:54:26.229725+0000","last_became_peered":"2023-11-27T20:54:26.229725+0000","last_unstale":"2023-11-27T21:21:36.493048+0000","last_undegraded":"2023-11-27T21:21:36.493048+0000","last_fullsized":"2023-11-27T21:21:36.493048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:01.075715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":413,"num_read_kb":420,"num_write":418,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'469","reported_seq":955,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:27.071063+0000","last_change":"2023-11-27T20:54:26.221975+0000","last_active":"2023-11-27T21:21:27.071063+0000","last_peered":"2023-11-27T21:21:27.071063+0000","last_clean":"2023-11-27T21:21:27.071063+0000","last_became_active":"2023-11-27T20:54:26.221715+0000","last_became_peered":"2023-11-27T20:54:26.221715+0000","last_unstale":"2023-11-27T21:21:27.071063+0000","last_undegraded":"2023-11-27T21:21:27.071063+0000","last_fullsized":"2023-11-27T21:21:27.071063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:15.156440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70496,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":458,"num_read_kb":466,"num_write":467,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'78","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.503170+0000","last_change":"2023-11-27T20:54:27.517213+0000","last_active":"2023-11-27T21:21:49.503170+0000","last_peered":"2023-11-27T21:21:49.503170+0000","last_clean":"2023-11-27T21:21:49.503170+0000","last_became_active":"2023-11-27T20:54:27.516887+0000","last_became_peered":"2023-11-27T20:54:27.516887+0000","last_unstale":"2023-11-27T21:21:49.503170+0000","last_undegraded":"2023-11-27T21:21:49.503170+0000","last_fullsized":"2023-11-27T21:21:49.503170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:51:29.249661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'144","reported_seq":169,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:07.511751+0000","last_change":"2023-11-27T20:54:31.827740+0000","last_active":"2023-11-27T21:21:07.511751+0000","last_peered":"2023-11-27T21:21:07.511751+0000","last_clean":"2023-11-27T21:21:07.511751+0000","last_became_active":"2023-11-27T20:54:31.827395+0000","last_became_peered":"2023-11-27T20:54:31.827395+0000","last_unstale":"2023-11-27T21:21:07.511751+0000","last_undegraded":"2023-11-27T21:21:07.511751+0000","last_fullsized":"2023-11-27T21:21:07.511751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:20:29.485550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":4976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'2868","reported_seq":2896,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.016313+0000","last_change":"2023-11-27T20:54:26.227971+0000","last_active":"2023-11-27T21:21:49.016313+0000","last_peered":"2023-11-27T21:21:49.016313+0000","last_clean":"2023-11-27T21:21:49.016313+0000","last_became_active":"2023-11-27T20:54:26.227713+0000","last_became_peered":"2023-11-27T20:54:26.227713+0000","last_unstale":"2023-11-27T21:21:49.016313+0000","last_undegraded":"2023-11-27T21:21:49.016313+0000","last_fullsized":"2023-11-27T21:21:49.016313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2868,"log_dups_size":0,"ondisk_log_size":2868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:39.965666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12113008,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2860,"num_write_kb":13160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"28'94","reported_seq":120,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.425483+0000","last_change":"2023-11-27T20:54:27.506394+0000","last_active":"2023-11-27T21:21:49.425483+0000","last_peered":"2023-11-27T21:21:49.425483+0000","last_clean":"2023-11-27T21:21:49.425483+0000","last_became_active":"2023-11-27T20:54:27.506119+0000","last_became_peered":"2023-11-27T20:54:27.506119+0000","last_unstale":"2023-11-27T21:21:49.425483+0000","last_undegraded":"2023-11-27T21:21:49.425483+0000","last_fullsized":"2023-11-27T21:21:49.425483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:21.736684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"28'135","reported_seq":160,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.951210+0000","last_change":"2023-11-27T20:54:31.833185+0000","last_active":"2023-11-27T21:21:12.951210+0000","last_peered":"2023-11-27T21:21:12.951210+0000","last_clean":"2023-11-27T21:21:12.951210+0000","last_became_active":"2023-11-27T20:54:31.832813+0000","last_became_peered":"2023-11-27T20:54:31.832813+0000","last_unstale":"2023-11-27T21:21:12.951210+0000","last_undegraded":"2023-11-27T21:21:12.951210+0000","last_fullsized":"2023-11-27T21:21:12.951210+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:13.856393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'74","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.526599+0000","last_change":"2023-11-27T20:54:27.500687+0000","last_active":"2023-11-27T21:21:49.526599+0000","last_peered":"2023-11-27T21:21:49.526599+0000","last_clean":"2023-11-27T21:21:49.526599+0000","last_became_active":"2023-11-27T20:54:27.500394+0000","last_became_peered":"2023-11-27T20:54:27.500394+0000","last_unstale":"2023-11-27T21:21:49.526599+0000","last_undegraded":"2023-11-27T21:21:49.526599+0000","last_fullsized":"2023-11-27T21:21:49.526599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:15:32.173306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"28'91","reported_seq":120,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.393968+0000","last_change":"2023-11-27T20:54:27.515441+0000","last_active":"2023-11-27T21:21:49.393968+0000","last_peered":"2023-11-27T21:21:49.393968+0000","last_clean":"2023-11-27T21:21:49.393968+0000","last_became_active":"2023-11-27T20:54:27.515173+0000","last_became_peered":"2023-11-27T20:54:27.515173+0000","last_unstale":"2023-11-27T21:21:49.393968+0000","last_undegraded":"2023-11-27T21:21:49.393968+0000","last_fullsized":"2023-11-27T21:21:49.393968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:19:36.361734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"28'79","reported_seq":109,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.498624+0000","last_change":"2023-11-27T20:54:27.506358+0000","last_active":"2023-11-27T21:21:49.498624+0000","last_peered":"2023-11-27T21:21:49.498624+0000","last_clean":"2023-11-27T21:21:49.498624+0000","last_became_active":"2023-11-27T20:54:27.506112+0000","last_became_peered":"2023-11-27T20:54:27.506112+0000","last_unstale":"2023-11-27T21:21:49.498624+0000","last_undegraded":"2023-11-27T21:21:49.498624+0000","last_fullsized":"2023-11-27T21:21:49.498624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:58.300979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'73","reported_seq":103,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.477477+0000","last_change":"2023-11-27T20:54:27.510776+0000","last_active":"2023-11-27T21:21:49.477477+0000","last_peered":"2023-11-27T21:21:49.477477+0000","last_clean":"2023-11-27T21:21:49.477477+0000","last_became_active":"2023-11-27T20:54:27.510532+0000","last_became_peered":"2023-11-27T20:54:27.510532+0000","last_unstale":"2023-11-27T21:21:49.477477+0000","last_undegraded":"2023-11-27T21:21:49.477477+0000","last_fullsized":"2023-11-27T21:21:49.477477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:36.428770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"28'58","reported_seq":87,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.400922+0000","last_change":"2023-11-27T20:54:27.513775+0000","last_active":"2023-11-27T21:21:49.400922+0000","last_peered":"2023-11-27T21:21:49.400922+0000","last_clean":"2023-11-27T21:21:49.400922+0000","last_became_active":"2023-11-27T20:54:27.513517+0000","last_became_peered":"2023-11-27T20:54:27.513517+0000","last_unstale":"2023-11-27T21:21:49.400922+0000","last_undegraded":"2023-11-27T21:21:49.400922+0000","last_fullsized":"2023-11-27T21:21:49.400922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:07:21.815516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'78","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.397802+0000","last_change":"2023-11-27T20:54:27.511798+0000","last_active":"2023-11-27T21:21:49.397802+0000","last_peered":"2023-11-27T21:21:49.397802+0000","last_clean":"2023-11-27T21:21:49.397802+0000","last_became_active":"2023-11-27T20:54:27.511559+0000","last_became_peered":"2023-11-27T20:54:27.511559+0000","last_unstale":"2023-11-27T21:21:49.397802+0000","last_undegraded":"2023-11-27T21:21:49.397802+0000","last_fullsized":"2023-11-27T21:21:49.397802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:41.057877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"28'75","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.527495+0000","last_change":"2023-11-27T20:54:27.499585+0000","last_active":"2023-11-27T21:21:49.527495+0000","last_peered":"2023-11-27T21:21:49.527495+0000","last_clean":"2023-11-27T21:21:49.527495+0000","last_became_active":"2023-11-27T20:54:27.499323+0000","last_became_peered":"2023-11-27T20:54:27.499323+0000","last_unstale":"2023-11-27T21:21:49.527495+0000","last_undegraded":"2023-11-27T21:21:49.527495+0000","last_fullsized":"2023-11-27T21:21:49.527495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:59:41.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"28'64","reported_seq":93,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.458062+0000","last_change":"2023-11-27T20:54:27.508846+0000","last_active":"2023-11-27T21:21:49.458062+0000","last_peered":"2023-11-27T21:21:49.458062+0000","last_clean":"2023-11-27T21:21:49.458062+0000","last_became_active":"2023-11-27T20:54:27.508615+0000","last_became_peered":"2023-11-27T20:54:27.508615+0000","last_unstale":"2023-11-27T21:21:49.458062+0000","last_undegraded":"2023-11-27T21:21:49.458062+0000","last_fullsized":"2023-11-27T21:21:49.458062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:53.751196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'78","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.498024+0000","last_change":"2023-11-27T20:54:27.510920+0000","last_active":"2023-11-27T21:21:49.498024+0000","last_peered":"2023-11-27T21:21:49.498024+0000","last_clean":"2023-11-27T21:21:49.498024+0000","last_became_active":"2023-11-27T20:54:27.510647+0000","last_became_peered":"2023-11-27T20:54:27.510647+0000","last_unstale":"2023-11-27T21:21:49.498024+0000","last_undegraded":"2023-11-27T21:21:49.498024+0000","last_fullsized":"2023-11-27T21:21:49.498024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:32:30.458506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"28'92","reported_seq":121,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.477139+0000","last_change":"2023-11-27T20:54:27.508596+0000","last_active":"2023-11-27T21:21:49.477139+0000","last_peered":"2023-11-27T21:21:49.477139+0000","last_clean":"2023-11-27T21:21:49.477139+0000","last_became_active":"2023-11-27T20:54:27.508360+0000","last_became_peered":"2023-11-27T20:54:27.508360+0000","last_unstale":"2023-11-27T21:21:49.477139+0000","last_undegraded":"2023-11-27T21:21:49.477139+0000","last_fullsized":"2023-11-27T21:21:49.477139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:58.794639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"28'87","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.391357+0000","last_change":"2023-11-27T20:54:27.513374+0000","last_active":"2023-11-27T21:21:49.391357+0000","last_peered":"2023-11-27T21:21:49.391357+0000","last_clean":"2023-11-27T21:21:49.391357+0000","last_became_active":"2023-11-27T20:54:27.513105+0000","last_became_peered":"2023-11-27T20:54:27.513105+0000","last_unstale":"2023-11-27T21:21:49.391357+0000","last_undegraded":"2023-11-27T21:21:49.391357+0000","last_fullsized":"2023-11-27T21:21:49.391357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:59:41.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"28'77","reported_seq":106,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.504502+0000","last_change":"2023-11-27T20:54:27.433370+0000","last_active":"2023-11-27T21:21:49.504502+0000","last_peered":"2023-11-27T21:21:49.504502+0000","last_clean":"2023-11-27T21:21:49.504502+0000","last_became_active":"2023-11-27T20:54:27.433179+0000","last_became_peered":"2023-11-27T20:54:27.433179+0000","last_unstale":"2023-11-27T21:21:49.504502+0000","last_undegraded":"2023-11-27T21:21:49.504502+0000","last_fullsized":"2023-11-27T21:21:49.504502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:01.805918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'75","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.488661+0000","last_change":"2023-11-27T20:54:27.515324+0000","last_active":"2023-11-27T21:21:49.488661+0000","last_peered":"2023-11-27T21:21:49.488661+0000","last_clean":"2023-11-27T21:21:49.488661+0000","last_became_active":"2023-11-27T20:54:27.515068+0000","last_became_peered":"2023-11-27T20:54:27.515068+0000","last_unstale":"2023-11-27T21:21:49.488661+0000","last_undegraded":"2023-11-27T21:21:49.488661+0000","last_fullsized":"2023-11-27T21:21:49.488661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:11:42.954310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"28'86","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.500364+0000","last_change":"2023-11-27T20:54:27.498621+0000","last_active":"2023-11-27T21:21:49.500364+0000","last_peered":"2023-11-27T21:21:49.500364+0000","last_clean":"2023-11-27T21:21:49.500364+0000","last_became_active":"2023-11-27T20:54:27.498306+0000","last_became_peered":"2023-11-27T20:54:27.498306+0000","last_unstale":"2023-11-27T21:21:49.500364+0000","last_undegraded":"2023-11-27T21:21:49.500364+0000","last_fullsized":"2023-11-27T21:21:49.500364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:20:24.529896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'91","reported_seq":118,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.405687+0000","last_change":"2023-11-27T20:54:27.513134+0000","last_active":"2023-11-27T21:21:49.405687+0000","last_peered":"2023-11-27T21:21:49.405687+0000","last_clean":"2023-11-27T21:21:49.405687+0000","last_became_active":"2023-11-27T20:54:27.512897+0000","last_became_peered":"2023-11-27T20:54:27.512897+0000","last_unstale":"2023-11-27T21:21:49.405687+0000","last_undegraded":"2023-11-27T21:21:49.405687+0000","last_fullsized":"2023-11-27T21:21:49.405687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:13:40.877792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"28'67","reported_seq":95,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.444605+0000","last_change":"2023-11-27T20:54:27.515196+0000","last_active":"2023-11-27T21:21:49.444605+0000","last_peered":"2023-11-27T21:21:49.444605+0000","last_clean":"2023-11-27T21:21:49.444605+0000","last_became_active":"2023-11-27T20:54:27.514946+0000","last_became_peered":"2023-11-27T20:54:27.514946+0000","last_unstale":"2023-11-27T21:21:49.444605+0000","last_undegraded":"2023-11-27T21:21:49.444605+0000","last_fullsized":"2023-11-27T21:21:49.444605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:06:07.940123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"28'80","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.442976+0000","last_change":"2023-11-27T20:54:27.493565+0000","last_active":"2023-11-27T21:21:49.442976+0000","last_peered":"2023-11-27T21:21:49.442976+0000","last_clean":"2023-11-27T21:21:49.442976+0000","last_became_active":"2023-11-27T20:54:27.493297+0000","last_became_peered":"2023-11-27T20:54:27.493297+0000","last_unstale":"2023-11-27T21:21:49.442976+0000","last_undegraded":"2023-11-27T21:21:49.442976+0000","last_fullsized":"2023-11-27T21:21:49.442976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:28:51.839397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"28'75","reported_seq":103,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.495955+0000","last_change":"2023-11-27T20:54:27.512910+0000","last_active":"2023-11-27T21:21:49.495955+0000","last_peered":"2023-11-27T21:21:49.495955+0000","last_clean":"2023-11-27T21:21:49.495955+0000","last_became_active":"2023-11-27T20:54:27.512662+0000","last_became_peered":"2023-11-27T20:54:27.512662+0000","last_unstale":"2023-11-27T21:21:49.495955+0000","last_undegraded":"2023-11-27T21:21:49.495955+0000","last_fullsized":"2023-11-27T21:21:49.495955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:52.629755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'70","reported_seq":98,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.398075+0000","last_change":"2023-11-27T20:54:27.512406+0000","last_active":"2023-11-27T21:21:49.398075+0000","last_peered":"2023-11-27T21:21:49.398075+0000","last_clean":"2023-11-27T21:21:49.398075+0000","last_became_active":"2023-11-27T20:54:27.512124+0000","last_became_peered":"2023-11-27T20:54:27.512124+0000","last_unstale":"2023-11-27T21:21:49.398075+0000","last_undegraded":"2023-11-27T21:21:49.398075+0000","last_fullsized":"2023-11-27T21:21:49.398075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:21.736684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"28'82","reported_seq":110,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.401709+0000","last_change":"2023-11-27T20:54:27.517262+0000","last_active":"2023-11-27T21:21:49.401709+0000","last_peered":"2023-11-27T21:21:49.401709+0000","last_clean":"2023-11-27T21:21:49.401709+0000","last_became_active":"2023-11-27T20:54:27.516907+0000","last_became_peered":"2023-11-27T20:54:27.516907+0000","last_unstale":"2023-11-27T21:21:49.401709+0000","last_undegraded":"2023-11-27T21:21:49.401709+0000","last_fullsized":"2023-11-27T21:21:49.401709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:05:09.885169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'68","reported_seq":96,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.492400+0000","last_change":"2023-11-27T20:54:27.515432+0000","last_active":"2023-11-27T21:21:49.492400+0000","last_peered":"2023-11-27T21:21:49.492400+0000","last_clean":"2023-11-27T21:21:49.492400+0000","last_became_active":"2023-11-27T20:54:27.515182+0000","last_became_peered":"2023-11-27T20:54:27.515182+0000","last_unstale":"2023-11-27T21:21:49.492400+0000","last_undegraded":"2023-11-27T21:21:49.492400+0000","last_fullsized":"2023-11-27T21:21:49.492400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:36.428770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'79","reported_seq":100,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.439014+0000","last_change":"2023-11-27T20:55:00.588607+0000","last_active":"2023-11-27T21:21:49.439014+0000","last_peered":"2023-11-27T21:21:49.439014+0000","last_clean":"2023-11-27T21:21:49.439014+0000","last_became_active":"2023-11-27T20:55:00.588298+0000","last_became_peered":"2023-11-27T20:55:00.588298+0000","last_unstale":"2023-11-27T21:21:49.439014+0000","last_undegraded":"2023-11-27T21:21:49.439014+0000","last_fullsized":"2023-11-27T21:21:49.439014+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:32:30.458506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'77","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.493919+0000","last_change":"2023-11-27T20:54:27.512956+0000","last_active":"2023-11-27T21:21:49.493919+0000","last_peered":"2023-11-27T21:21:49.493919+0000","last_clean":"2023-11-27T21:21:49.493919+0000","last_became_active":"2023-11-27T20:54:27.512692+0000","last_became_peered":"2023-11-27T20:54:27.512692+0000","last_unstale":"2023-11-27T21:21:49.493919+0000","last_undegraded":"2023-11-27T21:21:49.493919+0000","last_fullsized":"2023-11-27T21:21:49.493919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:53.751196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"28'75","reported_seq":102,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.398697+0000","last_change":"2023-11-27T20:54:27.499043+0000","last_active":"2023-11-27T21:21:49.398697+0000","last_peered":"2023-11-27T21:21:49.398697+0000","last_clean":"2023-11-27T21:21:49.398697+0000","last_became_active":"2023-11-27T20:54:27.498790+0000","last_became_peered":"2023-11-27T20:54:27.498790+0000","last_unstale":"2023-11-27T21:21:49.398697+0000","last_undegraded":"2023-11-27T21:21:49.398697+0000","last_fullsized":"2023-11-27T21:21:49.398697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:41.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"28'85","reported_seq":112,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.495571+0000","last_change":"2023-11-27T20:54:27.513089+0000","last_active":"2023-11-27T21:21:49.495571+0000","last_peered":"2023-11-27T21:21:49.495571+0000","last_clean":"2023-11-27T21:21:49.495571+0000","last_became_active":"2023-11-27T20:54:27.512777+0000","last_became_peered":"2023-11-27T20:54:27.512777+0000","last_unstale":"2023-11-27T21:21:49.495571+0000","last_undegraded":"2023-11-27T21:21:49.495571+0000","last_fullsized":"2023-11-27T21:21:49.495571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:32.362116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'65","reported_seq":92,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.496083+0000","last_change":"2023-11-27T20:54:27.512691+0000","last_active":"2023-11-27T21:21:49.496083+0000","last_peered":"2023-11-27T21:21:49.496083+0000","last_clean":"2023-11-27T21:21:49.496083+0000","last_became_active":"2023-11-27T20:54:27.512433+0000","last_became_peered":"2023-11-27T20:54:27.512433+0000","last_unstale":"2023-11-27T21:21:49.496083+0000","last_undegraded":"2023-11-27T21:21:49.496083+0000","last_fullsized":"2023-11-27T21:21:49.496083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:30.589702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'62","reported_seq":89,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.526396+0000","last_change":"2023-11-27T20:54:27.432322+0000","last_active":"2023-11-27T21:21:49.526396+0000","last_peered":"2023-11-27T21:21:49.526396+0000","last_clean":"2023-11-27T21:21:49.526396+0000","last_became_active":"2023-11-27T20:54:27.432152+0000","last_became_peered":"2023-11-27T20:54:27.432152+0000","last_unstale":"2023-11-27T21:21:49.526396+0000","last_undegraded":"2023-11-27T21:21:49.526396+0000","last_fullsized":"2023-11-27T21:21:49.526396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:02.167926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'69","reported_seq":96,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.497091+0000","last_change":"2023-11-27T20:54:27.516081+0000","last_active":"2023-11-27T21:21:49.497091+0000","last_peered":"2023-11-27T21:21:49.497091+0000","last_clean":"2023-11-27T21:21:49.497091+0000","last_became_active":"2023-11-27T20:54:27.515801+0000","last_became_peered":"2023-11-27T20:54:27.515801+0000","last_unstale":"2023-11-27T21:21:49.497091+0000","last_undegraded":"2023-11-27T21:21:49.497091+0000","last_fullsized":"2023-11-27T21:21:49.497091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:24:30.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'75","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.527386+0000","last_change":"2023-11-27T20:54:27.432375+0000","last_active":"2023-11-27T21:21:49.527386+0000","last_peered":"2023-11-27T21:21:49.527386+0000","last_clean":"2023-11-27T21:21:49.527386+0000","last_became_active":"2023-11-27T20:54:27.432160+0000","last_became_peered":"2023-11-27T20:54:27.432160+0000","last_unstale":"2023-11-27T21:21:49.527386+0000","last_undegraded":"2023-11-27T21:21:49.527386+0000","last_fullsized":"2023-11-27T21:21:49.527386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:36.652979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'77","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.495280+0000","last_change":"2023-11-27T20:54:27.505374+0000","last_active":"2023-11-27T21:21:49.495280+0000","last_peered":"2023-11-27T21:21:49.495280+0000","last_clean":"2023-11-27T21:21:49.495280+0000","last_became_active":"2023-11-27T20:54:27.505122+0000","last_became_peered":"2023-11-27T20:54:27.505122+0000","last_unstale":"2023-11-27T21:21:49.495280+0000","last_undegraded":"2023-11-27T21:21:49.495280+0000","last_fullsized":"2023-11-27T21:21:49.495280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:30.589702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"28'74","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.476666+0000","last_change":"2023-11-27T20:54:27.505531+0000","last_active":"2023-11-27T21:21:49.476666+0000","last_peered":"2023-11-27T21:21:49.476666+0000","last_clean":"2023-11-27T21:21:49.476666+0000","last_became_active":"2023-11-27T20:54:27.505236+0000","last_became_peered":"2023-11-27T20:54:27.505236+0000","last_unstale":"2023-11-27T21:21:49.476666+0000","last_undegraded":"2023-11-27T21:21:49.476666+0000","last_fullsized":"2023-11-27T21:21:49.476666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:56:02.651538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"28'79","reported_seq":109,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.494913+0000","last_change":"2023-11-27T20:54:27.515185+0000","last_active":"2023-11-27T21:21:49.494913+0000","last_peered":"2023-11-27T21:21:49.494913+0000","last_clean":"2023-11-27T21:21:49.494913+0000","last_became_active":"2023-11-27T20:54:27.514846+0000","last_became_peered":"2023-11-27T20:54:27.514846+0000","last_unstale":"2023-11-27T21:21:49.494913+0000","last_undegraded":"2023-11-27T21:21:49.494913+0000","last_fullsized":"2023-11-27T21:21:49.494913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:43:42.137077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":102,"num_write":4200,"num_write_kb":332069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5131,"ondisk_log_size":5131,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4855,"ondisk_log_size":4855,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":44272102,"num_objects":111,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":1673,"num_read_kb":1711,"num_write":16676,"num_write_kb":52124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":88793088,"data_stored":88544204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15183,"ondisk_log_size":15183,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509777,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95988,"kb_used_data":20396,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94275852,"statfs":{"total":96636764160,"available":96538472448,"internally_reserved":0,"allocated":20885504,"data_stored":20696148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.40200000000000002,"15min":0.40699999999999997},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.19900000000000001},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.95599999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46500000000000002,"15min":0.46400000000000002},"min":{"1min":0.30199999999999999,"5min":0.27500000000000002,"15min":0.24199999999999999},"max":{"1min":0.56399999999999995,"5min":0.58899999999999997,"15min":1.1819999999999999},"last":0.504}]},{"osd":1,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.42899999999999999,"15min":0.432},"min":{"1min":0.27100000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.78300000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.40200000000000002,"15min":0.40600000000000003},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.247},"max":{"1min":0.59599999999999997,"5min":0.59899999999999998,"15min":1.2250000000000001},"last":0.46800000000000003}]},{"osd":2,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41599999999999998,"15min":0.40999999999999998},"min":{"1min":0.30399999999999999,"5min":0.27700000000000002,"15min":0.21199999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":1.2549999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.436,"15min":0.436},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.23899999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":1.2450000000000001},"last":0.44500000000000001}]},{"osd":3,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.438},"min":{"1min":0.307,"5min":0.307,"15min":0.26800000000000002},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.87},"last":0.436},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.45600000000000002,"15min":0.44400000000000001},"min":{"1min":0.39100000000000001,"5min":0.34699999999999998,"15min":0.307},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":1.2090000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.41199999999999998,"15min":0.39700000000000002},"min":{"1min":0.25900000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.80600000000000005},"last":0.376},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.42699999999999999,"15min":0.41899999999999998},"min":{"1min":0.29499999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.64900000000000002,"5min":0.68100000000000005,"15min":0.92800000000000005},"last":0.35499999999999998}]},{"osd":5,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.41799999999999998,"15min":0.40400000000000003},"min":{"1min":0.33000000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.47899999999999998,"15min":0.45900000000000002},"min":{"1min":0.33900000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.77600000000000002},"last":0.29499999999999998}]},{"osd":7,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47199999999999998,"15min":0.46700000000000003},"min":{"1min":0.371,"5min":0.26600000000000001,"15min":0.249},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.95599999999999996},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.46600000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28199999999999997},"max":{"1min":0.79400000000000004,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.40799999999999997}]}]},{"osd":5,"up_from":15,"seq":64424509777,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94852,"kb_used_data":19260,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94276988,"statfs":{"total":96636764160,"available":96539635712,"internally_reserved":0,"allocated":19722240,"data_stored":19520171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.41199999999999998,"15min":0.40600000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.216},"max":{"1min":0.57799999999999996,"5min":1.331,"15min":1.331},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42199999999999999,"15min":0.41799999999999998},"min":{"1min":0.318,"5min":0.27900000000000003,"15min":0.222},"max":{"1min":0.49199999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.54300000000000004}]},{"osd":1,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41399999999999998,"15min":0.42399999999999999},"min":{"1min":0.307,"5min":0.224,"15min":0.221},"max":{"1min":0.56100000000000005,"5min":0.624,"15min":0.95999999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42399999999999999,"15min":0.41599999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.28599999999999998},"max":{"1min":0.59399999999999997,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.435}]},{"osd":2,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42299999999999999,"15min":0.42999999999999999},"min":{"1min":0.309,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.94599999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.438,"15min":0.42799999999999999},"min":{"1min":0.33600000000000002,"5min":0.30599999999999999,"15min":0.29899999999999999},"max":{"1min":0.61599999999999999,"5min":1.359,"15min":1.359},"last":0.59799999999999998}]},{"osd":3,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.45500000000000002,"15min":0.45000000000000001},"min":{"1min":0.35999999999999999,"5min":0.32500000000000001,"15min":0.28899999999999998},"max":{"1min":0.59099999999999997,"5min":0.64500000000000002,"15min":0.93300000000000005},"last":0.63},{"interface":"front","average":{"1min":0.432,"5min":0.47599999999999998,"15min":0.46000000000000002},"min":{"1min":0.34000000000000002,"5min":0.32600000000000001,"15min":0.30199999999999999},"max":{"1min":0.54800000000000004,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":0.47499999999999998}]},{"osd":4,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.38400000000000001,"15min":0.379},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23100000000000001},"max":{"1min":0.65800000000000003,"5min":0.66300000000000003,"15min":0.69199999999999995},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.40400000000000003,"15min":0.40300000000000002},"min":{"1min":0.29899999999999999,"5min":0.255,"15min":0.23200000000000001},"max":{"1min":0.61499999999999999,"5min":0.66800000000000004,"15min":0.70299999999999996},"last":0.375}]},{"osd":6,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.41099999999999998,"15min":0.40400000000000003},"min":{"1min":0.28299999999999997,"5min":0.27100000000000002,"15min":0.246},"max":{"1min":0.67600000000000005,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42899999999999999,"15min":0.42799999999999999},"min":{"1min":0.315,"5min":0.27100000000000002,"15min":0.23300000000000001},"max":{"1min":0.68600000000000005,"5min":0.69299999999999995,"15min":0.70399999999999996},"last":0.34499999999999997}]},{"osd":7,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.46400000000000002,"15min":0.45800000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.24199999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.311},{"interface":"front","average":{"1min":0.495,"5min":0.49399999999999999,"15min":0.49099999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.751},"last":0.39600000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509778,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53560,"kb_used_data":8496,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318280,"statfs":{"total":96636764160,"available":96581918720,"internally_reserved":0,"allocated":8699904,"data_stored":8509387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32000000000000001,"15min":0.30399999999999999},"min":{"1min":0.25,"5min":0.19600000000000001,"15min":0.17899999999999999},"max":{"1min":0.44900000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.316},"min":{"1min":0.26100000000000001,"5min":0.20200000000000001,"15min":0.17299999999999999},"max":{"1min":0.438,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.45800000000000002}]},{"osd":1,"last update":"Mon Nov 27 21:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.35899999999999999,"15min":0.34200000000000003},"min":{"1min":0.27000000000000002,"5min":0.20599999999999999,"15min":0.192},"max":{"1min":0.59299999999999997,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.36499999999999999,"15min":0.34799999999999998},"min":{"1min":0.27700000000000002,"5min":0.22900000000000001,"15min":0.20899999999999999},"max":{"1min":0.53900000000000003,"5min":0.751,"15min":0.751},"last":0.51800000000000002}]},{"osd":3,"last update":"Mon Nov 27 21:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.35899999999999999,"15min":0.34499999999999997},"min":{"1min":0.26000000000000001,"5min":0.22500000000000001,"15min":0.224},"max":{"1min":0.53200000000000003,"5min":0.55700000000000005,"15min":0.66200000000000003},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42599999999999999,"15min":0.38700000000000001},"min":{"1min":0.317,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":0.59199999999999997,"5min":0.62,"15min":0.63700000000000001},"last":0.56299999999999994}]},{"osd":4,"last update":"Mon Nov 27 21:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.49399999999999999,"15min":0.48199999999999998},"min":{"1min":0.42199999999999999,"5min":0.313,"15min":0.28199999999999997},"max":{"1min":0.59299999999999997,"5min":0.71299999999999997,"15min":0.879},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.48999999999999999,"15min":0.48399999999999999},"min":{"1min":0.40600000000000003,"5min":0.35799999999999998,"15min":0.311},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.83299999999999996},"last":0.57899999999999996}]},{"osd":5,"last update":"Mon Nov 27 21:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47299999999999998,"15min":0.47599999999999998},"min":{"1min":0.36399999999999999,"5min":0.32300000000000001,"15min":0.30399999999999999},"max":{"1min":0.628,"5min":0.69099999999999995,"15min":0.83199999999999996},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52500000000000002,"15min":0.5},"min":{"1min":0.35299999999999998,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.71099999999999997,"5min":0.77200000000000002,"15min":0.84099999999999997},"last":0.68799999999999994}]},{"osd":6,"last update":"Mon Nov 27 21:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51600000000000001,"15min":0.502},"min":{"1min":0.39100000000000001,"5min":0.372,"15min":0.34000000000000002},"max":{"1min":0.80700000000000005,"5min":0.81399999999999995,"15min":0.90900000000000003},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.503,"15min":0.496},"min":{"1min":0.40899999999999997,"5min":0.34999999999999998,"15min":0.316},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.76900000000000002},"last":0.753}]},{"osd":7,"last update":"Mon Nov 27 21:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53600000000000003,"15min":0.52300000000000002},"min":{"1min":0.39700000000000002,"5min":0.39300000000000002,"15min":0.36399999999999999},"max":{"1min":0.77000000000000002,"5min":0.79100000000000004,"15min":0.85799999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.43099999999999999,"5min":0.36099999999999999,"15min":0.34000000000000002},"max":{"1min":0.64300000000000002,"5min":0.73999999999999999,"15min":0.92400000000000004},"last":0.77000000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509778,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42852,"kb_used_data":3356,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94328988,"statfs":{"total":96636764160,"available":96592883712,"internally_reserved":0,"allocated":3436544,"data_stored":3238767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30599999999999999,"15min":0.307},"min":{"1min":0.214,"5min":0.20599999999999999,"15min":0.17000000000000001},"max":{"1min":0.47899999999999998,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.311,"5min":0.311,"15min":0.30499999999999999},"min":{"1min":0.222,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.37}]},{"osd":2,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.33000000000000002,"15min":0.309},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.188},"max":{"1min":0.54600000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.33800000000000002,"15min":0.34000000000000002},"min":{"1min":0.25900000000000001,"5min":0.22600000000000001,"15min":0.20499999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.40300000000000002}]},{"osd":3,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.37,"15min":0.36599999999999999},"min":{"1min":0.27500000000000002,"5min":0.23899999999999999,"15min":0.23300000000000001},"max":{"1min":0.441,"5min":0.626,"15min":0.68200000000000005},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.377,"15min":0.36499999999999999},"min":{"1min":0.26800000000000002,"5min":0.24399999999999999,"15min":0.22600000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.27700000000000002}]},{"osd":4,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45300000000000001,"15min":0.46999999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.26600000000000001},"max":{"1min":0.60299999999999998,"5min":0.70599999999999996,"15min":1.4510000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.47899999999999998,"15min":0.48399999999999999},"min":{"1min":0.34300000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.61799999999999999,"5min":0.84199999999999997,"15min":0.89900000000000002},"last":0.56399999999999995}]},{"osd":5,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.35399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.64300000000000002,"5min":0.81799999999999995,"15min":0.82199999999999995},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.46999999999999997,"15min":0.49099999999999999},"min":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.29999999999999999},"max":{"1min":0.67600000000000005,"5min":0.70999999999999996,"15min":1.4119999999999999},"last":0.629}]},{"osd":6,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.38200000000000001,"5min":0.36499999999999999,"15min":0.33600000000000002},"max":{"1min":0.72199999999999998,"5min":0.79800000000000004,"15min":0.92800000000000005},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.503,"15min":0.51700000000000002},"min":{"1min":0.36199999999999999,"5min":0.35899999999999999,"15min":0.34499999999999997},"max":{"1min":0.60299999999999998,"5min":0.86399999999999999,"15min":1.4239999999999999},"last":0.64300000000000002}]},{"osd":7,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.51900000000000002,"15min":0.52400000000000002},"min":{"1min":0.39900000000000002,"5min":0.371,"15min":0.33200000000000002},"max":{"1min":0.67600000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.51100000000000001,"15min":0.51600000000000001},"min":{"1min":0.39000000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.64200000000000002,"5min":0.83099999999999996,"15min":1.4399999999999999},"last":0.57699999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509777,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76024,"kb_used_data":8752,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94295816,"statfs":{"total":96636764160,"available":96558915584,"internally_reserved":0,"allocated":8962048,"data_stored":8748777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.315,"15min":0.309},"min":{"1min":0.24199999999999999,"5min":0.20100000000000001,"15min":0.186},"max":{"1min":0.44800000000000001,"5min":0.54600000000000004,"15min":0.57799999999999996},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.28799999999999998,"5min":0.31,"15min":0.311},"min":{"1min":0.219,"5min":0.219,"15min":0.19},"max":{"1min":0.42299999999999999,"5min":0.503,"15min":0.69699999999999995},"last":0.311}]},{"osd":2,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.34399999999999997,"15min":0.34100000000000003},"min":{"1min":0.223,"5min":0.223,"15min":0.189},"max":{"1min":0.48699999999999999,"5min":0.54300000000000004,"15min":0.59299999999999997},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.315,"5min":0.34999999999999998,"15min":0.34200000000000003},"min":{"1min":0.25900000000000001,"5min":0.223,"15min":0.19900000000000001},"max":{"1min":0.40100000000000002,"5min":0.55500000000000005,"15min":0.66900000000000004},"last":0.34699999999999998}]},{"osd":3,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.36099999999999999,"15min":0.34699999999999998},"min":{"1min":0.25600000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.44900000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39400000000000002,"15min":0.38100000000000001},"min":{"1min":0.25800000000000001,"5min":0.253,"15min":0.21099999999999999},"max":{"1min":0.58399999999999996,"5min":0.59699999999999998,"15min":0.61599999999999999},"last":0.36499999999999999}]},{"osd":4,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.44800000000000001,"15min":0.45900000000000002},"min":{"1min":0.32300000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":1.3009999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46899999999999997,"15min":0.47399999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.27200000000000002},"max":{"1min":0.56599999999999995,"5min":0.71199999999999997,"15min":1.1220000000000001},"last":0.44600000000000001}]},{"osd":5,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.50700000000000001,"15min":0.5},"min":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.32700000000000001},"max":{"1min":0.58499999999999996,"5min":0.81499999999999995,"15min":1.1930000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46600000000000003,"15min":0.46700000000000003},"min":{"1min":0.36099999999999999,"5min":0.35099999999999998,"15min":0.317},"max":{"1min":0.63700000000000001,"5min":0.753,"15min":1.3180000000000001},"last":0.45800000000000002}]},{"osd":6,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.31900000000000001},"max":{"1min":0.73099999999999998,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.505,"5min":0.52500000000000002,"15min":0.52200000000000002},"min":{"1min":0.41599999999999998,"5min":0.36799999999999999,"15min":0.34499999999999997},"max":{"1min":0.60899999999999999,"5min":0.85699999999999998,"15min":1.282},"last":0.46899999999999997}]},{"osd":7,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.33500000000000002},"max":{"1min":0.65200000000000002,"5min":0.89300000000000002,"15min":1.171},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48899999999999999,"15min":0.498},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":1.2589999999999999},"last":0.50900000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542482,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52808,"kb_used_data":7744,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94319032,"statfs":{"total":96636764160,"available":96582688768,"internally_reserved":0,"allocated":7929856,"data_stored":7711066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":46135755},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:21:01 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.39400000000000002,"15min":0.39900000000000002},"min":{"1min":0.26100000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.61499999999999999,"5min":0.63300000000000001,"15min":0.82899999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41499999999999998,"15min":0.42799999999999999},"min":{"1min":0.27000000000000002,"5min":0.26200000000000001,"15min":0.22900000000000001},"max":{"1min":0.48699999999999999,"5min":0.57599999999999996,"15min":0.61399999999999999},"last":0.46400000000000002}]},{"osd":1,"last update":"Mon Nov 27 21:21:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42399999999999999,"15min":0.432},"min":{"1min":0.26800000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.88500000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.373,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.59099999999999997,"5min":0.59199999999999997,"15min":0.873},"last":0.47799999999999998}]},{"osd":2,"last update":"Mon Nov 27 21:21:01 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.41999999999999998,"15min":0.435},"min":{"1min":0.34699999999999998,"5min":0.29399999999999998,"15min":0.27000000000000002},"max":{"1min":0.56699999999999995,"5min":0.65300000000000002,"15min":0.79700000000000004},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.41399999999999998,"15min":0.41999999999999998},"min":{"1min":0.29599999999999999,"5min":0.27000000000000002,"15min":0.247},"max":{"1min":0.496,"5min":0.55200000000000005,"15min":0.68700000000000006},"last":0.501}]},{"osd":3,"last update":"Mon Nov 27 21:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.442,"15min":0.44900000000000001},"min":{"1min":0.29599999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.77100000000000002},"last":0.432},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.45900000000000002,"15min":0.45100000000000001},"min":{"1min":0.36799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.90200000000000002},"last":0.51300000000000001}]},{"osd":4,"last update":"Mon Nov 27 21:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.39800000000000002,"15min":0.40200000000000002},"min":{"1min":0.30099999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.55300000000000005,"5min":0.59199999999999997,"15min":0.70099999999999996},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.41499999999999998,"15min":0.42199999999999999},"min":{"1min":0.307,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.745},"last":0.30499999999999999}]},{"osd":5,"last update":"Mon Nov 27 21:21:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.45200000000000001,"15min":0.44400000000000001},"min":{"1min":0.30499999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.438,"15min":0.44600000000000001},"min":{"1min":0.32400000000000001,"5min":0.26400000000000001,"15min":0.248},"max":{"1min":0.70299999999999996,"5min":0.71499999999999997,"15min":0.77700000000000002},"last":0.379}]},{"osd":6,"last update":"Mon Nov 27 21:21:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45700000000000002,"15min":0.46000000000000002},"min":{"1min":0.35499999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52600000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.496,"15min":0.499},"min":{"1min":0.35799999999999998,"5min":0.29099999999999998,"15min":0.28100000000000003},"max":{"1min":0.751,"5min":0.751,"15min":0.84999999999999998},"last":0.39600000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542482,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57800,"kb_used_data":8576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94314040,"statfs":{"total":96636764160,"available":96577576960,"internally_reserved":0,"allocated":8781824,"data_stored":8552244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,3,5,48,9,32,9,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41499999999999998,"15min":0.40600000000000003},"min":{"1min":0.27900000000000003,"5min":0.248,"15min":0.20200000000000001},"max":{"1min":0.58599999999999997,"5min":0.59299999999999997,"15min":0.66100000000000003},"last":1.446},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44700000000000001,"15min":0.435},"min":{"1min":0.29399999999999998,"5min":0.28299999999999997,"15min":0.24099999999999999},"max":{"1min":0.60499999999999998,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":3.948}]},{"osd":1,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.41499999999999998,"15min":0.41699999999999998},"min":{"1min":0.309,"5min":0.30199999999999999,"15min":0.24099999999999999},"max":{"1min":0.52800000000000002,"5min":0.626,"15min":0.65100000000000002},"last":5.0410000000000004},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42599999999999999,"15min":0.41599999999999998},"min":{"1min":0.33800000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.50600000000000001,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":1.181}]},{"osd":2,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.42599999999999999,"15min":0.42699999999999999},"min":{"1min":0.34000000000000002,"5min":0.29499999999999998,"15min":0.26100000000000001},"max":{"1min":0.622,"5min":0.64300000000000002,"15min":0.745},"last":1.5089999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.441,"15min":0.44600000000000001},"min":{"1min":0.307,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":0.51700000000000002,"5min":0.65200000000000002,"15min":0.78100000000000003},"last":4.008}]},{"osd":3,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.47799999999999998,"15min":0.46800000000000003},"min":{"1min":0.38800000000000001,"5min":0.318,"15min":0.29899999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.79200000000000004},"last":1.532},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46200000000000002,"15min":0.45500000000000002},"min":{"1min":0.35799999999999998,"5min":0.32600000000000001,"15min":0.28499999999999998},"max":{"1min":0.55100000000000005,"5min":0.63400000000000001,"15min":0.68500000000000005},"last":10.747999999999999}]},{"osd":5,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41499999999999998,"15min":0.39400000000000002},"min":{"1min":0.26300000000000001,"5min":0.23100000000000001,"15min":0.221},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":20.847999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40799999999999997,"15min":0.41199999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23100000000000001},"max":{"1min":0.55400000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":5.0800000000000001}]},{"osd":6,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.42999999999999999,"15min":0.41799999999999998},"min":{"1min":0.29899999999999999,"5min":0.26800000000000002,"15min":0.24399999999999999},"max":{"1min":0.60599999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.48999999999999999,"15min":0.46800000000000003},"min":{"1min":0.35099999999999998,"5min":0.28100000000000003,"15min":0.27400000000000002},"max":{"1min":0.66000000000000003,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":1.478}]},{"osd":7,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46200000000000002,"15min":0.45500000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.64300000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":1.113},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.434,"5min":0.35199999999999998,"15min":0.33400000000000002},"max":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":3.4649999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542482,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89188,"kb_used_data":13596,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94282652,"statfs":{"total":96636764160,"available":96545435648,"internally_reserved":0,"allocated":13922304,"data_stored":13708692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.311,"15min":0.312},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.47899999999999998,"5min":0.52400000000000002,"15min":0.56499999999999995},"last":0.254},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.31,"15min":0.307},"min":{"1min":0.21099999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.56999999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.29099999999999998}]},{"osd":1,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.29499999999999998,"5min":0.30099999999999999,"15min":0.309},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.39300000000000002,"5min":0.45800000000000002,"15min":1.0249999999999999},"last":0.317},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.35899999999999999,"15min":0.34999999999999998},"min":{"1min":0.23999999999999999,"5min":0.23000000000000001,"15min":0.21199999999999999},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":1.0069999999999999},"last":0.33400000000000002}]},{"osd":2,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36699999999999999,"15min":0.36799999999999999},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.22600000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":1.046},"last":0.377},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.371},"min":{"1min":0.27700000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.59899999999999998,"5min":0.623,"15min":0.69999999999999996},"last":0.35799999999999998}]},{"osd":4,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45200000000000001,"15min":0.46200000000000002},"min":{"1min":0.35099999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.59099999999999997,"5min":0.69799999999999995,"15min":0.93799999999999994},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.47599999999999998,"15min":0.48399999999999999},"min":{"1min":0.39400000000000002,"5min":0.34499999999999997,"15min":0.314},"max":{"1min":0.65900000000000003,"5min":0.71199999999999997,"15min":0.73999999999999999},"last":0.47899999999999998}]},{"osd":5,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48399999999999999,"15min":0.48599999999999999},"min":{"1min":0.42099999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.71499999999999997,"5min":0.75,"15min":0.75},"last":0.505},{"interface":"front","average":{"1min":0.502,"5min":0.495,"15min":0.50600000000000001},"min":{"1min":0.373,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67900000000000005,"5min":0.78600000000000003,"15min":1.071},"last":0.46899999999999997}]},{"osd":6,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.495,"15min":0.504},"min":{"1min":0.39100000000000001,"5min":0.36599999999999999,"15min":0.311},"max":{"1min":0.61299999999999999,"5min":0.65400000000000003,"15min":0.97899999999999998},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.49199999999999999,"15min":0.5},"min":{"1min":0.35999999999999999,"5min":0.35599999999999998,"15min":0.314},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.46000000000000002}]},{"osd":7,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51500000000000001,"15min":0.52200000000000002},"min":{"1min":0.40699999999999997,"5min":0.36099999999999999,"15min":0.35999999999999999},"max":{"1min":0.66800000000000004,"5min":0.75800000000000001,"15min":1.0900000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51900000000000002,"15min":0.52200000000000002},"min":{"1min":0.42199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68999999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.51700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8667136,"data_stored":8628738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2547712,"data_stored":2528360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13627392,"data_stored":13588653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8486912,"data_stored":8432205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18833408,"data_stored":18809764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20590592,"data_stored":20576109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7634944,"data_stored":7591027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T21:21:56.645 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-27T21:21:56.645 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T21:21:56.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.778+0000 7fad82e23640 1 Processor -- start 2023-11-27T21:21:56.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.778+0000 7fad82e23640 1 -- start start 2023-11-27T21:21:56.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.779+0000 7fad82e23640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fad7c151220 0x7fad7c06ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:56.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.779+0000 7fad82e23640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fad7c157240 0x7fad7c0c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:56.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.779+0000 7fad82e23640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad7c1577f0 con 0x7fad7c0c4610 2023-11-27T21:21:56.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.779+0000 7fad82e23640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad7c157a90 con 0x7fad7c151220 2023-11-27T21:21:56.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.779+0000 7fad82e23640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad7c157d30 con 0x7fad7c157240 2023-11-27T21:21:56.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.779+0000 7fad80bbf640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fad7c151220 0x7fad7c06ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:56.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.779+0000 7fad7bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fad7c157240 0x7fad7c0c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:56.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.780+0000 7fad7bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fad7c157240 0x7fad7c0c40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:51600/0 (socket says 172.21.15.88:51600) 2023-11-27T21:21:56.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.780+0000 7fad7bfff640 1 -- 172.21.15.88:0/252327675 learned_addr learned my addr 172.21.15.88:0/252327675 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:56.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.782+0000 7fad7bfff640 1 -- 172.21.15.88:0/252327675 >> v2:172.21.15.88:3300/0 conn(0x7fad7c151220 msgr2=0x7fad7c06ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:21:56.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.782+0000 7fad7bfff640 1 --2- 172.21.15.88:0/252327675 >> v2:172.21.15.88:3300/0 conn(0x7fad7c151220 0x7fad7c06ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:56.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.782+0000 7fad7bfff640 1 -- 172.21.15.88:0/252327675 >> v1:172.21.15.88:6789/0 conn(0x7fad7c0c4610 legacy=0x7fad7c0710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:56.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.782+0000 7fad7bfff640 1 -- 172.21.15.88:0/252327675 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7c157ff0 con 0x7fad7c157240 2023-11-27T21:21:56.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.784+0000 7fad7bfff640 1 --2- 172.21.15.88:0/252327675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad7c157240 0x7fad7c0c40d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fad7c06d5e0 tx=0x7fad6802ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2da6fb43a4d8de23 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:56.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.788+0000 7fad7b7fe640 1 -- 172.21.15.88:0/252327675 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6802f850 con 0x7fad7c157240 2023-11-27T21:21:56.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.788+0000 7fad7b7fe640 1 -- 172.21.15.88:0/252327675 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6802f9b0 con 0x7fad7c157240 2023-11-27T21:21:56.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.788+0000 7fad7b7fe640 1 -- 172.21.15.88:0/252327675 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6802fd40 con 0x7fad7c157240 2023-11-27T21:21:56.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.789+0000 7fad82e23640 1 -- 172.21.15.88:0/252327675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad7c157240 msgr2=0x7fad7c0c40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:56.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.789+0000 7fad82e23640 1 --2- 172.21.15.88:0/252327675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad7c157240 0x7fad7c0c40d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fad7c06d5e0 tx=0x7fad6802ba30 comp rx=0 tx=0).stop 2023-11-27T21:21:56.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.789+0000 7fad82e23640 1 -- 172.21.15.88:0/252327675 shutdown_connections 2023-11-27T21:21:56.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.789+0000 7fad82e23640 1 --2- 172.21.15.88:0/252327675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad7c157240 0x7fad7c0c40d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:56.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.789+0000 7fad82e23640 1 --2- 172.21.15.88:0/252327675 >> v2:172.21.15.88:3300/0 conn(0x7fad7c151220 0x7fad7c06ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:56.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.789+0000 7fad82e23640 1 -- 172.21.15.88:0/252327675 >> 172.21.15.88:0/252327675 conn(0x7fad7c06c5f0 msgr2=0x7fad7c06c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:56.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.789+0000 7fad82e23640 1 -- 172.21.15.88:0/252327675 shutdown_connections 2023-11-27T21:21:56.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.789+0000 7fad82e23640 1 -- 172.21.15.88:0/252327675 wait complete. 2023-11-27T21:21:56.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.790+0000 7fad82e23640 1 Processor -- start 2023-11-27T21:21:56.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.790+0000 7fad82e23640 1 -- start start 2023-11-27T21:21:56.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.791+0000 7fad82e23640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad7c0c4610 0x7fad7c155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:56.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.791+0000 7fad82e23640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad7c151220 0x7fad7c143640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:56.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.791+0000 7fad82e23640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad7c157240 0x7fad7c143b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:56.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.791+0000 7fad82e23640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c156670 con 0x7fad7c157240 2023-11-27T21:21:56.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.791+0000 7fad82e23640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c0cac90 con 0x7fad7c0c4610 2023-11-27T21:21:56.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.791+0000 7fad82e23640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c155bd0 con 0x7fad7c151220 2023-11-27T21:21:56.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.791+0000 7fad813c0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad7c157240 0x7fad7c143b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:56.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.791+0000 7fad80bbf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad7c0c4610 0x7fad7c155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:56.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.791+0000 7fad7bfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad7c151220 0x7fad7c143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:56.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.792+0000 7fad813c0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad7c157240 0x7fad7c143b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47136/0 (socket says 172.21.15.88:47136) 2023-11-27T21:21:56.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.792+0000 7fad813c0640 1 -- 172.21.15.88:0/573058593 learned_addr learned my addr 172.21.15.88:0/573058593 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:56.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.795+0000 7fad813c0640 1 -- 172.21.15.88:0/573058593 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad7c151220 msgr2=0x7fad7c143640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:56.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.795+0000 7fad813c0640 1 --2- 172.21.15.88:0/573058593 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad7c151220 0x7fad7c143640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:56.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.795+0000 7fad813c0640 1 -- 172.21.15.88:0/573058593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad7c0c4610 msgr2=0x7fad7c155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:56.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.795+0000 7fad813c0640 1 --2- 172.21.15.88:0/573058593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad7c0c4610 0x7fad7c155690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:56.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.795+0000 7fad813c0640 1 -- 172.21.15.88:0/573058593 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad680094d0 con 0x7fad7c157240 2023-11-27T21:21:56.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.797+0000 7fad813c0640 1 --2- 172.21.15.88:0/573058593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad7c157240 0x7fad7c143b80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fad7400c6e0 tx=0x7fad7400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:56.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.801+0000 7fad797fa640 1 -- 172.21.15.88:0/573058593 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad74003b70 con 0x7fad7c157240 2023-11-27T21:21:56.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.801+0000 7fad797fa640 1 -- 172.21.15.88:0/573058593 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad74003cf0 con 0x7fad7c157240 2023-11-27T21:21:56.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.801+0000 7fad797fa640 1 -- 172.21.15.88:0/573058593 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad74005310 con 0x7fad7c157240 2023-11-27T21:21:56.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.801+0000 7fad82e23640 1 -- 172.21.15.88:0/573058593 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad7c155df0 con 0x7fad7c157240 2023-11-27T21:21:56.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.801+0000 7fad82e23640 1 -- 172.21.15.88:0/573058593 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7c156e70 con 0x7fad7c157240 2023-11-27T21:21:56.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:56.802+0000 7fad82e23640 1 -- 172.21.15.88:0/573058593 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad7c072020 con 0x7fad7c157240 2023-11-27T21:21:57.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.050+0000 7fad797fa640 1 -- 172.21.15.88:0/573058593 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fad74005470 con 0x7fad7c157240 2023-11-27T21:21:57.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.050+0000 7fad797fa640 1 --2- 172.21.15.88:0/573058593 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fad6006b240 0x7fad6006d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:57.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.050+0000 7fad80bbf640 1 --2- 172.21.15.88:0/573058593 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fad6006b240 0x7fad6006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:57.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.051+0000 7fad80bbf640 1 --2- 172.21.15.88:0/573058593 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fad6006b240 0x7fad6006d700 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fad70009b40 tx=0x7fad70009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:57.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.065+0000 7fad797fa640 1 -- 172.21.15.88:0/573058593 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fad74058bc0 con 0x7fad7c157240 2023-11-27T21:21:57.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.065+0000 7fad797fa640 1 -- 172.21.15.88:0/573058593 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fad74054f00 con 0x7fad7c157240 2023-11-27T21:21:57.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.234+0000 7fad82e23640 1 -- 172.21.15.88:0/573058593 --> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fad7c06f2a0 con 0x7fad6006b240 2023-11-27T21:21:57.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.243+0000 7fad797fa640 1 -- 172.21.15.88:0/573058593 <== mgr.4105 v2:172.21.15.88:6800/352455703 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371094 (secure 0 0 0) 0x7fad70011a60 con 0x7fad6006b240 2023-11-27T21:21:57.249 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T21:21:57.251 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-11-27T21:21:57.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.246+0000 7fad82e23640 1 -- 172.21.15.88:0/573058593 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fad6006b240 msgr2=0x7fad6006d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:57.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.246+0000 7fad82e23640 1 --2- 172.21.15.88:0/573058593 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fad6006b240 0x7fad6006d700 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fad70009b40 tx=0x7fad70009190 comp rx=0 tx=0).stop 2023-11-27T21:21:57.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.246+0000 7fad82e23640 1 -- 172.21.15.88:0/573058593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad7c157240 msgr2=0x7fad7c143b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:57.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.246+0000 7fad82e23640 1 --2- 172.21.15.88:0/573058593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad7c157240 0x7fad7c143b80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fad7400c6e0 tx=0x7fad7400cba0 comp rx=0 tx=0).stop 2023-11-27T21:21:57.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.246+0000 7fad82e23640 1 -- 172.21.15.88:0/573058593 shutdown_connections 2023-11-27T21:21:57.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.246+0000 7fad82e23640 1 --2- 172.21.15.88:0/573058593 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fad6006b240 0x7fad6006d700 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:57.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.246+0000 7fad82e23640 1 --2- 172.21.15.88:0/573058593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad7c157240 0x7fad7c143b80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:57.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.246+0000 7fad82e23640 1 --2- 172.21.15.88:0/573058593 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad7c151220 0x7fad7c143640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:57.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.246+0000 7fad82e23640 1 --2- 172.21.15.88:0/573058593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad7c0c4610 0x7fad7c155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:57.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.246+0000 7fad82e23640 1 -- 172.21.15.88:0/573058593 >> 172.21.15.88:0/573058593 conn(0x7fad7c06c5f0 msgr2=0x7fad7c14e810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:57.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.246+0000 7fad82e23640 1 -- 172.21.15.88:0/573058593 shutdown_connections 2023-11-27T21:21:57.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.246+0000 7fad82e23640 1 -- 172.21.15.88:0/573058593 wait complete. 2023-11-27T21:21:57.259 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":856,"stamp":"2023-11-27T21:21:55.265714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":44862470,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":1793,"num_read_kb":1913,"num_write":21035,"num_write_kb":386609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25286,"ondisk_log_size":25286,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":563072,"kb_used_data":90176,"kb_used_omap":12,"kb_used_meta":472819,"kb_avail":754411648,"statfs":{"total":773094113280,"available":772517527552,"internally_reserved":0,"allocated":92340224,"data_stored":90685252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":484167217},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,3,5,48,9,32,9,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":65,"apply_latency_ms":65,"commit_latency_ns":65000000,"apply_latency_ns":65000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16384,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":38,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003000"},"pg_stats":[{"pgid":"2.1f","version":"28'332","reported_seq":363,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.011175+0000","last_change":"2023-11-27T20:54:26.222003+0000","last_active":"2023-11-27T21:21:49.011175+0000","last_peered":"2023-11-27T21:21:49.011175+0000","last_clean":"2023-11-27T21:21:49.011175+0000","last_became_active":"2023-11-27T20:54:26.221715+0000","last_became_peered":"2023-11-27T20:54:26.221715+0000","last_unstale":"2023-11-27T21:21:49.011175+0000","last_undegraded":"2023-11-27T21:21:49.011175+0000","last_fullsized":"2023-11-27T21:21:49.011175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:36:45.301515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922212,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":1068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"28'71","reported_seq":101,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.476594+0000","last_change":"2023-11-27T20:54:27.508401+0000","last_active":"2023-11-27T21:21:49.476594+0000","last_peered":"2023-11-27T21:21:49.476594+0000","last_clean":"2023-11-27T21:21:49.476594+0000","last_became_active":"2023-11-27T20:54:27.508003+0000","last_became_peered":"2023-11-27T20:54:27.508003+0000","last_unstale":"2023-11-27T21:21:49.476594+0000","last_undegraded":"2023-11-27T21:21:49.476594+0000","last_fullsized":"2023-11-27T21:21:49.476594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:11:42.954310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"28'159","reported_seq":185,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.951498+0000","last_change":"2023-11-27T20:54:31.837226+0000","last_active":"2023-11-27T21:21:12.951498+0000","last_peered":"2023-11-27T21:21:12.951498+0000","last_clean":"2023-11-27T21:21:12.951498+0000","last_became_active":"2023-11-27T20:54:31.836803+0000","last_became_peered":"2023-11-27T20:54:31.836803+0000","last_unstale":"2023-11-27T21:21:12.951498+0000","last_undegraded":"2023-11-27T21:21:12.951498+0000","last_fullsized":"2023-11-27T21:21:12.951498+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:06.363326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":7710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'738","reported_seq":769,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:24.329906+0000","last_change":"2023-11-27T20:54:26.227906+0000","last_active":"2023-11-27T21:21:24.329906+0000","last_peered":"2023-11-27T21:21:24.329906+0000","last_clean":"2023-11-27T21:21:24.329906+0000","last_became_active":"2023-11-27T20:54:26.227620+0000","last_became_peered":"2023-11-27T20:54:26.227620+0000","last_unstale":"2023-11-27T21:21:24.329906+0000","last_undegraded":"2023-11-27T21:21:24.329906+0000","last_fullsized":"2023-11-27T21:21:24.329906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:35.560769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":733,"num_write_kb":4484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"28'77","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.476122+0000","last_change":"2023-11-27T20:54:27.507740+0000","last_active":"2023-11-27T21:21:49.476122+0000","last_peered":"2023-11-27T21:21:49.476122+0000","last_clean":"2023-11-27T21:21:49.476122+0000","last_became_active":"2023-11-27T20:54:27.507460+0000","last_became_peered":"2023-11-27T20:54:27.507460+0000","last_unstale":"2023-11-27T21:21:49.476122+0000","last_undegraded":"2023-11-27T21:21:49.476122+0000","last_fullsized":"2023-11-27T21:21:49.476122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:24:30.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"28'166","reported_seq":201,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:09.269897+0000","last_change":"2023-11-27T20:55:00.593902+0000","last_active":"2023-11-27T21:21:09.269897+0000","last_peered":"2023-11-27T21:21:09.269897+0000","last_clean":"2023-11-27T21:21:09.269897+0000","last_became_active":"2023-11-27T20:55:00.593543+0000","last_became_peered":"2023-11-27T20:55:00.593543+0000","last_unstale":"2023-11-27T21:21:09.269897+0000","last_undegraded":"2023-11-27T21:21:09.269897+0000","last_fullsized":"2023-11-27T21:21:09.269897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:57:38.465675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":12743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"28'180","reported_seq":208,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:36.501028+0000","last_change":"2023-11-27T20:54:26.226645+0000","last_active":"2023-11-27T21:21:36.501028+0000","last_peered":"2023-11-27T21:21:36.501028+0000","last_clean":"2023-11-27T21:21:36.501028+0000","last_became_active":"2023-11-27T20:54:26.226407+0000","last_became_peered":"2023-11-27T20:54:26.226407+0000","last_unstale":"2023-11-27T21:21:36.501028+0000","last_undegraded":"2023-11-27T21:21:36.501028+0000","last_fullsized":"2023-11-27T21:21:36.501028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:32:19.691350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'78","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.391101+0000","last_change":"2023-11-27T20:54:27.512803+0000","last_active":"2023-11-27T21:21:49.391101+0000","last_peered":"2023-11-27T21:21:49.391101+0000","last_clean":"2023-11-27T21:21:49.391101+0000","last_became_active":"2023-11-27T20:54:27.512548+0000","last_became_peered":"2023-11-27T20:54:27.512548+0000","last_unstale":"2023-11-27T21:21:49.391101+0000","last_undegraded":"2023-11-27T21:21:49.391101+0000","last_fullsized":"2023-11-27T21:21:49.391101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:36.652979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"28'164","reported_seq":189,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:11.314014+0000","last_change":"2023-11-27T20:54:31.828391+0000","last_active":"2023-11-27T21:21:11.314014+0000","last_peered":"2023-11-27T21:21:11.314014+0000","last_clean":"2023-11-27T21:21:11.314014+0000","last_became_active":"2023-11-27T20:54:31.828045+0000","last_became_peered":"2023-11-27T20:54:31.828045+0000","last_unstale":"2023-11-27T21:21:11.314014+0000","last_undegraded":"2023-11-27T21:21:11.314014+0000","last_fullsized":"2023-11-27T21:21:11.314014+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:58.308604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":12089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"28'9","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:33.519716+0000","last_change":"2023-11-27T20:54:26.226762+0000","last_active":"2023-11-27T21:21:33.519716+0000","last_peered":"2023-11-27T21:21:33.519716+0000","last_clean":"2023-11-27T21:21:33.519716+0000","last_became_active":"2023-11-27T20:54:26.226522+0000","last_became_peered":"2023-11-27T20:54:26.226522+0000","last_unstale":"2023-11-27T21:21:33.519716+0000","last_undegraded":"2023-11-27T21:21:33.519716+0000","last_fullsized":"2023-11-27T21:21:33.519716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:31.269905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"28'85","reported_seq":119,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.446167+0000","last_change":"2023-11-27T20:55:00.790042+0000","last_active":"2023-11-27T21:21:49.446167+0000","last_peered":"2023-11-27T21:21:49.446167+0000","last_clean":"2023-11-27T21:21:49.446167+0000","last_became_active":"2023-11-27T20:55:00.789772+0000","last_became_peered":"2023-11-27T20:55:00.789772+0000","last_unstale":"2023-11-27T21:21:49.446167+0000","last_undegraded":"2023-11-27T21:21:49.446167+0000","last_fullsized":"2023-11-27T21:21:49.446167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:51:32.237462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"28'169","reported_seq":194,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:07.313840+0000","last_change":"2023-11-27T20:54:31.828759+0000","last_active":"2023-11-27T21:21:07.313840+0000","last_peered":"2023-11-27T21:21:07.313840+0000","last_clean":"2023-11-27T21:21:07.313840+0000","last_became_active":"2023-11-27T20:54:31.828371+0000","last_became_peered":"2023-11-27T20:54:31.828371+0000","last_unstale":"2023-11-27T21:21:07.313840+0000","last_undegraded":"2023-11-27T21:21:07.313840+0000","last_fullsized":"2023-11-27T21:21:07.313840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:40.986177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":6774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"28'74","reported_seq":103,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.445340+0000","last_change":"2023-11-27T20:54:27.498572+0000","last_active":"2023-11-27T21:21:49.445340+0000","last_peered":"2023-11-27T21:21:49.445340+0000","last_clean":"2023-11-27T21:21:49.445340+0000","last_became_active":"2023-11-27T20:54:27.498279+0000","last_became_peered":"2023-11-27T20:54:27.498279+0000","last_unstale":"2023-11-27T21:21:49.445340+0000","last_undegraded":"2023-11-27T21:21:49.445340+0000","last_fullsized":"2023-11-27T21:21:49.445340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:23:57.929109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'1121","reported_seq":1151,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:35.299616+0000","last_change":"2023-11-27T20:54:26.227734+0000","last_active":"2023-11-27T21:21:35.299616+0000","last_peered":"2023-11-27T21:21:35.299616+0000","last_clean":"2023-11-27T21:21:35.299616+0000","last_became_active":"2023-11-27T20:54:26.227503+0000","last_became_peered":"2023-11-27T20:54:26.227503+0000","last_unstale":"2023-11-27T21:21:35.299616+0000","last_undegraded":"2023-11-27T21:21:35.299616+0000","last_fullsized":"2023-11-27T21:21:35.299616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1121,"log_dups_size":0,"ondisk_log_size":1121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:08.206775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1114,"num_write_kb":4562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"28'173","reported_seq":200,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:15.784237+0000","last_change":"2023-11-27T20:54:31.827976+0000","last_active":"2023-11-27T21:21:15.784237+0000","last_peered":"2023-11-27T21:21:15.784237+0000","last_clean":"2023-11-27T21:21:15.784237+0000","last_became_active":"2023-11-27T20:54:31.827631+0000","last_became_peered":"2023-11-27T20:54:31.827631+0000","last_unstale":"2023-11-27T21:21:15.784237+0000","last_undegraded":"2023-11-27T21:21:15.784237+0000","last_fullsized":"2023-11-27T21:21:15.784237+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:58:58.404897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":8292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"28'70","reported_seq":98,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.390638+0000","last_change":"2023-11-27T20:54:27.510917+0000","last_active":"2023-11-27T21:21:49.390638+0000","last_peered":"2023-11-27T21:21:49.390638+0000","last_clean":"2023-11-27T21:21:49.390638+0000","last_became_active":"2023-11-27T20:54:27.510668+0000","last_became_peered":"2023-11-27T20:54:27.510668+0000","last_unstale":"2023-11-27T21:21:49.390638+0000","last_undegraded":"2023-11-27T21:21:49.390638+0000","last_fullsized":"2023-11-27T21:21:49.390638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:27:15.390631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'447","reported_seq":477,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:42.292239+0000","last_change":"2023-11-27T20:54:26.231461+0000","last_active":"2023-11-27T21:21:42.292239+0000","last_peered":"2023-11-27T21:21:42.292239+0000","last_clean":"2023-11-27T21:21:42.292239+0000","last_became_active":"2023-11-27T20:54:26.231081+0000","last_became_peered":"2023-11-27T20:54:26.231081+0000","last_unstale":"2023-11-27T21:21:42.292239+0000","last_undegraded":"2023-11-27T21:21:42.292239+0000","last_fullsized":"2023-11-27T21:21:42.292239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:35.560769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"28'191","reported_seq":218,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:16.059056+0000","last_change":"2023-11-27T20:54:31.817058+0000","last_active":"2023-11-27T21:21:16.059056+0000","last_peered":"2023-11-27T21:21:16.059056+0000","last_clean":"2023-11-27T21:21:16.059056+0000","last_became_active":"2023-11-27T20:54:31.816700+0000","last_became_peered":"2023-11-27T20:54:31.816700+0000","last_unstale":"2023-11-27T21:21:16.059056+0000","last_undegraded":"2023-11-27T21:21:16.059056+0000","last_fullsized":"2023-11-27T21:21:16.059056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:02.384459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":12458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"28'73","reported_seq":102,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.481340+0000","last_change":"2023-11-27T20:54:27.510195+0000","last_active":"2023-11-27T21:21:49.481340+0000","last_peered":"2023-11-27T21:21:49.481340+0000","last_clean":"2023-11-27T21:21:49.481340+0000","last_became_active":"2023-11-27T20:54:27.509961+0000","last_became_peered":"2023-11-27T20:54:27.509961+0000","last_unstale":"2023-11-27T21:21:49.481340+0000","last_undegraded":"2023-11-27T21:21:49.481340+0000","last_fullsized":"2023-11-27T21:21:49.481340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:15:47.196613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'335","reported_seq":365,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:36.505451+0000","last_change":"2023-11-27T20:54:26.223978+0000","last_active":"2023-11-27T21:21:36.505451+0000","last_peered":"2023-11-27T21:21:36.505451+0000","last_clean":"2023-11-27T21:21:36.505451+0000","last_became_active":"2023-11-27T20:54:26.223717+0000","last_became_peered":"2023-11-27T20:54:26.223717+0000","last_unstale":"2023-11-27T21:21:36.505451+0000","last_undegraded":"2023-11-27T21:21:36.505451+0000","last_fullsized":"2023-11-27T21:21:36.505451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:19:35.269523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":333,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'146","reported_seq":173,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.963929+0000","last_change":"2023-11-27T20:54:31.836718+0000","last_active":"2023-11-27T21:21:12.963929+0000","last_peered":"2023-11-27T21:21:12.963929+0000","last_clean":"2023-11-27T21:21:12.963929+0000","last_became_active":"2023-11-27T20:54:31.836346+0000","last_became_peered":"2023-11-27T20:54:31.836346+0000","last_unstale":"2023-11-27T21:21:12.963929+0000","last_undegraded":"2023-11-27T21:21:12.963929+0000","last_fullsized":"2023-11-27T21:21:12.963929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:29:03.931226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":6504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'66","reported_seq":95,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.501577+0000","last_change":"2023-11-27T20:54:27.493578+0000","last_active":"2023-11-27T21:21:49.501577+0000","last_peered":"2023-11-27T21:21:49.501577+0000","last_clean":"2023-11-27T21:21:49.501577+0000","last_became_active":"2023-11-27T20:54:27.493327+0000","last_became_peered":"2023-11-27T20:54:27.493327+0000","last_unstale":"2023-11-27T21:21:49.501577+0000","last_undegraded":"2023-11-27T21:21:49.501577+0000","last_fullsized":"2023-11-27T21:21:49.501577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:48:56.464995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"28'7","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:35.299412+0000","last_change":"2023-11-27T20:54:26.227383+0000","last_active":"2023-11-27T21:21:35.299412+0000","last_peered":"2023-11-27T21:21:35.299412+0000","last_clean":"2023-11-27T21:21:35.299412+0000","last_became_active":"2023-11-27T20:54:26.227120+0000","last_became_peered":"2023-11-27T20:54:26.227120+0000","last_unstale":"2023-11-27T21:21:35.299412+0000","last_undegraded":"2023-11-27T21:21:35.299412+0000","last_fullsized":"2023-11-27T21:21:35.299412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:20.644474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'197","reported_seq":233,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:13.022761+0000","last_change":"2023-11-27T20:55:01.286453+0000","last_active":"2023-11-27T21:21:13.022761+0000","last_peered":"2023-11-27T21:21:13.022761+0000","last_clean":"2023-11-27T21:21:13.022761+0000","last_became_active":"2023-11-27T20:55:01.286057+0000","last_became_peered":"2023-11-27T20:55:01.286057+0000","last_unstale":"2023-11-27T21:21:13.022761+0000","last_undegraded":"2023-11-27T21:21:13.022761+0000","last_fullsized":"2023-11-27T21:21:13.022761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:17.334107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":17829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5,7],"acting":[2,1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"28'63","reported_seq":92,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.481101+0000","last_change":"2023-11-27T20:54:27.510815+0000","last_active":"2023-11-27T21:21:49.481101+0000","last_peered":"2023-11-27T21:21:49.481101+0000","last_clean":"2023-11-27T21:21:49.481101+0000","last_became_active":"2023-11-27T20:54:27.510573+0000","last_became_peered":"2023-11-27T20:54:27.510573+0000","last_unstale":"2023-11-27T21:21:49.481101+0000","last_undegraded":"2023-11-27T21:21:49.481101+0000","last_fullsized":"2023-11-27T21:21:49.481101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:44:21.573980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'13","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:36.499632+0000","last_change":"2023-11-27T20:54:26.224703+0000","last_active":"2023-11-27T21:21:36.499632+0000","last_peered":"2023-11-27T21:21:36.499632+0000","last_clean":"2023-11-27T21:21:36.499632+0000","last_became_active":"2023-11-27T20:54:26.224412+0000","last_became_peered":"2023-11-27T20:54:26.224412+0000","last_unstale":"2023-11-27T21:21:36.499632+0000","last_undegraded":"2023-11-27T21:21:36.499632+0000","last_fullsized":"2023-11-27T21:21:36.499632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:02.889092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'174","reported_seq":202,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.959471+0000","last_change":"2023-11-27T20:54:31.819739+0000","last_active":"2023-11-27T21:21:12.959471+0000","last_peered":"2023-11-27T21:21:12.959471+0000","last_clean":"2023-11-27T21:21:12.959471+0000","last_became_active":"2023-11-27T20:54:31.819371+0000","last_became_peered":"2023-11-27T20:54:31.819371+0000","last_unstale":"2023-11-27T21:21:12.959471+0000","last_undegraded":"2023-11-27T21:21:12.959471+0000","last_fullsized":"2023-11-27T21:21:12.959471+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:35.147110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":8398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"28'71","reported_seq":100,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.480758+0000","last_change":"2023-11-27T20:54:27.500858+0000","last_active":"2023-11-27T21:21:49.480758+0000","last_peered":"2023-11-27T21:21:49.480758+0000","last_clean":"2023-11-27T21:21:49.480758+0000","last_became_active":"2023-11-27T20:54:27.500455+0000","last_became_peered":"2023-11-27T20:54:27.500455+0000","last_unstale":"2023-11-27T21:21:49.480758+0000","last_undegraded":"2023-11-27T21:21:49.480758+0000","last_fullsized":"2023-11-27T21:21:49.480758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:12:05.775037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'160","reported_seq":190,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:41.647576+0000","last_change":"2023-11-27T20:54:26.223401+0000","last_active":"2023-11-27T21:21:41.647576+0000","last_peered":"2023-11-27T21:21:41.647576+0000","last_clean":"2023-11-27T21:21:41.647576+0000","last_became_active":"2023-11-27T20:54:26.222981+0000","last_became_peered":"2023-11-27T20:54:26.222981+0000","last_unstale":"2023-11-27T21:21:41.647576+0000","last_undegraded":"2023-11-27T21:21:41.647576+0000","last_fullsized":"2023-11-27T21:21:41.647576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:43:11.830626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":391,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"28'157","reported_seq":185,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.779032+0000","last_change":"2023-11-27T20:54:31.814118+0000","last_active":"2023-11-27T21:21:12.779032+0000","last_peered":"2023-11-27T21:21:12.779032+0000","last_clean":"2023-11-27T21:21:12.779032+0000","last_became_active":"2023-11-27T20:54:31.813765+0000","last_became_peered":"2023-11-27T20:54:31.813765+0000","last_unstale":"2023-11-27T21:21:12.779032+0000","last_undegraded":"2023-11-27T21:21:12.779032+0000","last_fullsized":"2023-11-27T21:21:12.779032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:28:56.396805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":11921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"28'78","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.415446+0000","last_change":"2023-11-27T20:54:27.506449+0000","last_active":"2023-11-27T21:21:49.415446+0000","last_peered":"2023-11-27T21:21:49.415446+0000","last_clean":"2023-11-27T21:21:49.415446+0000","last_became_active":"2023-11-27T20:54:27.506210+0000","last_became_peered":"2023-11-27T20:54:27.506210+0000","last_unstale":"2023-11-27T21:21:49.415446+0000","last_undegraded":"2023-11-27T21:21:49.415446+0000","last_fullsized":"2023-11-27T21:21:49.415446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:32:20.783560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'245","reported_seq":276,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:40.084015+0000","last_change":"2023-11-27T20:54:26.220043+0000","last_active":"2023-11-27T21:21:40.084015+0000","last_peered":"2023-11-27T21:21:40.084015+0000","last_clean":"2023-11-27T21:21:40.084015+0000","last_became_active":"2023-11-27T20:54:26.219775+0000","last_became_peered":"2023-11-27T20:54:26.219775+0000","last_unstale":"2023-11-27T21:21:40.084015+0000","last_undegraded":"2023-11-27T21:21:40.084015+0000","last_fullsized":"2023-11-27T21:21:40.084015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:33.812297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"28'177","reported_seq":205,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:11.896181+0000","last_change":"2023-11-27T20:54:31.825960+0000","last_active":"2023-11-27T21:21:11.896181+0000","last_peered":"2023-11-27T21:21:11.896181+0000","last_clean":"2023-11-27T21:21:11.896181+0000","last_became_active":"2023-11-27T20:54:31.825591+0000","last_became_peered":"2023-11-27T20:54:31.825591+0000","last_unstale":"2023-11-27T21:21:11.896181+0000","last_undegraded":"2023-11-27T21:21:11.896181+0000","last_fullsized":"2023-11-27T21:21:11.896181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:24:35.498899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":8135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"28'65","reported_seq":95,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.526249+0000","last_change":"2023-11-27T20:54:27.500927+0000","last_active":"2023-11-27T21:21:49.526249+0000","last_peered":"2023-11-27T21:21:49.526249+0000","last_clean":"2023-11-27T21:21:49.526249+0000","last_became_active":"2023-11-27T20:54:27.500677+0000","last_became_peered":"2023-11-27T20:54:27.500677+0000","last_unstale":"2023-11-27T21:21:49.526249+0000","last_undegraded":"2023-11-27T21:21:49.526249+0000","last_fullsized":"2023-11-27T21:21:49.526249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:56.708375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"28'6","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:36.500820+0000","last_change":"2023-11-27T20:54:26.227877+0000","last_active":"2023-11-27T21:21:36.500820+0000","last_peered":"2023-11-27T21:21:36.500820+0000","last_clean":"2023-11-27T21:21:36.500820+0000","last_became_active":"2023-11-27T20:54:26.227605+0000","last_became_peered":"2023-11-27T20:54:26.227605+0000","last_unstale":"2023-11-27T21:21:36.500820+0000","last_undegraded":"2023-11-27T21:21:36.500820+0000","last_fullsized":"2023-11-27T21:21:36.500820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:40.031252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"28'178","reported_seq":206,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:15.791510+0000","last_change":"2023-11-27T20:54:31.826732+0000","last_active":"2023-11-27T21:21:15.791510+0000","last_peered":"2023-11-27T21:21:15.791510+0000","last_clean":"2023-11-27T21:21:15.791510+0000","last_became_active":"2023-11-27T20:54:31.826406+0000","last_became_peered":"2023-11-27T20:54:31.826406+0000","last_unstale":"2023-11-27T21:21:15.791510+0000","last_undegraded":"2023-11-27T21:21:15.791510+0000","last_fullsized":"2023-11-27T21:21:15.791510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:54.926925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":6957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"28'85","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.489365+0000","last_change":"2023-11-27T20:54:27.517007+0000","last_active":"2023-11-27T21:21:49.489365+0000","last_peered":"2023-11-27T21:21:49.489365+0000","last_clean":"2023-11-27T21:21:49.489365+0000","last_became_active":"2023-11-27T20:54:27.516686+0000","last_became_peered":"2023-11-27T20:54:27.516686+0000","last_unstale":"2023-11-27T21:21:49.489365+0000","last_undegraded":"2023-11-27T21:21:49.489365+0000","last_fullsized":"2023-11-27T21:21:49.489365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:50.369518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'915","reported_seq":946,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.016379+0000","last_change":"2023-11-27T20:54:26.230192+0000","last_active":"2023-11-27T21:21:49.016379+0000","last_peered":"2023-11-27T21:21:49.016379+0000","last_clean":"2023-11-27T21:21:49.016379+0000","last_became_active":"2023-11-27T20:54:26.229985+0000","last_became_peered":"2023-11-27T20:54:26.229985+0000","last_unstale":"2023-11-27T21:21:49.016379+0000","last_undegraded":"2023-11-27T21:21:49.016379+0000","last_fullsized":"2023-11-27T21:21:49.016379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:58:59.280763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206463,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":911,"num_write_kb":4580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"28'139","reported_seq":163,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:13.022778+0000","last_change":"2023-11-27T20:55:00.588512+0000","last_active":"2023-11-27T21:21:13.022778+0000","last_peered":"2023-11-27T21:21:13.022778+0000","last_clean":"2023-11-27T21:21:13.022778+0000","last_became_active":"2023-11-27T20:55:00.588018+0000","last_became_peered":"2023-11-27T20:55:00.588018+0000","last_unstale":"2023-11-27T21:21:13.022778+0000","last_undegraded":"2023-11-27T21:21:13.022778+0000","last_fullsized":"2023-11-27T21:21:13.022778+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:06.015093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":13169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,0,3],"acting":[2,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'77","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.482999+0000","last_change":"2023-11-27T20:54:27.513378+0000","last_active":"2023-11-27T21:21:49.482999+0000","last_peered":"2023-11-27T21:21:49.482999+0000","last_clean":"2023-11-27T21:21:49.482999+0000","last_became_active":"2023-11-27T20:54:27.512093+0000","last_became_peered":"2023-11-27T20:54:27.512093+0000","last_unstale":"2023-11-27T21:21:49.482999+0000","last_undegraded":"2023-11-27T21:21:49.482999+0000","last_fullsized":"2023-11-27T21:21:49.482999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:24:36.921232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'270","reported_seq":470,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:44.209461+0000","last_change":"2023-11-27T20:54:26.230913+0000","last_active":"2023-11-27T21:21:44.209461+0000","last_peered":"2023-11-27T21:21:44.209461+0000","last_clean":"2023-11-27T21:21:44.209461+0000","last_became_active":"2023-11-27T20:54:26.230548+0000","last_became_peered":"2023-11-27T20:54:26.230548+0000","last_unstale":"2023-11-27T21:21:44.209461+0000","last_undegraded":"2023-11-27T21:21:44.209461+0000","last_fullsized":"2023-11-27T21:21:44.209461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:42:11.153092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28446,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":170,"num_read_kb":173,"num_write":266,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"28'141","reported_seq":177,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.292190+0000","last_change":"2023-11-27T20:55:00.595104+0000","last_active":"2023-11-27T21:21:12.292190+0000","last_peered":"2023-11-27T21:21:12.292190+0000","last_clean":"2023-11-27T21:21:12.292190+0000","last_became_active":"2023-11-27T20:55:00.594705+0000","last_became_peered":"2023-11-27T20:55:00.594705+0000","last_unstale":"2023-11-27T21:21:12.292190+0000","last_undegraded":"2023-11-27T21:21:12.292190+0000","last_fullsized":"2023-11-27T21:21:12.292190+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:06.015093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":12035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"28'77","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.424310+0000","last_change":"2023-11-27T20:54:27.503689+0000","last_active":"2023-11-27T21:21:49.424310+0000","last_peered":"2023-11-27T21:21:49.424310+0000","last_clean":"2023-11-27T21:21:49.424310+0000","last_became_active":"2023-11-27T20:54:27.502941+0000","last_became_peered":"2023-11-27T20:54:27.502941+0000","last_unstale":"2023-11-27T21:21:49.424310+0000","last_undegraded":"2023-11-27T21:21:49.424310+0000","last_fullsized":"2023-11-27T21:21:49.424310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:59:41.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'11","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:40.287864+0000","last_change":"2023-11-27T20:54:26.214419+0000","last_active":"2023-11-27T21:21:40.287864+0000","last_peered":"2023-11-27T21:21:40.287864+0000","last_clean":"2023-11-27T21:21:40.287864+0000","last_became_active":"2023-11-27T20:54:26.214166+0000","last_became_peered":"2023-11-27T20:54:26.214166+0000","last_unstale":"2023-11-27T21:21:40.287864+0000","last_undegraded":"2023-11-27T21:21:40.287864+0000","last_fullsized":"2023-11-27T21:21:40.287864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:44:20.481769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"28'132","reported_seq":159,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:14.318094+0000","last_change":"2023-11-27T20:54:31.832551+0000","last_active":"2023-11-27T21:21:14.318094+0000","last_peered":"2023-11-27T21:21:14.318094+0000","last_clean":"2023-11-27T21:21:14.318094+0000","last_became_active":"2023-11-27T20:54:31.832196+0000","last_became_peered":"2023-11-27T20:54:31.832196+0000","last_unstale":"2023-11-27T21:21:14.318094+0000","last_undegraded":"2023-11-27T21:21:14.318094+0000","last_fullsized":"2023-11-27T21:21:14.318094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:26:46.712422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":8461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'69","reported_seq":99,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.481057+0000","last_change":"2023-11-27T20:54:27.433404+0000","last_active":"2023-11-27T21:21:49.481057+0000","last_peered":"2023-11-27T21:21:49.481057+0000","last_clean":"2023-11-27T21:21:49.481057+0000","last_became_active":"2023-11-27T20:54:27.433161+0000","last_became_peered":"2023-11-27T20:54:27.433161+0000","last_unstale":"2023-11-27T21:21:49.481057+0000","last_undegraded":"2023-11-27T21:21:49.481057+0000","last_fullsized":"2023-11-27T21:21:49.481057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:09.298985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'8","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:26.067458+0000","last_change":"2023-11-27T20:54:26.227451+0000","last_active":"2023-11-27T21:21:26.067458+0000","last_peered":"2023-11-27T21:21:26.067458+0000","last_clean":"2023-11-27T21:21:26.067458+0000","last_became_active":"2023-11-27T20:54:26.227133+0000","last_became_peered":"2023-11-27T20:54:26.227133+0000","last_unstale":"2023-11-27T21:21:26.067458+0000","last_undegraded":"2023-11-27T21:21:26.067458+0000","last_fullsized":"2023-11-27T21:21:26.067458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:58.281608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:18:14.202215+0000","last_change":"2023-11-27T20:54:11.452973+0000","last_active":"2023-11-27T21:18:14.202215+0000","last_peered":"2023-11-27T21:18:14.202215+0000","last_clean":"2023-11-27T21:18:14.202215+0000","last_became_active":"2023-11-27T20:54:11.452181+0000","last_became_peered":"2023-11-27T20:54:11.452181+0000","last_unstale":"2023-11-27T21:18:14.202215+0000","last_undegraded":"2023-11-27T21:18:14.202215+0000","last_fullsized":"2023-11-27T21:18:14.202215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:09.564478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:09.564478+0000","last_clean_scrub_stamp":"2023-11-27T20:54:09.564478+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:07.792065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'171","reported_seq":199,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.805300+0000","last_change":"2023-11-27T20:54:31.818408+0000","last_active":"2023-11-27T21:21:12.805300+0000","last_peered":"2023-11-27T21:21:12.805300+0000","last_clean":"2023-11-27T21:21:12.805300+0000","last_became_active":"2023-11-27T20:54:31.818048+0000","last_became_peered":"2023-11-27T20:54:31.818048+0000","last_unstale":"2023-11-27T21:21:12.805300+0000","last_undegraded":"2023-11-27T21:21:12.805300+0000","last_fullsized":"2023-11-27T21:21:12.805300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:48:53.892148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":10034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"28'75","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.445353+0000","last_change":"2023-11-27T20:54:27.493626+0000","last_active":"2023-11-27T21:21:49.445353+0000","last_peered":"2023-11-27T21:21:49.445353+0000","last_clean":"2023-11-27T21:21:49.445353+0000","last_became_active":"2023-11-27T20:54:27.493256+0000","last_became_peered":"2023-11-27T20:54:27.493256+0000","last_unstale":"2023-11-27T21:21:49.445353+0000","last_undegraded":"2023-11-27T21:21:49.445353+0000","last_fullsized":"2023-11-27T21:21:49.445353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:40:57.665118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'1018","reported_seq":1048,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:26.066735+0000","last_change":"2023-11-27T20:54:26.230079+0000","last_active":"2023-11-27T21:21:26.066735+0000","last_peered":"2023-11-27T21:21:26.066735+0000","last_clean":"2023-11-27T21:21:26.066735+0000","last_became_active":"2023-11-27T20:54:26.229796+0000","last_became_peered":"2023-11-27T20:54:26.229796+0000","last_unstale":"2023-11-27T21:21:26.066735+0000","last_undegraded":"2023-11-27T21:21:26.066735+0000","last_fullsized":"2023-11-27T21:21:26.066735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1018,"log_dups_size":0,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:55.616164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1013,"num_write_kb":4611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'180","reported_seq":207,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:10.821878+0000","last_change":"2023-11-27T20:54:31.825472+0000","last_active":"2023-11-27T21:21:10.821878+0000","last_peered":"2023-11-27T21:21:10.821878+0000","last_clean":"2023-11-27T21:21:10.821878+0000","last_became_active":"2023-11-27T20:54:31.825080+0000","last_became_peered":"2023-11-27T20:54:31.825080+0000","last_unstale":"2023-11-27T21:21:10.821878+0000","last_undegraded":"2023-11-27T21:21:10.821878+0000","last_fullsized":"2023-11-27T21:21:10.821878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:56:07.208945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":9643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'78","reported_seq":99,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.490397+0000","last_change":"2023-11-27T20:55:00.593751+0000","last_active":"2023-11-27T21:21:49.490397+0000","last_peered":"2023-11-27T21:21:49.490397+0000","last_clean":"2023-11-27T21:21:49.490397+0000","last_became_active":"2023-11-27T20:55:00.593249+0000","last_became_peered":"2023-11-27T20:55:00.593249+0000","last_unstale":"2023-11-27T21:21:49.490397+0000","last_undegraded":"2023-11-27T21:21:49.490397+0000","last_fullsized":"2023-11-27T21:21:49.490397+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:10.486151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"28'436","reported_seq":466,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.016200+0000","last_change":"2023-11-27T20:54:26.226148+0000","last_active":"2023-11-27T21:21:49.016200+0000","last_peered":"2023-11-27T21:21:49.016200+0000","last_clean":"2023-11-27T21:21:49.016200+0000","last_became_active":"2023-11-27T20:54:26.225886+0000","last_became_peered":"2023-11-27T20:54:26.225886+0000","last_unstale":"2023-11-27T21:21:49.016200+0000","last_undegraded":"2023-11-27T21:21:49.016200+0000","last_fullsized":"2023-11-27T21:21:49.016200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:32:19.691350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2473984,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":2660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"28'169","reported_seq":196,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:14.309237+0000","last_change":"2023-11-27T20:54:31.828729+0000","last_active":"2023-11-27T21:21:14.309237+0000","last_peered":"2023-11-27T21:21:14.309237+0000","last_clean":"2023-11-27T21:21:14.309237+0000","last_became_active":"2023-11-27T20:54:31.828368+0000","last_became_peered":"2023-11-27T20:54:31.828368+0000","last_unstale":"2023-11-27T21:21:14.309237+0000","last_undegraded":"2023-11-27T21:21:14.309237+0000","last_fullsized":"2023-11-27T21:21:14.309237+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:02.384459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":8527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"28'75","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.492569+0000","last_change":"2023-11-27T20:54:27.515800+0000","last_active":"2023-11-27T21:21:49.492569+0000","last_peered":"2023-11-27T21:21:49.492569+0000","last_clean":"2023-11-27T21:21:49.492569+0000","last_became_active":"2023-11-27T20:54:27.515416+0000","last_became_peered":"2023-11-27T20:54:27.515416+0000","last_unstale":"2023-11-27T21:21:49.492569+0000","last_undegraded":"2023-11-27T21:21:49.492569+0000","last_fullsized":"2023-11-27T21:21:49.492569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:03:00.166936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"28'8","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:27.856575+0000","last_change":"2023-11-27T20:54:26.224880+0000","last_active":"2023-11-27T21:21:27.856575+0000","last_peered":"2023-11-27T21:21:27.856575+0000","last_clean":"2023-11-27T21:21:27.856575+0000","last_became_active":"2023-11-27T20:54:26.224604+0000","last_became_peered":"2023-11-27T20:54:26.224604+0000","last_unstale":"2023-11-27T21:21:27.856575+0000","last_undegraded":"2023-11-27T21:21:27.856575+0000","last_fullsized":"2023-11-27T21:21:27.856575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:15:45.927622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"28'149","reported_seq":176,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:10.315785+0000","last_change":"2023-11-27T20:54:31.819648+0000","last_active":"2023-11-27T21:21:10.315785+0000","last_peered":"2023-11-27T21:21:10.315785+0000","last_clean":"2023-11-27T21:21:10.315785+0000","last_became_active":"2023-11-27T20:54:31.819294+0000","last_became_peered":"2023-11-27T20:54:31.819294+0000","last_unstale":"2023-11-27T21:21:10.315785+0000","last_undegraded":"2023-11-27T21:21:10.315785+0000","last_fullsized":"2023-11-27T21:21:10.315785+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:15.043559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"28'77","reported_seq":106,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.528436+0000","last_change":"2023-11-27T20:54:27.512925+0000","last_active":"2023-11-27T21:21:49.528436+0000","last_peered":"2023-11-27T21:21:49.528436+0000","last_clean":"2023-11-27T21:21:49.528436+0000","last_became_active":"2023-11-27T20:54:27.512663+0000","last_became_peered":"2023-11-27T20:54:27.512663+0000","last_unstale":"2023-11-27T21:21:49.528436+0000","last_undegraded":"2023-11-27T21:21:49.528436+0000","last_fullsized":"2023-11-27T21:21:49.528436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:41.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"28'239","reported_seq":269,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:36.186311+0000","last_change":"2023-11-27T20:54:26.225344+0000","last_active":"2023-11-27T21:21:36.186311+0000","last_peered":"2023-11-27T21:21:36.186311+0000","last_clean":"2023-11-27T21:21:36.186311+0000","last_became_active":"2023-11-27T20:54:26.225056+0000","last_became_peered":"2023-11-27T20:54:26.225056+0000","last_unstale":"2023-11-27T21:21:36.186311+0000","last_undegraded":"2023-11-27T21:21:36.186311+0000","last_fullsized":"2023-11-27T21:21:36.186311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:39.965666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"28'126","reported_seq":153,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:11.958197+0000","last_change":"2023-11-27T20:54:31.827590+0000","last_active":"2023-11-27T21:21:11.958197+0000","last_peered":"2023-11-27T21:21:11.958197+0000","last_clean":"2023-11-27T21:21:11.958197+0000","last_became_active":"2023-11-27T20:54:31.827175+0000","last_became_peered":"2023-11-27T20:54:31.827175+0000","last_unstale":"2023-11-27T21:21:11.958197+0000","last_undegraded":"2023-11-27T21:21:11.958197+0000","last_fullsized":"2023-11-27T21:21:11.958197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:07:26.372924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":7629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"28'69","reported_seq":97,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.444328+0000","last_change":"2023-11-27T20:54:27.498488+0000","last_active":"2023-11-27T21:21:49.444328+0000","last_peered":"2023-11-27T21:21:49.444328+0000","last_clean":"2023-11-27T21:21:49.444328+0000","last_became_active":"2023-11-27T20:54:27.498225+0000","last_became_peered":"2023-11-27T20:54:27.498225+0000","last_unstale":"2023-11-27T21:21:49.444328+0000","last_undegraded":"2023-11-27T21:21:49.444328+0000","last_fullsized":"2023-11-27T21:21:49.444328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:20:24.928142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'1029","reported_seq":1058,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.015885+0000","last_change":"2023-11-27T20:54:26.225580+0000","last_active":"2023-11-27T21:21:49.015885+0000","last_peered":"2023-11-27T21:21:49.015885+0000","last_clean":"2023-11-27T21:21:49.015885+0000","last_became_active":"2023-11-27T20:54:26.225333+0000","last_became_peered":"2023-11-27T20:54:26.225333+0000","last_unstale":"2023-11-27T21:21:49.015885+0000","last_undegraded":"2023-11-27T21:21:49.015885+0000","last_fullsized":"2023-11-27T21:21:49.015885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1029,"log_dups_size":0,"ondisk_log_size":1029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:46:01.797509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3313963,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1025,"num_write_kb":3921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"28'159","reported_seq":185,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:11.889011+0000","last_change":"2023-11-27T20:54:31.836029+0000","last_active":"2023-11-27T21:21:11.889011+0000","last_peered":"2023-11-27T21:21:11.889011+0000","last_clean":"2023-11-27T21:21:11.889011+0000","last_became_active":"2023-11-27T20:54:31.835629+0000","last_became_peered":"2023-11-27T20:54:31.835629+0000","last_unstale":"2023-11-27T21:21:11.889011+0000","last_undegraded":"2023-11-27T21:21:11.889011+0000","last_fullsized":"2023-11-27T21:21:11.889011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:06.015093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":12674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'64","reported_seq":91,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.430617+0000","last_change":"2023-11-27T20:54:27.511034+0000","last_active":"2023-11-27T21:21:49.430617+0000","last_peered":"2023-11-27T21:21:49.430617+0000","last_clean":"2023-11-27T21:21:49.430617+0000","last_became_active":"2023-11-27T20:54:27.510775+0000","last_became_peered":"2023-11-27T20:54:27.510775+0000","last_unstale":"2023-11-27T21:21:49.430617+0000","last_undegraded":"2023-11-27T21:21:49.430617+0000","last_fullsized":"2023-11-27T21:21:49.430617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:56.708375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"28'1188","reported_seq":1217,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:20:09.292900+0000","last_change":"2023-11-27T20:54:26.227007+0000","last_active":"2023-11-27T21:20:09.292900+0000","last_peered":"2023-11-27T21:20:09.292900+0000","last_clean":"2023-11-27T21:20:09.292900+0000","last_became_active":"2023-11-27T20:54:26.226745+0000","last_became_peered":"2023-11-27T20:54:26.226745+0000","last_unstale":"2023-11-27T21:20:09.292900+0000","last_undegraded":"2023-11-27T21:20:09.292900+0000","last_fullsized":"2023-11-27T21:20:09.292900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1188,"log_dups_size":0,"ondisk_log_size":1188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:41:46.312385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":4695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"28'169","reported_seq":195,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:10.950189+0000","last_change":"2023-11-27T20:54:31.831969+0000","last_active":"2023-11-27T21:21:10.950189+0000","last_peered":"2023-11-27T21:21:10.950189+0000","last_clean":"2023-11-27T21:21:10.950189+0000","last_became_active":"2023-11-27T20:54:31.831620+0000","last_became_peered":"2023-11-27T20:54:31.831620+0000","last_unstale":"2023-11-27T21:21:10.950189+0000","last_undegraded":"2023-11-27T21:21:10.950189+0000","last_fullsized":"2023-11-27T21:21:10.950189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:57:38.465675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":13064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'85","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.445927+0000","last_change":"2023-11-27T20:54:27.515785+0000","last_active":"2023-11-27T21:21:49.445927+0000","last_peered":"2023-11-27T21:21:49.445927+0000","last_clean":"2023-11-27T21:21:49.445927+0000","last_became_active":"2023-11-27T20:54:27.515524+0000","last_became_peered":"2023-11-27T20:54:27.515524+0000","last_unstale":"2023-11-27T21:21:49.445927+0000","last_undegraded":"2023-11-27T21:21:49.445927+0000","last_fullsized":"2023-11-27T21:21:49.445927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:40:33.267986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'242","reported_seq":271,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:42.288454+0000","last_change":"2023-11-27T20:54:26.225975+0000","last_active":"2023-11-27T21:21:42.288454+0000","last_peered":"2023-11-27T21:21:42.288454+0000","last_clean":"2023-11-27T21:21:42.288454+0000","last_became_active":"2023-11-27T20:54:26.225691+0000","last_became_peered":"2023-11-27T20:54:26.225691+0000","last_unstale":"2023-11-27T21:21:42.288454+0000","last_undegraded":"2023-11-27T21:21:42.288454+0000","last_fullsized":"2023-11-27T21:21:42.288454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:25.427192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":236,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"28'150","reported_seq":176,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.291749+0000","last_change":"2023-11-27T20:54:31.827058+0000","last_active":"2023-11-27T21:21:12.291749+0000","last_peered":"2023-11-27T21:21:12.291749+0000","last_clean":"2023-11-27T21:21:12.291749+0000","last_became_active":"2023-11-27T20:54:31.826669+0000","last_became_peered":"2023-11-27T20:54:31.826669+0000","last_unstale":"2023-11-27T21:21:12.291749+0000","last_undegraded":"2023-11-27T21:21:12.291749+0000","last_fullsized":"2023-11-27T21:21:12.291749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:40.986177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":7432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"28'77","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.398536+0000","last_change":"2023-11-27T20:54:27.503066+0000","last_active":"2023-11-27T21:21:49.398536+0000","last_peered":"2023-11-27T21:21:49.398536+0000","last_clean":"2023-11-27T21:21:49.398536+0000","last_became_active":"2023-11-27T20:54:27.502677+0000","last_became_peered":"2023-11-27T20:54:27.502677+0000","last_unstale":"2023-11-27T21:21:49.398536+0000","last_undegraded":"2023-11-27T21:21:49.398536+0000","last_fullsized":"2023-11-27T21:21:49.398536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:41.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'326","reported_seq":668,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:42.283413+0000","last_change":"2023-11-27T20:54:26.228175+0000","last_active":"2023-11-27T21:21:42.283413+0000","last_peered":"2023-11-27T21:21:42.283413+0000","last_clean":"2023-11-27T21:21:42.283413+0000","last_became_active":"2023-11-27T20:54:26.227911+0000","last_became_peered":"2023-11-27T20:54:26.227911+0000","last_unstale":"2023-11-27T21:21:42.283413+0000","last_undegraded":"2023-11-27T21:21:42.283413+0000","last_fullsized":"2023-11-27T21:21:42.283413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:57.995466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53552,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":314,"num_read_kb":325,"num_write":327,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'174","reported_seq":200,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:09.987996+0000","last_change":"2023-11-27T20:54:31.828136+0000","last_active":"2023-11-27T21:21:09.987996+0000","last_peered":"2023-11-27T21:21:09.987996+0000","last_clean":"2023-11-27T21:21:09.987996+0000","last_became_active":"2023-11-27T20:54:31.827785+0000","last_became_peered":"2023-11-27T20:54:31.827785+0000","last_unstale":"2023-11-27T21:21:09.987996+0000","last_undegraded":"2023-11-27T21:21:09.987996+0000","last_fullsized":"2023-11-27T21:21:09.987996+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:28:18.206490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":11290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'75","reported_seq":103,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.490363+0000","last_change":"2023-11-27T20:54:27.514185+0000","last_active":"2023-11-27T21:21:49.490363+0000","last_peered":"2023-11-27T21:21:49.490363+0000","last_clean":"2023-11-27T21:21:49.490363+0000","last_became_active":"2023-11-27T20:54:27.513655+0000","last_became_peered":"2023-11-27T20:54:27.513655+0000","last_unstale":"2023-11-27T21:21:49.490363+0000","last_undegraded":"2023-11-27T21:21:49.490363+0000","last_fullsized":"2023-11-27T21:21:49.490363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:52.629755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'1482","reported_seq":1511,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:32.579507+0000","last_change":"2023-11-27T20:54:26.230827+0000","last_active":"2023-11-27T21:21:32.579507+0000","last_peered":"2023-11-27T21:21:32.579507+0000","last_clean":"2023-11-27T21:21:32.579507+0000","last_became_active":"2023-11-27T20:54:26.230570+0000","last_became_peered":"2023-11-27T20:54:26.230570+0000","last_unstale":"2023-11-27T21:21:32.579507+0000","last_undegraded":"2023-11-27T21:21:32.579507+0000","last_fullsized":"2023-11-27T21:21:32.579507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1482,"log_dups_size":0,"ondisk_log_size":1482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:42:04.480038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1482,"num_write_kb":4539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"28'155","reported_seq":181,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.855294+0000","last_change":"2023-11-27T20:54:31.828482+0000","last_active":"2023-11-27T21:21:12.855294+0000","last_peered":"2023-11-27T21:21:12.855294+0000","last_clean":"2023-11-27T21:21:12.855294+0000","last_became_active":"2023-11-27T20:54:31.827872+0000","last_became_peered":"2023-11-27T20:54:31.827872+0000","last_unstale":"2023-11-27T21:21:12.855294+0000","last_undegraded":"2023-11-27T21:21:12.855294+0000","last_fullsized":"2023-11-27T21:21:12.855294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:32:35.015914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":8855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'67","reported_seq":95,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.446147+0000","last_change":"2023-11-27T20:54:27.493526+0000","last_active":"2023-11-27T21:21:49.446147+0000","last_peered":"2023-11-27T21:21:49.446147+0000","last_clean":"2023-11-27T21:21:49.446147+0000","last_became_active":"2023-11-27T20:54:27.493257+0000","last_became_peered":"2023-11-27T20:54:27.493257+0000","last_unstale":"2023-11-27T21:21:49.446147+0000","last_undegraded":"2023-11-27T21:21:49.446147+0000","last_fullsized":"2023-11-27T21:21:49.446147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:04.222900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'149","reported_seq":177,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:42.291396+0000","last_change":"2023-11-27T20:54:26.231237+0000","last_active":"2023-11-27T21:21:42.291396+0000","last_peered":"2023-11-27T21:21:42.291396+0000","last_clean":"2023-11-27T21:21:42.291396+0000","last_became_active":"2023-11-27T20:54:26.230963+0000","last_became_peered":"2023-11-27T20:54:26.230963+0000","last_unstale":"2023-11-27T21:21:42.291396+0000","last_undegraded":"2023-11-27T21:21:42.291396+0000","last_fullsized":"2023-11-27T21:21:42.291396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:11:24.730507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"28'195","reported_seq":225,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:16.055228+0000","last_change":"2023-11-27T20:54:31.825391+0000","last_active":"2023-11-27T21:21:16.055228+0000","last_peered":"2023-11-27T21:21:16.055228+0000","last_clean":"2023-11-27T21:21:16.055228+0000","last_became_active":"2023-11-27T20:54:31.825038+0000","last_became_peered":"2023-11-27T20:54:31.825038+0000","last_unstale":"2023-11-27T21:21:16.055228+0000","last_undegraded":"2023-11-27T21:21:16.055228+0000","last_fullsized":"2023-11-27T21:21:16.055228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:11:47.511718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":102,"num_write":164,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"28'89","reported_seq":117,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.489472+0000","last_change":"2023-11-27T20:54:27.508226+0000","last_active":"2023-11-27T21:21:49.489472+0000","last_peered":"2023-11-27T21:21:49.489472+0000","last_clean":"2023-11-27T21:21:49.489472+0000","last_became_active":"2023-11-27T20:54:27.507805+0000","last_became_peered":"2023-11-27T20:54:27.507805+0000","last_unstale":"2023-11-27T21:21:49.489472+0000","last_undegraded":"2023-11-27T21:21:49.489472+0000","last_fullsized":"2023-11-27T21:21:49.489472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:43:42.137077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'328","reported_seq":675,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:40.082191+0000","last_change":"2023-11-27T20:54:26.226915+0000","last_active":"2023-11-27T21:21:40.082191+0000","last_peered":"2023-11-27T21:21:40.082191+0000","last_clean":"2023-11-27T21:21:40.082191+0000","last_became_active":"2023-11-27T20:54:26.226679+0000","last_became_peered":"2023-11-27T20:54:26.226679+0000","last_unstale":"2023-11-27T21:21:40.082191+0000","last_undegraded":"2023-11-27T21:21:40.082191+0000","last_fullsized":"2023-11-27T21:21:40.082191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:05:08.792958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53032,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":318,"num_read_kb":327,"num_write":324,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"28'159","reported_seq":185,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:15.790221+0000","last_change":"2023-11-27T20:54:31.834934+0000","last_active":"2023-11-27T21:21:15.790221+0000","last_peered":"2023-11-27T21:21:15.790221+0000","last_clean":"2023-11-27T21:21:15.790221+0000","last_became_active":"2023-11-27T20:54:31.834569+0000","last_became_peered":"2023-11-27T20:54:31.834569+0000","last_unstale":"2023-11-27T21:21:15.790221+0000","last_undegraded":"2023-11-27T21:21:15.790221+0000","last_fullsized":"2023-11-27T21:21:15.790221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:15:51.754021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":7865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'79","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.528002+0000","last_change":"2023-11-27T20:54:27.498841+0000","last_active":"2023-11-27T21:21:49.528002+0000","last_peered":"2023-11-27T21:21:49.528002+0000","last_clean":"2023-11-27T21:21:49.528002+0000","last_became_active":"2023-11-27T20:54:27.498535+0000","last_became_peered":"2023-11-27T20:54:27.498535+0000","last_unstale":"2023-11-27T21:21:49.528002+0000","last_undegraded":"2023-11-27T21:21:49.528002+0000","last_fullsized":"2023-11-27T21:21:49.528002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:21.736684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'176","reported_seq":204,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:36.147269+0000","last_change":"2023-11-27T20:54:26.228140+0000","last_active":"2023-11-27T21:21:36.147269+0000","last_peered":"2023-11-27T21:21:36.147269+0000","last_clean":"2023-11-27T21:21:36.147269+0000","last_became_active":"2023-11-27T20:54:26.227878+0000","last_became_peered":"2023-11-27T20:54:26.227878+0000","last_unstale":"2023-11-27T21:21:36.147269+0000","last_undegraded":"2023-11-27T21:21:36.147269+0000","last_fullsized":"2023-11-27T21:21:36.147269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:21:36.965668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'104","reported_seq":130,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:14.321452+0000","last_change":"2023-11-27T20:54:31.825264+0000","last_active":"2023-11-27T21:21:14.321452+0000","last_peered":"2023-11-27T21:21:14.321452+0000","last_clean":"2023-11-27T21:21:14.321452+0000","last_became_active":"2023-11-27T20:54:31.824914+0000","last_became_peered":"2023-11-27T20:54:31.824914+0000","last_unstale":"2023-11-27T21:21:14.321452+0000","last_undegraded":"2023-11-27T21:21:14.321452+0000","last_fullsized":"2023-11-27T21:21:14.321452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:49:01.022403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":7715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"28'152","reported_seq":180,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:10.946992+0000","last_change":"2023-11-27T20:54:31.828359+0000","last_active":"2023-11-27T21:21:10.946992+0000","last_peered":"2023-11-27T21:21:10.946992+0000","last_clean":"2023-11-27T21:21:10.946992+0000","last_became_active":"2023-11-27T20:54:31.827971+0000","last_became_peered":"2023-11-27T20:54:31.827971+0000","last_unstale":"2023-11-27T21:21:10.946992+0000","last_undegraded":"2023-11-27T21:21:10.946992+0000","last_fullsized":"2023-11-27T21:21:10.946992+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:02.858386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":9456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"28'80","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.492929+0000","last_change":"2023-11-27T20:54:27.434914+0000","last_active":"2023-11-27T21:21:49.492929+0000","last_peered":"2023-11-27T21:21:49.492929+0000","last_clean":"2023-11-27T21:21:49.492929+0000","last_became_active":"2023-11-27T20:54:27.434635+0000","last_became_peered":"2023-11-27T20:54:27.434635+0000","last_unstale":"2023-11-27T21:21:49.492929+0000","last_undegraded":"2023-11-27T21:21:49.492929+0000","last_fullsized":"2023-11-27T21:21:49.492929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:59.373818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'6","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:18.070088+0000","last_change":"2023-11-27T20:54:26.224770+0000","last_active":"2023-11-27T21:21:18.070088+0000","last_peered":"2023-11-27T21:21:18.070088+0000","last_clean":"2023-11-27T21:21:18.070088+0000","last_became_active":"2023-11-27T20:54:26.224502+0000","last_became_peered":"2023-11-27T20:54:26.224502+0000","last_unstale":"2023-11-27T21:21:18.070088+0000","last_undegraded":"2023-11-27T21:21:18.070088+0000","last_fullsized":"2023-11-27T21:21:18.070088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:51:28.157451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"28'177","reported_seq":205,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:10.947037+0000","last_change":"2023-11-27T20:54:31.827147+0000","last_active":"2023-11-27T21:21:10.947037+0000","last_peered":"2023-11-27T21:21:10.947037+0000","last_clean":"2023-11-27T21:21:10.947037+0000","last_became_active":"2023-11-27T20:54:31.826790+0000","last_became_peered":"2023-11-27T20:54:31.826790+0000","last_unstale":"2023-11-27T21:21:10.947037+0000","last_undegraded":"2023-11-27T21:21:10.947037+0000","last_fullsized":"2023-11-27T21:21:10.947037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:11:33.954256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":15468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'77","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.483070+0000","last_change":"2023-11-27T20:54:27.507947+0000","last_active":"2023-11-27T21:21:49.483070+0000","last_peered":"2023-11-27T21:21:49.483070+0000","last_clean":"2023-11-27T21:21:49.483070+0000","last_became_active":"2023-11-27T20:54:27.507698+0000","last_became_peered":"2023-11-27T20:54:27.507698+0000","last_unstale":"2023-11-27T21:21:49.483070+0000","last_undegraded":"2023-11-27T21:21:49.483070+0000","last_fullsized":"2023-11-27T21:21:49.483070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:50.369518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'422","reported_seq":864,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:36.493048+0000","last_change":"2023-11-27T20:54:26.230417+0000","last_active":"2023-11-27T21:21:36.493048+0000","last_peered":"2023-11-27T21:21:36.493048+0000","last_clean":"2023-11-27T21:21:36.493048+0000","last_became_active":"2023-11-27T20:54:26.229725+0000","last_became_peered":"2023-11-27T20:54:26.229725+0000","last_unstale":"2023-11-27T21:21:36.493048+0000","last_undegraded":"2023-11-27T21:21:36.493048+0000","last_fullsized":"2023-11-27T21:21:36.493048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:01.075715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":413,"num_read_kb":420,"num_write":418,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'469","reported_seq":955,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:27.071063+0000","last_change":"2023-11-27T20:54:26.221975+0000","last_active":"2023-11-27T21:21:27.071063+0000","last_peered":"2023-11-27T21:21:27.071063+0000","last_clean":"2023-11-27T21:21:27.071063+0000","last_became_active":"2023-11-27T20:54:26.221715+0000","last_became_peered":"2023-11-27T20:54:26.221715+0000","last_unstale":"2023-11-27T21:21:27.071063+0000","last_undegraded":"2023-11-27T21:21:27.071063+0000","last_fullsized":"2023-11-27T21:21:27.071063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:15.156440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70496,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":458,"num_read_kb":466,"num_write":467,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'78","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.503170+0000","last_change":"2023-11-27T20:54:27.517213+0000","last_active":"2023-11-27T21:21:49.503170+0000","last_peered":"2023-11-27T21:21:49.503170+0000","last_clean":"2023-11-27T21:21:49.503170+0000","last_became_active":"2023-11-27T20:54:27.516887+0000","last_became_peered":"2023-11-27T20:54:27.516887+0000","last_unstale":"2023-11-27T21:21:49.503170+0000","last_undegraded":"2023-11-27T21:21:49.503170+0000","last_fullsized":"2023-11-27T21:21:49.503170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:51:29.249661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'144","reported_seq":169,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:07.511751+0000","last_change":"2023-11-27T20:54:31.827740+0000","last_active":"2023-11-27T21:21:07.511751+0000","last_peered":"2023-11-27T21:21:07.511751+0000","last_clean":"2023-11-27T21:21:07.511751+0000","last_became_active":"2023-11-27T20:54:31.827395+0000","last_became_peered":"2023-11-27T20:54:31.827395+0000","last_unstale":"2023-11-27T21:21:07.511751+0000","last_undegraded":"2023-11-27T21:21:07.511751+0000","last_fullsized":"2023-11-27T21:21:07.511751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:20:29.485550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":4976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'2868","reported_seq":2896,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.016313+0000","last_change":"2023-11-27T20:54:26.227971+0000","last_active":"2023-11-27T21:21:49.016313+0000","last_peered":"2023-11-27T21:21:49.016313+0000","last_clean":"2023-11-27T21:21:49.016313+0000","last_became_active":"2023-11-27T20:54:26.227713+0000","last_became_peered":"2023-11-27T20:54:26.227713+0000","last_unstale":"2023-11-27T21:21:49.016313+0000","last_undegraded":"2023-11-27T21:21:49.016313+0000","last_fullsized":"2023-11-27T21:21:49.016313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2868,"log_dups_size":0,"ondisk_log_size":2868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:39.965666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12113008,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2860,"num_write_kb":13160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"28'94","reported_seq":120,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.425483+0000","last_change":"2023-11-27T20:54:27.506394+0000","last_active":"2023-11-27T21:21:49.425483+0000","last_peered":"2023-11-27T21:21:49.425483+0000","last_clean":"2023-11-27T21:21:49.425483+0000","last_became_active":"2023-11-27T20:54:27.506119+0000","last_became_peered":"2023-11-27T20:54:27.506119+0000","last_unstale":"2023-11-27T21:21:49.425483+0000","last_undegraded":"2023-11-27T21:21:49.425483+0000","last_fullsized":"2023-11-27T21:21:49.425483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:21.736684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"28'135","reported_seq":160,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.951210+0000","last_change":"2023-11-27T20:54:31.833185+0000","last_active":"2023-11-27T21:21:12.951210+0000","last_peered":"2023-11-27T21:21:12.951210+0000","last_clean":"2023-11-27T21:21:12.951210+0000","last_became_active":"2023-11-27T20:54:31.832813+0000","last_became_peered":"2023-11-27T20:54:31.832813+0000","last_unstale":"2023-11-27T21:21:12.951210+0000","last_undegraded":"2023-11-27T21:21:12.951210+0000","last_fullsized":"2023-11-27T21:21:12.951210+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:13.856393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'74","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.526599+0000","last_change":"2023-11-27T20:54:27.500687+0000","last_active":"2023-11-27T21:21:49.526599+0000","last_peered":"2023-11-27T21:21:49.526599+0000","last_clean":"2023-11-27T21:21:49.526599+0000","last_became_active":"2023-11-27T20:54:27.500394+0000","last_became_peered":"2023-11-27T20:54:27.500394+0000","last_unstale":"2023-11-27T21:21:49.526599+0000","last_undegraded":"2023-11-27T21:21:49.526599+0000","last_fullsized":"2023-11-27T21:21:49.526599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:15:32.173306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"28'91","reported_seq":120,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.393968+0000","last_change":"2023-11-27T20:54:27.515441+0000","last_active":"2023-11-27T21:21:49.393968+0000","last_peered":"2023-11-27T21:21:49.393968+0000","last_clean":"2023-11-27T21:21:49.393968+0000","last_became_active":"2023-11-27T20:54:27.515173+0000","last_became_peered":"2023-11-27T20:54:27.515173+0000","last_unstale":"2023-11-27T21:21:49.393968+0000","last_undegraded":"2023-11-27T21:21:49.393968+0000","last_fullsized":"2023-11-27T21:21:49.393968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:19:36.361734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"28'79","reported_seq":109,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.498624+0000","last_change":"2023-11-27T20:54:27.506358+0000","last_active":"2023-11-27T21:21:49.498624+0000","last_peered":"2023-11-27T21:21:49.498624+0000","last_clean":"2023-11-27T21:21:49.498624+0000","last_became_active":"2023-11-27T20:54:27.506112+0000","last_became_peered":"2023-11-27T20:54:27.506112+0000","last_unstale":"2023-11-27T21:21:49.498624+0000","last_undegraded":"2023-11-27T21:21:49.498624+0000","last_fullsized":"2023-11-27T21:21:49.498624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:58.300979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'73","reported_seq":103,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.477477+0000","last_change":"2023-11-27T20:54:27.510776+0000","last_active":"2023-11-27T21:21:49.477477+0000","last_peered":"2023-11-27T21:21:49.477477+0000","last_clean":"2023-11-27T21:21:49.477477+0000","last_became_active":"2023-11-27T20:54:27.510532+0000","last_became_peered":"2023-11-27T20:54:27.510532+0000","last_unstale":"2023-11-27T21:21:49.477477+0000","last_undegraded":"2023-11-27T21:21:49.477477+0000","last_fullsized":"2023-11-27T21:21:49.477477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:36.428770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"28'58","reported_seq":87,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.400922+0000","last_change":"2023-11-27T20:54:27.513775+0000","last_active":"2023-11-27T21:21:49.400922+0000","last_peered":"2023-11-27T21:21:49.400922+0000","last_clean":"2023-11-27T21:21:49.400922+0000","last_became_active":"2023-11-27T20:54:27.513517+0000","last_became_peered":"2023-11-27T20:54:27.513517+0000","last_unstale":"2023-11-27T21:21:49.400922+0000","last_undegraded":"2023-11-27T21:21:49.400922+0000","last_fullsized":"2023-11-27T21:21:49.400922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:07:21.815516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'78","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.397802+0000","last_change":"2023-11-27T20:54:27.511798+0000","last_active":"2023-11-27T21:21:49.397802+0000","last_peered":"2023-11-27T21:21:49.397802+0000","last_clean":"2023-11-27T21:21:49.397802+0000","last_became_active":"2023-11-27T20:54:27.511559+0000","last_became_peered":"2023-11-27T20:54:27.511559+0000","last_unstale":"2023-11-27T21:21:49.397802+0000","last_undegraded":"2023-11-27T21:21:49.397802+0000","last_fullsized":"2023-11-27T21:21:49.397802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:41.057877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"28'75","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.527495+0000","last_change":"2023-11-27T20:54:27.499585+0000","last_active":"2023-11-27T21:21:49.527495+0000","last_peered":"2023-11-27T21:21:49.527495+0000","last_clean":"2023-11-27T21:21:49.527495+0000","last_became_active":"2023-11-27T20:54:27.499323+0000","last_became_peered":"2023-11-27T20:54:27.499323+0000","last_unstale":"2023-11-27T21:21:49.527495+0000","last_undegraded":"2023-11-27T21:21:49.527495+0000","last_fullsized":"2023-11-27T21:21:49.527495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:59:41.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"28'64","reported_seq":93,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.458062+0000","last_change":"2023-11-27T20:54:27.508846+0000","last_active":"2023-11-27T21:21:49.458062+0000","last_peered":"2023-11-27T21:21:49.458062+0000","last_clean":"2023-11-27T21:21:49.458062+0000","last_became_active":"2023-11-27T20:54:27.508615+0000","last_became_peered":"2023-11-27T20:54:27.508615+0000","last_unstale":"2023-11-27T21:21:49.458062+0000","last_undegraded":"2023-11-27T21:21:49.458062+0000","last_fullsized":"2023-11-27T21:21:49.458062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:53.751196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'78","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.498024+0000","last_change":"2023-11-27T20:54:27.510920+0000","last_active":"2023-11-27T21:21:49.498024+0000","last_peered":"2023-11-27T21:21:49.498024+0000","last_clean":"2023-11-27T21:21:49.498024+0000","last_became_active":"2023-11-27T20:54:27.510647+0000","last_became_peered":"2023-11-27T20:54:27.510647+0000","last_unstale":"2023-11-27T21:21:49.498024+0000","last_undegraded":"2023-11-27T21:21:49.498024+0000","last_fullsized":"2023-11-27T21:21:49.498024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:32:30.458506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"28'92","reported_seq":121,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.477139+0000","last_change":"2023-11-27T20:54:27.508596+0000","last_active":"2023-11-27T21:21:49.477139+0000","last_peered":"2023-11-27T21:21:49.477139+0000","last_clean":"2023-11-27T21:21:49.477139+0000","last_became_active":"2023-11-27T20:54:27.508360+0000","last_became_peered":"2023-11-27T20:54:27.508360+0000","last_unstale":"2023-11-27T21:21:49.477139+0000","last_undegraded":"2023-11-27T21:21:49.477139+0000","last_fullsized":"2023-11-27T21:21:49.477139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:58.794639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"28'87","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.391357+0000","last_change":"2023-11-27T20:54:27.513374+0000","last_active":"2023-11-27T21:21:49.391357+0000","last_peered":"2023-11-27T21:21:49.391357+0000","last_clean":"2023-11-27T21:21:49.391357+0000","last_became_active":"2023-11-27T20:54:27.513105+0000","last_became_peered":"2023-11-27T20:54:27.513105+0000","last_unstale":"2023-11-27T21:21:49.391357+0000","last_undegraded":"2023-11-27T21:21:49.391357+0000","last_fullsized":"2023-11-27T21:21:49.391357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:59:41.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"28'77","reported_seq":106,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.504502+0000","last_change":"2023-11-27T20:54:27.433370+0000","last_active":"2023-11-27T21:21:49.504502+0000","last_peered":"2023-11-27T21:21:49.504502+0000","last_clean":"2023-11-27T21:21:49.504502+0000","last_became_active":"2023-11-27T20:54:27.433179+0000","last_became_peered":"2023-11-27T20:54:27.433179+0000","last_unstale":"2023-11-27T21:21:49.504502+0000","last_undegraded":"2023-11-27T21:21:49.504502+0000","last_fullsized":"2023-11-27T21:21:49.504502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:01.805918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'75","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.488661+0000","last_change":"2023-11-27T20:54:27.515324+0000","last_active":"2023-11-27T21:21:49.488661+0000","last_peered":"2023-11-27T21:21:49.488661+0000","last_clean":"2023-11-27T21:21:49.488661+0000","last_became_active":"2023-11-27T20:54:27.515068+0000","last_became_peered":"2023-11-27T20:54:27.515068+0000","last_unstale":"2023-11-27T21:21:49.488661+0000","last_undegraded":"2023-11-27T21:21:49.488661+0000","last_fullsized":"2023-11-27T21:21:49.488661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:11:42.954310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"28'86","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.500364+0000","last_change":"2023-11-27T20:54:27.498621+0000","last_active":"2023-11-27T21:21:49.500364+0000","last_peered":"2023-11-27T21:21:49.500364+0000","last_clean":"2023-11-27T21:21:49.500364+0000","last_became_active":"2023-11-27T20:54:27.498306+0000","last_became_peered":"2023-11-27T20:54:27.498306+0000","last_unstale":"2023-11-27T21:21:49.500364+0000","last_undegraded":"2023-11-27T21:21:49.500364+0000","last_fullsized":"2023-11-27T21:21:49.500364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:20:24.529896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'91","reported_seq":118,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.405687+0000","last_change":"2023-11-27T20:54:27.513134+0000","last_active":"2023-11-27T21:21:49.405687+0000","last_peered":"2023-11-27T21:21:49.405687+0000","last_clean":"2023-11-27T21:21:49.405687+0000","last_became_active":"2023-11-27T20:54:27.512897+0000","last_became_peered":"2023-11-27T20:54:27.512897+0000","last_unstale":"2023-11-27T21:21:49.405687+0000","last_undegraded":"2023-11-27T21:21:49.405687+0000","last_fullsized":"2023-11-27T21:21:49.405687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:13:40.877792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"28'67","reported_seq":95,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.444605+0000","last_change":"2023-11-27T20:54:27.515196+0000","last_active":"2023-11-27T21:21:49.444605+0000","last_peered":"2023-11-27T21:21:49.444605+0000","last_clean":"2023-11-27T21:21:49.444605+0000","last_became_active":"2023-11-27T20:54:27.514946+0000","last_became_peered":"2023-11-27T20:54:27.514946+0000","last_unstale":"2023-11-27T21:21:49.444605+0000","last_undegraded":"2023-11-27T21:21:49.444605+0000","last_fullsized":"2023-11-27T21:21:49.444605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:06:07.940123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"28'80","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.442976+0000","last_change":"2023-11-27T20:54:27.493565+0000","last_active":"2023-11-27T21:21:49.442976+0000","last_peered":"2023-11-27T21:21:49.442976+0000","last_clean":"2023-11-27T21:21:49.442976+0000","last_became_active":"2023-11-27T20:54:27.493297+0000","last_became_peered":"2023-11-27T20:54:27.493297+0000","last_unstale":"2023-11-27T21:21:49.442976+0000","last_undegraded":"2023-11-27T21:21:49.442976+0000","last_fullsized":"2023-11-27T21:21:49.442976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:28:51.839397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"28'75","reported_seq":103,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.495955+0000","last_change":"2023-11-27T20:54:27.512910+0000","last_active":"2023-11-27T21:21:49.495955+0000","last_peered":"2023-11-27T21:21:49.495955+0000","last_clean":"2023-11-27T21:21:49.495955+0000","last_became_active":"2023-11-27T20:54:27.512662+0000","last_became_peered":"2023-11-27T20:54:27.512662+0000","last_unstale":"2023-11-27T21:21:49.495955+0000","last_undegraded":"2023-11-27T21:21:49.495955+0000","last_fullsized":"2023-11-27T21:21:49.495955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:52.629755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'70","reported_seq":98,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.398075+0000","last_change":"2023-11-27T20:54:27.512406+0000","last_active":"2023-11-27T21:21:49.398075+0000","last_peered":"2023-11-27T21:21:49.398075+0000","last_clean":"2023-11-27T21:21:49.398075+0000","last_became_active":"2023-11-27T20:54:27.512124+0000","last_became_peered":"2023-11-27T20:54:27.512124+0000","last_unstale":"2023-11-27T21:21:49.398075+0000","last_undegraded":"2023-11-27T21:21:49.398075+0000","last_fullsized":"2023-11-27T21:21:49.398075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:21.736684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"28'82","reported_seq":110,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.401709+0000","last_change":"2023-11-27T20:54:27.517262+0000","last_active":"2023-11-27T21:21:49.401709+0000","last_peered":"2023-11-27T21:21:49.401709+0000","last_clean":"2023-11-27T21:21:49.401709+0000","last_became_active":"2023-11-27T20:54:27.516907+0000","last_became_peered":"2023-11-27T20:54:27.516907+0000","last_unstale":"2023-11-27T21:21:49.401709+0000","last_undegraded":"2023-11-27T21:21:49.401709+0000","last_fullsized":"2023-11-27T21:21:49.401709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:05:09.885169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'68","reported_seq":96,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.492400+0000","last_change":"2023-11-27T20:54:27.515432+0000","last_active":"2023-11-27T21:21:49.492400+0000","last_peered":"2023-11-27T21:21:49.492400+0000","last_clean":"2023-11-27T21:21:49.492400+0000","last_became_active":"2023-11-27T20:54:27.515182+0000","last_became_peered":"2023-11-27T20:54:27.515182+0000","last_unstale":"2023-11-27T21:21:49.492400+0000","last_undegraded":"2023-11-27T21:21:49.492400+0000","last_fullsized":"2023-11-27T21:21:49.492400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:36.428770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'79","reported_seq":100,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.439014+0000","last_change":"2023-11-27T20:55:00.588607+0000","last_active":"2023-11-27T21:21:49.439014+0000","last_peered":"2023-11-27T21:21:49.439014+0000","last_clean":"2023-11-27T21:21:49.439014+0000","last_became_active":"2023-11-27T20:55:00.588298+0000","last_became_peered":"2023-11-27T20:55:00.588298+0000","last_unstale":"2023-11-27T21:21:49.439014+0000","last_undegraded":"2023-11-27T21:21:49.439014+0000","last_fullsized":"2023-11-27T21:21:49.439014+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:32:30.458506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'77","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.493919+0000","last_change":"2023-11-27T20:54:27.512956+0000","last_active":"2023-11-27T21:21:49.493919+0000","last_peered":"2023-11-27T21:21:49.493919+0000","last_clean":"2023-11-27T21:21:49.493919+0000","last_became_active":"2023-11-27T20:54:27.512692+0000","last_became_peered":"2023-11-27T20:54:27.512692+0000","last_unstale":"2023-11-27T21:21:49.493919+0000","last_undegraded":"2023-11-27T21:21:49.493919+0000","last_fullsized":"2023-11-27T21:21:49.493919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:53.751196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"28'75","reported_seq":102,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.398697+0000","last_change":"2023-11-27T20:54:27.499043+0000","last_active":"2023-11-27T21:21:49.398697+0000","last_peered":"2023-11-27T21:21:49.398697+0000","last_clean":"2023-11-27T21:21:49.398697+0000","last_became_active":"2023-11-27T20:54:27.498790+0000","last_became_peered":"2023-11-27T20:54:27.498790+0000","last_unstale":"2023-11-27T21:21:49.398697+0000","last_undegraded":"2023-11-27T21:21:49.398697+0000","last_fullsized":"2023-11-27T21:21:49.398697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:41.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"28'85","reported_seq":112,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.495571+0000","last_change":"2023-11-27T20:54:27.513089+0000","last_active":"2023-11-27T21:21:49.495571+0000","last_peered":"2023-11-27T21:21:49.495571+0000","last_clean":"2023-11-27T21:21:49.495571+0000","last_became_active":"2023-11-27T20:54:27.512777+0000","last_became_peered":"2023-11-27T20:54:27.512777+0000","last_unstale":"2023-11-27T21:21:49.495571+0000","last_undegraded":"2023-11-27T21:21:49.495571+0000","last_fullsized":"2023-11-27T21:21:49.495571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:32.362116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'65","reported_seq":92,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.496083+0000","last_change":"2023-11-27T20:54:27.512691+0000","last_active":"2023-11-27T21:21:49.496083+0000","last_peered":"2023-11-27T21:21:49.496083+0000","last_clean":"2023-11-27T21:21:49.496083+0000","last_became_active":"2023-11-27T20:54:27.512433+0000","last_became_peered":"2023-11-27T20:54:27.512433+0000","last_unstale":"2023-11-27T21:21:49.496083+0000","last_undegraded":"2023-11-27T21:21:49.496083+0000","last_fullsized":"2023-11-27T21:21:49.496083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:30.589702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'62","reported_seq":89,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.526396+0000","last_change":"2023-11-27T20:54:27.432322+0000","last_active":"2023-11-27T21:21:49.526396+0000","last_peered":"2023-11-27T21:21:49.526396+0000","last_clean":"2023-11-27T21:21:49.526396+0000","last_became_active":"2023-11-27T20:54:27.432152+0000","last_became_peered":"2023-11-27T20:54:27.432152+0000","last_unstale":"2023-11-27T21:21:49.526396+0000","last_undegraded":"2023-11-27T21:21:49.526396+0000","last_fullsized":"2023-11-27T21:21:49.526396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:02.167926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'69","reported_seq":96,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.497091+0000","last_change":"2023-11-27T20:54:27.516081+0000","last_active":"2023-11-27T21:21:49.497091+0000","last_peered":"2023-11-27T21:21:49.497091+0000","last_clean":"2023-11-27T21:21:49.497091+0000","last_became_active":"2023-11-27T20:54:27.515801+0000","last_became_peered":"2023-11-27T20:54:27.515801+0000","last_unstale":"2023-11-27T21:21:49.497091+0000","last_undegraded":"2023-11-27T21:21:49.497091+0000","last_fullsized":"2023-11-27T21:21:49.497091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:24:30.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'75","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.527386+0000","last_change":"2023-11-27T20:54:27.432375+0000","last_active":"2023-11-27T21:21:49.527386+0000","last_peered":"2023-11-27T21:21:49.527386+0000","last_clean":"2023-11-27T21:21:49.527386+0000","last_became_active":"2023-11-27T20:54:27.432160+0000","last_became_peered":"2023-11-27T20:54:27.432160+0000","last_unstale":"2023-11-27T21:21:49.527386+0000","last_undegraded":"2023-11-27T21:21:49.527386+0000","last_fullsized":"2023-11-27T21:21:49.527386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:36.652979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'77","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.495280+0000","last_change":"2023-11-27T20:54:27.505374+0000","last_active":"2023-11-27T21:21:49.495280+0000","last_peered":"2023-11-27T21:21:49.495280+0000","last_clean":"2023-11-27T21:21:49.495280+0000","last_became_active":"2023-11-27T20:54:27.505122+0000","last_became_peered":"2023-11-27T20:54:27.505122+0000","last_unstale":"2023-11-27T21:21:49.495280+0000","last_undegraded":"2023-11-27T21:21:49.495280+0000","last_fullsized":"2023-11-27T21:21:49.495280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:10:30.589702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"28'74","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.476666+0000","last_change":"2023-11-27T20:54:27.505531+0000","last_active":"2023-11-27T21:21:49.476666+0000","last_peered":"2023-11-27T21:21:49.476666+0000","last_clean":"2023-11-27T21:21:49.476666+0000","last_became_active":"2023-11-27T20:54:27.505236+0000","last_became_peered":"2023-11-27T20:54:27.505236+0000","last_unstale":"2023-11-27T21:21:49.476666+0000","last_undegraded":"2023-11-27T21:21:49.476666+0000","last_fullsized":"2023-11-27T21:21:49.476666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:56:02.651538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"28'79","reported_seq":109,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.494913+0000","last_change":"2023-11-27T20:54:27.515185+0000","last_active":"2023-11-27T21:21:49.494913+0000","last_peered":"2023-11-27T21:21:49.494913+0000","last_clean":"2023-11-27T21:21:49.494913+0000","last_became_active":"2023-11-27T20:54:27.514846+0000","last_became_peered":"2023-11-27T20:54:27.514846+0000","last_unstale":"2023-11-27T21:21:49.494913+0000","last_undegraded":"2023-11-27T21:21:49.494913+0000","last_fullsized":"2023-11-27T21:21:49.494913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:43:42.137077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":102,"num_write":4200,"num_write_kb":332069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5131,"ondisk_log_size":5131,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4855,"ondisk_log_size":4855,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":44272102,"num_objects":111,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":1673,"num_read_kb":1711,"num_write":16676,"num_write_kb":52124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":88793088,"data_stored":88544204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15183,"ondisk_log_size":15183,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509777,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95988,"kb_used_data":20396,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94275852,"statfs":{"total":96636764160,"available":96538472448,"internally_reserved":0,"allocated":20885504,"data_stored":20696148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.40200000000000002,"15min":0.40699999999999997},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.19900000000000001},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.95599999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46500000000000002,"15min":0.46400000000000002},"min":{"1min":0.30199999999999999,"5min":0.27500000000000002,"15min":0.24199999999999999},"max":{"1min":0.56399999999999995,"5min":0.58899999999999997,"15min":1.1819999999999999},"last":0.504}]},{"osd":1,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.42899999999999999,"15min":0.432},"min":{"1min":0.27100000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.78300000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.40200000000000002,"15min":0.40600000000000003},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.247},"max":{"1min":0.59599999999999997,"5min":0.59899999999999998,"15min":1.2250000000000001},"last":0.46800000000000003}]},{"osd":2,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41599999999999998,"15min":0.40999999999999998},"min":{"1min":0.30399999999999999,"5min":0.27700000000000002,"15min":0.21199999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":1.2549999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.436,"15min":0.436},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.23899999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":1.2450000000000001},"last":0.44500000000000001}]},{"osd":3,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.438},"min":{"1min":0.307,"5min":0.307,"15min":0.26800000000000002},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.87},"last":0.436},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.45600000000000002,"15min":0.44400000000000001},"min":{"1min":0.39100000000000001,"5min":0.34699999999999998,"15min":0.307},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":1.2090000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.41199999999999998,"15min":0.39700000000000002},"min":{"1min":0.25900000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.80600000000000005},"last":0.376},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.42699999999999999,"15min":0.41899999999999998},"min":{"1min":0.29499999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.64900000000000002,"5min":0.68100000000000005,"15min":0.92800000000000005},"last":0.35499999999999998}]},{"osd":5,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.41799999999999998,"15min":0.40400000000000003},"min":{"1min":0.33000000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.47899999999999998,"15min":0.45900000000000002},"min":{"1min":0.33900000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.77600000000000002},"last":0.29499999999999998}]},{"osd":7,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47199999999999998,"15min":0.46700000000000003},"min":{"1min":0.371,"5min":0.26600000000000001,"15min":0.249},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.95599999999999996},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.46600000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28199999999999997},"max":{"1min":0.79400000000000004,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.40799999999999997}]}]},{"osd":5,"up_from":15,"seq":64424509777,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94852,"kb_used_data":19260,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94276988,"statfs":{"total":96636764160,"available":96539635712,"internally_reserved":0,"allocated":19722240,"data_stored":19520171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.41199999999999998,"15min":0.40600000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.216},"max":{"1min":0.57799999999999996,"5min":1.331,"15min":1.331},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42199999999999999,"15min":0.41799999999999998},"min":{"1min":0.318,"5min":0.27900000000000003,"15min":0.222},"max":{"1min":0.49199999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.54300000000000004}]},{"osd":1,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41399999999999998,"15min":0.42399999999999999},"min":{"1min":0.307,"5min":0.224,"15min":0.221},"max":{"1min":0.56100000000000005,"5min":0.624,"15min":0.95999999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42399999999999999,"15min":0.41599999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.28599999999999998},"max":{"1min":0.59399999999999997,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.435}]},{"osd":2,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42299999999999999,"15min":0.42999999999999999},"min":{"1min":0.309,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.94599999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.438,"15min":0.42799999999999999},"min":{"1min":0.33600000000000002,"5min":0.30599999999999999,"15min":0.29899999999999999},"max":{"1min":0.61599999999999999,"5min":1.359,"15min":1.359},"last":0.59799999999999998}]},{"osd":3,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.45500000000000002,"15min":0.45000000000000001},"min":{"1min":0.35999999999999999,"5min":0.32500000000000001,"15min":0.28899999999999998},"max":{"1min":0.59099999999999997,"5min":0.64500000000000002,"15min":0.93300000000000005},"last":0.63},{"interface":"front","average":{"1min":0.432,"5min":0.47599999999999998,"15min":0.46000000000000002},"min":{"1min":0.34000000000000002,"5min":0.32600000000000001,"15min":0.30199999999999999},"max":{"1min":0.54800000000000004,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":0.47499999999999998}]},{"osd":4,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.38400000000000001,"15min":0.379},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23100000000000001},"max":{"1min":0.65800000000000003,"5min":0.66300000000000003,"15min":0.69199999999999995},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.40400000000000003,"15min":0.40300000000000002},"min":{"1min":0.29899999999999999,"5min":0.255,"15min":0.23200000000000001},"max":{"1min":0.61499999999999999,"5min":0.66800000000000004,"15min":0.70299999999999996},"last":0.375}]},{"osd":6,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.41099999999999998,"15min":0.40400000000000003},"min":{"1min":0.28299999999999997,"5min":0.27100000000000002,"15min":0.246},"max":{"1min":0.67600000000000005,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42899999999999999,"15min":0.42799999999999999},"min":{"1min":0.315,"5min":0.27100000000000002,"15min":0.23300000000000001},"max":{"1min":0.68600000000000005,"5min":0.69299999999999995,"15min":0.70399999999999996},"last":0.34499999999999997}]},{"osd":7,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.46400000000000002,"15min":0.45800000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.24199999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.311},{"interface":"front","average":{"1min":0.495,"5min":0.49399999999999999,"15min":0.49099999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.751},"last":0.39600000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509778,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53560,"kb_used_data":8496,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318280,"statfs":{"total":96636764160,"available":96581918720,"internally_reserved":0,"allocated":8699904,"data_stored":8509387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32000000000000001,"15min":0.30399999999999999},"min":{"1min":0.25,"5min":0.19600000000000001,"15min":0.17899999999999999},"max":{"1min":0.44900000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.316},"min":{"1min":0.26100000000000001,"5min":0.20200000000000001,"15min":0.17299999999999999},"max":{"1min":0.438,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.45800000000000002}]},{"osd":1,"last update":"Mon Nov 27 21:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.35899999999999999,"15min":0.34200000000000003},"min":{"1min":0.27000000000000002,"5min":0.20599999999999999,"15min":0.192},"max":{"1min":0.59299999999999997,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.36499999999999999,"15min":0.34799999999999998},"min":{"1min":0.27700000000000002,"5min":0.22900000000000001,"15min":0.20899999999999999},"max":{"1min":0.53900000000000003,"5min":0.751,"15min":0.751},"last":0.51800000000000002}]},{"osd":3,"last update":"Mon Nov 27 21:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.35899999999999999,"15min":0.34499999999999997},"min":{"1min":0.26000000000000001,"5min":0.22500000000000001,"15min":0.224},"max":{"1min":0.53200000000000003,"5min":0.55700000000000005,"15min":0.66200000000000003},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42599999999999999,"15min":0.38700000000000001},"min":{"1min":0.317,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":0.59199999999999997,"5min":0.62,"15min":0.63700000000000001},"last":0.56299999999999994}]},{"osd":4,"last update":"Mon Nov 27 21:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.49399999999999999,"15min":0.48199999999999998},"min":{"1min":0.42199999999999999,"5min":0.313,"15min":0.28199999999999997},"max":{"1min":0.59299999999999997,"5min":0.71299999999999997,"15min":0.879},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.48999999999999999,"15min":0.48399999999999999},"min":{"1min":0.40600000000000003,"5min":0.35799999999999998,"15min":0.311},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.83299999999999996},"last":0.57899999999999996}]},{"osd":5,"last update":"Mon Nov 27 21:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47299999999999998,"15min":0.47599999999999998},"min":{"1min":0.36399999999999999,"5min":0.32300000000000001,"15min":0.30399999999999999},"max":{"1min":0.628,"5min":0.69099999999999995,"15min":0.83199999999999996},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52500000000000002,"15min":0.5},"min":{"1min":0.35299999999999998,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.71099999999999997,"5min":0.77200000000000002,"15min":0.84099999999999997},"last":0.68799999999999994}]},{"osd":6,"last update":"Mon Nov 27 21:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51600000000000001,"15min":0.502},"min":{"1min":0.39100000000000001,"5min":0.372,"15min":0.34000000000000002},"max":{"1min":0.80700000000000005,"5min":0.81399999999999995,"15min":0.90900000000000003},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.503,"15min":0.496},"min":{"1min":0.40899999999999997,"5min":0.34999999999999998,"15min":0.316},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.76900000000000002},"last":0.753}]},{"osd":7,"last update":"Mon Nov 27 21:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53600000000000003,"15min":0.52300000000000002},"min":{"1min":0.39700000000000002,"5min":0.39300000000000002,"15min":0.36399999999999999},"max":{"1min":0.77000000000000002,"5min":0.79100000000000004,"15min":0.85799999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.43099999999999999,"5min":0.36099999999999999,"15min":0.34000000000000002},"max":{"1min":0.64300000000000002,"5min":0.73999999999999999,"15min":0.92400000000000004},"last":0.77000000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509778,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42852,"kb_used_data":3356,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94328988,"statfs":{"total":96636764160,"available":96592883712,"internally_reserved":0,"allocated":3436544,"data_stored":3238767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30599999999999999,"15min":0.307},"min":{"1min":0.214,"5min":0.20599999999999999,"15min":0.17000000000000001},"max":{"1min":0.47899999999999998,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.311,"5min":0.311,"15min":0.30499999999999999},"min":{"1min":0.222,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.37}]},{"osd":2,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.33000000000000002,"15min":0.309},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.188},"max":{"1min":0.54600000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.33800000000000002,"15min":0.34000000000000002},"min":{"1min":0.25900000000000001,"5min":0.22600000000000001,"15min":0.20499999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.40300000000000002}]},{"osd":3,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.37,"15min":0.36599999999999999},"min":{"1min":0.27500000000000002,"5min":0.23899999999999999,"15min":0.23300000000000001},"max":{"1min":0.441,"5min":0.626,"15min":0.68200000000000005},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.377,"15min":0.36499999999999999},"min":{"1min":0.26800000000000002,"5min":0.24399999999999999,"15min":0.22600000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.27700000000000002}]},{"osd":4,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45300000000000001,"15min":0.46999999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.26600000000000001},"max":{"1min":0.60299999999999998,"5min":0.70599999999999996,"15min":1.4510000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.47899999999999998,"15min":0.48399999999999999},"min":{"1min":0.34300000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.61799999999999999,"5min":0.84199999999999997,"15min":0.89900000000000002},"last":0.56399999999999995}]},{"osd":5,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.35399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.64300000000000002,"5min":0.81799999999999995,"15min":0.82199999999999995},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.46999999999999997,"15min":0.49099999999999999},"min":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.29999999999999999},"max":{"1min":0.67600000000000005,"5min":0.70999999999999996,"15min":1.4119999999999999},"last":0.629}]},{"osd":6,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.38200000000000001,"5min":0.36499999999999999,"15min":0.33600000000000002},"max":{"1min":0.72199999999999998,"5min":0.79800000000000004,"15min":0.92800000000000005},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.503,"15min":0.51700000000000002},"min":{"1min":0.36199999999999999,"5min":0.35899999999999999,"15min":0.34499999999999997},"max":{"1min":0.60299999999999998,"5min":0.86399999999999999,"15min":1.4239999999999999},"last":0.64300000000000002}]},{"osd":7,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.51900000000000002,"15min":0.52400000000000002},"min":{"1min":0.39900000000000002,"5min":0.371,"15min":0.33200000000000002},"max":{"1min":0.67600000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.51100000000000001,"15min":0.51600000000000001},"min":{"1min":0.39000000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.64200000000000002,"5min":0.83099999999999996,"15min":1.4399999999999999},"last":0.57699999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509777,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76024,"kb_used_data":8752,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94295816,"statfs":{"total":96636764160,"available":96558915584,"internally_reserved":0,"allocated":8962048,"data_stored":8748777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.315,"15min":0.309},"min":{"1min":0.24199999999999999,"5min":0.20100000000000001,"15min":0.186},"max":{"1min":0.44800000000000001,"5min":0.54600000000000004,"15min":0.57799999999999996},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.28799999999999998,"5min":0.31,"15min":0.311},"min":{"1min":0.219,"5min":0.219,"15min":0.19},"max":{"1min":0.42299999999999999,"5min":0.503,"15min":0.69699999999999995},"last":0.311}]},{"osd":2,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.34399999999999997,"15min":0.34100000000000003},"min":{"1min":0.223,"5min":0.223,"15min":0.189},"max":{"1min":0.48699999999999999,"5min":0.54300000000000004,"15min":0.59299999999999997},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.315,"5min":0.34999999999999998,"15min":0.34200000000000003},"min":{"1min":0.25900000000000001,"5min":0.223,"15min":0.19900000000000001},"max":{"1min":0.40100000000000002,"5min":0.55500000000000005,"15min":0.66900000000000004},"last":0.34699999999999998}]},{"osd":3,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.36099999999999999,"15min":0.34699999999999998},"min":{"1min":0.25600000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.44900000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39400000000000002,"15min":0.38100000000000001},"min":{"1min":0.25800000000000001,"5min":0.253,"15min":0.21099999999999999},"max":{"1min":0.58399999999999996,"5min":0.59699999999999998,"15min":0.61599999999999999},"last":0.36499999999999999}]},{"osd":4,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.44800000000000001,"15min":0.45900000000000002},"min":{"1min":0.32300000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":1.3009999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46899999999999997,"15min":0.47399999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.27200000000000002},"max":{"1min":0.56599999999999995,"5min":0.71199999999999997,"15min":1.1220000000000001},"last":0.44600000000000001}]},{"osd":5,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.50700000000000001,"15min":0.5},"min":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.32700000000000001},"max":{"1min":0.58499999999999996,"5min":0.81499999999999995,"15min":1.1930000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46600000000000003,"15min":0.46700000000000003},"min":{"1min":0.36099999999999999,"5min":0.35099999999999998,"15min":0.317},"max":{"1min":0.63700000000000001,"5min":0.753,"15min":1.3180000000000001},"last":0.45800000000000002}]},{"osd":6,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.31900000000000001},"max":{"1min":0.73099999999999998,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.505,"5min":0.52500000000000002,"15min":0.52200000000000002},"min":{"1min":0.41599999999999998,"5min":0.36799999999999999,"15min":0.34499999999999997},"max":{"1min":0.60899999999999999,"5min":0.85699999999999998,"15min":1.282},"last":0.46899999999999997}]},{"osd":7,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.33500000000000002},"max":{"1min":0.65200000000000002,"5min":0.89300000000000002,"15min":1.171},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48899999999999999,"15min":0.498},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":1.2589999999999999},"last":0.50900000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542482,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52808,"kb_used_data":7744,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94319032,"statfs":{"total":96636764160,"available":96582688768,"internally_reserved":0,"allocated":7929856,"data_stored":7711066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":46135755},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:21:01 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.39400000000000002,"15min":0.39900000000000002},"min":{"1min":0.26100000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.61499999999999999,"5min":0.63300000000000001,"15min":0.82899999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41499999999999998,"15min":0.42799999999999999},"min":{"1min":0.27000000000000002,"5min":0.26200000000000001,"15min":0.22900000000000001},"max":{"1min":0.48699999999999999,"5min":0.57599999999999996,"15min":0.61399999999999999},"last":0.46400000000000002}]},{"osd":1,"last update":"Mon Nov 27 21:21:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42399999999999999,"15min":0.432},"min":{"1min":0.26800000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.88500000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.373,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.59099999999999997,"5min":0.59199999999999997,"15min":0.873},"last":0.47799999999999998}]},{"osd":2,"last update":"Mon Nov 27 21:21:01 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.41999999999999998,"15min":0.435},"min":{"1min":0.34699999999999998,"5min":0.29399999999999998,"15min":0.27000000000000002},"max":{"1min":0.56699999999999995,"5min":0.65300000000000002,"15min":0.79700000000000004},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.41399999999999998,"15min":0.41999999999999998},"min":{"1min":0.29599999999999999,"5min":0.27000000000000002,"15min":0.247},"max":{"1min":0.496,"5min":0.55200000000000005,"15min":0.68700000000000006},"last":0.501}]},{"osd":3,"last update":"Mon Nov 27 21:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.442,"15min":0.44900000000000001},"min":{"1min":0.29599999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.77100000000000002},"last":0.432},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.45900000000000002,"15min":0.45100000000000001},"min":{"1min":0.36799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.90200000000000002},"last":0.51300000000000001}]},{"osd":4,"last update":"Mon Nov 27 21:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.39800000000000002,"15min":0.40200000000000002},"min":{"1min":0.30099999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.55300000000000005,"5min":0.59199999999999997,"15min":0.70099999999999996},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.41499999999999998,"15min":0.42199999999999999},"min":{"1min":0.307,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.745},"last":0.30499999999999999}]},{"osd":5,"last update":"Mon Nov 27 21:21:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.45200000000000001,"15min":0.44400000000000001},"min":{"1min":0.30499999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.438,"15min":0.44600000000000001},"min":{"1min":0.32400000000000001,"5min":0.26400000000000001,"15min":0.248},"max":{"1min":0.70299999999999996,"5min":0.71499999999999997,"15min":0.77700000000000002},"last":0.379}]},{"osd":6,"last update":"Mon Nov 27 21:21:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45700000000000002,"15min":0.46000000000000002},"min":{"1min":0.35499999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52600000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.496,"15min":0.499},"min":{"1min":0.35799999999999998,"5min":0.29099999999999998,"15min":0.28100000000000003},"max":{"1min":0.751,"5min":0.751,"15min":0.84999999999999998},"last":0.39600000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542482,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57800,"kb_used_data":8576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94314040,"statfs":{"total":96636764160,"available":96577576960,"internally_reserved":0,"allocated":8781824,"data_stored":8552244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,3,5,48,9,32,9,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41499999999999998,"15min":0.40600000000000003},"min":{"1min":0.27900000000000003,"5min":0.248,"15min":0.20200000000000001},"max":{"1min":0.58599999999999997,"5min":0.59299999999999997,"15min":0.66100000000000003},"last":1.446},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44700000000000001,"15min":0.435},"min":{"1min":0.29399999999999998,"5min":0.28299999999999997,"15min":0.24099999999999999},"max":{"1min":0.60499999999999998,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":3.948}]},{"osd":1,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.41499999999999998,"15min":0.41699999999999998},"min":{"1min":0.309,"5min":0.30199999999999999,"15min":0.24099999999999999},"max":{"1min":0.52800000000000002,"5min":0.626,"15min":0.65100000000000002},"last":5.0410000000000004},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42599999999999999,"15min":0.41599999999999998},"min":{"1min":0.33800000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.50600000000000001,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":1.181}]},{"osd":2,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.42599999999999999,"15min":0.42699999999999999},"min":{"1min":0.34000000000000002,"5min":0.29499999999999998,"15min":0.26100000000000001},"max":{"1min":0.622,"5min":0.64300000000000002,"15min":0.745},"last":1.5089999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.441,"15min":0.44600000000000001},"min":{"1min":0.307,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":0.51700000000000002,"5min":0.65200000000000002,"15min":0.78100000000000003},"last":4.008}]},{"osd":3,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.47799999999999998,"15min":0.46800000000000003},"min":{"1min":0.38800000000000001,"5min":0.318,"15min":0.29899999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.79200000000000004},"last":1.532},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46200000000000002,"15min":0.45500000000000002},"min":{"1min":0.35799999999999998,"5min":0.32600000000000001,"15min":0.28499999999999998},"max":{"1min":0.55100000000000005,"5min":0.63400000000000001,"15min":0.68500000000000005},"last":10.747999999999999}]},{"osd":5,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41499999999999998,"15min":0.39400000000000002},"min":{"1min":0.26300000000000001,"5min":0.23100000000000001,"15min":0.221},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":20.847999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40799999999999997,"15min":0.41199999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23100000000000001},"max":{"1min":0.55400000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":5.0800000000000001}]},{"osd":6,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.42999999999999999,"15min":0.41799999999999998},"min":{"1min":0.29899999999999999,"5min":0.26800000000000002,"15min":0.24399999999999999},"max":{"1min":0.60599999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.48999999999999999,"15min":0.46800000000000003},"min":{"1min":0.35099999999999998,"5min":0.28100000000000003,"15min":0.27400000000000002},"max":{"1min":0.66000000000000003,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":1.478}]},{"osd":7,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46200000000000002,"15min":0.45500000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.64300000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":1.113},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.434,"5min":0.35199999999999998,"15min":0.33400000000000002},"max":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":3.4649999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542482,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89188,"kb_used_data":13596,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94282652,"statfs":{"total":96636764160,"available":96545435648,"internally_reserved":0,"allocated":13922304,"data_stored":13708692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.311,"15min":0.312},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.47899999999999998,"5min":0.52400000000000002,"15min":0.56499999999999995},"last":0.254},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.31,"15min":0.307},"min":{"1min":0.21099999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.56999999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.29099999999999998}]},{"osd":1,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.29499999999999998,"5min":0.30099999999999999,"15min":0.309},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.39300000000000002,"5min":0.45800000000000002,"15min":1.0249999999999999},"last":0.317},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.35899999999999999,"15min":0.34999999999999998},"min":{"1min":0.23999999999999999,"5min":0.23000000000000001,"15min":0.21199999999999999},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":1.0069999999999999},"last":0.33400000000000002}]},{"osd":2,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36699999999999999,"15min":0.36799999999999999},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.22600000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":1.046},"last":0.377},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.371},"min":{"1min":0.27700000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.59899999999999998,"5min":0.623,"15min":0.69999999999999996},"last":0.35799999999999998}]},{"osd":4,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45200000000000001,"15min":0.46200000000000002},"min":{"1min":0.35099999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.59099999999999997,"5min":0.69799999999999995,"15min":0.93799999999999994},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.47599999999999998,"15min":0.48399999999999999},"min":{"1min":0.39400000000000002,"5min":0.34499999999999997,"15min":0.314},"max":{"1min":0.65900000000000003,"5min":0.71199999999999997,"15min":0.73999999999999999},"last":0.47899999999999998}]},{"osd":5,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48399999999999999,"15min":0.48599999999999999},"min":{"1min":0.42099999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.71499999999999997,"5min":0.75,"15min":0.75},"last":0.505},{"interface":"front","average":{"1min":0.502,"5min":0.495,"15min":0.50600000000000001},"min":{"1min":0.373,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67900000000000005,"5min":0.78600000000000003,"15min":1.071},"last":0.46899999999999997}]},{"osd":6,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.495,"15min":0.504},"min":{"1min":0.39100000000000001,"5min":0.36599999999999999,"15min":0.311},"max":{"1min":0.61299999999999999,"5min":0.65400000000000003,"15min":0.97899999999999998},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.49199999999999999,"15min":0.5},"min":{"1min":0.35999999999999999,"5min":0.35599999999999998,"15min":0.314},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.46000000000000002}]},{"osd":7,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51500000000000001,"15min":0.52200000000000002},"min":{"1min":0.40699999999999997,"5min":0.36099999999999999,"15min":0.35999999999999999},"max":{"1min":0.66800000000000004,"5min":0.75800000000000001,"15min":1.0900000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51900000000000002,"15min":0.52200000000000002},"min":{"1min":0.42199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68999999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.51700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8667136,"data_stored":8628738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2547712,"data_stored":2528360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13627392,"data_stored":13588653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8486912,"data_stored":8432205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18833408,"data_stored":18809764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20590592,"data_stored":20576109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7634944,"data_stored":7591027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T21:21:57.265 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T21:21:57.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.399+0000 7f2285f68640 1 Processor -- start 2023-11-27T21:21:57.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.399+0000 7f2285f68640 1 -- start start 2023-11-27T21:21:57.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.399+0000 7f2285f68640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f22800cda70 0x7f22800ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:57.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.399+0000 7f2285f68640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f22800cc420 0x7f2280159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:57.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.399+0000 7f2285f68640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22800cbda0 con 0x7f2280159b50 2023-11-27T21:21:57.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.399+0000 7f2285f68640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22800cc230 con 0x7f22800cda70 2023-11-27T21:21:57.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.399+0000 7f2285f68640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22800cb4e0 con 0x7f22800cc420 2023-11-27T21:21:57.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.400+0000 7f227f7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f22800cda70 0x7f22800ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:57.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.400+0000 7f227effd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f22800cc420 0x7f2280159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:57.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.400+0000 7f227effd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f22800cc420 0x7f2280159610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:51626/0 (socket says 172.21.15.88:51626) 2023-11-27T21:21:57.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.400+0000 7f227effd640 1 -- 172.21.15.88:0/753018595 learned_addr learned my addr 172.21.15.88:0/753018595 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:57.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.403+0000 7f227effd640 1 -- 172.21.15.88:0/753018595 >> v2:172.21.15.88:3300/0 conn(0x7f22800cda70 msgr2=0x7f22800ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:21:57.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.403+0000 7f227effd640 1 --2- 172.21.15.88:0/753018595 >> v2:172.21.15.88:3300/0 conn(0x7f22800cda70 0x7f22800ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:57.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.403+0000 7f227effd640 1 -- 172.21.15.88:0/753018595 >> v1:172.21.15.88:6789/0 conn(0x7f2280159b50 legacy=0x7f22800c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:57.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.403+0000 7f227effd640 1 -- 172.21.15.88:0/753018595 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22800cce00 con 0x7f22800cc420 2023-11-27T21:21:57.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.405+0000 7f227effd640 1 --2- 172.21.15.88:0/753018595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22800cc420 0x7f2280159610 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f22800cfda0 tx=0x7f227002ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad3d96a217e52fb8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:57.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.408+0000 7f227e7fc640 1 -- 172.21.15.88:0/753018595 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227002f850 con 0x7f22800cc420 2023-11-27T21:21:57.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.408+0000 7f227e7fc640 1 -- 172.21.15.88:0/753018595 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227002f9b0 con 0x7f22800cc420 2023-11-27T21:21:57.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.408+0000 7f227e7fc640 1 -- 172.21.15.88:0/753018595 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227002fd40 con 0x7f22800cc420 2023-11-27T21:21:57.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.409+0000 7f2285f68640 1 -- 172.21.15.88:0/753018595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22800cc420 msgr2=0x7f2280159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:57.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.409+0000 7f2285f68640 1 --2- 172.21.15.88:0/753018595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22800cc420 0x7f2280159610 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f22800cfda0 tx=0x7f227002ba30 comp rx=0 tx=0).stop 2023-11-27T21:21:57.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.409+0000 7f2285f68640 1 -- 172.21.15.88:0/753018595 shutdown_connections 2023-11-27T21:21:57.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.409+0000 7f2285f68640 1 --2- 172.21.15.88:0/753018595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22800cc420 0x7f2280159610 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:57.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.409+0000 7f2285f68640 1 --2- 172.21.15.88:0/753018595 >> v2:172.21.15.88:3300/0 conn(0x7f22800cda70 0x7f22800ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:57.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.409+0000 7f2285f68640 1 -- 172.21.15.88:0/753018595 >> 172.21.15.88:0/753018595 conn(0x7f22800b07b0 msgr2=0x7f22800b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:57.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.409+0000 7f2285f68640 1 -- 172.21.15.88:0/753018595 shutdown_connections 2023-11-27T21:21:57.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.409+0000 7f2285f68640 1 -- 172.21.15.88:0/753018595 wait complete. 2023-11-27T21:21:57.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.410+0000 7f2285f68640 1 Processor -- start 2023-11-27T21:21:57.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.410+0000 7f2285f68640 1 -- start start 2023-11-27T21:21:57.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.411+0000 7f2285f68640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22800cc420 0x7f22800b1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:57.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.411+0000 7f2285f68640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22800cda70 0x7f22800c3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:57.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.411+0000 7f2285f68640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2280159b50 0x7f22801f2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:57.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.411+0000 7f2285f68640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22800b1d80 con 0x7f22800cc420 2023-11-27T21:21:57.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.411+0000 7f2285f68640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2280154830 con 0x7f2280159b50 2023-11-27T21:21:57.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.411+0000 7f2285f68640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22801553b0 con 0x7f22800cda70 2023-11-27T21:21:57.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.412+0000 7f227f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22800cc420 0x7f22800b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:57.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.412+0000 7f227ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2280159b50 0x7f22801f2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:57.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.412+0000 7f227f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22800cc420 0x7f22800b1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47150/0 (socket says 172.21.15.88:47150) 2023-11-27T21:21:57.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.412+0000 7f227f7fe640 1 -- 172.21.15.88:0/1681990726 learned_addr learned my addr 172.21.15.88:0/1681990726 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:57.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.412+0000 7f227effd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22800cda70 0x7f22800c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:57.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.415+0000 7f227f7fe640 1 -- 172.21.15.88:0/1681990726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22800cda70 msgr2=0x7f22800c3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:57.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.415+0000 7f227f7fe640 1 --2- 172.21.15.88:0/1681990726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22800cda70 0x7f22800c3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:57.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.415+0000 7f227f7fe640 1 -- 172.21.15.88:0/1681990726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2280159b50 msgr2=0x7f22801f2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:57.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.415+0000 7f227f7fe640 1 --2- 172.21.15.88:0/1681990726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2280159b50 0x7f22801f2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:57.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.415+0000 7f227f7fe640 1 -- 172.21.15.88:0/1681990726 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22700094d0 con 0x7f22800cc420 2023-11-27T21:21:57.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.417+0000 7f227f7fe640 1 --2- 172.21.15.88:0/1681990726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22800cc420 0x7f22800b1840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f227400e9e0 tx=0x7f227400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:57.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.421+0000 7f2267fff640 1 -- 172.21.15.88:0/1681990726 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2274009670 con 0x7f22800cc420 2023-11-27T21:21:57.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.421+0000 7f2267fff640 1 -- 172.21.15.88:0/1681990726 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227400c9d0 con 0x7f22800cc420 2023-11-27T21:21:57.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.421+0000 7f2285f68640 1 -- 172.21.15.88:0/1681990726 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2280156a50 con 0x7f22800cc420 2023-11-27T21:21:57.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.421+0000 7f2267fff640 1 -- 172.21.15.88:0/1681990726 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227400cd80 con 0x7f22800cc420 2023-11-27T21:21:57.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.421+0000 7f2285f68640 1 -- 172.21.15.88:0/1681990726 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2280154d60 con 0x7f22800cc420 2023-11-27T21:21:57.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.422+0000 7f2285f68640 1 -- 172.21.15.88:0/1681990726 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2280067470 con 0x7f22800cc420 2023-11-27T21:21:57.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.666+0000 7f2267fff640 1 -- 172.21.15.88:0/1681990726 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2274013470 con 0x7f22800cc420 2023-11-27T21:21:57.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.666+0000 7f2267fff640 1 --2- 172.21.15.88:0/1681990726 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f226c06b210 0x7f226c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:57.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.666+0000 7f227effd640 1 --2- 172.21.15.88:0/1681990726 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f226c06b210 0x7f226c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:57.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.667+0000 7f227effd640 1 --2- 172.21.15.88:0/1681990726 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f226c06b210 0x7f226c06d6d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2270036000 tx=0x7f2270008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:57.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.680+0000 7f2267fff640 1 -- 172.21.15.88:0/1681990726 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2274058e60 con 0x7f22800cc420 2023-11-27T21:21:57.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.680+0000 7f2267fff640 1 -- 172.21.15.88:0/1681990726 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f22740551a0 con 0x7f22800cc420 2023-11-27T21:21:57.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.853+0000 7f2285f68640 1 -- 172.21.15.88:0/1681990726 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22800b4c20 con 0x7f22800cc420 2023-11-27T21:21:57.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.891+0000 7f2267fff640 1 -- 172.21.15.88:0/1681990726 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18666 (secure 0 0 0) 0x7f2274017090 con 0x7f22800cc420 2023-11-27T21:21:57.894 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T21:21:57.894 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":28,"fsid":"ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc","created":"2023-11-27T20:53:53.110827+0000","modified":"2023-11-27T20:55:00.550945+0000","last_up_change":"2023-11-27T20:54:08.219383+0000","last_in_change":"2023-11-27T20:53:59.022798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:54:09.277670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:54:24.503156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:54:25.744043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T20:54:29.704111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1207ca0f-bef1-44c6-b66b-58bf0e080ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6819","nonce":3952326022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6821","nonce":3952326022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6825","nonce":3952326022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6823","nonce":3952326022}]},"public_addr":"172.21.15.88:6819/3952326022","cluster_addr":"172.21.15.88:6821/3952326022","heartbeat_back_addr":"172.21.15.88:6825/3952326022","heartbeat_front_addr":"172.21.15.88:6823/3952326022","state":["exists","up"]},{"osd":1,"uuid":"8d1be479-4241-4335-9633-1394311fde76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6827","nonce":1788401966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6829","nonce":1788401966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6833","nonce":1788401966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6831","nonce":1788401966}]},"public_addr":"172.21.15.88:6827/1788401966","cluster_addr":"172.21.15.88:6829/1788401966","heartbeat_back_addr":"172.21.15.88:6833/1788401966","heartbeat_front_addr":"172.21.15.88:6831/1788401966","state":["exists","up"]},{"osd":2,"uuid":"7536b008-05dd-40eb-9d4a-bdac4b1c38c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6803","nonce":1166333913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6805","nonce":1166333913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6809","nonce":1166333913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6807","nonce":1166333913}]},"public_addr":"172.21.15.88:6803/1166333913","cluster_addr":"172.21.15.88:6805/1166333913","heartbeat_back_addr":"172.21.15.88:6809/1166333913","heartbeat_front_addr":"172.21.15.88:6807/1166333913","state":["exists","up"]},{"osd":3,"uuid":"47edd4d7-e99c-4ce3-851b-cc9c8e2d4480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6811","nonce":406887502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6813","nonce":406887502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6817","nonce":406887502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6815","nonce":406887502}]},"public_addr":"172.21.15.88:6811/406887502","cluster_addr":"172.21.15.88:6813/406887502","heartbeat_back_addr":"172.21.15.88:6817/406887502","heartbeat_front_addr":"172.21.15.88:6815/406887502","state":["exists","up"]},{"osd":4,"uuid":"0a81dd31-1a8b-41af-b933-d74aae63f3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6801","nonce":2551293703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6803","nonce":2551293703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6807","nonce":2551293703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6805","nonce":2551293703}]},"public_addr":"172.21.15.167:6801/2551293703","cluster_addr":"172.21.15.167:6803/2551293703","heartbeat_back_addr":"172.21.15.167:6807/2551293703","heartbeat_front_addr":"172.21.15.167:6805/2551293703","state":["exists","up"]},{"osd":5,"uuid":"1c462d0d-3361-48b3-a82a-86a920539e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6825","nonce":866085094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6827","nonce":866085094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6831","nonce":866085094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6829","nonce":866085094}]},"public_addr":"172.21.15.167:6825/866085094","cluster_addr":"172.21.15.167:6827/866085094","heartbeat_back_addr":"172.21.15.167:6831/866085094","heartbeat_front_addr":"172.21.15.167:6829/866085094","state":["exists","up"]},{"osd":6,"uuid":"d687c5ad-6c88-4a15-8120-0cdbc5610535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6809","nonce":2766725538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6811","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6813","nonce":2766725538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6819","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6821","nonce":2766725538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6815","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6817","nonce":2766725538}]},"public_addr":"172.21.15.167:6809/2766725538","cluster_addr":"172.21.15.167:6813/2766725538","heartbeat_back_addr":"172.21.15.167:6821/2766725538","heartbeat_front_addr":"172.21.15.167:6817/2766725538","state":["exists","up"]},{"osd":7,"uuid":"c9a50596-4981-4bd8-a8ef-d7679f8d9559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6812","nonce":2695037266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6816","nonce":2695037266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6823","nonce":2695037266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6820","nonce":2695037266}]},"public_addr":"172.21.15.167:6812/2695037266","cluster_addr":"172.21.15.167:6816/2695037266","heartbeat_back_addr":"172.21.15.167:6823/2695037266","heartbeat_front_addr":"172.21.15.167:6820/2695037266","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.522590+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.483170+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.492504+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.432204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.414964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.459803+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.437250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.460394+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.1d","mappings":[{"from":0,"to":1}]},{"pgid":"3.35","mappings":[{"from":0,"to":7}]},{"pgid":"4.4","mappings":[{"from":6,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":4}]},{"pgid":"4.e","mappings":[{"from":3,"to":5}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T21:21:57.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.894+0000 7f2285f68640 1 -- 172.21.15.88:0/1681990726 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f226c06b210 msgr2=0x7f226c06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:57.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.894+0000 7f2285f68640 1 --2- 172.21.15.88:0/1681990726 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f226c06b210 0x7f226c06d6d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2270036000 tx=0x7f2270008030 comp rx=0 tx=0).stop 2023-11-27T21:21:57.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.894+0000 7f2285f68640 1 -- 172.21.15.88:0/1681990726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22800cc420 msgr2=0x7f22800b1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:57.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.894+0000 7f2285f68640 1 --2- 172.21.15.88:0/1681990726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22800cc420 0x7f22800b1840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f227400e9e0 tx=0x7f227400eea0 comp rx=0 tx=0).stop 2023-11-27T21:21:57.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.894+0000 7f2285f68640 1 -- 172.21.15.88:0/1681990726 shutdown_connections 2023-11-27T21:21:57.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.894+0000 7f2285f68640 1 --2- 172.21.15.88:0/1681990726 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f226c06b210 0x7f226c06d6d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:57.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.894+0000 7f2285f68640 1 --2- 172.21.15.88:0/1681990726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2280159b50 0x7f22801f2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:57.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.894+0000 7f2285f68640 1 --2- 172.21.15.88:0/1681990726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22800cda70 0x7f22800c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:57.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.894+0000 7f2285f68640 1 --2- 172.21.15.88:0/1681990726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22800cc420 0x7f22800b1840 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:57.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.894+0000 7f2285f68640 1 -- 172.21.15.88:0/1681990726 >> 172.21.15.88:0/1681990726 conn(0x7f22800b07b0 msgr2=0x7f22800c6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:57.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.894+0000 7f2285f68640 1 -- 172.21.15.88:0/1681990726 shutdown_connections 2023-11-27T21:21:57.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:57.894+0000 7f2285f68640 1 -- 172.21.15.88:0/1681990726 wait complete. 2023-11-27T21:21:58.908 INFO:tasks.ceph:Scrubbing osd.0 2023-11-27T21:21:58.908 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-27T21:21:59.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.012+0000 7f37057d0640 1 Processor -- start 2023-11-27T21:21:59.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.012+0000 7f37057d0640 1 -- start start 2023-11-27T21:21:59.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.012+0000 7f37057d0640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f37000cda70 0x7f37000ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:59.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.012+0000 7f37057d0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37000cc420 0x7f3700159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:59.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.012+0000 7f37057d0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3700159b50 0x7f37000c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:59.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.012+0000 7f37057d0640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37000cc230 con 0x7f37000cda70 2023-11-27T21:21:59.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.012+0000 7f37057d0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37000cbda0 con 0x7f3700159b50 2023-11-27T21:21:59.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.012+0000 7f37057d0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37000cb4e0 con 0x7f37000cc420 2023-11-27T21:21:59.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.013+0000 7f36feffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f37000cda70 0x7f37000ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:59.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.013+0000 7f36ff7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3700159b50 0x7f37000c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:59.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.013+0000 7f36f7fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37000cc420 0x7f3700159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:59.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.013+0000 7f36ff7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3700159b50 0x7f37000c9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:51646/0 (socket says 172.21.15.88:51646) 2023-11-27T21:21:59.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.013+0000 7f36ff7fe640 1 -- 172.21.15.88:0/104889312 learned_addr learned my addr 172.21.15.88:0/104889312 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:59.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.016+0000 7f36ff7fe640 1 -- 172.21.15.88:0/104889312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37000cc420 msgr2=0x7f3700159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:21:59.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.016+0000 7f36ff7fe640 1 --2- 172.21.15.88:0/104889312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37000cc420 0x7f3700159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:59.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.016+0000 7f36ff7fe640 1 -- 172.21.15.88:0/104889312 >> v2:172.21.15.88:3300/0 conn(0x7f37000cda70 msgr2=0x7f37000ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:21:59.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.016+0000 7f36ff7fe640 1 --2- 172.21.15.88:0/104889312 >> v2:172.21.15.88:3300/0 conn(0x7f37000cda70 0x7f37000ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:59.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.016+0000 7f36ff7fe640 1 -- 172.21.15.88:0/104889312 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37000cce00 con 0x7f3700159b50 2023-11-27T21:21:59.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.018+0000 7f36ff7fe640 1 --2- 172.21.15.88:0/104889312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3700159b50 0x7f37000c9620 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f370006a7f0 tx=0x7f36f802bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86fb9a67c4bfee6b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:59.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.022+0000 7f36fe7fc640 1 -- 172.21.15.88:0/104889312 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f802cb00 con 0x7f3700159b50 2023-11-27T21:21:59.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.022+0000 7f36fe7fc640 1 -- 172.21.15.88:0/104889312 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f802cc60 con 0x7f3700159b50 2023-11-27T21:21:59.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.022+0000 7f36fe7fc640 1 -- 172.21.15.88:0/104889312 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f80343f0 con 0x7f3700159b50 2023-11-27T21:21:59.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.022+0000 7f37057d0640 1 -- 172.21.15.88:0/104889312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3700159b50 msgr2=0x7f37000c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:59.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.022+0000 7f37057d0640 1 --2- 172.21.15.88:0/104889312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3700159b50 0x7f37000c9620 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f370006a7f0 tx=0x7f36f802bf60 comp rx=0 tx=0).stop 2023-11-27T21:21:59.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.023+0000 7f37057d0640 1 -- 172.21.15.88:0/104889312 shutdown_connections 2023-11-27T21:21:59.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.023+0000 7f37057d0640 1 --2- 172.21.15.88:0/104889312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3700159b50 0x7f37000c9620 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:59.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.023+0000 7f37057d0640 1 --2- 172.21.15.88:0/104889312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37000cc420 0x7f3700159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:59.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.023+0000 7f37057d0640 1 --2- 172.21.15.88:0/104889312 >> v2:172.21.15.88:3300/0 conn(0x7f37000cda70 0x7f37000ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:59.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.023+0000 7f37057d0640 1 -- 172.21.15.88:0/104889312 >> 172.21.15.88:0/104889312 conn(0x7f37000b07b0 msgr2=0x7f37000b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:59.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.023+0000 7f37057d0640 1 -- 172.21.15.88:0/104889312 shutdown_connections 2023-11-27T21:21:59.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.023+0000 7f37057d0640 1 -- 172.21.15.88:0/104889312 wait complete. 2023-11-27T21:21:59.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.024+0000 7f37057d0640 1 Processor -- start 2023-11-27T21:21:59.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.024+0000 7f37057d0640 1 -- start start 2023-11-27T21:21:59.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.024+0000 7f37057d0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37000cc420 0x7f37000afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:59.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.024+0000 7f37057d0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37000cda70 0x7f37001ef080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:59.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.024+0000 7f37057d0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3700159b50 0x7f37001ef5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:59.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.024+0000 7f37057d0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37001f3260 con 0x7f37000cda70 2023-11-27T21:21:59.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.024+0000 7f37057d0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37001f23d0 con 0x7f37000cc420 2023-11-27T21:21:59.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.024+0000 7f37057d0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37001f25e0 con 0x7f3700159b50 2023-11-27T21:21:59.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.025+0000 7f36f7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37000cda70 0x7f37001ef080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:59.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.025+0000 7f36feffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37000cc420 0x7f37000afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:59.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.025+0000 7f36f7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37000cda70 0x7f37001ef080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47172/0 (socket says 172.21.15.88:47172) 2023-11-27T21:21:59.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.025+0000 7f36f7fff640 1 -- 172.21.15.88:0/3506776470 learned_addr learned my addr 172.21.15.88:0/3506776470 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:59.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.025+0000 7f36ff7fe640 1 --2- 172.21.15.88:0/3506776470 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3700159b50 0x7f37001ef5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:59.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.029+0000 7f36f7fff640 1 -- 172.21.15.88:0/3506776470 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3700159b50 msgr2=0x7f37001ef5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:59.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.029+0000 7f36f7fff640 1 --2- 172.21.15.88:0/3506776470 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3700159b50 0x7f37001ef5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:59.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.029+0000 7f36f7fff640 1 -- 172.21.15.88:0/3506776470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37000cc420 msgr2=0x7f37000afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:59.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.029+0000 7f36f7fff640 1 --2- 172.21.15.88:0/3506776470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37000cc420 0x7f37000afaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:59.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.029+0000 7f36f7fff640 1 -- 172.21.15.88:0/3506776470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f8009b30 con 0x7f37000cda70 2023-11-27T21:21:59.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.031+0000 7f36f7fff640 1 --2- 172.21.15.88:0/3506776470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37000cda70 0x7f37001ef080 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f36e800e840 tx=0x7f36e800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:59.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.034+0000 7f36f77fe640 1 -- 172.21.15.88:0/3506776470 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e80094f0 con 0x7f37000cda70 2023-11-27T21:21:59.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.034+0000 7f36f77fe640 1 -- 172.21.15.88:0/3506776470 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e800c940 con 0x7f37000cda70 2023-11-27T21:21:59.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.034+0000 7f37057d0640 1 -- 172.21.15.88:0/3506776470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37001f28c0 con 0x7f37000cda70 2023-11-27T21:21:59.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.034+0000 7f36f77fe640 1 -- 172.21.15.88:0/3506776470 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e800ccd0 con 0x7f37000cda70 2023-11-27T21:21:59.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.035+0000 7f37057d0640 1 -- 172.21.15.88:0/3506776470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37001f2e80 con 0x7f37000cda70 2023-11-27T21:21:59.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.035+0000 7f37057d0640 1 -- 172.21.15.88:0/3506776470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f37000cba30 con 0x7f37000cda70 2023-11-27T21:21:59.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.055+0000 7f36f77fe640 1 -- 172.21.15.88:0/3506776470 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f36e8013470 con 0x7f37000cda70 2023-11-27T21:21:59.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.055+0000 7f36f77fe640 1 --2- 172.21.15.88:0/3506776470 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f36e006b210 0x7f36e006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:59.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.056+0000 7f36feffd640 1 --2- 172.21.15.88:0/3506776470 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f36e006b210 0x7f36e006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:59.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.056+0000 7f36feffd640 1 --2- 172.21.15.88:0/3506776470 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f36e006b210 0x7f36e006d6d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f36f0009ac0 tx=0x7f36f0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:59.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.058+0000 7f36f77fe640 1 -- 172.21.15.88:0/3506776470 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f36e800ce30 con 0x7f37000cda70 2023-11-27T21:21:59.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.058+0000 7f36f77fe640 1 --2- 172.21.15.88:0/3506776470 >> [v2:172.21.15.88:6818/3952326022,v1:172.21.15.88:6819/3952326022] conn(0x7f36e0074a70 0x7f36e0076f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:59.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.058+0000 7f36f77fe640 1 -- 172.21.15.88:0/3506776470 --> [v2:172.21.15.88:6818/3952326022,v1:172.21.15.88:6819/3952326022] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f36e00775e0 con 0x7f36e0074a70 2023-11-27T21:21:59.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.058+0000 7f36f77fe640 1 -- 172.21.15.88:0/3506776470 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36e8054b60 con 0x7f37000cda70 2023-11-27T21:21:59.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.058+0000 7f36ff7fe640 1 --2- 172.21.15.88:0/3506776470 >> [v2:172.21.15.88:6818/3952326022,v1:172.21.15.88:6819/3952326022] conn(0x7f36e0074a70 0x7f36e0076f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:59.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.059+0000 7f36ff7fe640 1 --2- 172.21.15.88:0/3506776470 >> [v2:172.21.15.88:6818/3952326022,v1:172.21.15.88:6819/3952326022] conn(0x7f36e0074a70 0x7f36e0076f10 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:59.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.059+0000 7f36f77fe640 1 -- 172.21.15.88:0/3506776470 <== osd.0 v2:172.21.15.88:6818/3952326022 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f36e00775e0 con 0x7f36e0074a70 2023-11-27T21:21:59.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.072+0000 7f37057d0640 1 -- 172.21.15.88:0/3506776470 --> [v2:172.21.15.88:6818/3952326022,v1:172.21.15.88:6819/3952326022] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f37000cb750 con 0x7f36e0074a70 2023-11-27T21:21:59.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.072+0000 7f36f77fe640 1 -- 172.21.15.88:0/3506776470 <== osd.0 v2:172.21.15.88:6818/3952326022 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f36f802c9c0 con 0x7f36e0074a70 2023-11-27T21:21:59.075 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-27T21:21:59.075 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-27T21:21:59.075 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-27T21:21:59.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.072+0000 7f37057d0640 1 -- 172.21.15.88:0/3506776470 >> [v2:172.21.15.88:6818/3952326022,v1:172.21.15.88:6819/3952326022] conn(0x7f36e0074a70 msgr2=0x7f36e0076f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:59.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.072+0000 7f37057d0640 1 --2- 172.21.15.88:0/3506776470 >> [v2:172.21.15.88:6818/3952326022,v1:172.21.15.88:6819/3952326022] conn(0x7f36e0074a70 0x7f36e0076f10 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:59.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.073+0000 7f37057d0640 1 -- 172.21.15.88:0/3506776470 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f36e006b210 msgr2=0x7f36e006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:59.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.073+0000 7f37057d0640 1 --2- 172.21.15.88:0/3506776470 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f36e006b210 0x7f36e006d6d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f36f0009ac0 tx=0x7f36f0009190 comp rx=0 tx=0).stop 2023-11-27T21:21:59.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.073+0000 7f37057d0640 1 -- 172.21.15.88:0/3506776470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37000cda70 msgr2=0x7f37001ef080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:59.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.073+0000 7f37057d0640 1 --2- 172.21.15.88:0/3506776470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37000cda70 0x7f37001ef080 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f36e800e840 tx=0x7f36e800ed00 comp rx=0 tx=0).stop 2023-11-27T21:21:59.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.073+0000 7f36ff7fe640 1 -- 172.21.15.88:0/3506776470 reap_dead start 2023-11-27T21:21:59.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.073+0000 7f37057d0640 1 -- 172.21.15.88:0/3506776470 shutdown_connections 2023-11-27T21:21:59.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.073+0000 7f37057d0640 1 -- 172.21.15.88:0/3506776470 >> 172.21.15.88:0/3506776470 conn(0x7f37000b07b0 msgr2=0x7f37000c6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:59.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.073+0000 7f37057d0640 1 -- 172.21.15.88:0/3506776470 shutdown_connections 2023-11-27T21:21:59.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.073+0000 7f37057d0640 1 -- 172.21.15.88:0/3506776470 wait complete. 2023-11-27T21:21:59.085 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-27T21:21:59.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.183+0000 7fb2674cf640 1 Processor -- start 2023-11-27T21:21:59.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.184+0000 7fb2674cf640 1 -- start start 2023-11-27T21:21:59.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.184+0000 7fb2674cf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb260153730 0x7fb26006eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:59.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.184+0000 7fb2674cf640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb26015a0c0 0x7fb2600ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:59.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.184+0000 7fb2674cf640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb26006f090 con 0x7fb2600c91d0 2023-11-27T21:21:59.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.184+0000 7fb2674cf640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2600c38f0 con 0x7fb26015a0c0 2023-11-27T21:21:59.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.184+0000 7fb2674cf640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2601593d0 con 0x7fb260153730 2023-11-27T21:21:59.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.185+0000 7fb264a6a640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fb2600c91d0 0x7fb2600c2b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:59194/0 (socket says 172.21.15.88:59194) 2023-11-27T21:21:59.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.185+0000 7fb265a6c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb26015a0c0 0x7fb2600ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:59.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.185+0000 7fb264a6a640 1 -- 172.21.15.88:0/827816454 learned_addr learned my addr 172.21.15.88:0/827816454 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:21:59.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.185+0000 7fb26526b640 1 --2- 172.21.15.88:0/827816454 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb260153730 0x7fb26006eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:59.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.187+0000 7fb257fff640 1 -- 172.21.15.88:0/827816454 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 525113148 0 0) 0x7fb26006f090 con 0x7fb2600c91d0 2023-11-27T21:21:59.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.187+0000 7fb257fff640 1 -- 172.21.15.88:0/827816454 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb24c003520 con 0x7fb2600c91d0 2023-11-27T21:21:59.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.188+0000 7fb265a6c640 1 -- 172.21.15.88:0/827816454 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb260153730 msgr2=0x7fb26006eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:21:59.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.188+0000 7fb265a6c640 1 --2- 172.21.15.88:0/827816454 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb260153730 0x7fb26006eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:59.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.188+0000 7fb265a6c640 1 -- 172.21.15.88:0/827816454 >> v1:172.21.15.167:6789/0 conn(0x7fb2600c91d0 legacy=0x7fb2600c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:59.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.188+0000 7fb265a6c640 1 -- 172.21.15.88:0/827816454 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb260153b10 con 0x7fb26015a0c0 2023-11-27T21:21:59.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.189+0000 7fb265a6c640 1 --2- 172.21.15.88:0/827816454 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb26015a0c0 0x7fb2600ccac0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb258009d90 tx=0x7fb25802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=859c17f67f646559 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:59.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.193+0000 7fb257fff640 1 -- 172.21.15.88:0/827816454 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25802cce0 con 0x7fb26015a0c0 2023-11-27T21:21:59.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.193+0000 7fb257fff640 1 -- 172.21.15.88:0/827816454 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25802ce40 con 0x7fb26015a0c0 2023-11-27T21:21:59.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.193+0000 7fb257fff640 1 -- 172.21.15.88:0/827816454 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258034660 con 0x7fb26015a0c0 2023-11-27T21:21:59.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.193+0000 7fb2674cf640 1 -- 172.21.15.88:0/827816454 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb26015a0c0 msgr2=0x7fb2600ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:59.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.193+0000 7fb2674cf640 1 --2- 172.21.15.88:0/827816454 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb26015a0c0 0x7fb2600ccac0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb258009d90 tx=0x7fb25802bf30 comp rx=0 tx=0).stop 2023-11-27T21:21:59.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.193+0000 7fb2674cf640 1 -- 172.21.15.88:0/827816454 shutdown_connections 2023-11-27T21:21:59.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.193+0000 7fb2674cf640 1 --2- 172.21.15.88:0/827816454 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb26015a0c0 0x7fb2600ccac0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:59.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.193+0000 7fb2674cf640 1 --2- 172.21.15.88:0/827816454 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb260153730 0x7fb26006eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:59.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.193+0000 7fb2674cf640 1 -- 172.21.15.88:0/827816454 >> 172.21.15.88:0/827816454 conn(0x7fb2600707f0 msgr2=0x7fb260070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:59.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.194+0000 7fb2674cf640 1 -- 172.21.15.88:0/827816454 shutdown_connections 2023-11-27T21:21:59.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.194+0000 7fb2674cf640 1 -- 172.21.15.88:0/827816454 wait complete. 2023-11-27T21:21:59.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.195+0000 7fb2674cf640 1 Processor -- start 2023-11-27T21:21:59.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.195+0000 7fb2674cf640 1 -- start start 2023-11-27T21:21:59.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.196+0000 7fb2674cf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2600c91d0 0x7fb2601f2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:59.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.196+0000 7fb2674cf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb260153730 0x7fb2600acab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:59.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.196+0000 7fb2674cf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb26015a0c0 0x7fb2600c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:59.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.196+0000 7fb2674cf640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2601f2aa0 con 0x7fb26015a0c0 2023-11-27T21:21:59.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.196+0000 7fb2674cf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2601f2d40 con 0x7fb260153730 2023-11-27T21:21:59.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.196+0000 7fb2674cf640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2600c6ac0 con 0x7fb2600c91d0 2023-11-27T21:21:59.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.196+0000 7fb265a6c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb26015a0c0 0x7fb2600c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:59.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.196+0000 7fb264a6a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb260153730 0x7fb2600acab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:59.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.196+0000 7fb26526b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2600c91d0 0x7fb2601f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:59.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.196+0000 7fb264a6a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb260153730 0x7fb2600acab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:51674/0 (socket says 172.21.15.88:51674) 2023-11-27T21:21:59.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.196+0000 7fb264a6a640 1 -- 172.21.15.88:0/1331763532 learned_addr learned my addr 172.21.15.88:0/1331763532 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:59.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.200+0000 7fb265a6c640 1 -- 172.21.15.88:0/1331763532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2600c91d0 msgr2=0x7fb2601f2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:59.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.200+0000 7fb265a6c640 1 --2- 172.21.15.88:0/1331763532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2600c91d0 0x7fb2601f2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:59.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.200+0000 7fb265a6c640 1 -- 172.21.15.88:0/1331763532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb260153730 msgr2=0x7fb2600acab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:59.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.200+0000 7fb265a6c640 1 --2- 172.21.15.88:0/1331763532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb260153730 0x7fb2600acab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:59.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.200+0000 7fb265a6c640 1 -- 172.21.15.88:0/1331763532 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb258009a70 con 0x7fb26015a0c0 2023-11-27T21:21:59.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.200+0000 7fb264a6a640 1 --2- 172.21.15.88:0/1331763532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb260153730 0x7fb2600acab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T21:21:59.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.202+0000 7fb265a6c640 1 --2- 172.21.15.88:0/1331763532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb26015a0c0 0x7fb2600c4d40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb258033000 tx=0x7fb258004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:59.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.205+0000 7fb255ffb640 1 -- 172.21.15.88:0/1331763532 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25803e610 con 0x7fb26015a0c0 2023-11-27T21:21:59.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.205+0000 7fb255ffb640 1 -- 172.21.15.88:0/1331763532 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25803e770 con 0x7fb26015a0c0 2023-11-27T21:21:59.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.205+0000 7fb255ffb640 1 -- 172.21.15.88:0/1331763532 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25803eb20 con 0x7fb26015a0c0 2023-11-27T21:21:59.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.205+0000 7fb2674cf640 1 -- 172.21.15.88:0/1331763532 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2600c6da0 con 0x7fb26015a0c0 2023-11-27T21:21:59.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.206+0000 7fb2674cf640 1 -- 172.21.15.88:0/1331763532 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb260153e80 con 0x7fb26015a0c0 2023-11-27T21:21:59.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.206+0000 7fb2674cf640 1 -- 172.21.15.88:0/1331763532 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb260073dc0 con 0x7fb26015a0c0 2023-11-27T21:21:59.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.456+0000 7fb255ffb640 1 -- 172.21.15.88:0/1331763532 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb25803b050 con 0x7fb26015a0c0 2023-11-27T21:21:59.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.457+0000 7fb255ffb640 1 --2- 172.21.15.88:0/1331763532 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb24406b210 0x7fb24406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:59.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.457+0000 7fb26526b640 1 --2- 172.21.15.88:0/1331763532 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb24406b210 0x7fb24406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:59.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.457+0000 7fb26526b640 1 --2- 172.21.15.88:0/1331763532 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb24406b210 0x7fb24406d6d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb250009b40 tx=0x7fb250009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:59.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.470+0000 7fb255ffb640 1 -- 172.21.15.88:0/1331763532 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb25807aca0 con 0x7fb26015a0c0 2023-11-27T21:21:59.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.470+0000 7fb255ffb640 1 -- 172.21.15.88:0/1331763532 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb258076fe0 con 0x7fb26015a0c0 2023-11-27T21:21:59.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.647+0000 7fb2674cf640 1 -- 172.21.15.88:0/1331763532 --> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2601595e0 con 0x7fb24406b210 2023-11-27T21:21:59.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.647+0000 7fb255ffb640 1 -- 172.21.15.88:0/1331763532 <== mgr.4105 v2:172.21.15.88:6800/352455703 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb250011a60 con 0x7fb24406b210 2023-11-27T21:21:59.649 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 0 to deep-scrub 2023-11-27T21:21:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.649+0000 7fb2674cf640 1 -- 172.21.15.88:0/1331763532 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb24406b210 msgr2=0x7fb24406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.649+0000 7fb2674cf640 1 --2- 172.21.15.88:0/1331763532 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb24406b210 0x7fb24406d6d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb250009b40 tx=0x7fb250009190 comp rx=0 tx=0).stop 2023-11-27T21:21:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.649+0000 7fb2674cf640 1 -- 172.21.15.88:0/1331763532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb26015a0c0 msgr2=0x7fb2600c4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.649+0000 7fb2674cf640 1 --2- 172.21.15.88:0/1331763532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb26015a0c0 0x7fb2600c4d40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb258033000 tx=0x7fb258004a40 comp rx=0 tx=0).stop 2023-11-27T21:21:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.649+0000 7fb2674cf640 1 -- 172.21.15.88:0/1331763532 shutdown_connections 2023-11-27T21:21:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.649+0000 7fb2674cf640 1 --2- 172.21.15.88:0/1331763532 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb24406b210 0x7fb24406d6d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.649+0000 7fb2674cf640 1 --2- 172.21.15.88:0/1331763532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb26015a0c0 0x7fb2600c4d40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.649+0000 7fb2674cf640 1 --2- 172.21.15.88:0/1331763532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb260153730 0x7fb2600acab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.649+0000 7fb2674cf640 1 --2- 172.21.15.88:0/1331763532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2600c91d0 0x7fb2601f2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.649+0000 7fb2674cf640 1 -- 172.21.15.88:0/1331763532 >> 172.21.15.88:0/1331763532 conn(0x7fb2600707f0 msgr2=0x7fb2601526e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:59.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.649+0000 7fb2674cf640 1 -- 172.21.15.88:0/1331763532 shutdown_connections 2023-11-27T21:21:59.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.649+0000 7fb2674cf640 1 -- 172.21.15.88:0/1331763532 wait complete. 2023-11-27T21:21:59.663 INFO:tasks.ceph:Scrubbing osd.1 2023-11-27T21:21:59.663 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-27T21:21:59.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.766+0000 7fda9d256640 1 Processor -- start 2023-11-27T21:21:59.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.766+0000 7fda9d256640 1 -- start start 2023-11-27T21:21:59.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.767+0000 7fda9d256640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fda980c8660 0x7fda9815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:59.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.767+0000 7fda9d256640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda980728b0 0x7fda980c4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:59.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.767+0000 7fda9d256640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9815d970 con 0x7fda980c8a40 2023-11-27T21:21:59.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.767+0000 7fda9d256640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda98071e10 con 0x7fda980c8660 2023-11-27T21:21:59.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.767+0000 7fda9d256640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda980cc7a0 con 0x7fda980728b0 2023-11-27T21:21:59.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.768+0000 7fda96d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fda980c8660 0x7fda9815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:59.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.768+0000 7fda9759e640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fda980c8a40 0x7fda98153100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:55958/0 (socket says 172.21.15.88:55958) 2023-11-27T21:21:59.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.768+0000 7fda9759e640 1 -- 172.21.15.88:0/4083597668 learned_addr learned my addr 172.21.15.88:0/4083597668 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:21:59.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.768+0000 7fda9659c640 1 --2- 172.21.15.88:0/4083597668 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda980728b0 0x7fda980c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:59.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.770+0000 7fda95d9b640 1 -- 172.21.15.88:0/4083597668 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902562096 0 0) 0x7fda9815d970 con 0x7fda980c8a40 2023-11-27T21:21:59.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.770+0000 7fda95d9b640 1 -- 172.21.15.88:0/4083597668 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda80003520 con 0x7fda980c8a40 2023-11-27T21:21:59.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.771+0000 7fda96d9d640 1 -- 172.21.15.88:0/4083597668 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda980728b0 msgr2=0x7fda980c4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:21:59.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.771+0000 7fda96d9d640 1 --2- 172.21.15.88:0/4083597668 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda980728b0 0x7fda980c4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:59.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.771+0000 7fda96d9d640 1 -- 172.21.15.88:0/4083597668 >> v1:172.21.15.88:6789/0 conn(0x7fda980c8a40 legacy=0x7fda98153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:59.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.771+0000 7fda96d9d640 1 -- 172.21.15.88:0/4083597668 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda98159430 con 0x7fda980c8660 2023-11-27T21:21:59.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.774+0000 7fda96d9d640 1 --2- 172.21.15.88:0/4083597668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda980c8660 0x7fda9815d430 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fda88009d90 tx=0x7fda8802bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=810ad9405a50dc68 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:59.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.777+0000 7fda95d9b640 1 -- 172.21.15.88:0/4083597668 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8802cce0 con 0x7fda980c8660 2023-11-27T21:21:59.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.777+0000 7fda95d9b640 1 -- 172.21.15.88:0/4083597668 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8802ce40 con 0x7fda980c8660 2023-11-27T21:21:59.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.777+0000 7fda95d9b640 1 -- 172.21.15.88:0/4083597668 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda88034660 con 0x7fda980c8660 2023-11-27T21:21:59.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.778+0000 7fda9d256640 1 -- 172.21.15.88:0/4083597668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda980c8660 msgr2=0x7fda9815d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:59.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.778+0000 7fda9d256640 1 --2- 172.21.15.88:0/4083597668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda980c8660 0x7fda9815d430 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fda88009d90 tx=0x7fda8802bf30 comp rx=0 tx=0).stop 2023-11-27T21:21:59.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.778+0000 7fda9d256640 1 -- 172.21.15.88:0/4083597668 shutdown_connections 2023-11-27T21:21:59.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.778+0000 7fda9d256640 1 --2- 172.21.15.88:0/4083597668 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda980728b0 0x7fda980c4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:59.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.778+0000 7fda9d256640 1 --2- 172.21.15.88:0/4083597668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda980c8660 0x7fda9815d430 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:59.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.778+0000 7fda9d256640 1 -- 172.21.15.88:0/4083597668 >> 172.21.15.88:0/4083597668 conn(0x7fda9806b5c0 msgr2=0x7fda9806b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:59.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.778+0000 7fda9d256640 1 -- 172.21.15.88:0/4083597668 shutdown_connections 2023-11-27T21:21:59.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.778+0000 7fda9d256640 1 -- 172.21.15.88:0/4083597668 wait complete. 2023-11-27T21:21:59.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.780+0000 7fda9d256640 1 Processor -- start 2023-11-27T21:21:59.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.780+0000 7fda9d256640 1 -- start start 2023-11-27T21:21:59.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.780+0000 7fda9d256640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda980728b0 0x7fda98152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:59.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.780+0000 7fda9d256640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda980c8660 0x7fda980bd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:59.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.780+0000 7fda9d256640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda980c8a40 0x7fda980bd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:59.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.780+0000 7fda9d256640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda981f3290 con 0x7fda980728b0 2023-11-27T21:21:59.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.780+0000 7fda9d256640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda980bb460 con 0x7fda980c8a40 2023-11-27T21:21:59.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.780+0000 7fda9d256640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda980bb740 con 0x7fda980c8660 2023-11-27T21:21:59.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.781+0000 7fda96d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda980728b0 0x7fda98152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:59.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.781+0000 7fda9759e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda980c8a40 0x7fda980bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:59.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.781+0000 7fda9659c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda980c8660 0x7fda980bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:59.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.781+0000 7fda96d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda980728b0 0x7fda98152440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47206/0 (socket says 172.21.15.88:47206) 2023-11-27T21:21:59.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.781+0000 7fda96d9d640 1 -- 172.21.15.88:0/237070166 learned_addr learned my addr 172.21.15.88:0/237070166 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:59.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.781+0000 7fda9759e640 1 --2- 172.21.15.88:0/237070166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda980c8a40 0x7fda980bd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:51698/0 (socket says 172.21.15.88:51698) 2023-11-27T21:21:59.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.784+0000 7fda96d9d640 1 -- 172.21.15.88:0/237070166 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda980c8660 msgr2=0x7fda980bd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:59.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.784+0000 7fda96d9d640 1 --2- 172.21.15.88:0/237070166 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda980c8660 0x7fda980bd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:59.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.785+0000 7fda96d9d640 1 -- 172.21.15.88:0/237070166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda980c8a40 msgr2=0x7fda980bd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:59.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.785+0000 7fda96d9d640 1 --2- 172.21.15.88:0/237070166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda980c8a40 0x7fda980bd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:59.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.785+0000 7fda96d9d640 1 -- 172.21.15.88:0/237070166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda88009a70 con 0x7fda980728b0 2023-11-27T21:21:59.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.787+0000 7fda96d9d640 1 --2- 172.21.15.88:0/237070166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda980728b0 0x7fda98152440 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fda88000f80 tx=0x7fda88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:59.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.790+0000 7fda7f7fe640 1 -- 172.21.15.88:0/237070166 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8803e610 con 0x7fda980728b0 2023-11-27T21:21:59.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.790+0000 7fda7f7fe640 1 -- 172.21.15.88:0/237070166 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8803e770 con 0x7fda980728b0 2023-11-27T21:21:59.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.790+0000 7fda7f7fe640 1 -- 172.21.15.88:0/237070166 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8803eb00 con 0x7fda980728b0 2023-11-27T21:21:59.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.790+0000 7fda9d256640 1 -- 172.21.15.88:0/237070166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda980bba20 con 0x7fda980728b0 2023-11-27T21:21:59.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.790+0000 7fda9d256640 1 -- 172.21.15.88:0/237070166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda980bcbe0 con 0x7fda980728b0 2023-11-27T21:21:59.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.791+0000 7fda9d256640 1 -- 172.21.15.88:0/237070166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fda98159cb0 con 0x7fda980728b0 2023-11-27T21:21:59.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.810+0000 7fda7f7fe640 1 -- 172.21.15.88:0/237070166 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fda8803b050 con 0x7fda980728b0 2023-11-27T21:21:59.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.811+0000 7fda7f7fe640 1 --2- 172.21.15.88:0/237070166 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fda8406b210 0x7fda8406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:59.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.811+0000 7fda9659c640 1 --2- 172.21.15.88:0/237070166 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fda8406b210 0x7fda8406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:59.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.811+0000 7fda9659c640 1 --2- 172.21.15.88:0/237070166 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fda8406b210 0x7fda8406d6d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fda9806bf90 tx=0x7fda8c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:59.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.814+0000 7fda7f7fe640 1 -- 172.21.15.88:0/237070166 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fda8807b260 con 0x7fda980728b0 2023-11-27T21:21:59.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.814+0000 7fda7f7fe640 1 --2- 172.21.15.88:0/237070166 >> [v2:172.21.15.88:6826/1788401966,v1:172.21.15.88:6827/1788401966] conn(0x7fda84074af0 0x7fda84076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:59.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.814+0000 7fda7f7fe640 1 -- 172.21.15.88:0/237070166 --> [v2:172.21.15.88:6826/1788401966,v1:172.21.15.88:6827/1788401966] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fda84077660 con 0x7fda84074af0 2023-11-27T21:21:59.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.814+0000 7fda7f7fe640 1 -- 172.21.15.88:0/237070166 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda88054eb0 con 0x7fda980728b0 2023-11-27T21:21:59.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.814+0000 7fda9759e640 1 --2- 172.21.15.88:0/237070166 >> [v2:172.21.15.88:6826/1788401966,v1:172.21.15.88:6827/1788401966] conn(0x7fda84074af0 0x7fda84076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:59.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.814+0000 7fda9759e640 1 --2- 172.21.15.88:0/237070166 >> [v2:172.21.15.88:6826/1788401966,v1:172.21.15.88:6827/1788401966] conn(0x7fda84074af0 0x7fda84076f90 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:59.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.815+0000 7fda7f7fe640 1 -- 172.21.15.88:0/237070166 <== osd.1 v2:172.21.15.88:6826/1788401966 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fda84077660 con 0x7fda84074af0 2023-11-27T21:21:59.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.828+0000 7fda9d256640 1 -- 172.21.15.88:0/237070166 --> [v2:172.21.15.88:6826/1788401966,v1:172.21.15.88:6827/1788401966] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fda981599d0 con 0x7fda84074af0 2023-11-27T21:21:59.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.829+0000 7fda7f7fe640 1 -- 172.21.15.88:0/237070166 <== osd.1 v2:172.21.15.88:6826/1788401966 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fda900047e0 con 0x7fda84074af0 2023-11-27T21:21:59.832 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-27T21:21:59.832 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-27T21:21:59.832 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-27T21:21:59.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.829+0000 7fda9d256640 1 -- 172.21.15.88:0/237070166 >> [v2:172.21.15.88:6826/1788401966,v1:172.21.15.88:6827/1788401966] conn(0x7fda84074af0 msgr2=0x7fda84076f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:59.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.829+0000 7fda9d256640 1 --2- 172.21.15.88:0/237070166 >> [v2:172.21.15.88:6826/1788401966,v1:172.21.15.88:6827/1788401966] conn(0x7fda84074af0 0x7fda84076f90 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:59.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.829+0000 7fda9d256640 1 -- 172.21.15.88:0/237070166 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fda8406b210 msgr2=0x7fda8406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:59.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.829+0000 7fda9d256640 1 --2- 172.21.15.88:0/237070166 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fda8406b210 0x7fda8406d6d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fda9806bf90 tx=0x7fda8c009190 comp rx=0 tx=0).stop 2023-11-27T21:21:59.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.829+0000 7fda9d256640 1 -- 172.21.15.88:0/237070166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda980728b0 msgr2=0x7fda98152440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:59.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.829+0000 7fda9d256640 1 --2- 172.21.15.88:0/237070166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda980728b0 0x7fda98152440 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fda88000f80 tx=0x7fda88004a40 comp rx=0 tx=0).stop 2023-11-27T21:21:59.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.829+0000 7fda9759e640 1 -- 172.21.15.88:0/237070166 reap_dead start 2023-11-27T21:21:59.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.829+0000 7fda9d256640 1 -- 172.21.15.88:0/237070166 shutdown_connections 2023-11-27T21:21:59.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.829+0000 7fda9d256640 1 -- 172.21.15.88:0/237070166 >> 172.21.15.88:0/237070166 conn(0x7fda9806b5c0 msgr2=0x7fda98071f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:59.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.829+0000 7fda9d256640 1 -- 172.21.15.88:0/237070166 shutdown_connections 2023-11-27T21:21:59.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.829+0000 7fda9d256640 1 -- 172.21.15.88:0/237070166 wait complete. 2023-11-27T21:21:59.842 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-27T21:21:59.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.941+0000 7fd3caba5640 1 Processor -- start 2023-11-27T21:21:59.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.941+0000 7fd3caba5640 1 -- start start 2023-11-27T21:21:59.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.942+0000 7fd3caba5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3c415d0d0 0x7fd3c406a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:59.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.942+0000 7fd3caba5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c4159f80 con 0x7fd3c406a4b0 2023-11-27T21:21:59.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.942+0000 7fd3caba5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c41593d0 con 0x7fd3c40c59e0 2023-11-27T21:21:59.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.942+0000 7fd3caba5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c4072650 con 0x7fd3c415d0d0 2023-11-27T21:21:59.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.942+0000 7fd3bbfff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd3c406a4b0 0x7fd3c415c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:55970/0 (socket says 172.21.15.88:55970) 2023-11-27T21:21:59.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.942+0000 7fd3bbfff640 1 -- 172.21.15.88:0/3813093218 learned_addr learned my addr 172.21.15.88:0/3813093218 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:21:59.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.942+0000 7fd3c9142640 1 --2- 172.21.15.88:0/3813093218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3c415d0d0 0x7fd3c406a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:59.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.945+0000 7fd3bb7fe640 1 -- 172.21.15.88:0/3813093218 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 127144248 0 0) 0x7fd3c4159f80 con 0x7fd3c406a4b0 2023-11-27T21:21:59.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.945+0000 7fd3bb7fe640 1 -- 172.21.15.88:0/3813093218 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3ac003520 con 0x7fd3c406a4b0 2023-11-27T21:21:59.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.945+0000 7fd3bb7fe640 1 -- 172.21.15.88:0/3813093218 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3301808147 0 0) 0x7fd3c41593d0 con 0x7fd3c40c59e0 2023-11-27T21:21:59.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.945+0000 7fd3bb7fe640 1 -- 172.21.15.88:0/3813093218 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3c4159f80 con 0x7fd3c40c59e0 2023-11-27T21:21:59.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.945+0000 7fd3c9142640 1 -- 172.21.15.88:0/3813093218 >> v1:172.21.15.167:6789/0 conn(0x7fd3c40c59e0 legacy=0x7fd3c406d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:59.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.945+0000 7fd3c9142640 1 -- 172.21.15.88:0/3813093218 >> v1:172.21.15.88:6789/0 conn(0x7fd3c406a4b0 legacy=0x7fd3c415c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:59.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.945+0000 7fd3c9142640 1 -- 172.21.15.88:0/3813093218 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c40728f0 con 0x7fd3c415d0d0 2023-11-27T21:21:59.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.947+0000 7fd3c9142640 1 --2- 172.21.15.88:0/3813093218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3c415d0d0 0x7fd3c406a8e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009dc0 tx=0x7fd3bc02bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0750ecb486ad975 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:59.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.951+0000 7fd3bb7fe640 1 -- 172.21.15.88:0/3813093218 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc02cd50 con 0x7fd3c415d0d0 2023-11-27T21:21:59.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.951+0000 7fd3bb7fe640 1 -- 172.21.15.88:0/3813093218 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3bc034440 con 0x7fd3c415d0d0 2023-11-27T21:21:59.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.951+0000 7fd3bb7fe640 1 -- 172.21.15.88:0/3813093218 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc0347d0 con 0x7fd3c415d0d0 2023-11-27T21:21:59.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.952+0000 7fd3caba5640 1 -- 172.21.15.88:0/3813093218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3c415d0d0 msgr2=0x7fd3c406a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:59.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.952+0000 7fd3caba5640 1 --2- 172.21.15.88:0/3813093218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3c415d0d0 0x7fd3c406a8e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009dc0 tx=0x7fd3bc02bfa0 comp rx=0 tx=0).stop 2023-11-27T21:21:59.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.952+0000 7fd3caba5640 1 -- 172.21.15.88:0/3813093218 shutdown_connections 2023-11-27T21:21:59.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.952+0000 7fd3caba5640 1 --2- 172.21.15.88:0/3813093218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3c415d0d0 0x7fd3c406a8e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:59.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.952+0000 7fd3caba5640 1 -- 172.21.15.88:0/3813093218 >> 172.21.15.88:0/3813093218 conn(0x7fd3c406f6d0 msgr2=0x7fd3c406fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:21:59.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.952+0000 7fd3caba5640 1 -- 172.21.15.88:0/3813093218 shutdown_connections 2023-11-27T21:21:59.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.952+0000 7fd3caba5640 1 -- 172.21.15.88:0/3813093218 wait complete. 2023-11-27T21:21:59.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.953+0000 7fd3caba5640 1 Processor -- start 2023-11-27T21:21:59.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.953+0000 7fd3caba5640 1 -- start start 2023-11-27T21:21:59.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.954+0000 7fd3caba5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3c406a4b0 0x7fd3c414bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:59.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.954+0000 7fd3caba5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3c40c59e0 0x7fd3c41ef290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:59.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.954+0000 7fd3caba5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3c415a590 0x7fd3c41ef7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:21:59.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.954+0000 7fd3caba5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c41efd10 con 0x7fd3c406a4b0 2023-11-27T21:21:59.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.954+0000 7fd3caba5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c414c460 con 0x7fd3c415a590 2023-11-27T21:21:59.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.954+0000 7fd3caba5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c41f3440 con 0x7fd3c40c59e0 2023-11-27T21:21:59.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.955+0000 7fd3c8941640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3c406a4b0 0x7fd3c414bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:59.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.955+0000 7fd3c9142640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3c415a590 0x7fd3c41ef7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:59.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.955+0000 7fd3bbfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3c40c59e0 0x7fd3c41ef290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:21:59.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.955+0000 7fd3c8941640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3c406a4b0 0x7fd3c414bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47212/0 (socket says 172.21.15.88:47212) 2023-11-27T21:21:59.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.955+0000 7fd3c9142640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3c415a590 0x7fd3c41ef7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:51710/0 (socket says 172.21.15.88:51710) 2023-11-27T21:21:59.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.955+0000 7fd3c8941640 1 -- 172.21.15.88:0/1045395968 learned_addr learned my addr 172.21.15.88:0/1045395968 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:21:59.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.959+0000 7fd3c8941640 1 -- 172.21.15.88:0/1045395968 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3c40c59e0 msgr2=0x7fd3c41ef290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:59.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.959+0000 7fd3c8941640 1 --2- 172.21.15.88:0/1045395968 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3c40c59e0 0x7fd3c41ef290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:59.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.959+0000 7fd3c8941640 1 -- 172.21.15.88:0/1045395968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3c415a590 msgr2=0x7fd3c41ef7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:21:59.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.959+0000 7fd3c8941640 1 --2- 172.21.15.88:0/1045395968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3c415a590 0x7fd3c41ef7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:21:59.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.959+0000 7fd3c8941640 1 -- 172.21.15.88:0/1045395968 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3bc009a70 con 0x7fd3c406a4b0 2023-11-27T21:21:59.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.961+0000 7fd3c8941640 1 --2- 172.21.15.88:0/1045395968 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3c406a4b0 0x7fd3c414bab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000c460 tx=0x7fd3c000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:21:59.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.965+0000 7fd3b97fa640 1 -- 172.21.15.88:0/1045395968 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c00052d0 con 0x7fd3c406a4b0 2023-11-27T21:21:59.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.965+0000 7fd3b97fa640 1 -- 172.21.15.88:0/1045395968 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c0005450 con 0x7fd3c406a4b0 2023-11-27T21:21:59.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.965+0000 7fd3caba5640 1 -- 172.21.15.88:0/1045395968 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c41f28a0 con 0x7fd3c406a4b0 2023-11-27T21:21:59.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.965+0000 7fd3b97fa640 1 -- 172.21.15.88:0/1045395968 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0003830 con 0x7fd3c406a4b0 2023-11-27T21:21:59.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.965+0000 7fd3caba5640 1 -- 172.21.15.88:0/1045395968 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c41f2df0 con 0x7fd3c406a4b0 2023-11-27T21:21:59.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:21:59.966+0000 7fd3caba5640 1 -- 172.21.15.88:0/1045395968 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c4067d90 con 0x7fd3c406a4b0 2023-11-27T21:22:00.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.204+0000 7fd3b97fa640 1 -- 172.21.15.88:0/1045395968 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd3c0003990 con 0x7fd3c406a4b0 2023-11-27T21:22:00.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.205+0000 7fd3b97fa640 1 --2- 172.21.15.88:0/1045395968 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd3b006b240 0x7fd3b006d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:00.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.205+0000 7fd3bbfff640 1 --2- 172.21.15.88:0/1045395968 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd3b006b240 0x7fd3b006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:00.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.205+0000 7fd3bbfff640 1 --2- 172.21.15.88:0/1045395968 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd3b006b240 0x7fd3b006d700 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd3c40c9f70 tx=0x7fd3b4007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:00.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.217+0000 7fd3b97fa640 1 -- 172.21.15.88:0/1045395968 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd3c0057df0 con 0x7fd3c406a4b0 2023-11-27T21:22:00.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.217+0000 7fd3b97fa640 1 -- 172.21.15.88:0/1045395968 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd3c0054130 con 0x7fd3c406a4b0 2023-11-27T21:22:00.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.386+0000 7fd3caba5640 1 -- 172.21.15.88:0/1045395968 --> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3c40723d0 con 0x7fd3b006b240 2023-11-27T21:22:00.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.387+0000 7fd3b97fa640 1 -- 172.21.15.88:0/1045395968 <== mgr.4105 v2:172.21.15.88:6800/352455703 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd3c40723d0 con 0x7fd3b006b240 2023-11-27T21:22:00.389 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 1 to deep-scrub 2023-11-27T21:22:00.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.389+0000 7fd3caba5640 1 -- 172.21.15.88:0/1045395968 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd3b006b240 msgr2=0x7fd3b006d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:00.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.389+0000 7fd3caba5640 1 --2- 172.21.15.88:0/1045395968 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd3b006b240 0x7fd3b006d700 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd3c40c9f70 tx=0x7fd3b4007d30 comp rx=0 tx=0).stop 2023-11-27T21:22:00.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.389+0000 7fd3caba5640 1 -- 172.21.15.88:0/1045395968 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3c406a4b0 msgr2=0x7fd3c414bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:00.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.389+0000 7fd3caba5640 1 --2- 172.21.15.88:0/1045395968 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3c406a4b0 0x7fd3c414bab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000c460 tx=0x7fd3c000c920 comp rx=0 tx=0).stop 2023-11-27T21:22:00.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.389+0000 7fd3caba5640 1 -- 172.21.15.88:0/1045395968 shutdown_connections 2023-11-27T21:22:00.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.389+0000 7fd3caba5640 1 --2- 172.21.15.88:0/1045395968 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd3b006b240 0x7fd3b006d700 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:00.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.389+0000 7fd3caba5640 1 --2- 172.21.15.88:0/1045395968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3c415a590 0x7fd3c41ef7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:00.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.389+0000 7fd3caba5640 1 --2- 172.21.15.88:0/1045395968 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3c40c59e0 0x7fd3c41ef290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:00.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.389+0000 7fd3caba5640 1 --2- 172.21.15.88:0/1045395968 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3c406a4b0 0x7fd3c414bab0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:00.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.389+0000 7fd3caba5640 1 -- 172.21.15.88:0/1045395968 >> 172.21.15.88:0/1045395968 conn(0x7fd3c406f6d0 msgr2=0x7fd3c406fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:00.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.389+0000 7fd3caba5640 1 -- 172.21.15.88:0/1045395968 shutdown_connections 2023-11-27T21:22:00.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.389+0000 7fd3caba5640 1 -- 172.21.15.88:0/1045395968 wait complete. 2023-11-27T21:22:00.402 INFO:tasks.ceph:Scrubbing osd.2 2023-11-27T21:22:00.403 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-27T21:22:00.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.504+0000 7f1f8b9f1640 1 Processor -- start 2023-11-27T21:22:00.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.504+0000 7f1f8b9f1640 1 -- start start 2023-11-27T21:22:00.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.505+0000 7f1f8b9f1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f840c4340 0x7f1f8406ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:00.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.505+0000 7f1f8b9f1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1f84151040 0x7f1f841514b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:00.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.505+0000 7f1f8b9f1640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f840c68c0 con 0x7f1f840c4720 2023-11-27T21:22:00.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.505+0000 7f1f8b9f1640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f841519f0 con 0x7f1f84151040 2023-11-27T21:22:00.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.505+0000 7f1f8b9f1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f84071110 con 0x7f1f840c4340 2023-11-27T21:22:00.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.506+0000 7f1f8978d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f840c4340 0x7f1f8406ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:00.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.506+0000 7f1f8978d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f840c4340 0x7f1f8406ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:59270/0 (socket says 172.21.15.88:59270) 2023-11-27T21:22:00.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.506+0000 7f1f8978d640 1 -- 172.21.15.88:0/4249926367 learned_addr learned my addr 172.21.15.88:0/4249926367 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:22:00.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.507+0000 7f1f89f8e640 1 --2- 172.21.15.88:0/4249926367 >> v2:172.21.15.167:3300/0 conn(0x7f1f84151040 0x7f1f841514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:00.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.509+0000 7f1f8978d640 1 -- 172.21.15.88:0/4249926367 >> v2:172.21.15.167:3300/0 conn(0x7f1f84151040 msgr2=0x7f1f841514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:22:00.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.509+0000 7f1f8978d640 1 --2- 172.21.15.88:0/4249926367 >> v2:172.21.15.167:3300/0 conn(0x7f1f84151040 0x7f1f841514b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:00.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.509+0000 7f1f8978d640 1 -- 172.21.15.88:0/4249926367 >> v1:172.21.15.167:6789/0 conn(0x7f1f840c4720 legacy=0x7f1f84070a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:00.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.509+0000 7f1f8978d640 1 -- 172.21.15.88:0/4249926367 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f84157360 con 0x7f1f840c4340 2023-11-27T21:22:00.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.512+0000 7f1f8978d640 1 --2- 172.21.15.88:0/4249926367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f840c4340 0x7f1f8406ed60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1f80009870 tx=0x7f1f8002ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d55392baee41865d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:00.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.517+0000 7f1f7bfff640 1 -- 172.21.15.88:0/4249926367 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8002f840 con 0x7f1f840c4340 2023-11-27T21:22:00.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.517+0000 7f1f7bfff640 1 -- 172.21.15.88:0/4249926367 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8002f9a0 con 0x7f1f840c4340 2023-11-27T21:22:00.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.517+0000 7f1f7bfff640 1 -- 172.21.15.88:0/4249926367 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8002fd30 con 0x7f1f840c4340 2023-11-27T21:22:00.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.517+0000 7f1f8b9f1640 1 -- 172.21.15.88:0/4249926367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f840c4340 msgr2=0x7f1f8406ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:00.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.517+0000 7f1f8b9f1640 1 --2- 172.21.15.88:0/4249926367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f840c4340 0x7f1f8406ed60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1f80009870 tx=0x7f1f8002ba20 comp rx=0 tx=0).stop 2023-11-27T21:22:00.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.517+0000 7f1f8b9f1640 1 -- 172.21.15.88:0/4249926367 shutdown_connections 2023-11-27T21:22:00.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.517+0000 7f1f8b9f1640 1 --2- 172.21.15.88:0/4249926367 >> v2:172.21.15.167:3300/0 conn(0x7f1f84151040 0x7f1f841514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:00.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.517+0000 7f1f8b9f1640 1 --2- 172.21.15.88:0/4249926367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f840c4340 0x7f1f8406ed60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:00.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.517+0000 7f1f8b9f1640 1 -- 172.21.15.88:0/4249926367 >> 172.21.15.88:0/4249926367 conn(0x7f1f8406c5f0 msgr2=0x7f1f8406c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:00.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.517+0000 7f1f8b9f1640 1 -- 172.21.15.88:0/4249926367 shutdown_connections 2023-11-27T21:22:00.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.517+0000 7f1f8b9f1640 1 -- 172.21.15.88:0/4249926367 wait complete. 2023-11-27T21:22:00.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.518+0000 7f1f8b9f1640 1 Processor -- start 2023-11-27T21:22:00.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.519+0000 7f1f8b9f1640 1 -- start start 2023-11-27T21:22:00.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.519+0000 7f1f8b9f1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f840c4340 0x7f1f841ef430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:00.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.519+0000 7f1f8b9f1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f840c4720 0x7f1f840ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:00.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.519+0000 7f1f8b9f1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f84151040 0x7f1f841f1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:00.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.519+0000 7f1f8b9f1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f840c3cc0 con 0x7f1f840c4720 2023-11-27T21:22:00.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.519+0000 7f1f8b9f1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f840c36d0 con 0x7f1f84151040 2023-11-27T21:22:00.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.519+0000 7f1f8b9f1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8414b7d0 con 0x7f1f840c4340 2023-11-27T21:22:00.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.520+0000 7f1f89f8e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f84151040 0x7f1f841f1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:00.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.520+0000 7f1f88f8c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f840c4720 0x7f1f840ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:00.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.520+0000 7f1f8978d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f840c4340 0x7f1f841ef430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:00.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.520+0000 7f1f89f8e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f84151040 0x7f1f841f1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:40640/0 (socket says 172.21.15.88:40640) 2023-11-27T21:22:00.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.520+0000 7f1f89f8e640 1 -- 172.21.15.88:0/1664167041 learned_addr learned my addr 172.21.15.88:0/1664167041 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:22:00.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.524+0000 7f1f88f8c640 1 -- 172.21.15.88:0/1664167041 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f840c4340 msgr2=0x7f1f841ef430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:00.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.524+0000 7f1f88f8c640 1 --2- 172.21.15.88:0/1664167041 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f840c4340 0x7f1f841ef430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:00.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.524+0000 7f1f88f8c640 1 -- 172.21.15.88:0/1664167041 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f84151040 msgr2=0x7f1f841f1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:00.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.524+0000 7f1f88f8c640 1 --2- 172.21.15.88:0/1664167041 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f84151040 0x7f1f841f1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:00.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.524+0000 7f1f88f8c640 1 -- 172.21.15.88:0/1664167041 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f800094d0 con 0x7f1f840c4720 2023-11-27T21:22:00.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.527+0000 7f1f88f8c640 1 --2- 172.21.15.88:0/1664167041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f840c4720 0x7f1f840ca750 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1f7400c390 tx=0x7f1f7400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:00.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.531+0000 7f1f79ffb640 1 -- 172.21.15.88:0/1664167041 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f740052d0 con 0x7f1f840c4720 2023-11-27T21:22:00.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.531+0000 7f1f79ffb640 1 -- 172.21.15.88:0/1664167041 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f74005430 con 0x7f1f840c4720 2023-11-27T21:22:00.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.531+0000 7f1f79ffb640 1 -- 172.21.15.88:0/1664167041 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f74003830 con 0x7f1f840c4720 2023-11-27T21:22:00.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.531+0000 7f1f8b9f1640 1 -- 172.21.15.88:0/1664167041 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f8414ba20 con 0x7f1f840c4720 2023-11-27T21:22:00.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.531+0000 7f1f8b9f1640 1 -- 172.21.15.88:0/1664167041 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f840c38e0 con 0x7f1f840c4720 2023-11-27T21:22:00.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.532+0000 7f1f8b9f1640 1 -- 172.21.15.88:0/1664167041 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1f8414bf40 con 0x7f1f840c4720 2023-11-27T21:22:00.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.551+0000 7f1f79ffb640 1 -- 172.21.15.88:0/1664167041 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1f74003990 con 0x7f1f840c4720 2023-11-27T21:22:00.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.551+0000 7f1f79ffb640 1 --2- 172.21.15.88:0/1664167041 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1f6806b1c0 0x7f1f6806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:00.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.551+0000 7f1f8978d640 1 --2- 172.21.15.88:0/1664167041 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1f6806b1c0 0x7f1f6806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:00.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.552+0000 7f1f8978d640 1 --2- 172.21.15.88:0/1664167041 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1f6806b1c0 0x7f1f6806d680 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1f80036000 tx=0x7f1f80008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:00.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.555+0000 7f1f79ffb640 1 -- 172.21.15.88:0/1664167041 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1f74058060 con 0x7f1f840c4720 2023-11-27T21:22:00.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.555+0000 7f1f79ffb640 1 --2- 172.21.15.88:0/1664167041 >> [v2:172.21.15.88:6802/1166333913,v1:172.21.15.88:6803/1166333913] conn(0x7f1f68074a20 0x7f1f68076ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:00.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.555+0000 7f1f79ffb640 1 -- 172.21.15.88:0/1664167041 --> [v2:172.21.15.88:6802/1166333913,v1:172.21.15.88:6803/1166333913] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1f68077590 con 0x7f1f68074a20 2023-11-27T21:22:00.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.555+0000 7f1f79ffb640 1 -- 172.21.15.88:0/1664167041 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f740543a0 con 0x7f1f840c4720 2023-11-27T21:22:00.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.555+0000 7f1f89f8e640 1 --2- 172.21.15.88:0/1664167041 >> [v2:172.21.15.88:6802/1166333913,v1:172.21.15.88:6803/1166333913] conn(0x7f1f68074a20 0x7f1f68076ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:00.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.555+0000 7f1f89f8e640 1 --2- 172.21.15.88:0/1664167041 >> [v2:172.21.15.88:6802/1166333913,v1:172.21.15.88:6803/1166333913] conn(0x7f1f68074a20 0x7f1f68076ec0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:00.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.556+0000 7f1f79ffb640 1 -- 172.21.15.88:0/1664167041 <== osd.2 v2:172.21.15.88:6802/1166333913 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f1f68077590 con 0x7f1f68074a20 2023-11-27T21:22:00.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.569+0000 7f1f8b9f1640 1 -- 172.21.15.88:0/1664167041 --> [v2:172.21.15.88:6802/1166333913,v1:172.21.15.88:6803/1166333913] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1f841578e0 con 0x7f1f68074a20 2023-11-27T21:22:00.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.569+0000 7f1f79ffb640 1 -- 172.21.15.88:0/1664167041 <== osd.2 v2:172.21.15.88:6802/1166333913 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1f7c007490 con 0x7f1f68074a20 2023-11-27T21:22:00.571 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-27T21:22:00.571 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-27T21:22:00.572 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-27T21:22:00.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.569+0000 7f1f8b9f1640 1 -- 172.21.15.88:0/1664167041 >> [v2:172.21.15.88:6802/1166333913,v1:172.21.15.88:6803/1166333913] conn(0x7f1f68074a20 msgr2=0x7f1f68076ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:00.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.569+0000 7f1f8b9f1640 1 --2- 172.21.15.88:0/1664167041 >> [v2:172.21.15.88:6802/1166333913,v1:172.21.15.88:6803/1166333913] conn(0x7f1f68074a20 0x7f1f68076ec0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:00.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.569+0000 7f1f8b9f1640 1 -- 172.21.15.88:0/1664167041 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1f6806b1c0 msgr2=0x7f1f6806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:00.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.569+0000 7f1f8b9f1640 1 --2- 172.21.15.88:0/1664167041 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f1f6806b1c0 0x7f1f6806d680 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1f80036000 tx=0x7f1f80008030 comp rx=0 tx=0).stop 2023-11-27T21:22:00.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.569+0000 7f1f8b9f1640 1 -- 172.21.15.88:0/1664167041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f840c4720 msgr2=0x7f1f840ca750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:00.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.569+0000 7f1f8b9f1640 1 --2- 172.21.15.88:0/1664167041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f840c4720 0x7f1f840ca750 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1f7400c390 tx=0x7f1f7400c850 comp rx=0 tx=0).stop 2023-11-27T21:22:00.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.569+0000 7f1f89f8e640 1 -- 172.21.15.88:0/1664167041 reap_dead start 2023-11-27T21:22:00.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.569+0000 7f1f8b9f1640 1 -- 172.21.15.88:0/1664167041 shutdown_connections 2023-11-27T21:22:00.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.569+0000 7f1f8b9f1640 1 -- 172.21.15.88:0/1664167041 >> 172.21.15.88:0/1664167041 conn(0x7f1f8406c5f0 msgr2=0x7f1f840c87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:00.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.569+0000 7f1f8b9f1640 1 -- 172.21.15.88:0/1664167041 shutdown_connections 2023-11-27T21:22:00.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.569+0000 7f1f8b9f1640 1 -- 172.21.15.88:0/1664167041 wait complete. 2023-11-27T21:22:00.582 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-27T21:22:00.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.686+0000 7f5f8fff1640 1 Processor -- start 2023-11-27T21:22:00.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.687+0000 7f5f8fff1640 1 -- start start 2023-11-27T21:22:00.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.687+0000 7f5f8fff1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5f880cda70 0x7f5f880ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:00.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.687+0000 7f5f8fff1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5f880cc420 0x7f5f88159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:00.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.687+0000 7f5f8fff1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f88159b50 0x7f5f880c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:00.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.687+0000 7f5f8fff1640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f880cc230 con 0x7f5f880cc420 2023-11-27T21:22:00.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.687+0000 7f5f8fff1640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f880cbda0 con 0x7f5f880cda70 2023-11-27T21:22:00.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.687+0000 7f5f8fff1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880cb4e0 con 0x7f5f88159b50 2023-11-27T21:22:00.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.727+0000 7f5f8d58c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5f880cc420 0x7f5f88159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:00.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.727+0000 7f5f8d58c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5f880cc420 0x7f5f88159610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56814/0 (socket says 172.21.15.88:56814) 2023-11-27T21:22:00.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.728+0000 7f5f8d58c640 1 -- 172.21.15.88:0/2426458797 learned_addr learned my addr 172.21.15.88:0/2426458797 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:22:00.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.730+0000 7f5f8d58c640 1 -- 172.21.15.88:0/2426458797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f88159b50 msgr2=0x7f5f880c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:22:00.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.730+0000 7f5f8d58c640 1 --2- 172.21.15.88:0/2426458797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f88159b50 0x7f5f880c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:00.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.730+0000 7f5f8d58c640 1 -- 172.21.15.88:0/2426458797 >> v2:172.21.15.167:3300/0 conn(0x7f5f880cda70 msgr2=0x7f5f880ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:22:00.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.730+0000 7f5f8d58c640 1 --2- 172.21.15.88:0/2426458797 >> v2:172.21.15.167:3300/0 conn(0x7f5f880cda70 0x7f5f880ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:00.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.730+0000 7f5f8d58c640 1 -- 172.21.15.88:0/2426458797 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f880cce00 con 0x7f5f880cc420 2023-11-27T21:22:00.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.732+0000 7f5f8d58c640 1 --2- 172.21.15.88:0/2426458797 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f880cc420 0x7f5f88159610 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5f88072a20 tx=0x7f5f8402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f67111a318b90f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:00.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.735+0000 7f5f8cd8b640 1 -- 172.21.15.88:0/2426458797 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f84030860 con 0x7f5f880cc420 2023-11-27T21:22:00.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.736+0000 7f5f8cd8b640 1 -- 172.21.15.88:0/2426458797 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f840309c0 con 0x7f5f880cc420 2023-11-27T21:22:00.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.736+0000 7f5f8cd8b640 1 -- 172.21.15.88:0/2426458797 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f84030d50 con 0x7f5f880cc420 2023-11-27T21:22:00.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.736+0000 7f5f8fff1640 1 -- 172.21.15.88:0/2426458797 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f880cc420 msgr2=0x7f5f88159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:00.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.736+0000 7f5f8fff1640 1 --2- 172.21.15.88:0/2426458797 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f880cc420 0x7f5f88159610 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5f88072a20 tx=0x7f5f8402b9a0 comp rx=0 tx=0).stop 2023-11-27T21:22:00.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.736+0000 7f5f8fff1640 1 -- 172.21.15.88:0/2426458797 shutdown_connections 2023-11-27T21:22:00.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.736+0000 7f5f8fff1640 1 --2- 172.21.15.88:0/2426458797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f88159b50 0x7f5f880c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:00.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.736+0000 7f5f8fff1640 1 --2- 172.21.15.88:0/2426458797 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f880cc420 0x7f5f88159610 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:00.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.736+0000 7f5f8fff1640 1 --2- 172.21.15.88:0/2426458797 >> v2:172.21.15.167:3300/0 conn(0x7f5f880cda70 0x7f5f880ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:00.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.736+0000 7f5f8fff1640 1 -- 172.21.15.88:0/2426458797 >> 172.21.15.88:0/2426458797 conn(0x7f5f880b07b0 msgr2=0x7f5f880b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:00.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.736+0000 7f5f8fff1640 1 -- 172.21.15.88:0/2426458797 shutdown_connections 2023-11-27T21:22:00.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.736+0000 7f5f8fff1640 1 -- 172.21.15.88:0/2426458797 wait complete. 2023-11-27T21:22:00.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.738+0000 7f5f8fff1640 1 Processor -- start 2023-11-27T21:22:00.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.738+0000 7f5f8fff1640 1 -- start start 2023-11-27T21:22:00.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.738+0000 7f5f8fff1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f880cc420 0x7f5f881ef640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:00.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.738+0000 7f5f8fff1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f880cda70 0x7f5f881f0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:00.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.738+0000 7f5f8fff1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f88159b50 0x7f5f881585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:00.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.738+0000 7f5f8fff1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f881efb80 con 0x7f5f880cda70 2023-11-27T21:22:00.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.738+0000 7f5f8fff1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880b4460 con 0x7f5f880cc420 2023-11-27T21:22:00.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.738+0000 7f5f8fff1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880b46b0 con 0x7f5f88159b50 2023-11-27T21:22:00.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.739+0000 7f5f8d58c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f880cda70 0x7f5f881f0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:00.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.739+0000 7f5f8d58c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f880cda70 0x7f5f881f0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56816/0 (socket says 172.21.15.88:56816) 2023-11-27T21:22:00.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.739+0000 7f5f8d58c640 1 -- 172.21.15.88:0/1741438460 learned_addr learned my addr 172.21.15.88:0/1741438460 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:22:00.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.742+0000 7f5f8d58c640 1 -- 172.21.15.88:0/1741438460 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f88159b50 msgr2=0x7f5f881585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:00.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.742+0000 7f5f8d58c640 1 --2- 172.21.15.88:0/1741438460 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f88159b50 0x7f5f881585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:00.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.742+0000 7f5f8d58c640 1 -- 172.21.15.88:0/1741438460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f880cc420 msgr2=0x7f5f881ef640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:00.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.742+0000 7f5f8d58c640 1 --2- 172.21.15.88:0/1741438460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f880cc420 0x7f5f881ef640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:00.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.742+0000 7f5f8d58c640 1 -- 172.21.15.88:0/1741438460 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f840094d0 con 0x7f5f880cda70 2023-11-27T21:22:00.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.744+0000 7f5f8d58c640 1 --2- 172.21.15.88:0/1741438460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f880cda70 0x7f5f881f0030 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5f84000c00 tx=0x7f5f84004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:00.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.748+0000 7f5f7e7fc640 1 -- 172.21.15.88:0/1741438460 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f84039e20 con 0x7f5f880cda70 2023-11-27T21:22:00.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.748+0000 7f5f7e7fc640 1 -- 172.21.15.88:0/1741438460 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f84043400 con 0x7f5f880cda70 2023-11-27T21:22:00.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.748+0000 7f5f7e7fc640 1 -- 172.21.15.88:0/1741438460 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f840437b0 con 0x7f5f880cda70 2023-11-27T21:22:00.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.748+0000 7f5f8fff1640 1 -- 172.21.15.88:0/1741438460 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f880b1e30 con 0x7f5f880cda70 2023-11-27T21:22:00.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.748+0000 7f5f8fff1640 1 -- 172.21.15.88:0/1741438460 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f880b23f0 con 0x7f5f880cda70 2023-11-27T21:22:00.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.749+0000 7f5f8fff1640 1 -- 172.21.15.88:0/1741438460 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f88067470 con 0x7f5f880cda70 2023-11-27T21:22:00.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.993+0000 7f5f7e7fc640 1 -- 172.21.15.88:0/1741438460 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5f84043910 con 0x7f5f880cda70 2023-11-27T21:22:00.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.993+0000 7f5f7e7fc640 1 --2- 172.21.15.88:0/1741438460 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5f6c06b240 0x7f5f6c06d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:00.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.994+0000 7f5f8dd8d640 1 --2- 172.21.15.88:0/1741438460 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5f6c06b240 0x7f5f6c06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:00.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:00.994+0000 7f5f8dd8d640 1 --2- 172.21.15.88:0/1741438460 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5f6c06b240 0x7f5f6c06d700 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5f78009710 tx=0x7f5f78006c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:01.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.024+0000 7f5f7e7fc640 1 -- 172.21.15.88:0/1741438460 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5f8403e070 con 0x7f5f880cda70 2023-11-27T21:22:01.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.024+0000 7f5f7e7fc640 1 -- 172.21.15.88:0/1741438460 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5f840784a0 con 0x7f5f880cda70 2023-11-27T21:22:01.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.201+0000 7f5f8fff1640 1 -- 172.21.15.88:0/1741438460 --> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f880cba30 con 0x7f5f6c06b240 2023-11-27T21:22:01.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.202+0000 7f5f7e7fc640 1 -- 172.21.15.88:0/1741438460 <== mgr.4105 v2:172.21.15.88:6800/352455703 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5f7800b480 con 0x7f5f6c06b240 2023-11-27T21:22:01.204 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 2 to deep-scrub 2023-11-27T21:22:01.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.204+0000 7f5f8fff1640 1 -- 172.21.15.88:0/1741438460 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5f6c06b240 msgr2=0x7f5f6c06d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:01.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.204+0000 7f5f8fff1640 1 --2- 172.21.15.88:0/1741438460 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5f6c06b240 0x7f5f6c06d700 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5f78009710 tx=0x7f5f78006c90 comp rx=0 tx=0).stop 2023-11-27T21:22:01.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.204+0000 7f5f8fff1640 1 -- 172.21.15.88:0/1741438460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f880cda70 msgr2=0x7f5f881f0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:01.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.204+0000 7f5f8fff1640 1 --2- 172.21.15.88:0/1741438460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f880cda70 0x7f5f881f0030 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5f84000c00 tx=0x7f5f84004730 comp rx=0 tx=0).stop 2023-11-27T21:22:01.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.204+0000 7f5f8fff1640 1 -- 172.21.15.88:0/1741438460 shutdown_connections 2023-11-27T21:22:01.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.204+0000 7f5f8fff1640 1 --2- 172.21.15.88:0/1741438460 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5f6c06b240 0x7f5f6c06d700 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:01.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.204+0000 7f5f8fff1640 1 --2- 172.21.15.88:0/1741438460 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f88159b50 0x7f5f881585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:01.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.204+0000 7f5f8fff1640 1 --2- 172.21.15.88:0/1741438460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f880cda70 0x7f5f881f0030 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:01.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.204+0000 7f5f8fff1640 1 --2- 172.21.15.88:0/1741438460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f880cc420 0x7f5f881ef640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:01.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.204+0000 7f5f8fff1640 1 -- 172.21.15.88:0/1741438460 >> 172.21.15.88:0/1741438460 conn(0x7f5f880b07b0 msgr2=0x7f5f880c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:01.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.204+0000 7f5f8fff1640 1 -- 172.21.15.88:0/1741438460 shutdown_connections 2023-11-27T21:22:01.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.204+0000 7f5f8fff1640 1 -- 172.21.15.88:0/1741438460 wait complete. 2023-11-27T21:22:01.217 INFO:tasks.ceph:Scrubbing osd.3 2023-11-27T21:22:01.217 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-27T21:22:01.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.322+0000 7fc3c4626640 1 Processor -- start 2023-11-27T21:22:01.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.322+0000 7fc3c4626640 1 -- start start 2023-11-27T21:22:01.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.323+0000 7fc3c4626640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3bc0c56c0 0x7fc3bc0c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:01.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.323+0000 7fc3c4626640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3bc15a7a0 con 0x7fc3bc15ac30 2023-11-27T21:22:01.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.323+0000 7fc3c4626640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3bc1574c0 con 0x7fc3bc0c52e0 2023-11-27T21:22:01.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.323+0000 7fc3c4626640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc0c7250 con 0x7fc3bc0c56c0 2023-11-27T21:22:01.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.323+0000 7fc3c2bc3640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc3bc15ac30 0x7fc3bc15b0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42450/0 (socket says 172.21.15.88:42450) 2023-11-27T21:22:01.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.323+0000 7fc3c2bc3640 1 -- 172.21.15.88:0/1138877858 learned_addr learned my addr 172.21.15.88:0/1138877858 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:22:01.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.323+0000 7fc3c1bc1640 1 --2- 172.21.15.88:0/1138877858 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3bc0c56c0 0x7fc3bc0c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:01.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.326+0000 7fc3c13c0640 1 -- 172.21.15.88:0/1138877858 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1207550650 0 0) 0x7fc3bc15a7a0 con 0x7fc3bc15ac30 2023-11-27T21:22:01.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.326+0000 7fc3c13c0640 1 -- 172.21.15.88:0/1138877858 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3a8003520 con 0x7fc3bc15ac30 2023-11-27T21:22:01.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.326+0000 7fc3c13c0640 1 -- 172.21.15.88:0/1138877858 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 423602896 0 0) 0x7fc3bc1574c0 con 0x7fc3bc0c52e0 2023-11-27T21:22:01.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.326+0000 7fc3c13c0640 1 -- 172.21.15.88:0/1138877858 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3bc15a7a0 con 0x7fc3bc0c52e0 2023-11-27T21:22:01.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.326+0000 7fc3c1bc1640 1 -- 172.21.15.88:0/1138877858 >> v1:172.21.15.167:6789/0 conn(0x7fc3bc0c52e0 legacy=0x7fc3bc0c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:01.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.326+0000 7fc3c1bc1640 1 -- 172.21.15.88:0/1138877858 >> v1:172.21.15.88:6789/0 conn(0x7fc3bc15ac30 legacy=0x7fc3bc15b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:01.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.326+0000 7fc3c1bc1640 1 -- 172.21.15.88:0/1138877858 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3bc157760 con 0x7fc3bc0c56c0 2023-11-27T21:22:01.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.329+0000 7fc3c1bc1640 1 --2- 172.21.15.88:0/1138877858 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3bc0c56c0 0x7fc3bc0c8220 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac0097d0 tx=0x7fc3ac02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d580086e3b5666ee server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:01.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.333+0000 7fc3c13c0640 1 -- 172.21.15.88:0/1138877858 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac031890 con 0x7fc3bc0c56c0 2023-11-27T21:22:01.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.333+0000 7fc3c13c0640 1 -- 172.21.15.88:0/1138877858 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ac0319f0 con 0x7fc3bc0c56c0 2023-11-27T21:22:01.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.333+0000 7fc3c13c0640 1 -- 172.21.15.88:0/1138877858 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac031d80 con 0x7fc3bc0c56c0 2023-11-27T21:22:01.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.333+0000 7fc3c4626640 1 -- 172.21.15.88:0/1138877858 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3bc0c56c0 msgr2=0x7fc3bc0c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:01.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.333+0000 7fc3c4626640 1 --2- 172.21.15.88:0/1138877858 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3bc0c56c0 0x7fc3bc0c8220 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac0097d0 tx=0x7fc3ac02b930 comp rx=0 tx=0).stop 2023-11-27T21:22:01.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.333+0000 7fc3c4626640 1 -- 172.21.15.88:0/1138877858 shutdown_connections 2023-11-27T21:22:01.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.333+0000 7fc3c4626640 1 --2- 172.21.15.88:0/1138877858 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3bc0c56c0 0x7fc3bc0c8220 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:01.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.333+0000 7fc3c4626640 1 -- 172.21.15.88:0/1138877858 >> 172.21.15.88:0/1138877858 conn(0x7fc3bc06f6d0 msgr2=0x7fc3bc06fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:01.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.333+0000 7fc3c4626640 1 -- 172.21.15.88:0/1138877858 shutdown_connections 2023-11-27T21:22:01.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.333+0000 7fc3c4626640 1 -- 172.21.15.88:0/1138877858 wait complete. 2023-11-27T21:22:01.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.335+0000 7fc3c4626640 1 Processor -- start 2023-11-27T21:22:01.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.335+0000 7fc3c4626640 1 -- start start 2023-11-27T21:22:01.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.335+0000 7fc3c4626640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3bc0c52e0 0x7fc3bc1e1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:01.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.335+0000 7fc3c4626640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3bc0c56c0 0x7fc3bc150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:01.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.335+0000 7fc3c4626640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3bc15ac30 0x7fc3bc1f0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:01.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.335+0000 7fc3c4626640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc1e1180 con 0x7fc3bc0c52e0 2023-11-27T21:22:01.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.335+0000 7fc3c4626640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc1f0440 con 0x7fc3bc15ac30 2023-11-27T21:22:01.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.335+0000 7fc3c4626640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc1e2210 con 0x7fc3bc0c56c0 2023-11-27T21:22:01.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.336+0000 7fc3c23c2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3bc0c52e0 0x7fc3bc1e1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:01.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.336+0000 7fc3c2bc3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3bc15ac30 0x7fc3bc1f0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:01.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.336+0000 7fc3c23c2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3bc0c52e0 0x7fc3bc1e1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56828/0 (socket says 172.21.15.88:56828) 2023-11-27T21:22:01.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.336+0000 7fc3c23c2640 1 -- 172.21.15.88:0/2842556800 learned_addr learned my addr 172.21.15.88:0/2842556800 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:22:01.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.336+0000 7fc3c1bc1640 1 --2- 172.21.15.88:0/2842556800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3bc0c56c0 0x7fc3bc150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:01.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.339+0000 7fc3c23c2640 1 -- 172.21.15.88:0/2842556800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3bc0c56c0 msgr2=0x7fc3bc150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:01.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.339+0000 7fc3c23c2640 1 --2- 172.21.15.88:0/2842556800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3bc0c56c0 0x7fc3bc150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:01.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.339+0000 7fc3c23c2640 1 -- 172.21.15.88:0/2842556800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3bc15ac30 msgr2=0x7fc3bc1f0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:01.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.339+0000 7fc3c23c2640 1 --2- 172.21.15.88:0/2842556800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3bc15ac30 0x7fc3bc1f0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:01.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.339+0000 7fc3c23c2640 1 -- 172.21.15.88:0/2842556800 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ac009400 con 0x7fc3bc0c52e0 2023-11-27T21:22:01.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.342+0000 7fc3c23c2640 1 --2- 172.21.15.88:0/2842556800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3bc0c52e0 0x7fc3bc1e1cd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800c530 tx=0x7fc3b800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:01.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.345+0000 7fc3b2ffd640 1 -- 172.21.15.88:0/2842556800 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b80052d0 con 0x7fc3bc0c52e0 2023-11-27T21:22:01.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.345+0000 7fc3b2ffd640 1 -- 172.21.15.88:0/2842556800 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b8005450 con 0x7fc3bc0c52e0 2023-11-27T21:22:01.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.345+0000 7fc3b2ffd640 1 -- 172.21.15.88:0/2842556800 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8012870 con 0x7fc3bc0c52e0 2023-11-27T21:22:01.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.345+0000 7fc3c4626640 1 -- 172.21.15.88:0/2842556800 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3bc1e29d0 con 0x7fc3bc0c52e0 2023-11-27T21:22:01.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.345+0000 7fc3c4626640 1 -- 172.21.15.88:0/2842556800 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3bc14ea00 con 0x7fc3bc0c52e0 2023-11-27T21:22:01.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.346+0000 7fc3c4626640 1 -- 172.21.15.88:0/2842556800 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc3bc158000 con 0x7fc3bc0c52e0 2023-11-27T21:22:01.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.366+0000 7fc3b2ffd640 1 -- 172.21.15.88:0/2842556800 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc3b80129d0 con 0x7fc3bc0c52e0 2023-11-27T21:22:01.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.366+0000 7fc3b2ffd640 1 --2- 172.21.15.88:0/2842556800 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fc3a006b210 0x7fc3a006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:01.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.366+0000 7fc3c1bc1640 1 --2- 172.21.15.88:0/2842556800 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fc3a006b210 0x7fc3a006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:01.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.366+0000 7fc3c1bc1640 1 --2- 172.21.15.88:0/2842556800 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fc3a006b210 0x7fc3a006d6d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac036000 tx=0x7fc3ac03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:01.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.370+0000 7fc3b2ffd640 1 -- 172.21.15.88:0/2842556800 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc3b8058900 con 0x7fc3bc0c52e0 2023-11-27T21:22:01.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.370+0000 7fc3b2ffd640 1 --2- 172.21.15.88:0/2842556800 >> [v2:172.21.15.88:6810/406887502,v1:172.21.15.88:6811/406887502] conn(0x7fc3a0074af0 0x7fc3a0076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:01.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.370+0000 7fc3b2ffd640 1 -- 172.21.15.88:0/2842556800 --> [v2:172.21.15.88:6810/406887502,v1:172.21.15.88:6811/406887502] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc3a0077660 con 0x7fc3a0074af0 2023-11-27T21:22:01.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.370+0000 7fc3b2ffd640 1 -- 172.21.15.88:0/2842556800 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3b8054c40 con 0x7fc3bc0c52e0 2023-11-27T21:22:01.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.370+0000 7fc3c2bc3640 1 --2- 172.21.15.88:0/2842556800 >> [v2:172.21.15.88:6810/406887502,v1:172.21.15.88:6811/406887502] conn(0x7fc3a0074af0 0x7fc3a0076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:01.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.370+0000 7fc3c2bc3640 1 --2- 172.21.15.88:0/2842556800 >> [v2:172.21.15.88:6810/406887502,v1:172.21.15.88:6811/406887502] conn(0x7fc3a0074af0 0x7fc3a0076f90 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:01.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.371+0000 7fc3b2ffd640 1 -- 172.21.15.88:0/2842556800 <== osd.3 v2:172.21.15.88:6810/406887502 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fc3a0077660 con 0x7fc3a0074af0 2023-11-27T21:22:01.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.384+0000 7fc3c4626640 1 -- 172.21.15.88:0/2842556800 --> [v2:172.21.15.88:6810/406887502,v1:172.21.15.88:6811/406887502] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc3bc157d20 con 0x7fc3a0074af0 2023-11-27T21:22:01.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.384+0000 7fc3b2ffd640 1 -- 172.21.15.88:0/2842556800 <== osd.3 v2:172.21.15.88:6810/406887502 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc3b4001f70 con 0x7fc3a0074af0 2023-11-27T21:22:01.386 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-27T21:22:01.386 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-27T21:22:01.386 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-27T21:22:01.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.384+0000 7fc3c4626640 1 -- 172.21.15.88:0/2842556800 >> [v2:172.21.15.88:6810/406887502,v1:172.21.15.88:6811/406887502] conn(0x7fc3a0074af0 msgr2=0x7fc3a0076f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:01.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.384+0000 7fc3c4626640 1 --2- 172.21.15.88:0/2842556800 >> [v2:172.21.15.88:6810/406887502,v1:172.21.15.88:6811/406887502] conn(0x7fc3a0074af0 0x7fc3a0076f90 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:01.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.384+0000 7fc3c4626640 1 -- 172.21.15.88:0/2842556800 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fc3a006b210 msgr2=0x7fc3a006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:01.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.384+0000 7fc3c4626640 1 --2- 172.21.15.88:0/2842556800 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fc3a006b210 0x7fc3a006d6d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac036000 tx=0x7fc3ac03c040 comp rx=0 tx=0).stop 2023-11-27T21:22:01.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.384+0000 7fc3c4626640 1 -- 172.21.15.88:0/2842556800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3bc0c52e0 msgr2=0x7fc3bc1e1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:01.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.384+0000 7fc3c4626640 1 --2- 172.21.15.88:0/2842556800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3bc0c52e0 0x7fc3bc1e1cd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800c530 tx=0x7fc3b800c9f0 comp rx=0 tx=0).stop 2023-11-27T21:22:01.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.384+0000 7fc3c2bc3640 1 -- 172.21.15.88:0/2842556800 reap_dead start 2023-11-27T21:22:01.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.384+0000 7fc3c4626640 1 -- 172.21.15.88:0/2842556800 shutdown_connections 2023-11-27T21:22:01.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.384+0000 7fc3c4626640 1 -- 172.21.15.88:0/2842556800 >> 172.21.15.88:0/2842556800 conn(0x7fc3bc06f6d0 msgr2=0x7fc3bc0c6050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:01.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.384+0000 7fc3c4626640 1 -- 172.21.15.88:0/2842556800 shutdown_connections 2023-11-27T21:22:01.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.384+0000 7fc3c4626640 1 -- 172.21.15.88:0/2842556800 wait complete. 2023-11-27T21:22:01.397 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-27T21:22:01.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.497+0000 7f20f07e3640 1 Processor -- start 2023-11-27T21:22:01.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.497+0000 7f20f07e3640 1 -- start start 2023-11-27T21:22:01.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.498+0000 7f20f07e3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f20e8157240 0x7f20e80c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:01.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.498+0000 7f20f07e3640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e81577f0 con 0x7f20e80c4610 2023-11-27T21:22:01.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.498+0000 7f20f07e3640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e8157a90 con 0x7f20e8151220 2023-11-27T21:22:01.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.498+0000 7f20f07e3640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e806f470 con 0x7f20e8157240 2023-11-27T21:22:01.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.499+0000 7f20eed80640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f20e80c4610 0x7f20e80710c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42454/0 (socket says 172.21.15.88:42454) 2023-11-27T21:22:01.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.499+0000 7f20eed80640 1 -- 172.21.15.88:0/1122161642 learned_addr learned my addr 172.21.15.88:0/1122161642 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:22:01.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.499+0000 7f20edd7e640 1 --2- 172.21.15.88:0/1122161642 >> v2:172.21.15.167:3300/0 conn(0x7f20e8157240 0x7f20e80c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:01.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.501+0000 7f20ed57d640 1 -- 172.21.15.88:0/1122161642 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813138899 0 0) 0x7f20e81577f0 con 0x7f20e80c4610 2023-11-27T21:22:01.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.501+0000 7f20ed57d640 1 -- 172.21.15.88:0/1122161642 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20d4003520 con 0x7f20e80c4610 2023-11-27T21:22:01.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.502+0000 7f20edd7e640 1 -- 172.21.15.88:0/1122161642 >> v1:172.21.15.167:6789/0 conn(0x7f20e8151220 legacy=0x7f20e806ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:01.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.502+0000 7f20edd7e640 1 -- 172.21.15.88:0/1122161642 >> v1:172.21.15.88:6789/0 conn(0x7f20e80c4610 legacy=0x7f20e80710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:01.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.502+0000 7f20edd7e640 1 -- 172.21.15.88:0/1122161642 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e8157d30 con 0x7f20e8157240 2023-11-27T21:22:01.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.506+0000 7f20edd7e640 1 --2- 172.21.15.88:0/1122161642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20e8157240 0x7f20e80c40d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f20e806f5b0 tx=0x7f20d802b9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdfa8f7341d8b403 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:01.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.509+0000 7f20ed57d640 1 -- 172.21.15.88:0/1122161642 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d8030890 con 0x7f20e8157240 2023-11-27T21:22:01.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.511+0000 7f20ed57d640 1 -- 172.21.15.88:0/1122161642 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d80309f0 con 0x7f20e8157240 2023-11-27T21:22:01.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.511+0000 7f20ed57d640 1 -- 172.21.15.88:0/1122161642 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d8030d60 con 0x7f20e8157240 2023-11-27T21:22:01.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.511+0000 7f20f07e3640 1 -- 172.21.15.88:0/1122161642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20e8157240 msgr2=0x7f20e80c40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:01.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.511+0000 7f20f07e3640 1 --2- 172.21.15.88:0/1122161642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20e8157240 0x7f20e80c40d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f20e806f5b0 tx=0x7f20d802b9d0 comp rx=0 tx=0).stop 2023-11-27T21:22:01.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.511+0000 7f20f07e3640 1 -- 172.21.15.88:0/1122161642 shutdown_connections 2023-11-27T21:22:01.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.511+0000 7f20f07e3640 1 --2- 172.21.15.88:0/1122161642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20e8157240 0x7f20e80c40d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:01.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.512+0000 7f20f07e3640 1 -- 172.21.15.88:0/1122161642 >> 172.21.15.88:0/1122161642 conn(0x7f20e806c5f0 msgr2=0x7f20e806c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:01.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.512+0000 7f20f07e3640 1 -- 172.21.15.88:0/1122161642 shutdown_connections 2023-11-27T21:22:01.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.512+0000 7f20f07e3640 1 -- 172.21.15.88:0/1122161642 wait complete. 2023-11-27T21:22:01.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.513+0000 7f20f07e3640 1 Processor -- start 2023-11-27T21:22:01.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.513+0000 7f20f07e3640 1 -- start start 2023-11-27T21:22:01.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.513+0000 7f20f07e3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20e80c4610 0x7f20e80c1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:01.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.513+0000 7f20f07e3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20e8151220 0x7f20e8155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:01.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.513+0000 7f20f07e3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20e8157240 0x7f20e8153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:01.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.513+0000 7f20f07e3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e81e2d30 con 0x7f20e8157240 2023-11-27T21:22:01.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.513+0000 7f20f07e3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e80caf30 con 0x7f20e8151220 2023-11-27T21:22:01.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.513+0000 7f20f07e3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e80cb510 con 0x7f20e80c4610 2023-11-27T21:22:01.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.514+0000 7f20edd7e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20e8151220 0x7f20e8155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:01.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.514+0000 7f20eed80640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20e8157240 0x7f20e8153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:01.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.514+0000 7f20ee57f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20e80c4610 0x7f20e80c1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:01.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.514+0000 7f20edd7e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20e8151220 0x7f20e8155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:40686/0 (socket says 172.21.15.88:40686) 2023-11-27T21:22:01.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.514+0000 7f20edd7e640 1 -- 172.21.15.88:0/3274237390 learned_addr learned my addr 172.21.15.88:0/3274237390 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:22:01.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.518+0000 7f20eed80640 1 -- 172.21.15.88:0/3274237390 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20e80c4610 msgr2=0x7f20e80c1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:01.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.518+0000 7f20eed80640 1 --2- 172.21.15.88:0/3274237390 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20e80c4610 0x7f20e80c1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:01.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.518+0000 7f20eed80640 1 -- 172.21.15.88:0/3274237390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20e8151220 msgr2=0x7f20e8155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:01.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.518+0000 7f20eed80640 1 --2- 172.21.15.88:0/3274237390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20e8151220 0x7f20e8155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:01.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.518+0000 7f20eed80640 1 -- 172.21.15.88:0/3274237390 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d8009400 con 0x7f20e8157240 2023-11-27T21:22:01.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.520+0000 7f20eed80640 1 --2- 172.21.15.88:0/3274237390 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20e8157240 0x7f20e8153230 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f20e000c3c0 tx=0x7f20e000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:01.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.523+0000 7f20deffd640 1 -- 172.21.15.88:0/3274237390 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e0005ce0 con 0x7f20e8157240 2023-11-27T21:22:01.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.523+0000 7f20deffd640 1 -- 172.21.15.88:0/3274237390 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e0005e40 con 0x7f20e8157240 2023-11-27T21:22:01.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.523+0000 7f20deffd640 1 -- 172.21.15.88:0/3274237390 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e00072d0 con 0x7f20e8157240 2023-11-27T21:22:01.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.523+0000 7f20f07e3640 1 -- 172.21.15.88:0/3274237390 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e80c16d0 con 0x7f20e8157240 2023-11-27T21:22:01.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.523+0000 7f20f07e3640 1 -- 172.21.15.88:0/3274237390 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e81549f0 con 0x7f20e8157240 2023-11-27T21:22:01.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.524+0000 7f20f07e3640 1 -- 172.21.15.88:0/3274237390 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e8072020 con 0x7f20e8157240 2023-11-27T21:22:01.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.543+0000 7f20deffd640 1 -- 172.21.15.88:0/3274237390 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f20e0007430 con 0x7f20e8157240 2023-11-27T21:22:01.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.543+0000 7f20deffd640 1 --2- 172.21.15.88:0/3274237390 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f20cc06b210 0x7f20cc06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:01.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.543+0000 7f20ee57f640 1 --2- 172.21.15.88:0/3274237390 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f20cc06b210 0x7f20cc06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:01.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.543+0000 7f20ee57f640 1 --2- 172.21.15.88:0/3274237390 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f20cc06b210 0x7f20cc06d6d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f20e40012e0 tx=0x7f20e4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:01.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.783+0000 7f20deffd640 1 -- 172.21.15.88:0/3274237390 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f20e0057e50 con 0x7f20e8157240 2023-11-27T21:22:01.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.783+0000 7f20deffd640 1 -- 172.21.15.88:0/3274237390 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f20e0054190 con 0x7f20e8157240 2023-11-27T21:22:01.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.955+0000 7f20f07e3640 1 -- 172.21.15.88:0/3274237390 --> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f20e8070ba0 con 0x7f20cc06b210 2023-11-27T21:22:01.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.956+0000 7f20deffd640 1 -- 172.21.15.88:0/3274237390 <== mgr.4105 v2:172.21.15.88:6800/352455703 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f20e400fe00 con 0x7f20cc06b210 2023-11-27T21:22:01.958 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 3 to deep-scrub 2023-11-27T21:22:01.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.958+0000 7f20f07e3640 1 -- 172.21.15.88:0/3274237390 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f20cc06b210 msgr2=0x7f20cc06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:01.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.958+0000 7f20f07e3640 1 --2- 172.21.15.88:0/3274237390 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f20cc06b210 0x7f20cc06d6d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f20e40012e0 tx=0x7f20e4009040 comp rx=0 tx=0).stop 2023-11-27T21:22:01.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.958+0000 7f20f07e3640 1 -- 172.21.15.88:0/3274237390 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20e8157240 msgr2=0x7f20e8153230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:01.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.958+0000 7f20f07e3640 1 --2- 172.21.15.88:0/3274237390 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20e8157240 0x7f20e8153230 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f20e000c3c0 tx=0x7f20e000c880 comp rx=0 tx=0).stop 2023-11-27T21:22:01.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.958+0000 7f20f07e3640 1 -- 172.21.15.88:0/3274237390 shutdown_connections 2023-11-27T21:22:01.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.958+0000 7f20f07e3640 1 --2- 172.21.15.88:0/3274237390 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f20cc06b210 0x7f20cc06d6d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:01.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.958+0000 7f20f07e3640 1 --2- 172.21.15.88:0/3274237390 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20e8157240 0x7f20e8153230 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:01.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.958+0000 7f20f07e3640 1 --2- 172.21.15.88:0/3274237390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20e8151220 0x7f20e8155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:01.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.958+0000 7f20f07e3640 1 --2- 172.21.15.88:0/3274237390 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20e80c4610 0x7f20e80c1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:01.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.958+0000 7f20f07e3640 1 -- 172.21.15.88:0/3274237390 >> 172.21.15.88:0/3274237390 conn(0x7f20e806c5f0 msgr2=0x7f20e8071210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:01.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.958+0000 7f20f07e3640 1 -- 172.21.15.88:0/3274237390 shutdown_connections 2023-11-27T21:22:01.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:01.958+0000 7f20f07e3640 1 -- 172.21.15.88:0/3274237390 wait complete. 2023-11-27T21:22:01.971 INFO:tasks.ceph:Scrubbing osd.4 2023-11-27T21:22:01.972 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-27T21:22:02.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.074+0000 7f6c746e5640 1 Processor -- start 2023-11-27T21:22:02.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.074+0000 7f6c746e5640 1 -- start start 2023-11-27T21:22:02.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.075+0000 7f6c746e5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6c6c0c46c0 0x7f6c6c0c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:02.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.075+0000 7f6c746e5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c6c0c4aa0 0x7f6c6c14fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:02.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.075+0000 7f6c746e5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c6c0c76f0 con 0x7f6c6c150290 2023-11-27T21:22:02.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.075+0000 7f6c746e5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c6c0c2bc0 con 0x7f6c6c0c46c0 2023-11-27T21:22:02.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.075+0000 7f6c746e5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c0c6dc0 con 0x7f6c6c0c4aa0 2023-11-27T21:22:02.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.076+0000 7f6c71c80640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c6c0c4aa0 0x7f6c6c14fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:02.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.076+0000 7f6c71c80640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c6c0c4aa0 0x7f6c6c14fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:59358/0 (socket says 172.21.15.88:59358) 2023-11-27T21:22:02.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.076+0000 7f6c71c80640 1 -- 172.21.15.88:0/1476555132 learned_addr learned my addr 172.21.15.88:0/1476555132 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:22:02.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.079+0000 7f6c71c80640 1 -- 172.21.15.88:0/1476555132 >> v2:172.21.15.88:3300/0 conn(0x7f6c6c0c46c0 msgr2=0x7f6c6c0c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:22:02.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.079+0000 7f6c71c80640 1 --2- 172.21.15.88:0/1476555132 >> v2:172.21.15.88:3300/0 conn(0x7f6c6c0c46c0 0x7f6c6c0c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:02.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.079+0000 7f6c71c80640 1 -- 172.21.15.88:0/1476555132 >> v1:172.21.15.88:6789/0 conn(0x7f6c6c150290 legacy=0x7f6c6c0c1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:22:02.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.079+0000 7f6c71c80640 1 -- 172.21.15.88:0/1476555132 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6c0c70a0 con 0x7f6c6c0c4aa0 2023-11-27T21:22:02.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.081+0000 7f6c71c80640 1 --2- 172.21.15.88:0/1476555132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c6c0c4aa0 0x7f6c6c14fd50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009870 tx=0x7f6c5c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab7827c88d19d688 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:02.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.087+0000 7f6c7147f640 1 -- 172.21.15.88:0/1476555132 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c031640 con 0x7f6c6c0c4aa0 2023-11-27T21:22:02.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.087+0000 7f6c7147f640 1 -- 172.21.15.88:0/1476555132 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5c0317a0 con 0x7f6c6c0c4aa0 2023-11-27T21:22:02.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.087+0000 7f6c7147f640 1 -- 172.21.15.88:0/1476555132 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c031b30 con 0x7f6c6c0c4aa0 2023-11-27T21:22:02.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.088+0000 7f6c746e5640 1 -- 172.21.15.88:0/1476555132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c6c0c4aa0 msgr2=0x7f6c6c14fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:02.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.088+0000 7f6c746e5640 1 --2- 172.21.15.88:0/1476555132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c6c0c4aa0 0x7f6c6c14fd50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009870 tx=0x7f6c5c02b8f0 comp rx=0 tx=0).stop 2023-11-27T21:22:02.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.088+0000 7f6c746e5640 1 -- 172.21.15.88:0/1476555132 shutdown_connections 2023-11-27T21:22:02.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.088+0000 7f6c746e5640 1 --2- 172.21.15.88:0/1476555132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c6c0c4aa0 0x7f6c6c14fd50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:02.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.088+0000 7f6c746e5640 1 --2- 172.21.15.88:0/1476555132 >> v2:172.21.15.88:3300/0 conn(0x7f6c6c0c46c0 0x7f6c6c0c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:02.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.088+0000 7f6c746e5640 1 -- 172.21.15.88:0/1476555132 >> 172.21.15.88:0/1476555132 conn(0x7f6c6c06c5f0 msgr2=0x7f6c6c06c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:02.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.088+0000 7f6c746e5640 1 -- 172.21.15.88:0/1476555132 shutdown_connections 2023-11-27T21:22:02.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.088+0000 7f6c746e5640 1 -- 172.21.15.88:0/1476555132 wait complete. 2023-11-27T21:22:02.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.089+0000 7f6c746e5640 1 Processor -- start 2023-11-27T21:22:02.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.089+0000 7f6c746e5640 1 -- start start 2023-11-27T21:22:02.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.090+0000 7f6c746e5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c6c0c46c0 0x7f6c6c0cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:02.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.090+0000 7f6c746e5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c6c0c4aa0 0x7f6c6c0ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:02.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.090+0000 7f6c746e5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c6c150290 0x7f6c6c0ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:02.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.090+0000 7f6c746e5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c151040 con 0x7f6c6c150290 2023-11-27T21:22:02.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.090+0000 7f6c746e5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c150a80 con 0x7f6c6c0c4aa0 2023-11-27T21:22:02.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.090+0000 7f6c746e5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c150d60 con 0x7f6c6c0c46c0 2023-11-27T21:22:02.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.091+0000 7f6c72c82640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c6c150290 0x7f6c6c0ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:02.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.091+0000 7f6c72481640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c6c0c46c0 0x7f6c6c0cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:02.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.091+0000 7f6c71c80640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c6c0c4aa0 0x7f6c6c0ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:02.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.091+0000 7f6c72c82640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c6c150290 0x7f6c6c0ca7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56840/0 (socket says 172.21.15.88:56840) 2023-11-27T21:22:02.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.091+0000 7f6c72c82640 1 -- 172.21.15.88:0/1594247134 learned_addr learned my addr 172.21.15.88:0/1594247134 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:22:02.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.094+0000 7f6c72c82640 1 -- 172.21.15.88:0/1594247134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c6c0c46c0 msgr2=0x7f6c6c0cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:02.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.094+0000 7f6c72c82640 1 --2- 172.21.15.88:0/1594247134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c6c0c46c0 0x7f6c6c0cb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:02.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.094+0000 7f6c72c82640 1 -- 172.21.15.88:0/1594247134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c6c0c4aa0 msgr2=0x7f6c6c0ca260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:02.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.094+0000 7f6c72c82640 1 --2- 172.21.15.88:0/1594247134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c6c0c4aa0 0x7f6c6c0ca260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:02.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.094+0000 7f6c72c82640 1 -- 172.21.15.88:0/1594247134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5c0094d0 con 0x7f6c6c150290 2023-11-27T21:22:02.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.094+0000 7f6c72481640 1 --2- 172.21.15.88:0/1594247134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c6c0c46c0 0x7f6c6c0cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T21:22:02.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.097+0000 7f6c72c82640 1 --2- 172.21.15.88:0/1594247134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c6c150290 0x7f6c6c0ca7a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400c780 tx=0x7f6c6400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:02.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.100+0000 7f6c62ffd640 1 -- 172.21.15.88:0/1594247134 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64003d80 con 0x7f6c6c150290 2023-11-27T21:22:02.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.100+0000 7f6c62ffd640 1 -- 172.21.15.88:0/1594247134 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6400ce90 con 0x7f6c6c150290 2023-11-27T21:22:02.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.100+0000 7f6c62ffd640 1 -- 172.21.15.88:0/1594247134 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c640052b0 con 0x7f6c6c150290 2023-11-27T21:22:02.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.100+0000 7f6c746e5640 1 -- 172.21.15.88:0/1594247134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c6c0c9780 con 0x7f6c6c150290 2023-11-27T21:22:02.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.100+0000 7f6c746e5640 1 -- 172.21.15.88:0/1594247134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c6c0c9d40 con 0x7f6c6c150290 2023-11-27T21:22:02.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.101+0000 7f6c746e5640 1 -- 172.21.15.88:0/1594247134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6c6c0c9600 con 0x7f6c6c150290 2023-11-27T21:22:02.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.120+0000 7f6c62ffd640 1 -- 172.21.15.88:0/1594247134 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6c64005410 con 0x7f6c6c150290 2023-11-27T21:22:02.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.121+0000 7f6c62ffd640 1 --2- 172.21.15.88:0/1594247134 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f6c5006b210 0x7f6c5006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:02.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.121+0000 7f6c72481640 1 --2- 172.21.15.88:0/1594247134 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f6c5006b210 0x7f6c5006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:02.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.121+0000 7f6c72481640 1 --2- 172.21.15.88:0/1594247134 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f6c5006b210 0x7f6c5006d6d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6c68009cb0 tx=0x7f6c68009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:02.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.123+0000 7f6c62ffd640 1 -- 172.21.15.88:0/1594247134 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6c64013e70 con 0x7f6c6c150290 2023-11-27T21:22:02.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.124+0000 7f6c62ffd640 1 --2- 172.21.15.88:0/1594247134 >> [v2:172.21.15.167:6800/2551293703,v1:172.21.15.167:6801/2551293703] conn(0x7f6c50074af0 0x7f6c50076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:02.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.124+0000 7f6c62ffd640 1 -- 172.21.15.88:0/1594247134 --> [v2:172.21.15.167:6800/2551293703,v1:172.21.15.167:6801/2551293703] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6c50077660 con 0x7f6c50074af0 2023-11-27T21:22:02.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.124+0000 7f6c62ffd640 1 -- 172.21.15.88:0/1594247134 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c64054730 con 0x7f6c6c150290 2023-11-27T21:22:02.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.124+0000 7f6c71c80640 1 --2- 172.21.15.88:0/1594247134 >> [v2:172.21.15.167:6800/2551293703,v1:172.21.15.167:6801/2551293703] conn(0x7f6c50074af0 0x7f6c50076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:02.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.124+0000 7f6c71c80640 1 --2- 172.21.15.88:0/1594247134 >> [v2:172.21.15.167:6800/2551293703,v1:172.21.15.167:6801/2551293703] conn(0x7f6c50074af0 0x7f6c50076f90 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:02.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.125+0000 7f6c62ffd640 1 -- 172.21.15.88:0/1594247134 <== osd.4 v2:172.21.15.167:6800/2551293703 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6c50077660 con 0x7f6c50074af0 2023-11-27T21:22:02.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.138+0000 7f6c746e5640 1 -- 172.21.15.88:0/1594247134 --> [v2:172.21.15.167:6800/2551293703,v1:172.21.15.167:6801/2551293703] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6c6c0c2e80 con 0x7f6c50074af0 2023-11-27T21:22:02.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.139+0000 7f6c62ffd640 1 -- 172.21.15.88:0/1594247134 <== osd.4 v2:172.21.15.167:6800/2551293703 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6c5c031990 con 0x7f6c50074af0 2023-11-27T21:22:02.141 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-27T21:22:02.141 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-27T21:22:02.141 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-27T21:22:02.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.139+0000 7f6c746e5640 1 -- 172.21.15.88:0/1594247134 >> [v2:172.21.15.167:6800/2551293703,v1:172.21.15.167:6801/2551293703] conn(0x7f6c50074af0 msgr2=0x7f6c50076f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:02.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.139+0000 7f6c746e5640 1 --2- 172.21.15.88:0/1594247134 >> [v2:172.21.15.167:6800/2551293703,v1:172.21.15.167:6801/2551293703] conn(0x7f6c50074af0 0x7f6c50076f90 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:02.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.139+0000 7f6c746e5640 1 -- 172.21.15.88:0/1594247134 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f6c5006b210 msgr2=0x7f6c5006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:02.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.139+0000 7f6c746e5640 1 --2- 172.21.15.88:0/1594247134 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f6c5006b210 0x7f6c5006d6d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6c68009cb0 tx=0x7f6c68009060 comp rx=0 tx=0).stop 2023-11-27T21:22:02.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.139+0000 7f6c746e5640 1 -- 172.21.15.88:0/1594247134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c6c150290 msgr2=0x7f6c6c0ca7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:02.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.139+0000 7f6c746e5640 1 --2- 172.21.15.88:0/1594247134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c6c150290 0x7f6c6c0ca7a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400c780 tx=0x7f6c6400cc40 comp rx=0 tx=0).stop 2023-11-27T21:22:02.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.139+0000 7f6c72c82640 1 -- 172.21.15.88:0/1594247134 reap_dead start 2023-11-27T21:22:02.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.139+0000 7f6c746e5640 1 -- 172.21.15.88:0/1594247134 shutdown_connections 2023-11-27T21:22:02.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.139+0000 7f6c746e5640 1 -- 172.21.15.88:0/1594247134 >> 172.21.15.88:0/1594247134 conn(0x7f6c6c06c5f0 msgr2=0x7f6c6c0c08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:02.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.139+0000 7f6c746e5640 1 -- 172.21.15.88:0/1594247134 shutdown_connections 2023-11-27T21:22:02.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.139+0000 7f6c746e5640 1 -- 172.21.15.88:0/1594247134 wait complete. 2023-11-27T21:22:02.151 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-27T21:22:02.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.253+0000 7f0e88539640 1 Processor -- start 2023-11-27T21:22:02.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.254+0000 7f0e88539640 1 -- start start 2023-11-27T21:22:02.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.255+0000 7f0e88539640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e800cda70 0x7f0e800ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:02.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.255+0000 7f0e88539640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0e800cc420 0x7f0e80159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:02.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.255+0000 7f0e88539640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e800cbda0 con 0x7f0e80159b50 2023-11-27T21:22:02.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.255+0000 7f0e88539640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e800cc230 con 0x7f0e800cc420 2023-11-27T21:22:02.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.255+0000 7f0e88539640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e800cb4e0 con 0x7f0e800cda70 2023-11-27T21:22:02.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.255+0000 7f0e85ad4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0e800cc420 0x7f0e80159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:02.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.256+0000 7f0e86ad6640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f0e80159b50 0x7f0e800c9620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:53596/0 (socket says 172.21.15.88:53596) 2023-11-27T21:22:02.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.256+0000 7f0e86ad6640 1 -- 172.21.15.88:0/2810096745 learned_addr learned my addr 172.21.15.88:0/2810096745 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:22:02.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.258+0000 7f0e862d5640 1 --2- 172.21.15.88:0/2810096745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e800cda70 0x7f0e800ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:02.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.258+0000 7f0e85ad4640 1 -- 172.21.15.88:0/2810096745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e800cda70 msgr2=0x7f0e800ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:22:02.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.258+0000 7f0e85ad4640 1 --2- 172.21.15.88:0/2810096745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e800cda70 0x7f0e800ce350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:02.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.258+0000 7f0e85ad4640 1 -- 172.21.15.88:0/2810096745 >> v1:172.21.15.167:6789/0 conn(0x7f0e80159b50 legacy=0x7f0e800c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:02.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.258+0000 7f0e85ad4640 1 -- 172.21.15.88:0/2810096745 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e800cce00 con 0x7f0e800cc420 2023-11-27T21:22:02.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.264+0000 7f0e85ad4640 1 --2- 172.21.15.88:0/2810096745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e800cc420 0x7f0e80159610 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0e700097a0 tx=0x7f0e7002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ecf6a526b81ae5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:02.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.269+0000 7f0e852d3640 1 -- 172.21.15.88:0/2810096745 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70030610 con 0x7f0e800cc420 2023-11-27T21:22:02.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.269+0000 7f0e852d3640 1 -- 172.21.15.88:0/2810096745 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e70030770 con 0x7f0e800cc420 2023-11-27T21:22:02.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.269+0000 7f0e852d3640 1 -- 172.21.15.88:0/2810096745 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70030b00 con 0x7f0e800cc420 2023-11-27T21:22:02.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.270+0000 7f0e88539640 1 -- 172.21.15.88:0/2810096745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e800cc420 msgr2=0x7f0e80159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:02.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.270+0000 7f0e88539640 1 --2- 172.21.15.88:0/2810096745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e800cc420 0x7f0e80159610 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0e700097a0 tx=0x7f0e7002b960 comp rx=0 tx=0).stop 2023-11-27T21:22:02.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.270+0000 7f0e88539640 1 -- 172.21.15.88:0/2810096745 shutdown_connections 2023-11-27T21:22:02.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.270+0000 7f0e88539640 1 --2- 172.21.15.88:0/2810096745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e800cc420 0x7f0e80159610 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:02.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.270+0000 7f0e88539640 1 --2- 172.21.15.88:0/2810096745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e800cda70 0x7f0e800ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:02.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.270+0000 7f0e88539640 1 -- 172.21.15.88:0/2810096745 >> 172.21.15.88:0/2810096745 conn(0x7f0e800b07b0 msgr2=0x7f0e800b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:02.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.270+0000 7f0e88539640 1 -- 172.21.15.88:0/2810096745 shutdown_connections 2023-11-27T21:22:02.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.270+0000 7f0e88539640 1 -- 172.21.15.88:0/2810096745 wait complete. 2023-11-27T21:22:02.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.271+0000 7f0e88539640 1 Processor -- start 2023-11-27T21:22:02.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.271+0000 7f0e88539640 1 -- start start 2023-11-27T21:22:02.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.273+0000 7f0e88539640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e800cc420 0x7f0e801ef970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:02.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.273+0000 7f0e88539640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e800cda70 0x7f0e801e5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:02.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.273+0000 7f0e88539640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e80159b50 0x7f0e801e61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:02.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.273+0000 7f0e88539640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e801ef550 con 0x7f0e80159b50 2023-11-27T21:22:02.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.273+0000 7f0e88539640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e800b1ec0 con 0x7f0e800cda70 2023-11-27T21:22:02.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.273+0000 7f0e88539640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e80157480 con 0x7f0e800cc420 2023-11-27T21:22:02.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.320+0000 7f0e85ad4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e800cda70 0x7f0e801e5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:02.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.321+0000 7f0e86ad6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e80159b50 0x7f0e801e61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:02.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.321+0000 7f0e86ad6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e80159b50 0x7f0e801e61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56858/0 (socket says 172.21.15.88:56858) 2023-11-27T21:22:02.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.321+0000 7f0e86ad6640 1 -- 172.21.15.88:0/2444100881 learned_addr learned my addr 172.21.15.88:0/2444100881 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:22:02.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.321+0000 7f0e862d5640 1 --2- 172.21.15.88:0/2444100881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e800cc420 0x7f0e801ef970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:02.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.325+0000 7f0e86ad6640 1 -- 172.21.15.88:0/2444100881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e800cc420 msgr2=0x7f0e801ef970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:02.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.325+0000 7f0e86ad6640 1 --2- 172.21.15.88:0/2444100881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e800cc420 0x7f0e801ef970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:02.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.325+0000 7f0e86ad6640 1 -- 172.21.15.88:0/2444100881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e800cda70 msgr2=0x7f0e801e5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:02.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.325+0000 7f0e86ad6640 1 --2- 172.21.15.88:0/2444100881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e800cda70 0x7f0e801e5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:02.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.325+0000 7f0e86ad6640 1 -- 172.21.15.88:0/2444100881 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e70009400 con 0x7f0e80159b50 2023-11-27T21:22:02.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.330+0000 7f0e86ad6640 1 --2- 172.21.15.88:0/2444100881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e80159b50 0x7f0e801e61b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0e7800ca70 tx=0x7f0e7800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:02.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.338+0000 7f0e76ffd640 1 -- 172.21.15.88:0/2444100881 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7800abd0 con 0x7f0e80159b50 2023-11-27T21:22:02.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.338+0000 7f0e76ffd640 1 -- 172.21.15.88:0/2444100881 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7800ad30 con 0x7f0e80159b50 2023-11-27T21:22:02.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.338+0000 7f0e76ffd640 1 -- 172.21.15.88:0/2444100881 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e78012600 con 0x7f0e80159b50 2023-11-27T21:22:02.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.338+0000 7f0e88539640 1 -- 172.21.15.88:0/2444100881 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e80157720 con 0x7f0e80159b50 2023-11-27T21:22:02.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.338+0000 7f0e88539640 1 -- 172.21.15.88:0/2444100881 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e80157cc0 con 0x7f0e80159b50 2023-11-27T21:22:02.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.339+0000 7f0e88539640 1 -- 172.21.15.88:0/2444100881 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e801ef690 con 0x7f0e80159b50 2023-11-27T21:22:02.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.356+0000 7f0e76ffd640 1 -- 172.21.15.88:0/2444100881 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0e78007070 con 0x7f0e80159b50 2023-11-27T21:22:02.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.357+0000 7f0e76ffd640 1 --2- 172.21.15.88:0/2444100881 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f0e6406b240 0x7f0e6406d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:02.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.357+0000 7f0e862d5640 1 --2- 172.21.15.88:0/2444100881 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f0e6406b240 0x7f0e6406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:02.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.357+0000 7f0e862d5640 1 --2- 172.21.15.88:0/2444100881 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f0e6406b240 0x7f0e6406d700 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c00a970 tx=0x7f0e7c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:02.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.360+0000 7f0e76ffd640 1 -- 172.21.15.88:0/2444100881 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0e78058600 con 0x7f0e80159b50 2023-11-27T21:22:02.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.597+0000 7f0e76ffd640 1 -- 172.21.15.88:0/2444100881 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0e78054940 con 0x7f0e80159b50 2023-11-27T21:22:02.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.767+0000 7f0e88539640 1 -- 172.21.15.88:0/2444100881 --> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e800cba30 con 0x7f0e6406b240 2023-11-27T21:22:02.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.768+0000 7f0e76ffd640 1 -- 172.21.15.88:0/2444100881 <== mgr.4105 v2:172.21.15.88:6800/352455703 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0e7c00c050 con 0x7f0e6406b240 2023-11-27T21:22:02.770 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 4 to deep-scrub 2023-11-27T21:22:02.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.769+0000 7f0e88539640 1 -- 172.21.15.88:0/2444100881 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f0e6406b240 msgr2=0x7f0e6406d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:02.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.769+0000 7f0e88539640 1 --2- 172.21.15.88:0/2444100881 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f0e6406b240 0x7f0e6406d700 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c00a970 tx=0x7f0e7c008040 comp rx=0 tx=0).stop 2023-11-27T21:22:02.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.769+0000 7f0e88539640 1 -- 172.21.15.88:0/2444100881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e80159b50 msgr2=0x7f0e801e61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:02.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.769+0000 7f0e88539640 1 --2- 172.21.15.88:0/2444100881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e80159b50 0x7f0e801e61b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0e7800ca70 tx=0x7f0e7800cf30 comp rx=0 tx=0).stop 2023-11-27T21:22:02.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.769+0000 7f0e88539640 1 -- 172.21.15.88:0/2444100881 shutdown_connections 2023-11-27T21:22:02.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.769+0000 7f0e88539640 1 --2- 172.21.15.88:0/2444100881 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f0e6406b240 0x7f0e6406d700 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:02.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.769+0000 7f0e88539640 1 --2- 172.21.15.88:0/2444100881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e80159b50 0x7f0e801e61b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:02.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.769+0000 7f0e88539640 1 --2- 172.21.15.88:0/2444100881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e800cda70 0x7f0e801e5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:02.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.769+0000 7f0e88539640 1 --2- 172.21.15.88:0/2444100881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e800cc420 0x7f0e801ef970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:02.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.769+0000 7f0e88539640 1 -- 172.21.15.88:0/2444100881 >> 172.21.15.88:0/2444100881 conn(0x7f0e800b07b0 msgr2=0x7f0e800c6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:02.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.770+0000 7f0e88539640 1 -- 172.21.15.88:0/2444100881 shutdown_connections 2023-11-27T21:22:02.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.770+0000 7f0e88539640 1 -- 172.21.15.88:0/2444100881 wait complete. 2023-11-27T21:22:02.783 INFO:tasks.ceph:Scrubbing osd.5 2023-11-27T21:22:02.783 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-27T21:22:02.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.885+0000 7fce069be640 1 Processor -- start 2023-11-27T21:22:02.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.885+0000 7fce069be640 1 -- start start 2023-11-27T21:22:02.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.886+0000 7fce069be640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce00150460 0x7fce000c1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:02.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.886+0000 7fce069be640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce000c76f0 con 0x7fce000c4aa0 2023-11-27T21:22:02.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.886+0000 7fce069be640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce000c2bc0 con 0x7fce000c46c0 2023-11-27T21:22:02.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.886+0000 7fce069be640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce000c6dc0 con 0x7fce00150460 2023-11-27T21:22:02.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.887+0000 7fcdff7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fce000c4aa0 0x7fce0014fd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42464/0 (socket says 172.21.15.88:42464) 2023-11-27T21:22:02.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.887+0000 7fcdff7fe640 1 -- 172.21.15.88:0/1101994462 learned_addr learned my addr 172.21.15.88:0/1101994462 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:22:02.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.887+0000 7fce04f5b640 1 --2- 172.21.15.88:0/1101994462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce00150460 0x7fce000c1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:02.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.889+0000 7fcdfeffd640 1 -- 172.21.15.88:0/1101994462 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3992838320 0 0) 0x7fce000c76f0 con 0x7fce000c4aa0 2023-11-27T21:22:02.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.889+0000 7fcdfeffd640 1 -- 172.21.15.88:0/1101994462 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcde8005730 con 0x7fce000c4aa0 2023-11-27T21:22:02.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.889+0000 7fcdfeffd640 1 -- 172.21.15.88:0/1101994462 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543476502 0 0) 0x7fce000c2bc0 con 0x7fce000c46c0 2023-11-27T21:22:02.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.889+0000 7fcdfeffd640 1 -- 172.21.15.88:0/1101994462 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce000c76f0 con 0x7fce000c46c0 2023-11-27T21:22:02.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.890+0000 7fce04f5b640 1 -- 172.21.15.88:0/1101994462 >> v1:172.21.15.167:6789/0 conn(0x7fce000c46c0 legacy=0x7fce000c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:02.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.890+0000 7fce04f5b640 1 -- 172.21.15.88:0/1101994462 >> v1:172.21.15.88:6789/0 conn(0x7fce000c4aa0 legacy=0x7fce0014fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:02.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.890+0000 7fce04f5b640 1 -- 172.21.15.88:0/1101994462 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce000c70a0 con 0x7fce00150460 2023-11-27T21:22:02.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.892+0000 7fce04f5b640 1 --2- 172.21.15.88:0/1101994462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce00150460 0x7fce000c1ec0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8009dc0 tx=0x7fcdf802bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f457c5178b60290 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:02.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.896+0000 7fcdfeffd640 1 -- 172.21.15.88:0/1101994462 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf802ccd0 con 0x7fce00150460 2023-11-27T21:22:02.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.896+0000 7fcdfeffd640 1 -- 172.21.15.88:0/1101994462 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf802ce30 con 0x7fce00150460 2023-11-27T21:22:02.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.896+0000 7fcdfeffd640 1 -- 172.21.15.88:0/1101994462 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8034660 con 0x7fce00150460 2023-11-27T21:22:02.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.896+0000 7fce069be640 1 -- 172.21.15.88:0/1101994462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce00150460 msgr2=0x7fce000c1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:02.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.896+0000 7fce069be640 1 --2- 172.21.15.88:0/1101994462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce00150460 0x7fce000c1ec0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8009dc0 tx=0x7fcdf802bf20 comp rx=0 tx=0).stop 2023-11-27T21:22:02.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.896+0000 7fce069be640 1 -- 172.21.15.88:0/1101994462 shutdown_connections 2023-11-27T21:22:02.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.896+0000 7fce069be640 1 --2- 172.21.15.88:0/1101994462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce00150460 0x7fce000c1ec0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:02.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.896+0000 7fce069be640 1 -- 172.21.15.88:0/1101994462 >> 172.21.15.88:0/1101994462 conn(0x7fce0006c5f0 msgr2=0x7fce0006c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:02.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.897+0000 7fce069be640 1 -- 172.21.15.88:0/1101994462 shutdown_connections 2023-11-27T21:22:02.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.897+0000 7fce069be640 1 -- 172.21.15.88:0/1101994462 wait complete. 2023-11-27T21:22:02.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.898+0000 7fce069be640 1 Processor -- start 2023-11-27T21:22:02.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.898+0000 7fce069be640 1 -- start start 2023-11-27T21:22:02.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.899+0000 7fce069be640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce000c46c0 0x7fce0014f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:02.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.899+0000 7fce069be640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce000c4aa0 0x7fce00143320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:02.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.899+0000 7fce069be640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce00150460 0x7fce00141260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:02.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.899+0000 7fce069be640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce00150d40 con 0x7fce000c4aa0 2023-11-27T21:22:02.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.899+0000 7fce069be640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0014da10 con 0x7fce000c46c0 2023-11-27T21:22:02.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.899+0000 7fce069be640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce001f27f0 con 0x7fce00150460 2023-11-27T21:22:02.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.899+0000 7fce04f5b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce00150460 0x7fce00141260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:02.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.899+0000 7fcdff7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce000c4aa0 0x7fce00143320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:02.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.899+0000 7fcdfffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce000c46c0 0x7fce0014f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:02.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.900+0000 7fcdfffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce000c46c0 0x7fce0014f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:40702/0 (socket says 172.21.15.88:40702) 2023-11-27T21:22:02.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.900+0000 7fcdfffff640 1 -- 172.21.15.88:0/2111020173 learned_addr learned my addr 172.21.15.88:0/2111020173 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:22:02.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.903+0000 7fcdff7fe640 1 -- 172.21.15.88:0/2111020173 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce00150460 msgr2=0x7fce00141260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:02.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.903+0000 7fcdff7fe640 1 --2- 172.21.15.88:0/2111020173 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce00150460 0x7fce00141260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:02.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.903+0000 7fcdff7fe640 1 -- 172.21.15.88:0/2111020173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce000c46c0 msgr2=0x7fce0014f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:02.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.903+0000 7fcdff7fe640 1 --2- 172.21.15.88:0/2111020173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce000c46c0 0x7fce0014f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:02.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.903+0000 7fcdff7fe640 1 -- 172.21.15.88:0/2111020173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf8009a70 con 0x7fce000c4aa0 2023-11-27T21:22:02.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.905+0000 7fcdff7fe640 1 --2- 172.21.15.88:0/2111020173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce000c4aa0 0x7fce00143320 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fce000c4eb0 tx=0x7fcdf400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:02.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.909+0000 7fcdfcff9640 1 -- 172.21.15.88:0/2111020173 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4005ce0 con 0x7fce000c4aa0 2023-11-27T21:22:02.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.909+0000 7fcdfcff9640 1 -- 172.21.15.88:0/2111020173 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf4005e40 con 0x7fce000c4aa0 2023-11-27T21:22:02.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.909+0000 7fcdfcff9640 1 -- 172.21.15.88:0/2111020173 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40072d0 con 0x7fce000c4aa0 2023-11-27T21:22:02.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.909+0000 7fce069be640 1 -- 172.21.15.88:0/2111020173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce001f2ad0 con 0x7fce000c4aa0 2023-11-27T21:22:02.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.909+0000 7fce069be640 1 -- 172.21.15.88:0/2111020173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce001f3090 con 0x7fce000c4aa0 2023-11-27T21:22:02.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.910+0000 7fce069be640 1 -- 172.21.15.88:0/2111020173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fce000c2e80 con 0x7fce000c4aa0 2023-11-27T21:22:02.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.930+0000 7fcdfcff9640 1 -- 172.21.15.88:0/2111020173 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fcdf4007430 con 0x7fce000c4aa0 2023-11-27T21:22:02.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.930+0000 7fcdfcff9640 1 --2- 172.21.15.88:0/2111020173 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fcdec06b240 0x7fcdec06d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:02.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.930+0000 7fcdfffff640 1 --2- 172.21.15.88:0/2111020173 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fcdec06b240 0x7fcdec06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:02.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.931+0000 7fcdfffff640 1 --2- 172.21.15.88:0/2111020173 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fcdec06b240 0x7fcdec06d700 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0007fd0 tx=0x7fcdf0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:02.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.934+0000 7fcdfcff9640 1 -- 172.21.15.88:0/2111020173 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcdf4058170 con 0x7fce000c4aa0 2023-11-27T21:22:02.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.934+0000 7fcdfcff9640 1 --2- 172.21.15.88:0/2111020173 >> [v2:172.21.15.167:6824/866085094,v1:172.21.15.167:6825/866085094] conn(0x7fcdec074b20 0x7fcdec076fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:02.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.934+0000 7fcdfcff9640 1 -- 172.21.15.88:0/2111020173 --> [v2:172.21.15.167:6824/866085094,v1:172.21.15.167:6825/866085094] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcdec077690 con 0x7fcdec074b20 2023-11-27T21:22:02.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.934+0000 7fcdfcff9640 1 -- 172.21.15.88:0/2111020173 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcdf40544b0 con 0x7fce000c4aa0 2023-11-27T21:22:02.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.934+0000 7fce04f5b640 1 --2- 172.21.15.88:0/2111020173 >> [v2:172.21.15.167:6824/866085094,v1:172.21.15.167:6825/866085094] conn(0x7fcdec074b20 0x7fcdec076fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:02.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.935+0000 7fce04f5b640 1 --2- 172.21.15.88:0/2111020173 >> [v2:172.21.15.167:6824/866085094,v1:172.21.15.167:6825/866085094] conn(0x7fcdec074b20 0x7fcdec076fc0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:02.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.936+0000 7fcdfcff9640 1 -- 172.21.15.88:0/2111020173 <== osd.5 v2:172.21.15.167:6824/866085094 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fcdec077690 con 0x7fcdec074b20 2023-11-27T21:22:02.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.948+0000 7fce069be640 1 -- 172.21.15.88:0/2111020173 --> [v2:172.21.15.167:6824/866085094,v1:172.21.15.167:6825/866085094] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fce001f32b0 con 0x7fcdec074b20 2023-11-27T21:22:02.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.948+0000 7fcdfcff9640 1 -- 172.21.15.88:0/2111020173 <== osd.5 v2:172.21.15.167:6824/866085094 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fce001f32b0 con 0x7fcdec074b20 2023-11-27T21:22:02.951 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-27T21:22:02.951 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-27T21:22:02.951 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-27T21:22:02.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.949+0000 7fce069be640 1 -- 172.21.15.88:0/2111020173 >> [v2:172.21.15.167:6824/866085094,v1:172.21.15.167:6825/866085094] conn(0x7fcdec074b20 msgr2=0x7fcdec076fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:02.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.949+0000 7fce069be640 1 --2- 172.21.15.88:0/2111020173 >> [v2:172.21.15.167:6824/866085094,v1:172.21.15.167:6825/866085094] conn(0x7fcdec074b20 0x7fcdec076fc0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:02.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.949+0000 7fce069be640 1 -- 172.21.15.88:0/2111020173 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fcdec06b240 msgr2=0x7fcdec06d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:02.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.949+0000 7fce069be640 1 --2- 172.21.15.88:0/2111020173 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fcdec06b240 0x7fcdec06d700 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0007fd0 tx=0x7fcdf0009040 comp rx=0 tx=0).stop 2023-11-27T21:22:02.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.949+0000 7fce069be640 1 -- 172.21.15.88:0/2111020173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce000c4aa0 msgr2=0x7fce00143320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:02.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.949+0000 7fce069be640 1 --2- 172.21.15.88:0/2111020173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce000c4aa0 0x7fce00143320 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fce000c4eb0 tx=0x7fcdf400c870 comp rx=0 tx=0).stop 2023-11-27T21:22:02.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.949+0000 7fce04f5b640 1 -- 172.21.15.88:0/2111020173 reap_dead start 2023-11-27T21:22:02.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.949+0000 7fce069be640 1 -- 172.21.15.88:0/2111020173 shutdown_connections 2023-11-27T21:22:02.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.949+0000 7fce069be640 1 -- 172.21.15.88:0/2111020173 >> 172.21.15.88:0/2111020173 conn(0x7fce0006c5f0 msgr2=0x7fce00154f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:02.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.949+0000 7fce069be640 1 -- 172.21.15.88:0/2111020173 shutdown_connections 2023-11-27T21:22:02.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:02.949+0000 7fce069be640 1 -- 172.21.15.88:0/2111020173 wait complete. 2023-11-27T21:22:02.961 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-27T21:22:03.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.061+0000 7f373a133640 1 Processor -- start 2023-11-27T21:22:03.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.061+0000 7f373a133640 1 -- start start 2023-11-27T21:22:03.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.061+0000 7f373a133640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f37340cc420 0x7f3734159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:03.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.061+0000 7f373a133640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3734159b50 0x7f37340c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:03.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.061+0000 7f373a133640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37340cbda0 con 0x7f37340cda70 2023-11-27T21:22:03.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.061+0000 7f373a133640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37340cc230 con 0x7f37340cc420 2023-11-27T21:22:03.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.061+0000 7f373a133640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37340cea60 con 0x7f3734159b50 2023-11-27T21:22:03.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.062+0000 7f3732ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f37340cc420 0x7f3734159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:03.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.062+0000 7f37337fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f37340cda70 0x7f37340ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:53608/0 (socket says 172.21.15.88:53608) 2023-11-27T21:22:03.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.062+0000 7f37337fe640 1 -- 172.21.15.88:0/3019245181 learned_addr learned my addr 172.21.15.88:0/3019245181 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:22:03.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.062+0000 7f3733fff640 1 --2- 172.21.15.88:0/3019245181 >> v2:172.21.15.167:3300/0 conn(0x7f3734159b50 0x7f37340c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:03.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.065+0000 7f3732ffd640 1 -- 172.21.15.88:0/3019245181 >> v2:172.21.15.167:3300/0 conn(0x7f3734159b50 msgr2=0x7f37340c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:22:03.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.065+0000 7f3732ffd640 1 --2- 172.21.15.88:0/3019245181 >> v2:172.21.15.167:3300/0 conn(0x7f3734159b50 0x7f37340c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:03.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.065+0000 7f3732ffd640 1 -- 172.21.15.88:0/3019245181 >> v1:172.21.15.167:6789/0 conn(0x7f37340cda70 legacy=0x7f37340ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:03.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.065+0000 7f3732ffd640 1 -- 172.21.15.88:0/3019245181 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37340cb4e0 con 0x7f37340cc420 2023-11-27T21:22:03.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.066+0000 7f3732ffd640 1 --2- 172.21.15.88:0/3019245181 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37340cc420 0x7f3734159610 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f373406d2d0 tx=0x7f372802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecbaa8bb72507da9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:03.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.070+0000 7f37327fc640 1 -- 172.21.15.88:0/3019245181 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3728030610 con 0x7f37340cc420 2023-11-27T21:22:03.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.070+0000 7f37327fc640 1 -- 172.21.15.88:0/3019245181 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3728030770 con 0x7f37340cc420 2023-11-27T21:22:03.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.070+0000 7f37327fc640 1 -- 172.21.15.88:0/3019245181 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3728030b00 con 0x7f37340cc420 2023-11-27T21:22:03.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.071+0000 7f373a133640 1 -- 172.21.15.88:0/3019245181 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37340cc420 msgr2=0x7f3734159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:03.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.071+0000 7f373a133640 1 --2- 172.21.15.88:0/3019245181 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37340cc420 0x7f3734159610 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f373406d2d0 tx=0x7f372802b960 comp rx=0 tx=0).stop 2023-11-27T21:22:03.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.071+0000 7f373a133640 1 -- 172.21.15.88:0/3019245181 shutdown_connections 2023-11-27T21:22:03.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.071+0000 7f373a133640 1 --2- 172.21.15.88:0/3019245181 >> v2:172.21.15.167:3300/0 conn(0x7f3734159b50 0x7f37340c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:03.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.071+0000 7f373a133640 1 --2- 172.21.15.88:0/3019245181 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37340cc420 0x7f3734159610 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:03.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.071+0000 7f373a133640 1 -- 172.21.15.88:0/3019245181 >> 172.21.15.88:0/3019245181 conn(0x7f37340b07b0 msgr2=0x7f37340b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:03.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.071+0000 7f373a133640 1 -- 172.21.15.88:0/3019245181 shutdown_connections 2023-11-27T21:22:03.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.071+0000 7f373a133640 1 -- 172.21.15.88:0/3019245181 wait complete. 2023-11-27T21:22:03.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.072+0000 7f373a133640 1 Processor -- start 2023-11-27T21:22:03.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.072+0000 7f373a133640 1 -- start start 2023-11-27T21:22:03.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.073+0000 7f373a133640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37340cc420 0x7f37340b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:03.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.073+0000 7f373a133640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37340cda70 0x7f37340c3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:03.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.073+0000 7f373a133640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3734159b50 0x7f37341f2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:03.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.073+0000 7f373a133640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37341dfa10 con 0x7f3734159b50 2023-11-27T21:22:03.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.073+0000 7f373a133640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37340c5360 con 0x7f37340cda70 2023-11-27T21:22:03.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.073+0000 7f373a133640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37341df730 con 0x7f37340cc420 2023-11-27T21:22:03.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.073+0000 7f3732ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37340cda70 0x7f37340c3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:03.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.073+0000 7f37337fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37340cc420 0x7f37340b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:03.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.073+0000 7f3733fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3734159b50 0x7f37341f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:03.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.074+0000 7f3732ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37340cda70 0x7f37340c3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:40718/0 (socket says 172.21.15.88:40718) 2023-11-27T21:22:03.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.074+0000 7f3732ffd640 1 -- 172.21.15.88:0/422693305 learned_addr learned my addr 172.21.15.88:0/422693305 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:22:03.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.077+0000 7f3732ffd640 1 -- 172.21.15.88:0/422693305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37340cc420 msgr2=0x7f37340b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:03.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.077+0000 7f3732ffd640 1 --2- 172.21.15.88:0/422693305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37340cc420 0x7f37340b2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:03.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.077+0000 7f3732ffd640 1 -- 172.21.15.88:0/422693305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3734159b50 msgr2=0x7f37341f2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:03.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.077+0000 7f3732ffd640 1 --2- 172.21.15.88:0/422693305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3734159b50 0x7f37341f2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:03.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.077+0000 7f3732ffd640 1 -- 172.21.15.88:0/422693305 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3728009400 con 0x7f37340cda70 2023-11-27T21:22:03.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.077+0000 7f3733fff640 1 --2- 172.21.15.88:0/422693305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3734159b50 0x7f37341f2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T21:22:03.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.079+0000 7f3732ffd640 1 --2- 172.21.15.88:0/422693305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37340cda70 0x7f37340c3720 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3728009890 tx=0x7f3728004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:03.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.083+0000 7f371bfff640 1 -- 172.21.15.88:0/422693305 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372803e040 con 0x7f37340cda70 2023-11-27T21:22:03.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.083+0000 7f371bfff640 1 -- 172.21.15.88:0/422693305 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3728039b90 con 0x7f37340cda70 2023-11-27T21:22:03.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.083+0000 7f371bfff640 1 -- 172.21.15.88:0/422693305 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37280443f0 con 0x7f37340cda70 2023-11-27T21:22:03.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.083+0000 7f373a133640 1 -- 172.21.15.88:0/422693305 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37340c4a30 con 0x7f37340cda70 2023-11-27T21:22:03.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.083+0000 7f373a133640 1 -- 172.21.15.88:0/422693305 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37340c4ff0 con 0x7f37340cda70 2023-11-27T21:22:03.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.084+0000 7f373a133640 1 -- 172.21.15.88:0/422693305 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37340c51b0 con 0x7f37340cda70 2023-11-27T21:22:03.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.333+0000 7f371bfff640 1 -- 172.21.15.88:0/422693305 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f372804d3b0 con 0x7f37340cda70 2023-11-27T21:22:03.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.333+0000 7f371bfff640 1 --2- 172.21.15.88:0/422693305 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f372006b240 0x7f372006d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:03.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.333+0000 7f37337fe640 1 --2- 172.21.15.88:0/422693305 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f372006b240 0x7f372006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:03.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.333+0000 7f37337fe640 1 --2- 172.21.15.88:0/422693305 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f372006b240 0x7f372006d700 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3724007fd0 tx=0x7f3724007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:03.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.336+0000 7f371bfff640 1 -- 172.21.15.88:0/422693305 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f372807aaf0 con 0x7f37340cda70 2023-11-27T21:22:03.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.347+0000 7f371bfff640 1 -- 172.21.15.88:0/422693305 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3728076e30 con 0x7f37340cda70 2023-11-27T21:22:03.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.523+0000 7f373a133640 1 -- 172.21.15.88:0/422693305 --> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f37340cb750 con 0x7f372006b240 2023-11-27T21:22:03.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.524+0000 7f371bfff640 1 -- 172.21.15.88:0/422693305 <== mgr.4105 v2:172.21.15.88:6800/352455703 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3724001460 con 0x7f372006b240 2023-11-27T21:22:03.526 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 5 to deep-scrub 2023-11-27T21:22:03.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.526+0000 7f373a133640 1 -- 172.21.15.88:0/422693305 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f372006b240 msgr2=0x7f372006d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:03.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.526+0000 7f373a133640 1 --2- 172.21.15.88:0/422693305 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f372006b240 0x7f372006d700 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3724007fd0 tx=0x7f3724007e80 comp rx=0 tx=0).stop 2023-11-27T21:22:03.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.526+0000 7f373a133640 1 -- 172.21.15.88:0/422693305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37340cda70 msgr2=0x7f37340c3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:03.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.526+0000 7f373a133640 1 --2- 172.21.15.88:0/422693305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37340cda70 0x7f37340c3720 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3728009890 tx=0x7f3728004730 comp rx=0 tx=0).stop 2023-11-27T21:22:03.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.526+0000 7f373a133640 1 -- 172.21.15.88:0/422693305 shutdown_connections 2023-11-27T21:22:03.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.526+0000 7f373a133640 1 --2- 172.21.15.88:0/422693305 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f372006b240 0x7f372006d700 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:03.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.526+0000 7f373a133640 1 --2- 172.21.15.88:0/422693305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3734159b50 0x7f37341f2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:03.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.526+0000 7f373a133640 1 --2- 172.21.15.88:0/422693305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37340cda70 0x7f37340c3720 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:03.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.526+0000 7f373a133640 1 --2- 172.21.15.88:0/422693305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37340cc420 0x7f37340b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:03.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.526+0000 7f373a133640 1 -- 172.21.15.88:0/422693305 >> 172.21.15.88:0/422693305 conn(0x7f37340b07b0 msgr2=0x7f3734073530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:03.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.526+0000 7f373a133640 1 -- 172.21.15.88:0/422693305 shutdown_connections 2023-11-27T21:22:03.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.526+0000 7f373a133640 1 -- 172.21.15.88:0/422693305 wait complete. 2023-11-27T21:22:03.540 INFO:tasks.ceph:Scrubbing osd.6 2023-11-27T21:22:03.541 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-27T21:22:03.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.644+0000 7fa04e89b640 1 Processor -- start 2023-11-27T21:22:03.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.645+0000 7fa04e89b640 1 -- start start 2023-11-27T21:22:03.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.645+0000 7fa04e89b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0480cda70 0x7fa0480ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:03.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.645+0000 7fa04e89b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa0480c9620 0x7fa0480c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:03.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.645+0000 7fa04e89b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0480cbda0 con 0x7fa0480cc420 2023-11-27T21:22:03.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.645+0000 7fa04e89b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0480cc230 con 0x7fa0480c9620 2023-11-27T21:22:03.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.645+0000 7fa04e89b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0480cb4e0 con 0x7fa0480cda70 2023-11-27T21:22:03.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.646+0000 7fa047fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0480cda70 0x7fa0480ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:03.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.646+0000 7fa047fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0480cda70 0x7fa0480ce350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:59412/0 (socket says 172.21.15.88:59412) 2023-11-27T21:22:03.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.646+0000 7fa047fff640 1 -- 172.21.15.88:0/1759705233 learned_addr learned my addr 172.21.15.88:0/1759705233 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:22:03.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.648+0000 7fa04ce38640 1 --2- 172.21.15.88:0/1759705233 >> v2:172.21.15.167:3300/0 conn(0x7fa0480c9620 0x7fa0480c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:03.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.649+0000 7fa047fff640 1 -- 172.21.15.88:0/1759705233 >> v2:172.21.15.167:3300/0 conn(0x7fa0480c9620 msgr2=0x7fa0480c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:22:03.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.649+0000 7fa047fff640 1 --2- 172.21.15.88:0/1759705233 >> v2:172.21.15.167:3300/0 conn(0x7fa0480c9620 0x7fa0480c9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:03.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.649+0000 7fa047fff640 1 -- 172.21.15.88:0/1759705233 >> v1:172.21.15.167:6789/0 conn(0x7fa0480cc420 legacy=0x7fa048159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:03.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.649+0000 7fa047fff640 1 -- 172.21.15.88:0/1759705233 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0480cce00 con 0x7fa0480cda70 2023-11-27T21:22:03.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.651+0000 7fa047fff640 1 --2- 172.21.15.88:0/1759705233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0480cda70 0x7fa0480ce350 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa038009870 tx=0x7fa03802ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=201d6114d12c31aa server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:03.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.653+0000 7fa046ffd640 1 -- 172.21.15.88:0/1759705233 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03802f840 con 0x7fa0480cda70 2023-11-27T21:22:03.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.655+0000 7fa046ffd640 1 -- 172.21.15.88:0/1759705233 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03802f9a0 con 0x7fa0480cda70 2023-11-27T21:22:03.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.655+0000 7fa046ffd640 1 -- 172.21.15.88:0/1759705233 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03802fd30 con 0x7fa0480cda70 2023-11-27T21:22:03.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.656+0000 7fa04e89b640 1 -- 172.21.15.88:0/1759705233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0480cda70 msgr2=0x7fa0480ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:03.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.656+0000 7fa04e89b640 1 --2- 172.21.15.88:0/1759705233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0480cda70 0x7fa0480ce350 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa038009870 tx=0x7fa03802ba20 comp rx=0 tx=0).stop 2023-11-27T21:22:03.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.656+0000 7fa04e89b640 1 -- 172.21.15.88:0/1759705233 shutdown_connections 2023-11-27T21:22:03.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.656+0000 7fa04e89b640 1 --2- 172.21.15.88:0/1759705233 >> v2:172.21.15.167:3300/0 conn(0x7fa0480c9620 0x7fa0480c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:03.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.656+0000 7fa04e89b640 1 --2- 172.21.15.88:0/1759705233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0480cda70 0x7fa0480ce350 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:03.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.656+0000 7fa04e89b640 1 -- 172.21.15.88:0/1759705233 >> 172.21.15.88:0/1759705233 conn(0x7fa0480b07b0 msgr2=0x7fa0480b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:03.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.656+0000 7fa04e89b640 1 -- 172.21.15.88:0/1759705233 shutdown_connections 2023-11-27T21:22:03.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.656+0000 7fa04e89b640 1 -- 172.21.15.88:0/1759705233 wait complete. 2023-11-27T21:22:03.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.657+0000 7fa04e89b640 1 Processor -- start 2023-11-27T21:22:03.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.657+0000 7fa04e89b640 1 -- start start 2023-11-27T21:22:03.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.658+0000 7fa04e89b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0480c9620 0x7fa0480c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:03.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.658+0000 7fa04e89b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0480cc420 0x7fa0480c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:03.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.658+0000 7fa04e89b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0480cda70 0x7fa048152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:03.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.658+0000 7fa04e89b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0481540f0 con 0x7fa0480cc420 2023-11-27T21:22:03.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.658+0000 7fa04e89b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0481f3840 con 0x7fa0480cda70 2023-11-27T21:22:03.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.658+0000 7fa04e89b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0481f29e0 con 0x7fa0480c9620 2023-11-27T21:22:03.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.658+0000 7fa0477fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0480cc420 0x7fa0480c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:03.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.658+0000 7fa04ce38640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0480cda70 0x7fa048152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:03.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.659+0000 7fa0477fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0480cc420 0x7fa0480c49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56890/0 (socket says 172.21.15.88:56890) 2023-11-27T21:22:03.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.659+0000 7fa047fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0480c9620 0x7fa0480c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:03.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.659+0000 7fa0477fe640 1 -- 172.21.15.88:0/2084726678 learned_addr learned my addr 172.21.15.88:0/2084726678 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:22:03.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.662+0000 7fa0477fe640 1 -- 172.21.15.88:0/2084726678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0480c9620 msgr2=0x7fa0480c44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:03.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.662+0000 7fa0477fe640 1 --2- 172.21.15.88:0/2084726678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0480c9620 0x7fa0480c44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:03.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.662+0000 7fa0477fe640 1 -- 172.21.15.88:0/2084726678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0480cda70 msgr2=0x7fa048152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:03.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.662+0000 7fa0477fe640 1 --2- 172.21.15.88:0/2084726678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0480cda70 0x7fa048152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:03.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.662+0000 7fa0477fe640 1 -- 172.21.15.88:0/2084726678 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0380094d0 con 0x7fa0480cc420 2023-11-27T21:22:03.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.664+0000 7fa0477fe640 1 --2- 172.21.15.88:0/2084726678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0480cc420 0x7fa0480c49f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00c400 tx=0x7fa03c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:03.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.668+0000 7fa044ff9640 1 -- 172.21.15.88:0/2084726678 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c0052d0 con 0x7fa0480cc420 2023-11-27T21:22:03.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.668+0000 7fa044ff9640 1 -- 172.21.15.88:0/2084726678 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03c005430 con 0x7fa0480cc420 2023-11-27T21:22:03.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.668+0000 7fa044ff9640 1 -- 172.21.15.88:0/2084726678 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c003830 con 0x7fa0480cc420 2023-11-27T21:22:03.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.668+0000 7fa04e89b640 1 -- 172.21.15.88:0/2084726678 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0481f2cc0 con 0x7fa0480cc420 2023-11-27T21:22:03.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.668+0000 7fa04e89b640 1 -- 172.21.15.88:0/2084726678 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0481f3280 con 0x7fa0480cc420 2023-11-27T21:22:03.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.669+0000 7fa04e89b640 1 -- 172.21.15.88:0/2084726678 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa0480726d0 con 0x7fa0480cc420 2023-11-27T21:22:03.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.687+0000 7fa044ff9640 1 -- 172.21.15.88:0/2084726678 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa03c003990 con 0x7fa0480cc420 2023-11-27T21:22:03.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.688+0000 7fa044ff9640 1 --2- 172.21.15.88:0/2084726678 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa03406b240 0x7fa03406d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:03.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.688+0000 7fa047fff640 1 --2- 172.21.15.88:0/2084726678 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa03406b240 0x7fa03406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:03.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.688+0000 7fa047fff640 1 --2- 172.21.15.88:0/2084726678 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa03406b240 0x7fa03406d700 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa038036000 tx=0x7fa038008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:03.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.691+0000 7fa044ff9640 1 -- 172.21.15.88:0/2084726678 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa03c058110 con 0x7fa0480cc420 2023-11-27T21:22:03.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.691+0000 7fa044ff9640 1 --2- 172.21.15.88:0/2084726678 >> [v2:172.21.15.167:6808/2766725538,v1:172.21.15.167:6809/2766725538] conn(0x7fa034074aa0 0x7fa034076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:03.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.691+0000 7fa044ff9640 1 -- 172.21.15.88:0/2084726678 --> [v2:172.21.15.167:6808/2766725538,v1:172.21.15.167:6809/2766725538] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa034077610 con 0x7fa034074aa0 2023-11-27T21:22:03.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.691+0000 7fa044ff9640 1 -- 172.21.15.88:0/2084726678 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa03c054450 con 0x7fa0480cc420 2023-11-27T21:22:03.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.691+0000 7fa04ce38640 1 --2- 172.21.15.88:0/2084726678 >> [v2:172.21.15.167:6808/2766725538,v1:172.21.15.167:6809/2766725538] conn(0x7fa034074aa0 0x7fa034076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:03.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.691+0000 7fa04ce38640 1 --2- 172.21.15.88:0/2084726678 >> [v2:172.21.15.167:6808/2766725538,v1:172.21.15.167:6809/2766725538] conn(0x7fa034074aa0 0x7fa034076f40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:03.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.692+0000 7fa044ff9640 1 -- 172.21.15.88:0/2084726678 <== osd.6 v2:172.21.15.167:6808/2766725538 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa034077610 con 0x7fa034074aa0 2023-11-27T21:22:03.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.706+0000 7fa04e89b640 1 -- 172.21.15.88:0/2084726678 --> [v2:172.21.15.167:6808/2766725538,v1:172.21.15.167:6809/2766725538] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa0480676f0 con 0x7fa034074aa0 2023-11-27T21:22:03.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.707+0000 7fa044ff9640 1 -- 172.21.15.88:0/2084726678 <== osd.6 v2:172.21.15.167:6808/2766725538 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa0480676f0 con 0x7fa034074aa0 2023-11-27T21:22:03.709 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-27T21:22:03.709 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-27T21:22:03.709 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-27T21:22:03.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.707+0000 7fa04e89b640 1 -- 172.21.15.88:0/2084726678 >> [v2:172.21.15.167:6808/2766725538,v1:172.21.15.167:6809/2766725538] conn(0x7fa034074aa0 msgr2=0x7fa034076f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:03.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.707+0000 7fa04e89b640 1 --2- 172.21.15.88:0/2084726678 >> [v2:172.21.15.167:6808/2766725538,v1:172.21.15.167:6809/2766725538] conn(0x7fa034074aa0 0x7fa034076f40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:03.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.707+0000 7fa04e89b640 1 -- 172.21.15.88:0/2084726678 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa03406b240 msgr2=0x7fa03406d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:03.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.707+0000 7fa04e89b640 1 --2- 172.21.15.88:0/2084726678 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fa03406b240 0x7fa03406d700 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa038036000 tx=0x7fa038008030 comp rx=0 tx=0).stop 2023-11-27T21:22:03.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.707+0000 7fa04e89b640 1 -- 172.21.15.88:0/2084726678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0480cc420 msgr2=0x7fa0480c49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:03.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.707+0000 7fa04e89b640 1 --2- 172.21.15.88:0/2084726678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0480cc420 0x7fa0480c49f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00c400 tx=0x7fa03c00c8c0 comp rx=0 tx=0).stop 2023-11-27T21:22:03.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.707+0000 7fa04ce38640 1 -- 172.21.15.88:0/2084726678 reap_dead start 2023-11-27T21:22:03.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.707+0000 7fa04e89b640 1 -- 172.21.15.88:0/2084726678 shutdown_connections 2023-11-27T21:22:03.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.707+0000 7fa04e89b640 1 -- 172.21.15.88:0/2084726678 >> 172.21.15.88:0/2084726678 conn(0x7fa0480b07b0 msgr2=0x7fa0480c6db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:03.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.707+0000 7fa04e89b640 1 -- 172.21.15.88:0/2084726678 shutdown_connections 2023-11-27T21:22:03.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.707+0000 7fa04e89b640 1 -- 172.21.15.88:0/2084726678 wait complete. 2023-11-27T21:22:03.720 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-27T21:22:03.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.819+0000 7f016dd61640 1 Processor -- start 2023-11-27T21:22:03.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.819+0000 7f016dd61640 1 -- start start 2023-11-27T21:22:03.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.820+0000 7f016dd61640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f01680cda70 0x7f01680ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:03.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.820+0000 7f016dd61640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01680cc420 0x7f0168159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:03.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.820+0000 7f016dd61640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01680cbda0 con 0x7f0168159b50 2023-11-27T21:22:03.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.820+0000 7f016dd61640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01680cc230 con 0x7f01680cda70 2023-11-27T21:22:03.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.820+0000 7f016dd61640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01680cb4e0 con 0x7f01680cc420 2023-11-27T21:22:03.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.821+0000 7f0167fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0168159b50 0x7f01680c9620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42474/0 (socket says 172.21.15.88:42474) 2023-11-27T21:22:03.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.821+0000 7f0167fff640 1 -- 172.21.15.88:0/4128137310 learned_addr learned my addr 172.21.15.88:0/4128137310 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:22:03.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.821+0000 7f01677fe640 1 --2- 172.21.15.88:0/4128137310 >> v2:172.21.15.167:3300/0 conn(0x7f01680cda70 0x7f01680ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:03.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.821+0000 7f015effd640 1 --2- 172.21.15.88:0/4128137310 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01680cc420 0x7f0168159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:03.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.823+0000 7f01677fe640 1 -- 172.21.15.88:0/4128137310 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01680cc420 msgr2=0x7f0168159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:22:03.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.823+0000 7f01677fe640 1 --2- 172.21.15.88:0/4128137310 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01680cc420 0x7f0168159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:03.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.823+0000 7f01677fe640 1 -- 172.21.15.88:0/4128137310 >> v1:172.21.15.88:6789/0 conn(0x7f0168159b50 legacy=0x7f01680c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:03.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.823+0000 7f01677fe640 1 -- 172.21.15.88:0/4128137310 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01680cce00 con 0x7f01680cda70 2023-11-27T21:22:03.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.826+0000 7f01677fe640 1 --2- 172.21.15.88:0/4128137310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01680cda70 0x7f01680ce350 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f01580097a0 tx=0x7f015802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dab44b6b7ace894 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:03.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.829+0000 7f0166ffd640 1 -- 172.21.15.88:0/4128137310 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0158030610 con 0x7f01680cda70 2023-11-27T21:22:03.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.829+0000 7f0166ffd640 1 -- 172.21.15.88:0/4128137310 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0158030770 con 0x7f01680cda70 2023-11-27T21:22:03.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.829+0000 7f0166ffd640 1 -- 172.21.15.88:0/4128137310 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0158030b00 con 0x7f01680cda70 2023-11-27T21:22:03.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.830+0000 7f016dd61640 1 -- 172.21.15.88:0/4128137310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01680cda70 msgr2=0x7f01680ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:03.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.830+0000 7f016dd61640 1 --2- 172.21.15.88:0/4128137310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01680cda70 0x7f01680ce350 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f01580097a0 tx=0x7f015802b960 comp rx=0 tx=0).stop 2023-11-27T21:22:03.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.830+0000 7f016dd61640 1 -- 172.21.15.88:0/4128137310 shutdown_connections 2023-11-27T21:22:03.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.830+0000 7f016dd61640 1 --2- 172.21.15.88:0/4128137310 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01680cc420 0x7f0168159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:03.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.830+0000 7f016dd61640 1 --2- 172.21.15.88:0/4128137310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01680cda70 0x7f01680ce350 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:03.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.830+0000 7f016dd61640 1 -- 172.21.15.88:0/4128137310 >> 172.21.15.88:0/4128137310 conn(0x7f01680b07b0 msgr2=0x7f01680b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:03.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.830+0000 7f016dd61640 1 -- 172.21.15.88:0/4128137310 shutdown_connections 2023-11-27T21:22:03.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.830+0000 7f016dd61640 1 -- 172.21.15.88:0/4128137310 wait complete. 2023-11-27T21:22:03.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.831+0000 7f016dd61640 1 Processor -- start 2023-11-27T21:22:03.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.831+0000 7f016dd61640 1 -- start start 2023-11-27T21:22:03.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.832+0000 7f016dd61640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01680cc420 0x7f0168152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:03.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.832+0000 7f016dd61640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01680cda70 0x7f01680ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:03.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.832+0000 7f016dd61640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0168159b50 0x7f01680abe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:03.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.832+0000 7f016dd61640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01680ab480 con 0x7f01680cda70 2023-11-27T21:22:03.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.832+0000 7f016dd61640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01680aac70 con 0x7f0168159b50 2023-11-27T21:22:03.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.832+0000 7f016dd61640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01681efeb0 con 0x7f01680cc420 2023-11-27T21:22:03.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.833+0000 7f015effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01680cda70 0x7f01680ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:03.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.833+0000 7f0167fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0168159b50 0x7f01680abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:03.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.833+0000 7f01677fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01680cc420 0x7f0168152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:03.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.833+0000 7f0167fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0168159b50 0x7f01680abe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:40750/0 (socket says 172.21.15.88:40750) 2023-11-27T21:22:03.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.833+0000 7f0167fff640 1 -- 172.21.15.88:0/355336554 learned_addr learned my addr 172.21.15.88:0/355336554 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:22:03.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.836+0000 7f01677fe640 1 -- 172.21.15.88:0/355336554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0168159b50 msgr2=0x7f01680abe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:03.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.836+0000 7f01677fe640 1 --2- 172.21.15.88:0/355336554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0168159b50 0x7f01680abe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:03.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.836+0000 7f01677fe640 1 -- 172.21.15.88:0/355336554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01680cda70 msgr2=0x7f01680ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:03.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.836+0000 7f01677fe640 1 --2- 172.21.15.88:0/355336554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01680cda70 0x7f01680ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:03.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.836+0000 7f01677fe640 1 -- 172.21.15.88:0/355336554 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0158009400 con 0x7f01680cc420 2023-11-27T21:22:03.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.836+0000 7f015effd640 1 --2- 172.21.15.88:0/355336554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01680cda70 0x7f01680ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T21:22:03.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.839+0000 7f01677fe640 1 --2- 172.21.15.88:0/355336554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01680cc420 0x7f0168152aa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0158033000 tx=0x7f0158004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:03.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.843+0000 7f0164ff9640 1 -- 172.21.15.88:0/355336554 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015803e040 con 0x7f01680cc420 2023-11-27T21:22:03.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.843+0000 7f0164ff9640 1 -- 172.21.15.88:0/355336554 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0158039a40 con 0x7f01680cc420 2023-11-27T21:22:03.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.843+0000 7f0164ff9640 1 -- 172.21.15.88:0/355336554 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0158039df0 con 0x7f01680cc420 2023-11-27T21:22:03.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.843+0000 7f016dd61640 1 -- 172.21.15.88:0/355336554 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01680aaec0 con 0x7f01680cc420 2023-11-27T21:22:03.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.843+0000 7f016dd61640 1 -- 172.21.15.88:0/355336554 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01681efb40 con 0x7f01680cc420 2023-11-27T21:22:03.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:03.844+0000 7f016dd61640 1 -- 172.21.15.88:0/355336554 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01681ef9a0 con 0x7f01680cc420 2023-11-27T21:22:04.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.090+0000 7f0164ff9640 1 -- 172.21.15.88:0/355336554 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0158043390 con 0x7f01680cc420 2023-11-27T21:22:04.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.090+0000 7f0164ff9640 1 --2- 172.21.15.88:0/355336554 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f014806b1c0 0x7f014806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:04.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.090+0000 7f015effd640 1 --2- 172.21.15.88:0/355336554 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f014806b1c0 0x7f014806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:04.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.091+0000 7f015effd640 1 --2- 172.21.15.88:0/355336554 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f014806b1c0 0x7f014806d680 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f01680aa770 tx=0x7f0150009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:04.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.093+0000 7f0164ff9640 1 -- 172.21.15.88:0/355336554 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f015807aa30 con 0x7f01680cc420 2023-11-27T21:22:04.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.103+0000 7f0164ff9640 1 -- 172.21.15.88:0/355336554 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0158076d70 con 0x7f01680cc420 2023-11-27T21:22:04.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.271+0000 7f016dd61640 1 -- 172.21.15.88:0/355336554 --> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f01681efd20 con 0x7f014806b1c0 2023-11-27T21:22:04.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.271+0000 7f0164ff9640 1 -- 172.21.15.88:0/355336554 <== mgr.4105 v2:172.21.15.88:6800/352455703 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f01681efd20 con 0x7f014806b1c0 2023-11-27T21:22:04.273 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 6 to deep-scrub 2023-11-27T21:22:04.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.273+0000 7f016dd61640 1 -- 172.21.15.88:0/355336554 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f014806b1c0 msgr2=0x7f014806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:04.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.273+0000 7f016dd61640 1 --2- 172.21.15.88:0/355336554 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f014806b1c0 0x7f014806d680 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f01680aa770 tx=0x7f0150009190 comp rx=0 tx=0).stop 2023-11-27T21:22:04.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.273+0000 7f016dd61640 1 -- 172.21.15.88:0/355336554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01680cc420 msgr2=0x7f0168152aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:04.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.273+0000 7f016dd61640 1 --2- 172.21.15.88:0/355336554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01680cc420 0x7f0168152aa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0158033000 tx=0x7f0158004730 comp rx=0 tx=0).stop 2023-11-27T21:22:04.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.273+0000 7f016dd61640 1 -- 172.21.15.88:0/355336554 shutdown_connections 2023-11-27T21:22:04.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.273+0000 7f016dd61640 1 --2- 172.21.15.88:0/355336554 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f014806b1c0 0x7f014806d680 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:04.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.273+0000 7f016dd61640 1 --2- 172.21.15.88:0/355336554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0168159b50 0x7f01680abe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:04.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.273+0000 7f016dd61640 1 --2- 172.21.15.88:0/355336554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01680cda70 0x7f01680ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:04.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.273+0000 7f016dd61640 1 --2- 172.21.15.88:0/355336554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01680cc420 0x7f0168152aa0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:04.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.273+0000 7f016dd61640 1 -- 172.21.15.88:0/355336554 >> 172.21.15.88:0/355336554 conn(0x7f01680b07b0 msgr2=0x7f01680c92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:04.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.273+0000 7f016dd61640 1 -- 172.21.15.88:0/355336554 shutdown_connections 2023-11-27T21:22:04.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.273+0000 7f016dd61640 1 -- 172.21.15.88:0/355336554 wait complete. 2023-11-27T21:22:04.286 INFO:tasks.ceph:Scrubbing osd.7 2023-11-27T21:22:04.287 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-27T21:22:04.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.395+0000 7f71fab9e640 1 Processor -- start 2023-11-27T21:22:04.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.395+0000 7f71fab9e640 1 -- start start 2023-11-27T21:22:04.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.396+0000 7f71fab9e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f71f41513f0 0x7f71f40c8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:04.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.396+0000 7f71fab9e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f71f4157860 0x7f71f4157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:04.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.396+0000 7f71fab9e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f40c9400 con 0x7f71f40c8a50 2023-11-27T21:22:04.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.396+0000 7f71fab9e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f415b730 con 0x7f71f41513f0 2023-11-27T21:22:04.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.396+0000 7f71fab9e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f415abb0 con 0x7f71f4157860 2023-11-27T21:22:04.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.424+0000 7f71f893a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f71f41513f0 0x7f71f40c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:04.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.425+0000 7f71f3fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f71f40c8a50 0x7f71f40c7850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42488/0 (socket says 172.21.15.88:42488) 2023-11-27T21:22:04.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.425+0000 7f71f3fff640 1 -- 172.21.15.88:0/3313331906 learned_addr learned my addr 172.21.15.88:0/3313331906 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:22:04.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.428+0000 7f71f37fe640 1 -- 172.21.15.88:0/3313331906 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3008204218 0 0) 0x7f71f40c9400 con 0x7f71f40c8a50 2023-11-27T21:22:04.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.428+0000 7f71f37fe640 1 -- 172.21.15.88:0/3313331906 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71e4003520 con 0x7f71f40c8a50 2023-11-27T21:22:04.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.430+0000 7f71f893a640 1 -- 172.21.15.88:0/3313331906 >> v2:172.21.15.167:3300/0 conn(0x7f71f4157860 msgr2=0x7f71f4157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:22:04.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.430+0000 7f71f893a640 1 --2- 172.21.15.88:0/3313331906 >> v2:172.21.15.167:3300/0 conn(0x7f71f4157860 0x7f71f4157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:04.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.430+0000 7f71f893a640 1 -- 172.21.15.88:0/3313331906 >> v1:172.21.15.88:6789/0 conn(0x7f71f40c8a50 legacy=0x7f71f40c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:04.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.430+0000 7f71f893a640 1 -- 172.21.15.88:0/3313331906 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f415ae90 con 0x7f71f41513f0 2023-11-27T21:22:04.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.435+0000 7f71f893a640 1 --2- 172.21.15.88:0/3313331906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71f41513f0 0x7f71f40c8510 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f71f40b0930 tx=0x7f71e802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f676a76d75fd3d19 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:04.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.439+0000 7f71f37fe640 1 -- 172.21.15.88:0/3313331906 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8030610 con 0x7f71f41513f0 2023-11-27T21:22:04.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.439+0000 7f71f37fe640 1 -- 172.21.15.88:0/3313331906 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e8030770 con 0x7f71f41513f0 2023-11-27T21:22:04.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.439+0000 7f71f37fe640 1 -- 172.21.15.88:0/3313331906 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8030b00 con 0x7f71f41513f0 2023-11-27T21:22:04.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.439+0000 7f71fab9e640 1 -- 172.21.15.88:0/3313331906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71f41513f0 msgr2=0x7f71f40c8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:04.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.439+0000 7f71fab9e640 1 --2- 172.21.15.88:0/3313331906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71f41513f0 0x7f71f40c8510 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f71f40b0930 tx=0x7f71e802b960 comp rx=0 tx=0).stop 2023-11-27T21:22:04.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.439+0000 7f71fab9e640 1 -- 172.21.15.88:0/3313331906 shutdown_connections 2023-11-27T21:22:04.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.440+0000 7f71fab9e640 1 --2- 172.21.15.88:0/3313331906 >> v2:172.21.15.167:3300/0 conn(0x7f71f4157860 0x7f71f4157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:04.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.440+0000 7f71fab9e640 1 --2- 172.21.15.88:0/3313331906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71f41513f0 0x7f71f40c8510 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:04.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.440+0000 7f71fab9e640 1 -- 172.21.15.88:0/3313331906 >> 172.21.15.88:0/3313331906 conn(0x7f71f4070780 msgr2=0x7f71f4070b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:04.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.440+0000 7f71fab9e640 1 -- 172.21.15.88:0/3313331906 shutdown_connections 2023-11-27T21:22:04.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.440+0000 7f71fab9e640 1 -- 172.21.15.88:0/3313331906 wait complete. 2023-11-27T21:22:04.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.441+0000 7f71fab9e640 1 Processor -- start 2023-11-27T21:22:04.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.441+0000 7f71fab9e640 1 -- start start 2023-11-27T21:22:04.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.442+0000 7f71fab9e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71f40c8a50 0x7f71f406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:04.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.442+0000 7f71fab9e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71f41513f0 0x7f71f40c25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:04.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.442+0000 7f71fab9e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71f4157860 0x7f71f41e1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:04.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.442+0000 7f71fab9e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f406d400 con 0x7f71f40c8a50 2023-11-27T21:22:04.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.442+0000 7f71fab9e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f41e2d30 con 0x7f71f41513f0 2023-11-27T21:22:04.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.442+0000 7f71fab9e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f41e2f80 con 0x7f71f4157860 2023-11-27T21:22:04.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.442+0000 7f71f893a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71f40c8a50 0x7f71f406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:04.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.443+0000 7f71f893a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71f40c8a50 0x7f71f406b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56920/0 (socket says 172.21.15.88:56920) 2023-11-27T21:22:04.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.443+0000 7f71f893a640 1 -- 172.21.15.88:0/226339584 learned_addr learned my addr 172.21.15.88:0/226339584 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:22:04.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.446+0000 7f71f893a640 1 -- 172.21.15.88:0/226339584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71f4157860 msgr2=0x7f71f41e1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:04.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.446+0000 7f71f893a640 1 --2- 172.21.15.88:0/226339584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71f4157860 0x7f71f41e1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:04.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.446+0000 7f71f893a640 1 -- 172.21.15.88:0/226339584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71f41513f0 msgr2=0x7f71f40c25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:04.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.446+0000 7f71f893a640 1 --2- 172.21.15.88:0/226339584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71f41513f0 0x7f71f40c25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:04.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.446+0000 7f71f893a640 1 -- 172.21.15.88:0/226339584 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e8009400 con 0x7f71f40c8a50 2023-11-27T21:22:04.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.449+0000 7f71f893a640 1 --2- 172.21.15.88:0/226339584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71f40c8a50 0x7f71f406b5c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f71e8009890 tx=0x7f71e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:04.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.452+0000 7f71f17fa640 1 -- 172.21.15.88:0/226339584 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e803e040 con 0x7f71f40c8a50 2023-11-27T21:22:04.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.452+0000 7f71f17fa640 1 -- 172.21.15.88:0/226339584 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e8039c10 con 0x7f71f40c8a50 2023-11-27T21:22:04.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.453+0000 7f71f17fa640 1 -- 172.21.15.88:0/226339584 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e80443f0 con 0x7f71f40c8a50 2023-11-27T21:22:04.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.453+0000 7f71fab9e640 1 -- 172.21.15.88:0/226339584 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f41f0050 con 0x7f71f40c8a50 2023-11-27T21:22:04.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.453+0000 7f71fab9e640 1 -- 172.21.15.88:0/226339584 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f41efd40 con 0x7f71f40c8a50 2023-11-27T21:22:04.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.453+0000 7f71fab9e640 1 -- 172.21.15.88:0/226339584 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f71f4157340 con 0x7f71f40c8a50 2023-11-27T21:22:04.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.473+0000 7f71f17fa640 1 -- 172.21.15.88:0/226339584 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f71e804d3b0 con 0x7f71f40c8a50 2023-11-27T21:22:04.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.474+0000 7f71f17fa640 1 --2- 172.21.15.88:0/226339584 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f71d806b210 0x7f71d806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:04.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.474+0000 7f71f3fff640 1 --2- 172.21.15.88:0/226339584 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f71d806b210 0x7f71d806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:04.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.474+0000 7f71f3fff640 1 --2- 172.21.15.88:0/226339584 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f71d806b210 0x7f71d806d6d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f71e0000f60 tx=0x7f71e00078f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:04.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.478+0000 7f71f17fa640 1 -- 172.21.15.88:0/226339584 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f71e807b730 con 0x7f71f40c8a50 2023-11-27T21:22:04.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.478+0000 7f71f17fa640 1 --2- 172.21.15.88:0/226339584 >> [v2:172.21.15.167:6810/2695037266,v1:172.21.15.167:6812/2695037266] conn(0x7f71d8074af0 0x7f71d8076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:04.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.478+0000 7f71f17fa640 1 -- 172.21.15.88:0/226339584 --> [v2:172.21.15.167:6810/2695037266,v1:172.21.15.167:6812/2695037266] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f71d8077660 con 0x7f71d8074af0 2023-11-27T21:22:04.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.478+0000 7f71f17fa640 1 -- 172.21.15.88:0/226339584 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71e8077370 con 0x7f71f40c8a50 2023-11-27T21:22:04.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.479+0000 7f71f913b640 1 --2- 172.21.15.88:0/226339584 >> [v2:172.21.15.167:6810/2695037266,v1:172.21.15.167:6812/2695037266] conn(0x7f71d8074af0 0x7f71d8076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:04.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.479+0000 7f71f913b640 1 --2- 172.21.15.88:0/226339584 >> [v2:172.21.15.167:6810/2695037266,v1:172.21.15.167:6812/2695037266] conn(0x7f71d8074af0 0x7f71d8076f90 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:04.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.480+0000 7f71f17fa640 1 -- 172.21.15.88:0/226339584 <== osd.7 v2:172.21.15.167:6810/2695037266 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f71d8077660 con 0x7f71d8074af0 2023-11-27T21:22:04.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.493+0000 7f71fab9e640 1 -- 172.21.15.88:0/226339584 --> [v2:172.21.15.167:6810/2695037266,v1:172.21.15.167:6812/2695037266] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f71f415b450 con 0x7f71d8074af0 2023-11-27T21:22:04.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.494+0000 7f71f17fa640 1 -- 172.21.15.88:0/226339584 <== osd.7 v2:172.21.15.167:6810/2695037266 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f71ec00ac70 con 0x7f71d8074af0 2023-11-27T21:22:04.496 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-27T21:22:04.497 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-27T21:22:04.497 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-27T21:22:04.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.494+0000 7f71fab9e640 1 -- 172.21.15.88:0/226339584 >> [v2:172.21.15.167:6810/2695037266,v1:172.21.15.167:6812/2695037266] conn(0x7f71d8074af0 msgr2=0x7f71d8076f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:04.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.494+0000 7f71fab9e640 1 --2- 172.21.15.88:0/226339584 >> [v2:172.21.15.167:6810/2695037266,v1:172.21.15.167:6812/2695037266] conn(0x7f71d8074af0 0x7f71d8076f90 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:04.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.494+0000 7f71fab9e640 1 -- 172.21.15.88:0/226339584 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f71d806b210 msgr2=0x7f71d806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:04.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.494+0000 7f71fab9e640 1 --2- 172.21.15.88:0/226339584 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f71d806b210 0x7f71d806d6d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f71e0000f60 tx=0x7f71e00078f0 comp rx=0 tx=0).stop 2023-11-27T21:22:04.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.494+0000 7f71fab9e640 1 -- 172.21.15.88:0/226339584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71f40c8a50 msgr2=0x7f71f406b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:04.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.494+0000 7f71fab9e640 1 --2- 172.21.15.88:0/226339584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71f40c8a50 0x7f71f406b5c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f71e8009890 tx=0x7f71e8004730 comp rx=0 tx=0).stop 2023-11-27T21:22:04.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.494+0000 7f71f913b640 1 -- 172.21.15.88:0/226339584 reap_dead start 2023-11-27T21:22:04.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.494+0000 7f71fab9e640 1 -- 172.21.15.88:0/226339584 shutdown_connections 2023-11-27T21:22:04.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.494+0000 7f71fab9e640 1 -- 172.21.15.88:0/226339584 >> 172.21.15.88:0/226339584 conn(0x7f71f4070780 msgr2=0x7f71f414f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:04.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.494+0000 7f71fab9e640 1 -- 172.21.15.88:0/226339584 shutdown_connections 2023-11-27T21:22:04.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.494+0000 7f71fab9e640 1 -- 172.21.15.88:0/226339584 wait complete. 2023-11-27T21:22:04.507 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-27T21:22:04.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.607+0000 7f668f11d640 1 Processor -- start 2023-11-27T21:22:04.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.607+0000 7f668f11d640 1 -- start start 2023-11-27T21:22:04.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.608+0000 7f668f11d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f66880c5080 0x7f668806b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:04.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.608+0000 7f668f11d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f668806a4b0 con 0x7f668815ae40 2023-11-27T21:22:04.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.608+0000 7f668f11d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66880c8330 con 0x7f66880c4ca0 2023-11-27T21:22:04.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.608+0000 7f668f11d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66880c85d0 con 0x7f66880c5080 2023-11-27T21:22:04.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.608+0000 7f668ceb9640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f66880c4ca0 0x7f6688157f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:53634/0 (socket says 172.21.15.88:53634) 2023-11-27T21:22:04.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.608+0000 7f668ceb9640 1 -- 172.21.15.88:0/2513434792 learned_addr learned my addr 172.21.15.88:0/2513434792 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:22:04.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.611+0000 7f66877fe640 1 -- 172.21.15.88:0/2513434792 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474181277 0 0) 0x7f66880c8330 con 0x7f66880c4ca0 2023-11-27T21:22:04.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.611+0000 7f66877fe640 1 -- 172.21.15.88:0/2513434792 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6678003520 con 0x7f66880c4ca0 2023-11-27T21:22:04.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.614+0000 7f66877fe640 1 -- 172.21.15.88:0/2513434792 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 641453840 0 0) 0x7f6678003520 con 0x7f66880c4ca0 2023-11-27T21:22:04.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.614+0000 7f66877fe640 1 -- 172.21.15.88:0/2513434792 >> v2:172.21.15.88:3300/0 conn(0x7f66880c5080 msgr2=0x7f668806b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:22:04.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.614+0000 7f66877fe640 1 --2- 172.21.15.88:0/2513434792 >> v2:172.21.15.88:3300/0 conn(0x7f66880c5080 0x7f668806b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:04.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.614+0000 7f66877fe640 1 -- 172.21.15.88:0/2513434792 >> v1:172.21.15.88:6789/0 conn(0x7f668815ae40 legacy=0x7f6688150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:22:04.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.614+0000 7f66877fe640 1 -- 172.21.15.88:0/2513434792 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668806a700 con 0x7f66880c4ca0 2023-11-27T21:22:04.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.614+0000 7f66877fe640 1 -- 172.21.15.88:0/2513434792 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1067350109 0 0) 0x7f667c001670 con 0x7f66880c4ca0 2023-11-27T21:22:04.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.614+0000 7f66877fe640 1 -- 172.21.15.88:0/2513434792 >> v1:172.21.15.167:6789/0 conn(0x7f66880c4ca0 legacy=0x7f6688157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:04.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.614+0000 7f66877fe640 1 --2- 172.21.15.88:0/2513434792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6678003a30 0x7f6678003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:04.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.614+0000 7f66877fe640 1 --2- 172.21.15.88:0/2513434792 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66780047c0 0x7f6678004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:04.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.614+0000 7f66877fe640 1 --2- 172.21.15.88:0/2513434792 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6678005380 0x7f667800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:04.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.614+0000 7f66877fe640 1 -- 172.21.15.88:0/2513434792 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66880c85d0 con 0x7f6678003a30 2023-11-27T21:22:04.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.614+0000 7f66877fe640 1 -- 172.21.15.88:0/2513434792 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667800c240 con 0x7f6678005380 2023-11-27T21:22:04.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.614+0000 7f66877fe640 1 -- 172.21.15.88:0/2513434792 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667800c400 con 0x7f66780047c0 2023-11-27T21:22:04.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.615+0000 7f6687fff640 1 --2- 172.21.15.88:0/2513434792 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66780047c0 0x7f6678004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:04.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.617+0000 7f668d6ba640 1 --2- 172.21.15.88:0/2513434792 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6678005380 0x7f667800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:04.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.617+0000 7f6687fff640 1 -- 172.21.15.88:0/2513434792 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6678005380 msgr2=0x7f667800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:22:04.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.617+0000 7f6687fff640 1 --2- 172.21.15.88:0/2513434792 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6678005380 0x7f667800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:04.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.617+0000 7f6687fff640 1 -- 172.21.15.88:0/2513434792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6678003a30 msgr2=0x7f6678003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:22:04.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.617+0000 7f6687fff640 1 --2- 172.21.15.88:0/2513434792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6678003a30 0x7f6678003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:04.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.617+0000 7f6687fff640 1 -- 172.21.15.88:0/2513434792 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6678003520 con 0x7f66780047c0 2023-11-27T21:22:04.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.617+0000 7f668d6ba640 1 -- 172.21.15.88:0/2513434792 reap_dead start 2023-11-27T21:22:04.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.620+0000 7f6687fff640 1 --2- 172.21.15.88:0/2513434792 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66780047c0 0x7f6678004c40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f66880c5490 tx=0x7f66780057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=605246f6721a1027 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:04.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.623+0000 7f66877fe640 1 -- 172.21.15.88:0/2513434792 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6674032600 con 0x7f66780047c0 2023-11-27T21:22:04.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.623+0000 7f66877fe640 1 -- 172.21.15.88:0/2513434792 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667402e050 con 0x7f66780047c0 2023-11-27T21:22:04.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.623+0000 7f66877fe640 1 -- 172.21.15.88:0/2513434792 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66740329c0 con 0x7f66780047c0 2023-11-27T21:22:04.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.624+0000 7f668f11d640 1 -- 172.21.15.88:0/2513434792 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66780047c0 msgr2=0x7f6678004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:04.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.624+0000 7f668f11d640 1 --2- 172.21.15.88:0/2513434792 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66780047c0 0x7f6678004c40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f66880c5490 tx=0x7f66780057f0 comp rx=0 tx=0).stop 2023-11-27T21:22:04.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.624+0000 7f668f11d640 1 -- 172.21.15.88:0/2513434792 shutdown_connections 2023-11-27T21:22:04.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.624+0000 7f668f11d640 1 --2- 172.21.15.88:0/2513434792 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66780047c0 0x7f6678004c40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:04.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.624+0000 7f668f11d640 1 -- 172.21.15.88:0/2513434792 >> 172.21.15.88:0/2513434792 conn(0x7f668806d170 msgr2=0x7f668806d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:04.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.624+0000 7f668f11d640 1 -- 172.21.15.88:0/2513434792 shutdown_connections 2023-11-27T21:22:04.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.624+0000 7f668f11d640 1 -- 172.21.15.88:0/2513434792 wait complete. 2023-11-27T21:22:04.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.625+0000 7f668f11d640 1 Processor -- start 2023-11-27T21:22:04.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.625+0000 7f668f11d640 1 -- start start 2023-11-27T21:22:04.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.626+0000 7f668f11d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66780047c0 0x7f668814a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:04.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.626+0000 7f668f11d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66880c6150 0x7f66880c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:04.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.626+0000 7f668f11d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66881f1f80 0x7f6688155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:04.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.626+0000 7f668f11d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6688150eb0 con 0x7f66880c6150 2023-11-27T21:22:04.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.626+0000 7f668f11d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6688149bd0 con 0x7f66881f1f80 2023-11-27T21:22:04.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.626+0000 7f668f11d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6688147e50 con 0x7f66780047c0 2023-11-27T21:22:04.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.626+0000 7f668d6ba640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66881f1f80 0x7f6688155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:04.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.627+0000 7f668d6ba640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66881f1f80 0x7f6688155f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:40786/0 (socket says 172.21.15.88:40786) 2023-11-27T21:22:04.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.627+0000 7f668d6ba640 1 -- 172.21.15.88:0/1628012631 learned_addr learned my addr 172.21.15.88:0/1628012631 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:22:04.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.627+0000 7f668ceb9640 1 --2- 172.21.15.88:0/1628012631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66780047c0 0x7f668814a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:04.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.630+0000 7f668d6ba640 1 -- 172.21.15.88:0/1628012631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66780047c0 msgr2=0x7f668814a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:04.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.630+0000 7f668d6ba640 1 --2- 172.21.15.88:0/1628012631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66780047c0 0x7f668814a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:04.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.630+0000 7f668d6ba640 1 -- 172.21.15.88:0/1628012631 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66880c6150 msgr2=0x7f66880c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:04.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.630+0000 7f668d6ba640 1 --2- 172.21.15.88:0/1628012631 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66880c6150 0x7f66880c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:04.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.630+0000 7f668d6ba640 1 -- 172.21.15.88:0/1628012631 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668814a5a0 con 0x7f66881f1f80 2023-11-27T21:22:04.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.633+0000 7f668d6ba640 1 --2- 172.21.15.88:0/1628012631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66881f1f80 0x7f6688155f50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f668815b220 tx=0x7f668000ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:04.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.636+0000 7f66857fa640 1 -- 172.21.15.88:0/1628012631 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6680003970 con 0x7f66881f1f80 2023-11-27T21:22:04.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.636+0000 7f66857fa640 1 -- 172.21.15.88:0/1628012631 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6680003af0 con 0x7f66881f1f80 2023-11-27T21:22:04.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.636+0000 7f668f11d640 1 -- 172.21.15.88:0/1628012631 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66881508f0 con 0x7f66881f1f80 2023-11-27T21:22:04.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.636+0000 7f66857fa640 1 -- 172.21.15.88:0/1628012631 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6680003ea0 con 0x7f66881f1f80 2023-11-27T21:22:04.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.637+0000 7f668f11d640 1 -- 172.21.15.88:0/1628012631 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6688149860 con 0x7f66881f1f80 2023-11-27T21:22:04.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.637+0000 7f668f11d640 1 -- 172.21.15.88:0/1628012631 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6688067470 con 0x7f66881f1f80 2023-11-27T21:22:04.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.886+0000 7f66857fa640 1 -- 172.21.15.88:0/1628012631 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f66800050d0 con 0x7f66881f1f80 2023-11-27T21:22:04.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.887+0000 7f66857fa640 1 --2- 172.21.15.88:0/1628012631 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f666c06b210 0x7f666c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:04.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.887+0000 7f668ceb9640 1 --2- 172.21.15.88:0/1628012631 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f666c06b210 0x7f666c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:04.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.887+0000 7f668ceb9640 1 --2- 172.21.15.88:0/1628012631 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f666c06b210 0x7f666c06d6d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f667c001820 tx=0x7f667c0019b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:04.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.891+0000 7f66857fa640 1 -- 172.21.15.88:0/1628012631 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6680059350 con 0x7f66881f1f80 2023-11-27T21:22:04.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:04.901+0000 7f66857fa640 1 -- 172.21.15.88:0/1628012631 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f6680054f90 con 0x7f66881f1f80 2023-11-27T21:22:05.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.071+0000 7f668f11d640 1 -- 172.21.15.88:0/1628012631 --> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f66880c8bf0 con 0x7f666c06b210 2023-11-27T21:22:05.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.071+0000 7f66857fa640 1 -- 172.21.15.88:0/1628012631 <== mgr.4105 v2:172.21.15.88:6800/352455703 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f667c00f890 con 0x7f666c06b210 2023-11-27T21:22:05.074 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 7 to deep-scrub 2023-11-27T21:22:05.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.073+0000 7f668f11d640 1 -- 172.21.15.88:0/1628012631 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f666c06b210 msgr2=0x7f666c06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:05.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.073+0000 7f668f11d640 1 --2- 172.21.15.88:0/1628012631 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f666c06b210 0x7f666c06d6d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f667c001820 tx=0x7f667c0019b0 comp rx=0 tx=0).stop 2023-11-27T21:22:05.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.073+0000 7f668f11d640 1 -- 172.21.15.88:0/1628012631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66881f1f80 msgr2=0x7f6688155f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:05.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.073+0000 7f668f11d640 1 --2- 172.21.15.88:0/1628012631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66881f1f80 0x7f6688155f50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f668815b220 tx=0x7f668000ec10 comp rx=0 tx=0).stop 2023-11-27T21:22:05.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.074+0000 7f668f11d640 1 -- 172.21.15.88:0/1628012631 shutdown_connections 2023-11-27T21:22:05.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.074+0000 7f668f11d640 1 --2- 172.21.15.88:0/1628012631 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f666c06b210 0x7f666c06d6d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:05.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.074+0000 7f668f11d640 1 --2- 172.21.15.88:0/1628012631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66881f1f80 0x7f6688155f50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:05.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.074+0000 7f668f11d640 1 --2- 172.21.15.88:0/1628012631 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66880c6150 0x7f66880c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:05.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.074+0000 7f668f11d640 1 --2- 172.21.15.88:0/1628012631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66780047c0 0x7f668814a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:05.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.074+0000 7f668f11d640 1 -- 172.21.15.88:0/1628012631 >> 172.21.15.88:0/1628012631 conn(0x7f668806d170 msgr2=0x7f668806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:05.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.074+0000 7f668f11d640 1 -- 172.21.15.88:0/1628012631 shutdown_connections 2023-11-27T21:22:05.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.074+0000 7f668f11d640 1 -- 172.21.15.88:0/1628012631 wait complete. 2023-11-27T21:22:05.089 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T21:22:05.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.188+0000 7f2425861640 1 Processor -- start 2023-11-27T21:22:05.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.188+0000 7f2425861640 1 -- start start 2023-11-27T21:22:05.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.188+0000 7f2425861640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2420151260 0x7f242006f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:05.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.188+0000 7f2425861640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f24200c2600 0x7f2420158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:05.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.188+0000 7f2425861640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24201573c0 con 0x7f24200c7640 2023-11-27T21:22:05.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.189+0000 7f2425861640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24201571d0 con 0x7f2420151260 2023-11-27T21:22:05.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.189+0000 7f2425861640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24201576a0 con 0x7f24200c2600 2023-11-27T21:22:05.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.189+0000 7f241effd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2420151260 0x7f242006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:05.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.189+0000 7f241f7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f24200c2600 0x7f2420158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:05.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.189+0000 7f241f7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f24200c2600 0x7f2420158aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:40794/0 (socket says 172.21.15.88:40794) 2023-11-27T21:22:05.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.189+0000 7f241f7fe640 1 -- 172.21.15.88:0/4286781902 learned_addr learned my addr 172.21.15.88:0/4286781902 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:22:05.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.192+0000 7f241f7fe640 1 -- 172.21.15.88:0/4286781902 >> v2:172.21.15.88:3300/0 conn(0x7f2420151260 msgr2=0x7f242006f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:22:05.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.192+0000 7f241f7fe640 1 --2- 172.21.15.88:0/4286781902 >> v2:172.21.15.88:3300/0 conn(0x7f2420151260 0x7f242006f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:05.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.192+0000 7f241f7fe640 1 -- 172.21.15.88:0/4286781902 >> v1:172.21.15.88:6789/0 conn(0x7f24200c7640 legacy=0x7f24200ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:05.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.192+0000 7f241f7fe640 1 -- 172.21.15.88:0/4286781902 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2420157980 con 0x7f24200c2600 2023-11-27T21:22:05.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.194+0000 7f241f7fe640 1 --2- 172.21.15.88:0/4286781902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24200c2600 0x7f2420158aa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f24200afec0 tx=0x7f241802bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e38deefd687af37 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:05.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.198+0000 7f241e7fc640 1 -- 172.21.15.88:0/4286781902 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241802cb20 con 0x7f24200c2600 2023-11-27T21:22:05.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.198+0000 7f241e7fc640 1 -- 172.21.15.88:0/4286781902 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241802cc80 con 0x7f24200c2600 2023-11-27T21:22:05.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.198+0000 7f241e7fc640 1 -- 172.21.15.88:0/4286781902 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24180343f0 con 0x7f24200c2600 2023-11-27T21:22:05.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.199+0000 7f2425861640 1 -- 172.21.15.88:0/4286781902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24200c2600 msgr2=0x7f2420158aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:05.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.199+0000 7f2425861640 1 --2- 172.21.15.88:0/4286781902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24200c2600 0x7f2420158aa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f24200afec0 tx=0x7f241802bf80 comp rx=0 tx=0).stop 2023-11-27T21:22:05.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.199+0000 7f2425861640 1 -- 172.21.15.88:0/4286781902 shutdown_connections 2023-11-27T21:22:05.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.199+0000 7f2425861640 1 --2- 172.21.15.88:0/4286781902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24200c2600 0x7f2420158aa0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:05.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.199+0000 7f2425861640 1 --2- 172.21.15.88:0/4286781902 >> v2:172.21.15.88:3300/0 conn(0x7f2420151260 0x7f242006f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:05.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.199+0000 7f2425861640 1 -- 172.21.15.88:0/4286781902 >> 172.21.15.88:0/4286781902 conn(0x7f2420070990 msgr2=0x7f2420070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:05.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.199+0000 7f2425861640 1 -- 172.21.15.88:0/4286781902 shutdown_connections 2023-11-27T21:22:05.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.199+0000 7f2425861640 1 -- 172.21.15.88:0/4286781902 wait complete. 2023-11-27T21:22:05.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.200+0000 7f2425861640 1 Processor -- start 2023-11-27T21:22:05.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.200+0000 7f2425861640 1 -- start start 2023-11-27T21:22:05.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.200+0000 7f2425861640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24200c2600 0x7f24200c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:05.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.200+0000 7f2425861640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24200c7640 0x7f2420144d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:05.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.200+0000 7f2425861640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2420151260 0x7f2420149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:05.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.201+0000 7f2425861640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24200c8fa0 con 0x7f24200c7640 2023-11-27T21:22:05.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.201+0000 7f2425861640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242006c710 con 0x7f2420151260 2023-11-27T21:22:05.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.201+0000 7f2425861640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24200c8a20 con 0x7f24200c2600 2023-11-27T21:22:05.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.201+0000 7f2417fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24200c7640 0x7f2420144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:05.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.201+0000 7f241f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2420151260 0x7f2420149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:05.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.201+0000 7f241effd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24200c2600 0x7f24200c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:05.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.201+0000 7f241f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2420151260 0x7f2420149a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:40808/0 (socket says 172.21.15.88:40808) 2023-11-27T21:22:05.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.201+0000 7f241f7fe640 1 -- 172.21.15.88:0/4094107829 learned_addr learned my addr 172.21.15.88:0/4094107829 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:22:05.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.205+0000 7f2417fff640 1 -- 172.21.15.88:0/4094107829 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24200c2600 msgr2=0x7f24200c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:05.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.205+0000 7f2417fff640 1 --2- 172.21.15.88:0/4094107829 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24200c2600 0x7f24200c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:05.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.205+0000 7f2417fff640 1 -- 172.21.15.88:0/4094107829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2420151260 msgr2=0x7f2420149a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:05.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.205+0000 7f2417fff640 1 --2- 172.21.15.88:0/4094107829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2420151260 0x7f2420149a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:05.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.205+0000 7f2417fff640 1 -- 172.21.15.88:0/4094107829 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2418009b30 con 0x7f24200c7640 2023-11-27T21:22:05.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.207+0000 7f2417fff640 1 --2- 172.21.15.88:0/4094107829 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24200c7640 0x7f2420144d00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f240800c340 tx=0x7f240800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:05.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.210+0000 7f241cff9640 1 -- 172.21.15.88:0/4094107829 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24080052d0 con 0x7f24200c7640 2023-11-27T21:22:05.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.210+0000 7f241cff9640 1 -- 172.21.15.88:0/4094107829 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2408005450 con 0x7f24200c7640 2023-11-27T21:22:05.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.210+0000 7f2425861640 1 -- 172.21.15.88:0/4094107829 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24200c9f10 con 0x7f24200c7640 2023-11-27T21:22:05.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.210+0000 7f241cff9640 1 -- 172.21.15.88:0/4094107829 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2408007260 con 0x7f24200c7640 2023-11-27T21:22:05.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.210+0000 7f2425861640 1 -- 172.21.15.88:0/4094107829 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f242006cf60 con 0x7f24200c7640 2023-11-27T21:22:05.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.211+0000 7f2425861640 1 -- 172.21.15.88:0/4094107829 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24200c3210 con 0x7f24200c7640 2023-11-27T21:22:05.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.230+0000 7f241cff9640 1 -- 172.21.15.88:0/4094107829 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f24080073c0 con 0x7f24200c7640 2023-11-27T21:22:05.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.230+0000 7f241cff9640 1 --2- 172.21.15.88:0/4094107829 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f240006b210 0x7f240006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:05.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.230+0000 7f241effd640 1 --2- 172.21.15.88:0/4094107829 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f240006b210 0x7f240006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:05.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.231+0000 7f241effd640 1 --2- 172.21.15.88:0/4094107829 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f240006b210 0x7f240006d6d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2410009b40 tx=0x7f2410009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:05.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.473+0000 7f241cff9640 1 -- 172.21.15.88:0/4094107829 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2408057c80 con 0x7f24200c7640 2023-11-27T21:22:05.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.473+0000 7f241cff9640 1 -- 172.21.15.88:0/4094107829 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2408053fc0 con 0x7f24200c7640 2023-11-27T21:22:05.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.652+0000 7f2425861640 1 -- 172.21.15.88:0/4094107829 --> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2420151640 con 0x7f240006b210 2023-11-27T21:22:05.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.660+0000 7f241cff9640 1 -- 172.21.15.88:0/4094107829 <== mgr.4105 v2:172.21.15.88:6800/352455703 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367437 (secure 0 0 0) 0x7f2410011a60 con 0x7f240006b210 2023-11-27T21:22:05.666 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T21:22:05.668 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-11-27T21:22:05.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.664+0000 7f2425861640 1 -- 172.21.15.88:0/4094107829 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f240006b210 msgr2=0x7f240006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:05.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.664+0000 7f2425861640 1 --2- 172.21.15.88:0/4094107829 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f240006b210 0x7f240006d6d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2410009b40 tx=0x7f2410009190 comp rx=0 tx=0).stop 2023-11-27T21:22:05.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.664+0000 7f2425861640 1 -- 172.21.15.88:0/4094107829 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24200c7640 msgr2=0x7f2420144d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:05.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.664+0000 7f2425861640 1 --2- 172.21.15.88:0/4094107829 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24200c7640 0x7f2420144d00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f240800c340 tx=0x7f240800c800 comp rx=0 tx=0).stop 2023-11-27T21:22:05.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.664+0000 7f2425861640 1 -- 172.21.15.88:0/4094107829 shutdown_connections 2023-11-27T21:22:05.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.664+0000 7f2425861640 1 --2- 172.21.15.88:0/4094107829 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f240006b210 0x7f240006d6d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:05.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.664+0000 7f2425861640 1 --2- 172.21.15.88:0/4094107829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2420151260 0x7f2420149a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:05.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.664+0000 7f2425861640 1 --2- 172.21.15.88:0/4094107829 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24200c7640 0x7f2420144d00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:05.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.664+0000 7f2425861640 1 --2- 172.21.15.88:0/4094107829 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24200c2600 0x7f24200c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:05.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.664+0000 7f2425861640 1 -- 172.21.15.88:0/4094107829 >> 172.21.15.88:0/4094107829 conn(0x7f2420070990 msgr2=0x7f2420070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:05.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.664+0000 7f2425861640 1 -- 172.21.15.88:0/4094107829 shutdown_connections 2023-11-27T21:22:05.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:05.664+0000 7f2425861640 1 -- 172.21.15.88:0/4094107829 wait complete. 2023-11-27T21:22:05.677 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":861,"stamp":"2023-11-27T21:22:05.268083+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":44862470,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":1793,"num_read_kb":1913,"num_write":21035,"num_write_kb":386609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25294,"ondisk_log_size":25294,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":563072,"kb_used_data":90176,"kb_used_omap":12,"kb_used_meta":472819,"kb_avail":754411648,"statfs":{"total":773094113280,"available":772517527552,"internally_reserved":0,"allocated":92340224,"data_stored":90685252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":484167217},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":152,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003017"},"pg_stats":[{"pgid":"2.1f","version":"28'332","reported_seq":364,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.601443+0000","last_change":"2023-11-27T20:54:26.222003+0000","last_active":"2023-11-27T21:21:49.601443+0000","last_peered":"2023-11-27T21:21:49.601443+0000","last_clean":"2023-11-27T21:21:49.601443+0000","last_became_active":"2023-11-27T20:54:26.221715+0000","last_became_peered":"2023-11-27T20:54:26.221715+0000","last_unstale":"2023-11-27T21:21:49.601443+0000","last_undegraded":"2023-11-27T21:21:49.601443+0000","last_fullsized":"2023-11-27T21:21:49.601443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922212,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":1068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"28'71","reported_seq":102,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.479421+0000","last_change":"2023-11-27T20:54:27.508401+0000","last_active":"2023-11-27T21:21:49.479421+0000","last_peered":"2023-11-27T21:21:49.479421+0000","last_clean":"2023-11-27T21:21:49.479421+0000","last_became_active":"2023-11-27T20:54:27.508003+0000","last_became_peered":"2023-11-27T20:54:27.508003+0000","last_unstale":"2023-11-27T21:21:49.479421+0000","last_undegraded":"2023-11-27T21:21:49.479421+0000","last_fullsized":"2023-11-27T21:21:49.479421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"28'159","reported_seq":185,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.951498+0000","last_change":"2023-11-27T20:54:31.837226+0000","last_active":"2023-11-27T21:21:12.951498+0000","last_peered":"2023-11-27T21:21:12.951498+0000","last_clean":"2023-11-27T21:21:12.951498+0000","last_became_active":"2023-11-27T20:54:31.836803+0000","last_became_peered":"2023-11-27T20:54:31.836803+0000","last_unstale":"2023-11-27T21:21:12.951498+0000","last_undegraded":"2023-11-27T21:21:12.951498+0000","last_fullsized":"2023-11-27T21:21:12.951498+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:06.363326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":7710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'738","reported_seq":770,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:33.524136+0000","last_change":"2023-11-27T20:54:26.227906+0000","last_active":"2023-11-27T21:21:33.524136+0000","last_peered":"2023-11-27T21:21:33.524136+0000","last_clean":"2023-11-27T21:21:33.524136+0000","last_became_active":"2023-11-27T20:54:26.227620+0000","last_became_peered":"2023-11-27T20:54:26.227620+0000","last_unstale":"2023-11-27T21:21:33.524136+0000","last_undegraded":"2023-11-27T21:21:33.524136+0000","last_fullsized":"2023-11-27T21:21:33.524136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":733,"num_write_kb":4484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"28'77","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.476188+0000","last_change":"2023-11-27T20:54:27.507740+0000","last_active":"2023-11-27T21:21:49.476188+0000","last_peered":"2023-11-27T21:21:49.476188+0000","last_clean":"2023-11-27T21:21:49.476188+0000","last_became_active":"2023-11-27T20:54:27.507460+0000","last_became_peered":"2023-11-27T20:54:27.507460+0000","last_unstale":"2023-11-27T21:21:49.476188+0000","last_undegraded":"2023-11-27T21:21:49.476188+0000","last_fullsized":"2023-11-27T21:21:49.476188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"28'166","reported_seq":202,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:09.956222+0000","last_change":"2023-11-27T20:55:00.593902+0000","last_active":"2023-11-27T21:21:09.956222+0000","last_peered":"2023-11-27T21:21:09.956222+0000","last_clean":"2023-11-27T21:21:09.956222+0000","last_became_active":"2023-11-27T20:55:00.593543+0000","last_became_peered":"2023-11-27T20:55:00.593543+0000","last_unstale":"2023-11-27T21:21:09.956222+0000","last_undegraded":"2023-11-27T21:21:09.956222+0000","last_fullsized":"2023-11-27T21:21:09.956222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":12743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"28'180","reported_seq":210,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:59.305381+0000","last_change":"2023-11-27T20:54:26.226645+0000","last_active":"2023-11-27T21:21:59.305381+0000","last_peered":"2023-11-27T21:21:59.305381+0000","last_clean":"2023-11-27T21:21:59.305381+0000","last_became_active":"2023-11-27T20:54:26.226407+0000","last_became_peered":"2023-11-27T20:54:26.226407+0000","last_unstale":"2023-11-27T21:21:59.305381+0000","last_undegraded":"2023-11-27T21:21:59.305381+0000","last_fullsized":"2023-11-27T21:21:59.305381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'78","reported_seq":106,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:59.222240+0000","last_change":"2023-11-27T20:54:27.512803+0000","last_active":"2023-11-27T21:21:59.222240+0000","last_peered":"2023-11-27T21:21:59.222240+0000","last_clean":"2023-11-27T21:21:59.222240+0000","last_became_active":"2023-11-27T20:54:27.512548+0000","last_became_peered":"2023-11-27T20:54:27.512548+0000","last_unstale":"2023-11-27T21:21:59.222240+0000","last_undegraded":"2023-11-27T21:21:59.222240+0000","last_fullsized":"2023-11-27T21:21:59.222240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"28'164","reported_seq":191,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:01.203495+0000","last_change":"2023-11-27T20:54:31.828391+0000","last_active":"2023-11-27T21:22:01.203495+0000","last_peered":"2023-11-27T21:22:01.203495+0000","last_clean":"2023-11-27T21:22:01.203495+0000","last_became_active":"2023-11-27T20:54:31.828045+0000","last_became_peered":"2023-11-27T20:54:31.828045+0000","last_unstale":"2023-11-27T21:22:01.203495+0000","last_undegraded":"2023-11-27T21:22:01.203495+0000","last_fullsized":"2023-11-27T21:22:01.203495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":12089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"28'9","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:59.305350+0000","last_change":"2023-11-27T20:54:26.226762+0000","last_active":"2023-11-27T21:21:59.305350+0000","last_peered":"2023-11-27T21:21:59.305350+0000","last_clean":"2023-11-27T21:21:59.305350+0000","last_became_active":"2023-11-27T20:54:26.226522+0000","last_became_peered":"2023-11-27T20:54:26.226522+0000","last_unstale":"2023-11-27T21:21:59.305350+0000","last_undegraded":"2023-11-27T21:21:59.305350+0000","last_fullsized":"2023-11-27T21:21:59.305350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"28'85","reported_seq":121,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:57.961750+0000","last_change":"2023-11-27T20:55:00.790042+0000","last_active":"2023-11-27T21:21:57.961750+0000","last_peered":"2023-11-27T21:21:57.961750+0000","last_clean":"2023-11-27T21:21:57.961750+0000","last_became_active":"2023-11-27T20:55:00.789772+0000","last_became_peered":"2023-11-27T20:55:00.789772+0000","last_unstale":"2023-11-27T21:21:57.961750+0000","last_undegraded":"2023-11-27T21:21:57.961750+0000","last_fullsized":"2023-11-27T21:21:57.961750+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"28'169","reported_seq":196,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:01.203488+0000","last_change":"2023-11-27T20:54:31.828759+0000","last_active":"2023-11-27T21:22:01.203488+0000","last_peered":"2023-11-27T21:22:01.203488+0000","last_clean":"2023-11-27T21:22:01.203488+0000","last_became_active":"2023-11-27T20:54:31.828371+0000","last_became_peered":"2023-11-27T20:54:31.828371+0000","last_unstale":"2023-11-27T21:22:01.203488+0000","last_undegraded":"2023-11-27T21:22:01.203488+0000","last_fullsized":"2023-11-27T21:22:01.203488+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":6774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"28'74","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.445372+0000","last_change":"2023-11-27T20:54:27.498572+0000","last_active":"2023-11-27T21:21:49.445372+0000","last_peered":"2023-11-27T21:21:49.445372+0000","last_clean":"2023-11-27T21:21:49.445372+0000","last_became_active":"2023-11-27T20:54:27.498279+0000","last_became_peered":"2023-11-27T20:54:27.498279+0000","last_unstale":"2023-11-27T21:21:49.445372+0000","last_undegraded":"2023-11-27T21:21:49.445372+0000","last_fullsized":"2023-11-27T21:21:49.445372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'1121","reported_seq":1152,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:38.067554+0000","last_change":"2023-11-27T20:54:26.227734+0000","last_active":"2023-11-27T21:21:38.067554+0000","last_peered":"2023-11-27T21:21:38.067554+0000","last_clean":"2023-11-27T21:21:38.067554+0000","last_became_active":"2023-11-27T20:54:26.227503+0000","last_became_peered":"2023-11-27T20:54:26.227503+0000","last_unstale":"2023-11-27T21:21:38.067554+0000","last_undegraded":"2023-11-27T21:21:38.067554+0000","last_fullsized":"2023-11-27T21:21:38.067554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1121,"log_dups_size":0,"ondisk_log_size":1121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1114,"num_write_kb":4562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"28'173","reported_seq":201,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:32.958848+0000","last_change":"2023-11-27T20:54:31.827976+0000","last_active":"2023-11-27T21:21:32.958848+0000","last_peered":"2023-11-27T21:21:32.958848+0000","last_clean":"2023-11-27T21:21:32.958848+0000","last_became_active":"2023-11-27T20:54:31.827631+0000","last_became_peered":"2023-11-27T20:54:31.827631+0000","last_unstale":"2023-11-27T21:21:32.958848+0000","last_undegraded":"2023-11-27T21:21:32.958848+0000","last_fullsized":"2023-11-27T21:21:32.958848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":8292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"28'70","reported_seq":98,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.390638+0000","last_change":"2023-11-27T20:54:27.510917+0000","last_active":"2023-11-27T21:21:49.390638+0000","last_peered":"2023-11-27T21:21:49.390638+0000","last_clean":"2023-11-27T21:21:49.390638+0000","last_became_active":"2023-11-27T20:54:27.510668+0000","last_became_peered":"2023-11-27T20:54:27.510668+0000","last_unstale":"2023-11-27T21:21:49.390638+0000","last_undegraded":"2023-11-27T21:21:49.390638+0000","last_fullsized":"2023-11-27T21:21:49.390638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:27:15.390631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'447","reported_seq":477,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:42.292239+0000","last_change":"2023-11-27T20:54:26.231461+0000","last_active":"2023-11-27T21:21:42.292239+0000","last_peered":"2023-11-27T21:21:42.292239+0000","last_clean":"2023-11-27T21:21:42.292239+0000","last_became_active":"2023-11-27T20:54:26.231081+0000","last_became_peered":"2023-11-27T20:54:26.231081+0000","last_unstale":"2023-11-27T21:21:42.292239+0000","last_undegraded":"2023-11-27T21:21:42.292239+0000","last_fullsized":"2023-11-27T21:21:42.292239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:35.560769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"28'191","reported_seq":219,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:34.301255+0000","last_change":"2023-11-27T20:54:31.817058+0000","last_active":"2023-11-27T21:21:34.301255+0000","last_peered":"2023-11-27T21:21:34.301255+0000","last_clean":"2023-11-27T21:21:34.301255+0000","last_became_active":"2023-11-27T20:54:31.816700+0000","last_became_peered":"2023-11-27T20:54:31.816700+0000","last_unstale":"2023-11-27T21:21:34.301255+0000","last_undegraded":"2023-11-27T21:21:34.301255+0000","last_fullsized":"2023-11-27T21:21:34.301255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":12458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"28'73","reported_seq":103,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.481401+0000","last_change":"2023-11-27T20:54:27.510195+0000","last_active":"2023-11-27T21:21:49.481401+0000","last_peered":"2023-11-27T21:21:49.481401+0000","last_clean":"2023-11-27T21:21:49.481401+0000","last_became_active":"2023-11-27T20:54:27.509961+0000","last_became_peered":"2023-11-27T20:54:27.509961+0000","last_unstale":"2023-11-27T21:21:49.481401+0000","last_undegraded":"2023-11-27T21:21:49.481401+0000","last_fullsized":"2023-11-27T21:21:49.481401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'335","reported_seq":366,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:40.087503+0000","last_change":"2023-11-27T20:54:26.223978+0000","last_active":"2023-11-27T21:21:40.087503+0000","last_peered":"2023-11-27T21:21:40.087503+0000","last_clean":"2023-11-27T21:21:40.087503+0000","last_became_active":"2023-11-27T20:54:26.223717+0000","last_became_peered":"2023-11-27T20:54:26.223717+0000","last_unstale":"2023-11-27T21:21:40.087503+0000","last_undegraded":"2023-11-27T21:21:40.087503+0000","last_fullsized":"2023-11-27T21:21:40.087503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":333,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'146","reported_seq":173,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.963929+0000","last_change":"2023-11-27T20:54:31.836718+0000","last_active":"2023-11-27T21:21:12.963929+0000","last_peered":"2023-11-27T21:21:12.963929+0000","last_clean":"2023-11-27T21:21:12.963929+0000","last_became_active":"2023-11-27T20:54:31.836346+0000","last_became_peered":"2023-11-27T20:54:31.836346+0000","last_unstale":"2023-11-27T21:21:12.963929+0000","last_undegraded":"2023-11-27T21:21:12.963929+0000","last_fullsized":"2023-11-27T21:21:12.963929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:29:03.931226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":6504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'66","reported_seq":96,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.501713+0000","last_change":"2023-11-27T20:54:27.493578+0000","last_active":"2023-11-27T21:21:49.501713+0000","last_peered":"2023-11-27T21:21:49.501713+0000","last_clean":"2023-11-27T21:21:49.501713+0000","last_became_active":"2023-11-27T20:54:27.493327+0000","last_became_peered":"2023-11-27T20:54:27.493327+0000","last_unstale":"2023-11-27T21:21:49.501713+0000","last_undegraded":"2023-11-27T21:21:49.501713+0000","last_fullsized":"2023-11-27T21:21:49.501713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"28'8","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.398352+0000","last_change":"2023-11-27T21:22:02.398392+0000","last_active":"2023-11-27T21:22:02.398352+0000","last_peered":"2023-11-27T21:22:02.398352+0000","last_clean":"2023-11-27T21:22:02.398352+0000","last_became_active":"2023-11-27T20:54:26.227120+0000","last_became_peered":"2023-11-27T20:54:26.227120+0000","last_unstale":"2023-11-27T21:22:02.398352+0000","last_undegraded":"2023-11-27T21:22:02.398352+0000","last_fullsized":"2023-11-27T21:22:02.398352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2023-11-27T21:22:02.398284+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2023-11-27T21:22:02.398284+0000","last_clean_scrub_stamp":"2023-11-27T21:22:02.398284+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:09:04.340440+0000","scrub_duration":0.00264496,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'197","reported_seq":234,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:34.272587+0000","last_change":"2023-11-27T20:55:01.286453+0000","last_active":"2023-11-27T21:21:34.272587+0000","last_peered":"2023-11-27T21:21:34.272587+0000","last_clean":"2023-11-27T21:21:34.272587+0000","last_became_active":"2023-11-27T20:55:01.286057+0000","last_became_peered":"2023-11-27T20:55:01.286057+0000","last_unstale":"2023-11-27T21:21:34.272587+0000","last_undegraded":"2023-11-27T21:21:34.272587+0000","last_fullsized":"2023-11-27T21:21:34.272587+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":17829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5,7],"acting":[2,1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"28'63","reported_seq":93,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.481168+0000","last_change":"2023-11-27T20:54:27.510815+0000","last_active":"2023-11-27T21:21:49.481168+0000","last_peered":"2023-11-27T21:21:49.481168+0000","last_clean":"2023-11-27T21:21:49.481168+0000","last_became_active":"2023-11-27T20:54:27.510573+0000","last_became_peered":"2023-11-27T20:54:27.510573+0000","last_unstale":"2023-11-27T21:21:49.481168+0000","last_undegraded":"2023-11-27T21:21:49.481168+0000","last_fullsized":"2023-11-27T21:21:49.481168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'13","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:42.239022+0000","last_change":"2023-11-27T20:54:26.224703+0000","last_active":"2023-11-27T21:21:42.239022+0000","last_peered":"2023-11-27T21:21:42.239022+0000","last_clean":"2023-11-27T21:21:42.239022+0000","last_became_active":"2023-11-27T20:54:26.224412+0000","last_became_peered":"2023-11-27T20:54:26.224412+0000","last_unstale":"2023-11-27T21:21:42.239022+0000","last_undegraded":"2023-11-27T21:21:42.239022+0000","last_fullsized":"2023-11-27T21:21:42.239022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'174","reported_seq":203,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:39.273075+0000","last_change":"2023-11-27T20:54:31.819739+0000","last_active":"2023-11-27T21:21:39.273075+0000","last_peered":"2023-11-27T21:21:39.273075+0000","last_clean":"2023-11-27T21:21:39.273075+0000","last_became_active":"2023-11-27T20:54:31.819371+0000","last_became_peered":"2023-11-27T20:54:31.819371+0000","last_unstale":"2023-11-27T21:21:39.273075+0000","last_undegraded":"2023-11-27T21:21:39.273075+0000","last_fullsized":"2023-11-27T21:21:39.273075+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":8398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"28'71","reported_seq":101,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.480831+0000","last_change":"2023-11-27T20:54:27.500858+0000","last_active":"2023-11-27T21:21:49.480831+0000","last_peered":"2023-11-27T21:21:49.480831+0000","last_clean":"2023-11-27T21:21:49.480831+0000","last_became_active":"2023-11-27T20:54:27.500455+0000","last_became_peered":"2023-11-27T20:54:27.500455+0000","last_unstale":"2023-11-27T21:21:49.480831+0000","last_undegraded":"2023-11-27T21:21:49.480831+0000","last_fullsized":"2023-11-27T21:21:49.480831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'160","reported_seq":191,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:46.655483+0000","last_change":"2023-11-27T20:54:26.223401+0000","last_active":"2023-11-27T21:21:46.655483+0000","last_peered":"2023-11-27T21:21:46.655483+0000","last_clean":"2023-11-27T21:21:46.655483+0000","last_became_active":"2023-11-27T20:54:26.222981+0000","last_became_peered":"2023-11-27T20:54:26.222981+0000","last_unstale":"2023-11-27T21:21:46.655483+0000","last_undegraded":"2023-11-27T21:21:46.655483+0000","last_fullsized":"2023-11-27T21:21:46.655483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":391,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"28'157","reported_seq":186,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.951048+0000","last_change":"2023-11-27T20:54:31.814118+0000","last_active":"2023-11-27T21:21:12.951048+0000","last_peered":"2023-11-27T21:21:12.951048+0000","last_clean":"2023-11-27T21:21:12.951048+0000","last_became_active":"2023-11-27T20:54:31.813765+0000","last_became_peered":"2023-11-27T20:54:31.813765+0000","last_unstale":"2023-11-27T21:21:12.951048+0000","last_undegraded":"2023-11-27T21:21:12.951048+0000","last_fullsized":"2023-11-27T21:21:12.951048+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":11921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"28'78","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.415446+0000","last_change":"2023-11-27T20:54:27.506449+0000","last_active":"2023-11-27T21:21:49.415446+0000","last_peered":"2023-11-27T21:21:49.415446+0000","last_clean":"2023-11-27T21:21:49.415446+0000","last_became_active":"2023-11-27T20:54:27.506210+0000","last_became_peered":"2023-11-27T20:54:27.506210+0000","last_unstale":"2023-11-27T21:21:49.415446+0000","last_undegraded":"2023-11-27T21:21:49.415446+0000","last_fullsized":"2023-11-27T21:21:49.415446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:32:20.783560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'245","reported_seq":277,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:40.092131+0000","last_change":"2023-11-27T20:54:26.220043+0000","last_active":"2023-11-27T21:21:40.092131+0000","last_peered":"2023-11-27T21:21:40.092131+0000","last_clean":"2023-11-27T21:21:40.092131+0000","last_became_active":"2023-11-27T20:54:26.219775+0000","last_became_peered":"2023-11-27T20:54:26.219775+0000","last_unstale":"2023-11-27T21:21:40.092131+0000","last_undegraded":"2023-11-27T21:21:40.092131+0000","last_fullsized":"2023-11-27T21:21:40.092131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"28'177","reported_seq":205,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:11.896181+0000","last_change":"2023-11-27T20:54:31.825960+0000","last_active":"2023-11-27T21:21:11.896181+0000","last_peered":"2023-11-27T21:21:11.896181+0000","last_clean":"2023-11-27T21:21:11.896181+0000","last_became_active":"2023-11-27T20:54:31.825591+0000","last_became_peered":"2023-11-27T20:54:31.825591+0000","last_unstale":"2023-11-27T21:21:11.896181+0000","last_undegraded":"2023-11-27T21:21:11.896181+0000","last_fullsized":"2023-11-27T21:21:11.896181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:24:35.498899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":8135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"28'65","reported_seq":96,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.526320+0000","last_change":"2023-11-27T20:54:27.500927+0000","last_active":"2023-11-27T21:21:49.526320+0000","last_peered":"2023-11-27T21:21:49.526320+0000","last_clean":"2023-11-27T21:21:49.526320+0000","last_became_active":"2023-11-27T20:54:27.500677+0000","last_became_peered":"2023-11-27T20:54:27.500677+0000","last_unstale":"2023-11-27T21:21:49.526320+0000","last_undegraded":"2023-11-27T21:21:49.526320+0000","last_fullsized":"2023-11-27T21:21:49.526320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"28'6","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:38.077429+0000","last_change":"2023-11-27T20:54:26.227877+0000","last_active":"2023-11-27T21:21:38.077429+0000","last_peered":"2023-11-27T21:21:38.077429+0000","last_clean":"2023-11-27T21:21:38.077429+0000","last_became_active":"2023-11-27T20:54:26.227605+0000","last_became_peered":"2023-11-27T20:54:26.227605+0000","last_unstale":"2023-11-27T21:21:38.077429+0000","last_undegraded":"2023-11-27T21:21:38.077429+0000","last_fullsized":"2023-11-27T21:21:38.077429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"28'178","reported_seq":206,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:15.791510+0000","last_change":"2023-11-27T20:54:31.826732+0000","last_active":"2023-11-27T21:21:15.791510+0000","last_peered":"2023-11-27T21:21:15.791510+0000","last_clean":"2023-11-27T21:21:15.791510+0000","last_became_active":"2023-11-27T20:54:31.826406+0000","last_became_peered":"2023-11-27T20:54:31.826406+0000","last_unstale":"2023-11-27T21:21:15.791510+0000","last_undegraded":"2023-11-27T21:21:15.791510+0000","last_fullsized":"2023-11-27T21:21:15.791510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:54.926925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":6957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"28'85","reported_seq":116,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.493092+0000","last_change":"2023-11-27T20:54:27.517007+0000","last_active":"2023-11-27T21:21:49.493092+0000","last_peered":"2023-11-27T21:21:49.493092+0000","last_clean":"2023-11-27T21:21:49.493092+0000","last_became_active":"2023-11-27T20:54:27.516686+0000","last_became_peered":"2023-11-27T20:54:27.516686+0000","last_unstale":"2023-11-27T21:21:49.493092+0000","last_undegraded":"2023-11-27T21:21:49.493092+0000","last_fullsized":"2023-11-27T21:21:49.493092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'915","reported_seq":947,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.616969+0000","last_change":"2023-11-27T20:54:26.230192+0000","last_active":"2023-11-27T21:21:49.616969+0000","last_peered":"2023-11-27T21:21:49.616969+0000","last_clean":"2023-11-27T21:21:49.616969+0000","last_became_active":"2023-11-27T20:54:26.229985+0000","last_became_peered":"2023-11-27T20:54:26.229985+0000","last_unstale":"2023-11-27T21:21:49.616969+0000","last_undegraded":"2023-11-27T21:21:49.616969+0000","last_fullsized":"2023-11-27T21:21:49.616969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206463,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":911,"num_write_kb":4580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"28'139","reported_seq":164,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:15.017289+0000","last_change":"2023-11-27T20:55:00.588512+0000","last_active":"2023-11-27T21:21:15.017289+0000","last_peered":"2023-11-27T21:21:15.017289+0000","last_clean":"2023-11-27T21:21:15.017289+0000","last_became_active":"2023-11-27T20:55:00.588018+0000","last_became_peered":"2023-11-27T20:55:00.588018+0000","last_unstale":"2023-11-27T21:21:15.017289+0000","last_undegraded":"2023-11-27T21:21:15.017289+0000","last_fullsized":"2023-11-27T21:21:15.017289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":13169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,0,3],"acting":[2,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'77","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.484590+0000","last_change":"2023-11-27T20:54:27.513378+0000","last_active":"2023-11-27T21:21:49.484590+0000","last_peered":"2023-11-27T21:21:49.484590+0000","last_clean":"2023-11-27T21:21:49.484590+0000","last_became_active":"2023-11-27T20:54:27.512093+0000","last_became_peered":"2023-11-27T20:54:27.512093+0000","last_unstale":"2023-11-27T21:21:49.484590+0000","last_undegraded":"2023-11-27T21:21:49.484590+0000","last_fullsized":"2023-11-27T21:21:49.484590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'270","reported_seq":470,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:44.209461+0000","last_change":"2023-11-27T20:54:26.230913+0000","last_active":"2023-11-27T21:21:44.209461+0000","last_peered":"2023-11-27T21:21:44.209461+0000","last_clean":"2023-11-27T21:21:44.209461+0000","last_became_active":"2023-11-27T20:54:26.230548+0000","last_became_peered":"2023-11-27T20:54:26.230548+0000","last_unstale":"2023-11-27T21:21:44.209461+0000","last_undegraded":"2023-11-27T21:21:44.209461+0000","last_fullsized":"2023-11-27T21:21:44.209461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:42:11.153092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28446,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":170,"num_read_kb":173,"num_write":266,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"28'141","reported_seq":177,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.292190+0000","last_change":"2023-11-27T20:55:00.595104+0000","last_active":"2023-11-27T21:21:12.292190+0000","last_peered":"2023-11-27T21:21:12.292190+0000","last_clean":"2023-11-27T21:21:12.292190+0000","last_became_active":"2023-11-27T20:55:00.594705+0000","last_became_peered":"2023-11-27T20:55:00.594705+0000","last_unstale":"2023-11-27T21:21:12.292190+0000","last_undegraded":"2023-11-27T21:21:12.292190+0000","last_fullsized":"2023-11-27T21:21:12.292190+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:06.015093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":12035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"28'77","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.424310+0000","last_change":"2023-11-27T20:54:27.503689+0000","last_active":"2023-11-27T21:21:49.424310+0000","last_peered":"2023-11-27T21:21:49.424310+0000","last_clean":"2023-11-27T21:21:49.424310+0000","last_became_active":"2023-11-27T20:54:27.502941+0000","last_became_peered":"2023-11-27T20:54:27.502941+0000","last_unstale":"2023-11-27T21:21:49.424310+0000","last_undegraded":"2023-11-27T21:21:49.424310+0000","last_fullsized":"2023-11-27T21:21:49.424310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:59:41.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'11","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:40.288019+0000","last_change":"2023-11-27T20:54:26.214419+0000","last_active":"2023-11-27T21:21:40.288019+0000","last_peered":"2023-11-27T21:21:40.288019+0000","last_clean":"2023-11-27T21:21:40.288019+0000","last_became_active":"2023-11-27T20:54:26.214166+0000","last_became_peered":"2023-11-27T20:54:26.214166+0000","last_unstale":"2023-11-27T21:21:40.288019+0000","last_undegraded":"2023-11-27T21:21:40.288019+0000","last_fullsized":"2023-11-27T21:21:40.288019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"28'132","reported_seq":160,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:15.010701+0000","last_change":"2023-11-27T20:54:31.832551+0000","last_active":"2023-11-27T21:21:15.010701+0000","last_peered":"2023-11-27T21:21:15.010701+0000","last_clean":"2023-11-27T21:21:15.010701+0000","last_became_active":"2023-11-27T20:54:31.832196+0000","last_became_peered":"2023-11-27T20:54:31.832196+0000","last_unstale":"2023-11-27T21:21:15.010701+0000","last_undegraded":"2023-11-27T21:21:15.010701+0000","last_fullsized":"2023-11-27T21:21:15.010701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":8461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'69","reported_seq":100,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.481125+0000","last_change":"2023-11-27T20:54:27.433404+0000","last_active":"2023-11-27T21:21:49.481125+0000","last_peered":"2023-11-27T21:21:49.481125+0000","last_clean":"2023-11-27T21:21:49.481125+0000","last_became_active":"2023-11-27T20:54:27.433161+0000","last_became_peered":"2023-11-27T20:54:27.433161+0000","last_unstale":"2023-11-27T21:21:49.481125+0000","last_undegraded":"2023-11-27T21:21:49.481125+0000","last_fullsized":"2023-11-27T21:21:49.481125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'8","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:32.958832+0000","last_change":"2023-11-27T20:54:26.227451+0000","last_active":"2023-11-27T21:21:32.958832+0000","last_peered":"2023-11-27T21:21:32.958832+0000","last_clean":"2023-11-27T21:21:32.958832+0000","last_became_active":"2023-11-27T20:54:26.227133+0000","last_became_peered":"2023-11-27T20:54:26.227133+0000","last_unstale":"2023-11-27T21:21:32.958832+0000","last_undegraded":"2023-11-27T21:21:32.958832+0000","last_fullsized":"2023-11-27T21:21:32.958832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":194,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:03.333411+0000","last_change":"2023-11-27T21:22:03.333433+0000","last_active":"2023-11-27T21:22:03.333411+0000","last_peered":"2023-11-27T21:22:03.333411+0000","last_clean":"2023-11-27T21:22:03.333411+0000","last_became_active":"2023-11-27T20:54:11.452181+0000","last_became_peered":"2023-11-27T20:54:11.452181+0000","last_unstale":"2023-11-27T21:22:03.333411+0000","last_undegraded":"2023-11-27T21:22:03.333411+0000","last_fullsized":"2023-11-27T21:22:03.333411+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2023-11-27T21:22:03.333356+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2023-11-27T21:22:03.333356+0000","last_clean_scrub_stamp":"2023-11-27T21:22:03.333356+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:51:11.809770+0000","scrub_duration":0.0045126749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'171","reported_seq":200,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:42.959901+0000","last_change":"2023-11-27T20:54:31.818408+0000","last_active":"2023-11-27T21:21:42.959901+0000","last_peered":"2023-11-27T21:21:42.959901+0000","last_clean":"2023-11-27T21:21:42.959901+0000","last_became_active":"2023-11-27T20:54:31.818048+0000","last_became_peered":"2023-11-27T20:54:31.818048+0000","last_unstale":"2023-11-27T21:21:42.959901+0000","last_undegraded":"2023-11-27T21:21:42.959901+0000","last_fullsized":"2023-11-27T21:21:42.959901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":10034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"28'75","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.521838+0000","last_change":"2023-11-27T21:22:02.521856+0000","last_active":"2023-11-27T21:22:02.521838+0000","last_peered":"2023-11-27T21:22:02.521838+0000","last_clean":"2023-11-27T21:22:02.521838+0000","last_became_active":"2023-11-27T20:54:27.493256+0000","last_became_peered":"2023-11-27T20:54:27.493256+0000","last_unstale":"2023-11-27T21:22:02.521838+0000","last_undegraded":"2023-11-27T21:22:02.521838+0000","last_fullsized":"2023-11-27T21:22:02.521838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:02.521779+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:02.521779+0000","last_clean_scrub_stamp":"2023-11-27T21:22:02.521779+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:35:12.329730+0000","scrub_duration":0.0011699499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'1018","reported_seq":1048,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:26.066735+0000","last_change":"2023-11-27T20:54:26.230079+0000","last_active":"2023-11-27T21:21:26.066735+0000","last_peered":"2023-11-27T21:21:26.066735+0000","last_clean":"2023-11-27T21:21:26.066735+0000","last_became_active":"2023-11-27T20:54:26.229796+0000","last_became_peered":"2023-11-27T20:54:26.229796+0000","last_unstale":"2023-11-27T21:21:26.066735+0000","last_undegraded":"2023-11-27T21:21:26.066735+0000","last_fullsized":"2023-11-27T21:21:26.066735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1018,"log_dups_size":0,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:55.616164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1013,"num_write_kb":4611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'180","reported_seq":208,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:11.944542+0000","last_change":"2023-11-27T20:54:31.825472+0000","last_active":"2023-11-27T21:21:11.944542+0000","last_peered":"2023-11-27T21:21:11.944542+0000","last_clean":"2023-11-27T21:21:11.944542+0000","last_became_active":"2023-11-27T20:54:31.825080+0000","last_became_peered":"2023-11-27T20:54:31.825080+0000","last_unstale":"2023-11-27T21:21:11.944542+0000","last_undegraded":"2023-11-27T21:21:11.944542+0000","last_fullsized":"2023-11-27T21:21:11.944542+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":9643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'78","reported_seq":101,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.769377+0000","last_change":"2023-11-27T20:55:00.593751+0000","last_active":"2023-11-27T21:22:02.769377+0000","last_peered":"2023-11-27T21:22:02.769377+0000","last_clean":"2023-11-27T21:22:02.769377+0000","last_became_active":"2023-11-27T20:55:00.593249+0000","last_became_peered":"2023-11-27T20:55:00.593249+0000","last_unstale":"2023-11-27T21:22:02.769377+0000","last_undegraded":"2023-11-27T21:22:02.769377+0000","last_fullsized":"2023-11-27T21:22:02.769377+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"28'436","reported_seq":467,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.623269+0000","last_change":"2023-11-27T20:54:26.226148+0000","last_active":"2023-11-27T21:21:49.623269+0000","last_peered":"2023-11-27T21:21:49.623269+0000","last_clean":"2023-11-27T21:21:49.623269+0000","last_became_active":"2023-11-27T20:54:26.225886+0000","last_became_peered":"2023-11-27T20:54:26.225886+0000","last_unstale":"2023-11-27T21:21:49.623269+0000","last_undegraded":"2023-11-27T21:21:49.623269+0000","last_fullsized":"2023-11-27T21:21:49.623269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2473984,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":2660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"28'169","reported_seq":197,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:34.314845+0000","last_change":"2023-11-27T20:54:31.828729+0000","last_active":"2023-11-27T21:21:34.314845+0000","last_peered":"2023-11-27T21:21:34.314845+0000","last_clean":"2023-11-27T21:21:34.314845+0000","last_became_active":"2023-11-27T20:54:31.828368+0000","last_became_peered":"2023-11-27T20:54:31.828368+0000","last_unstale":"2023-11-27T21:21:34.314845+0000","last_undegraded":"2023-11-27T21:21:34.314845+0000","last_fullsized":"2023-11-27T21:21:34.314845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":8527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"28'75","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.492674+0000","last_change":"2023-11-27T20:54:27.515800+0000","last_active":"2023-11-27T21:21:49.492674+0000","last_peered":"2023-11-27T21:21:49.492674+0000","last_clean":"2023-11-27T21:21:49.492674+0000","last_became_active":"2023-11-27T20:54:27.515416+0000","last_became_peered":"2023-11-27T20:54:27.515416+0000","last_unstale":"2023-11-27T21:21:49.492674+0000","last_undegraded":"2023-11-27T21:21:49.492674+0000","last_fullsized":"2023-11-27T21:21:49.492674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"28'8","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:31.970513+0000","last_change":"2023-11-27T20:54:26.224880+0000","last_active":"2023-11-27T21:21:31.970513+0000","last_peered":"2023-11-27T21:21:31.970513+0000","last_clean":"2023-11-27T21:21:31.970513+0000","last_became_active":"2023-11-27T20:54:26.224604+0000","last_became_peered":"2023-11-27T20:54:26.224604+0000","last_unstale":"2023-11-27T21:21:31.970513+0000","last_undegraded":"2023-11-27T21:21:31.970513+0000","last_fullsized":"2023-11-27T21:21:31.970513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"28'149","reported_seq":177,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:11.971505+0000","last_change":"2023-11-27T20:54:31.819648+0000","last_active":"2023-11-27T21:21:11.971505+0000","last_peered":"2023-11-27T21:21:11.971505+0000","last_clean":"2023-11-27T21:21:11.971505+0000","last_became_active":"2023-11-27T20:54:31.819294+0000","last_became_peered":"2023-11-27T20:54:31.819294+0000","last_unstale":"2023-11-27T21:21:11.971505+0000","last_undegraded":"2023-11-27T21:21:11.971505+0000","last_fullsized":"2023-11-27T21:21:11.971505+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"28'77","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.528587+0000","last_change":"2023-11-27T20:54:27.512925+0000","last_active":"2023-11-27T21:21:49.528587+0000","last_peered":"2023-11-27T21:21:49.528587+0000","last_clean":"2023-11-27T21:21:49.528587+0000","last_became_active":"2023-11-27T20:54:27.512663+0000","last_became_peered":"2023-11-27T20:54:27.512663+0000","last_unstale":"2023-11-27T21:21:49.528587+0000","last_undegraded":"2023-11-27T21:21:49.528587+0000","last_fullsized":"2023-11-27T21:21:49.528587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"28'239","reported_seq":270,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:41.185778+0000","last_change":"2023-11-27T20:54:26.225344+0000","last_active":"2023-11-27T21:21:41.185778+0000","last_peered":"2023-11-27T21:21:41.185778+0000","last_clean":"2023-11-27T21:21:41.185778+0000","last_became_active":"2023-11-27T20:54:26.225056+0000","last_became_peered":"2023-11-27T20:54:26.225056+0000","last_unstale":"2023-11-27T21:21:41.185778+0000","last_undegraded":"2023-11-27T21:21:41.185778+0000","last_fullsized":"2023-11-27T21:21:41.185778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"28'126","reported_seq":154,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.974610+0000","last_change":"2023-11-27T20:54:31.827590+0000","last_active":"2023-11-27T21:21:12.974610+0000","last_peered":"2023-11-27T21:21:12.974610+0000","last_clean":"2023-11-27T21:21:12.974610+0000","last_became_active":"2023-11-27T20:54:31.827175+0000","last_became_peered":"2023-11-27T20:54:31.827175+0000","last_unstale":"2023-11-27T21:21:12.974610+0000","last_undegraded":"2023-11-27T21:21:12.974610+0000","last_fullsized":"2023-11-27T21:21:12.974610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":7629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"28'69","reported_seq":98,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.445183+0000","last_change":"2023-11-27T20:54:27.498488+0000","last_active":"2023-11-27T21:21:49.445183+0000","last_peered":"2023-11-27T21:21:49.445183+0000","last_clean":"2023-11-27T21:21:49.445183+0000","last_became_active":"2023-11-27T20:54:27.498225+0000","last_became_peered":"2023-11-27T20:54:27.498225+0000","last_unstale":"2023-11-27T21:21:49.445183+0000","last_undegraded":"2023-11-27T21:21:49.445183+0000","last_fullsized":"2023-11-27T21:21:49.445183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'1029","reported_seq":1059,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.606061+0000","last_change":"2023-11-27T20:54:26.225580+0000","last_active":"2023-11-27T21:21:49.606061+0000","last_peered":"2023-11-27T21:21:49.606061+0000","last_clean":"2023-11-27T21:21:49.606061+0000","last_became_active":"2023-11-27T20:54:26.225333+0000","last_became_peered":"2023-11-27T20:54:26.225333+0000","last_unstale":"2023-11-27T21:21:49.606061+0000","last_undegraded":"2023-11-27T21:21:49.606061+0000","last_fullsized":"2023-11-27T21:21:49.606061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1029,"log_dups_size":0,"ondisk_log_size":1029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3313963,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1025,"num_write_kb":3921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"28'159","reported_seq":186,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:11.926419+0000","last_change":"2023-11-27T20:54:31.836029+0000","last_active":"2023-11-27T21:21:11.926419+0000","last_peered":"2023-11-27T21:21:11.926419+0000","last_clean":"2023-11-27T21:21:11.926419+0000","last_became_active":"2023-11-27T20:54:31.835629+0000","last_became_peered":"2023-11-27T20:54:31.835629+0000","last_unstale":"2023-11-27T21:21:11.926419+0000","last_undegraded":"2023-11-27T21:21:11.926419+0000","last_fullsized":"2023-11-27T21:21:11.926419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":12674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'64","reported_seq":92,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.430765+0000","last_change":"2023-11-27T20:54:27.511034+0000","last_active":"2023-11-27T21:21:49.430765+0000","last_peered":"2023-11-27T21:21:49.430765+0000","last_clean":"2023-11-27T21:21:49.430765+0000","last_became_active":"2023-11-27T20:54:27.510775+0000","last_became_peered":"2023-11-27T20:54:27.510775+0000","last_unstale":"2023-11-27T21:21:49.430765+0000","last_undegraded":"2023-11-27T21:21:49.430765+0000","last_fullsized":"2023-11-27T21:21:49.430765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"28'1188","reported_seq":1218,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:27.107401+0000","last_change":"2023-11-27T20:54:26.227007+0000","last_active":"2023-11-27T21:21:27.107401+0000","last_peered":"2023-11-27T21:21:27.107401+0000","last_clean":"2023-11-27T21:21:27.107401+0000","last_became_active":"2023-11-27T20:54:26.226745+0000","last_became_peered":"2023-11-27T20:54:26.226745+0000","last_unstale":"2023-11-27T21:21:27.107401+0000","last_undegraded":"2023-11-27T21:21:27.107401+0000","last_fullsized":"2023-11-27T21:21:27.107401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1188,"log_dups_size":0,"ondisk_log_size":1188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":4695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"28'169","reported_seq":196,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:13.920766+0000","last_change":"2023-11-27T20:54:31.831969+0000","last_active":"2023-11-27T21:21:13.920766+0000","last_peered":"2023-11-27T21:21:13.920766+0000","last_clean":"2023-11-27T21:21:13.920766+0000","last_became_active":"2023-11-27T20:54:31.831620+0000","last_became_peered":"2023-11-27T20:54:31.831620+0000","last_unstale":"2023-11-27T21:21:13.920766+0000","last_undegraded":"2023-11-27T21:21:13.920766+0000","last_fullsized":"2023-11-27T21:21:13.920766+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":13064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'85","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.446021+0000","last_change":"2023-11-27T20:54:27.515785+0000","last_active":"2023-11-27T21:21:49.446021+0000","last_peered":"2023-11-27T21:21:49.446021+0000","last_clean":"2023-11-27T21:21:49.446021+0000","last_became_active":"2023-11-27T20:54:27.515524+0000","last_became_peered":"2023-11-27T20:54:27.515524+0000","last_unstale":"2023-11-27T21:21:49.446021+0000","last_undegraded":"2023-11-27T21:21:49.446021+0000","last_fullsized":"2023-11-27T21:21:49.446021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'242","reported_seq":272,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:42.299849+0000","last_change":"2023-11-27T20:54:26.225975+0000","last_active":"2023-11-27T21:21:42.299849+0000","last_peered":"2023-11-27T21:21:42.299849+0000","last_clean":"2023-11-27T21:21:42.299849+0000","last_became_active":"2023-11-27T20:54:26.225691+0000","last_became_peered":"2023-11-27T20:54:26.225691+0000","last_unstale":"2023-11-27T21:21:42.299849+0000","last_undegraded":"2023-11-27T21:21:42.299849+0000","last_fullsized":"2023-11-27T21:21:42.299849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":236,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"28'150","reported_seq":176,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.291749+0000","last_change":"2023-11-27T20:54:31.827058+0000","last_active":"2023-11-27T21:21:12.291749+0000","last_peered":"2023-11-27T21:21:12.291749+0000","last_clean":"2023-11-27T21:21:12.291749+0000","last_became_active":"2023-11-27T20:54:31.826669+0000","last_became_peered":"2023-11-27T20:54:31.826669+0000","last_unstale":"2023-11-27T21:21:12.291749+0000","last_undegraded":"2023-11-27T21:21:12.291749+0000","last_fullsized":"2023-11-27T21:21:12.291749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:40.986177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":7432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"28'77","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.398536+0000","last_change":"2023-11-27T20:54:27.503066+0000","last_active":"2023-11-27T21:21:49.398536+0000","last_peered":"2023-11-27T21:21:49.398536+0000","last_clean":"2023-11-27T21:21:49.398536+0000","last_became_active":"2023-11-27T20:54:27.502677+0000","last_became_peered":"2023-11-27T20:54:27.502677+0000","last_unstale":"2023-11-27T21:21:49.398536+0000","last_undegraded":"2023-11-27T21:21:49.398536+0000","last_fullsized":"2023-11-27T21:21:49.398536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:41.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'326","reported_seq":668,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:42.283413+0000","last_change":"2023-11-27T20:54:26.228175+0000","last_active":"2023-11-27T21:21:42.283413+0000","last_peered":"2023-11-27T21:21:42.283413+0000","last_clean":"2023-11-27T21:21:42.283413+0000","last_became_active":"2023-11-27T20:54:26.227911+0000","last_became_peered":"2023-11-27T20:54:26.227911+0000","last_unstale":"2023-11-27T21:21:42.283413+0000","last_undegraded":"2023-11-27T21:21:42.283413+0000","last_fullsized":"2023-11-27T21:21:42.283413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:57.995466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53552,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":314,"num_read_kb":325,"num_write":327,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'174","reported_seq":201,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.976359+0000","last_change":"2023-11-27T20:54:31.828136+0000","last_active":"2023-11-27T21:21:12.976359+0000","last_peered":"2023-11-27T21:21:12.976359+0000","last_clean":"2023-11-27T21:21:12.976359+0000","last_became_active":"2023-11-27T20:54:31.827785+0000","last_became_peered":"2023-11-27T20:54:31.827785+0000","last_unstale":"2023-11-27T21:21:12.976359+0000","last_undegraded":"2023-11-27T21:21:12.976359+0000","last_fullsized":"2023-11-27T21:21:12.976359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":11290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'75","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.491397+0000","last_change":"2023-11-27T20:54:27.514185+0000","last_active":"2023-11-27T21:21:49.491397+0000","last_peered":"2023-11-27T21:21:49.491397+0000","last_clean":"2023-11-27T21:21:49.491397+0000","last_became_active":"2023-11-27T20:54:27.513655+0000","last_became_peered":"2023-11-27T20:54:27.513655+0000","last_unstale":"2023-11-27T21:21:49.491397+0000","last_undegraded":"2023-11-27T21:21:49.491397+0000","last_fullsized":"2023-11-27T21:21:49.491397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'1487","reported_seq":1525,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.911935+0000","last_change":"2023-11-27T21:22:02.911976+0000","last_active":"2023-11-27T21:22:02.911935+0000","last_peered":"2023-11-27T21:22:02.911935+0000","last_clean":"2023-11-27T21:22:02.911935+0000","last_became_active":"2023-11-27T20:54:26.230570+0000","last_became_peered":"2023-11-27T20:54:26.230570+0000","last_unstale":"2023-11-27T21:22:02.911935+0000","last_undegraded":"2023-11-27T21:22:02.911935+0000","last_fullsized":"2023-11-27T21:22:02.911935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1487","last_scrub_stamp":"2023-11-27T21:22:02.911868+0000","last_deep_scrub":"28'1487","last_deep_scrub_stamp":"2023-11-27T21:22:02.911868+0000","last_clean_scrub_stamp":"2023-11-27T21:22:02.911868+0000","objects_scrubbed":6,"log_size":1487,"log_dups_size":0,"ondisk_log_size":1487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:31:23.266746+0000","scrub_duration":0.017648026000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1482,"num_write_kb":4539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"28'155","reported_seq":182,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:15.004642+0000","last_change":"2023-11-27T20:54:31.828482+0000","last_active":"2023-11-27T21:21:15.004642+0000","last_peered":"2023-11-27T21:21:15.004642+0000","last_clean":"2023-11-27T21:21:15.004642+0000","last_became_active":"2023-11-27T20:54:31.827872+0000","last_became_peered":"2023-11-27T20:54:31.827872+0000","last_unstale":"2023-11-27T21:21:15.004642+0000","last_undegraded":"2023-11-27T21:21:15.004642+0000","last_fullsized":"2023-11-27T21:21:15.004642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":8855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'67","reported_seq":96,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.446215+0000","last_change":"2023-11-27T20:54:27.493526+0000","last_active":"2023-11-27T21:21:49.446215+0000","last_peered":"2023-11-27T21:21:49.446215+0000","last_clean":"2023-11-27T21:21:49.446215+0000","last_became_active":"2023-11-27T20:54:27.493257+0000","last_became_peered":"2023-11-27T20:54:27.493257+0000","last_unstale":"2023-11-27T21:21:49.446215+0000","last_undegraded":"2023-11-27T21:21:49.446215+0000","last_fullsized":"2023-11-27T21:21:49.446215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'149","reported_seq":177,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:42.291396+0000","last_change":"2023-11-27T20:54:26.231237+0000","last_active":"2023-11-27T21:21:42.291396+0000","last_peered":"2023-11-27T21:21:42.291396+0000","last_clean":"2023-11-27T21:21:42.291396+0000","last_became_active":"2023-11-27T20:54:26.230963+0000","last_became_peered":"2023-11-27T20:54:26.230963+0000","last_unstale":"2023-11-27T21:21:42.291396+0000","last_undegraded":"2023-11-27T21:21:42.291396+0000","last_fullsized":"2023-11-27T21:21:42.291396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:11:24.730507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"28'195","reported_seq":226,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:16.056200+0000","last_change":"2023-11-27T20:54:31.825391+0000","last_active":"2023-11-27T21:21:16.056200+0000","last_peered":"2023-11-27T21:21:16.056200+0000","last_clean":"2023-11-27T21:21:16.056200+0000","last_became_active":"2023-11-27T20:54:31.825038+0000","last_became_peered":"2023-11-27T20:54:31.825038+0000","last_unstale":"2023-11-27T21:21:16.056200+0000","last_undegraded":"2023-11-27T21:21:16.056200+0000","last_fullsized":"2023-11-27T21:21:16.056200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":102,"num_write":164,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"28'89","reported_seq":118,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.498621+0000","last_change":"2023-11-27T20:54:27.508226+0000","last_active":"2023-11-27T21:21:49.498621+0000","last_peered":"2023-11-27T21:21:49.498621+0000","last_clean":"2023-11-27T21:21:49.498621+0000","last_became_active":"2023-11-27T20:54:27.507805+0000","last_became_peered":"2023-11-27T20:54:27.507805+0000","last_unstale":"2023-11-27T21:21:49.498621+0000","last_undegraded":"2023-11-27T21:21:49.498621+0000","last_fullsized":"2023-11-27T21:21:49.498621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'328","reported_seq":676,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:42.291460+0000","last_change":"2023-11-27T20:54:26.226915+0000","last_active":"2023-11-27T21:21:42.291460+0000","last_peered":"2023-11-27T21:21:42.291460+0000","last_clean":"2023-11-27T21:21:42.291460+0000","last_became_active":"2023-11-27T20:54:26.226679+0000","last_became_peered":"2023-11-27T20:54:26.226679+0000","last_unstale":"2023-11-27T21:21:42.291460+0000","last_undegraded":"2023-11-27T21:21:42.291460+0000","last_fullsized":"2023-11-27T21:21:42.291460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53032,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":318,"num_read_kb":327,"num_write":324,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"28'159","reported_seq":185,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:15.790221+0000","last_change":"2023-11-27T20:54:31.834934+0000","last_active":"2023-11-27T21:21:15.790221+0000","last_peered":"2023-11-27T21:21:15.790221+0000","last_clean":"2023-11-27T21:21:15.790221+0000","last_became_active":"2023-11-27T20:54:31.834569+0000","last_became_peered":"2023-11-27T20:54:31.834569+0000","last_unstale":"2023-11-27T21:21:15.790221+0000","last_undegraded":"2023-11-27T21:21:15.790221+0000","last_fullsized":"2023-11-27T21:21:15.790221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:15:51.754021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":7865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'79","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.528707+0000","last_change":"2023-11-27T20:54:27.498841+0000","last_active":"2023-11-27T21:21:49.528707+0000","last_peered":"2023-11-27T21:21:49.528707+0000","last_clean":"2023-11-27T21:21:49.528707+0000","last_became_active":"2023-11-27T20:54:27.498535+0000","last_became_peered":"2023-11-27T20:54:27.498535+0000","last_unstale":"2023-11-27T21:21:49.528707+0000","last_undegraded":"2023-11-27T21:21:49.528707+0000","last_fullsized":"2023-11-27T21:21:49.528707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'176","reported_seq":205,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:41.435177+0000","last_change":"2023-11-27T20:54:26.228140+0000","last_active":"2023-11-27T21:21:41.435177+0000","last_peered":"2023-11-27T21:21:41.435177+0000","last_clean":"2023-11-27T21:21:41.435177+0000","last_became_active":"2023-11-27T20:54:26.227878+0000","last_became_peered":"2023-11-27T20:54:26.227878+0000","last_unstale":"2023-11-27T21:21:41.435177+0000","last_undegraded":"2023-11-27T21:21:41.435177+0000","last_fullsized":"2023-11-27T21:21:41.435177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'104","reported_seq":131,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:16.056237+0000","last_change":"2023-11-27T20:54:31.825264+0000","last_active":"2023-11-27T21:21:16.056237+0000","last_peered":"2023-11-27T21:21:16.056237+0000","last_clean":"2023-11-27T21:21:16.056237+0000","last_became_active":"2023-11-27T20:54:31.824914+0000","last_became_peered":"2023-11-27T20:54:31.824914+0000","last_unstale":"2023-11-27T21:21:16.056237+0000","last_undegraded":"2023-11-27T21:21:16.056237+0000","last_fullsized":"2023-11-27T21:21:16.056237+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":7715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"28'152","reported_seq":181,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.778384+0000","last_change":"2023-11-27T20:54:31.828359+0000","last_active":"2023-11-27T21:21:12.778384+0000","last_peered":"2023-11-27T21:21:12.778384+0000","last_clean":"2023-11-27T21:21:12.778384+0000","last_became_active":"2023-11-27T20:54:31.827971+0000","last_became_peered":"2023-11-27T20:54:31.827971+0000","last_unstale":"2023-11-27T21:21:12.778384+0000","last_undegraded":"2023-11-27T21:21:12.778384+0000","last_fullsized":"2023-11-27T21:21:12.778384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":9456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"28'80","reported_seq":109,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.493005+0000","last_change":"2023-11-27T20:54:27.434914+0000","last_active":"2023-11-27T21:21:49.493005+0000","last_peered":"2023-11-27T21:21:49.493005+0000","last_clean":"2023-11-27T21:21:49.493005+0000","last_became_active":"2023-11-27T20:54:27.434635+0000","last_became_peered":"2023-11-27T20:54:27.434635+0000","last_unstale":"2023-11-27T21:21:49.493005+0000","last_undegraded":"2023-11-27T21:21:49.493005+0000","last_fullsized":"2023-11-27T21:21:49.493005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'6","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:40.087148+0000","last_change":"2023-11-27T20:54:26.224770+0000","last_active":"2023-11-27T21:21:40.087148+0000","last_peered":"2023-11-27T21:21:40.087148+0000","last_clean":"2023-11-27T21:21:40.087148+0000","last_became_active":"2023-11-27T20:54:26.224502+0000","last_became_peered":"2023-11-27T20:54:26.224502+0000","last_unstale":"2023-11-27T21:21:40.087148+0000","last_undegraded":"2023-11-27T21:21:40.087148+0000","last_fullsized":"2023-11-27T21:21:40.087148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"28'177","reported_seq":206,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:37.959439+0000","last_change":"2023-11-27T20:54:31.827147+0000","last_active":"2023-11-27T21:21:37.959439+0000","last_peered":"2023-11-27T21:21:37.959439+0000","last_clean":"2023-11-27T21:21:37.959439+0000","last_became_active":"2023-11-27T20:54:31.826790+0000","last_became_peered":"2023-11-27T20:54:31.826790+0000","last_unstale":"2023-11-27T21:21:37.959439+0000","last_undegraded":"2023-11-27T21:21:37.959439+0000","last_fullsized":"2023-11-27T21:21:37.959439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":15468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'77","reported_seq":106,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.483144+0000","last_change":"2023-11-27T20:54:27.507947+0000","last_active":"2023-11-27T21:21:49.483144+0000","last_peered":"2023-11-27T21:21:49.483144+0000","last_clean":"2023-11-27T21:21:49.483144+0000","last_became_active":"2023-11-27T20:54:27.507698+0000","last_became_peered":"2023-11-27T20:54:27.507698+0000","last_unstale":"2023-11-27T21:21:49.483144+0000","last_undegraded":"2023-11-27T21:21:49.483144+0000","last_fullsized":"2023-11-27T21:21:49.483144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'422","reported_seq":864,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:36.493048+0000","last_change":"2023-11-27T20:54:26.230417+0000","last_active":"2023-11-27T21:21:36.493048+0000","last_peered":"2023-11-27T21:21:36.493048+0000","last_clean":"2023-11-27T21:21:36.493048+0000","last_became_active":"2023-11-27T20:54:26.229725+0000","last_became_peered":"2023-11-27T20:54:26.229725+0000","last_unstale":"2023-11-27T21:21:36.493048+0000","last_undegraded":"2023-11-27T21:21:36.493048+0000","last_fullsized":"2023-11-27T21:21:36.493048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:01.075715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":413,"num_read_kb":420,"num_write":418,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'469","reported_seq":957,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:57.961687+0000","last_change":"2023-11-27T20:54:26.221975+0000","last_active":"2023-11-27T21:21:57.961687+0000","last_peered":"2023-11-27T21:21:57.961687+0000","last_clean":"2023-11-27T21:21:57.961687+0000","last_became_active":"2023-11-27T20:54:26.221715+0000","last_became_peered":"2023-11-27T20:54:26.221715+0000","last_unstale":"2023-11-27T21:21:57.961687+0000","last_undegraded":"2023-11-27T21:21:57.961687+0000","last_fullsized":"2023-11-27T21:21:57.961687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70496,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":458,"num_read_kb":466,"num_write":467,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'78","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:57.859811+0000","last_change":"2023-11-27T20:54:27.517213+0000","last_active":"2023-11-27T21:21:57.859811+0000","last_peered":"2023-11-27T21:21:57.859811+0000","last_clean":"2023-11-27T21:21:57.859811+0000","last_became_active":"2023-11-27T20:54:27.516887+0000","last_became_peered":"2023-11-27T20:54:27.516887+0000","last_unstale":"2023-11-27T21:21:57.859811+0000","last_undegraded":"2023-11-27T21:21:57.859811+0000","last_fullsized":"2023-11-27T21:21:57.859811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'144","reported_seq":171,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.769469+0000","last_change":"2023-11-27T20:54:31.827740+0000","last_active":"2023-11-27T21:22:02.769469+0000","last_peered":"2023-11-27T21:22:02.769469+0000","last_clean":"2023-11-27T21:22:02.769469+0000","last_became_active":"2023-11-27T20:54:31.827395+0000","last_became_peered":"2023-11-27T20:54:31.827395+0000","last_unstale":"2023-11-27T21:22:02.769469+0000","last_undegraded":"2023-11-27T21:22:02.769469+0000","last_fullsized":"2023-11-27T21:22:02.769469+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":4976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'2868","reported_seq":2898,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:59.437468+0000","last_change":"2023-11-27T20:54:26.227971+0000","last_active":"2023-11-27T21:21:59.437468+0000","last_peered":"2023-11-27T21:21:59.437468+0000","last_clean":"2023-11-27T21:21:59.437468+0000","last_became_active":"2023-11-27T20:54:26.227713+0000","last_became_peered":"2023-11-27T20:54:26.227713+0000","last_unstale":"2023-11-27T21:21:59.437468+0000","last_undegraded":"2023-11-27T21:21:59.437468+0000","last_fullsized":"2023-11-27T21:21:59.437468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2868,"log_dups_size":0,"ondisk_log_size":2868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12113008,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2860,"num_write_kb":13160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"28'94","reported_seq":122,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:59.222225+0000","last_change":"2023-11-27T20:54:27.506394+0000","last_active":"2023-11-27T21:21:59.222225+0000","last_peered":"2023-11-27T21:21:59.222225+0000","last_clean":"2023-11-27T21:21:59.222225+0000","last_became_active":"2023-11-27T20:54:27.506119+0000","last_became_peered":"2023-11-27T20:54:27.506119+0000","last_unstale":"2023-11-27T21:21:59.222225+0000","last_undegraded":"2023-11-27T21:21:59.222225+0000","last_fullsized":"2023-11-27T21:21:59.222225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"28'135","reported_seq":161,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:15.017297+0000","last_change":"2023-11-27T20:54:31.833185+0000","last_active":"2023-11-27T21:21:15.017297+0000","last_peered":"2023-11-27T21:21:15.017297+0000","last_clean":"2023-11-27T21:21:15.017297+0000","last_became_active":"2023-11-27T20:54:31.832813+0000","last_became_peered":"2023-11-27T20:54:31.832813+0000","last_unstale":"2023-11-27T21:21:15.017297+0000","last_undegraded":"2023-11-27T21:21:15.017297+0000","last_fullsized":"2023-11-27T21:21:15.017297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:13.856393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'74","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:03.899170+0000","last_change":"2023-11-27T21:22:03.899204+0000","last_active":"2023-11-27T21:22:03.899170+0000","last_peered":"2023-11-27T21:22:03.899170+0000","last_clean":"2023-11-27T21:22:03.899170+0000","last_became_active":"2023-11-27T20:54:27.500394+0000","last_became_peered":"2023-11-27T20:54:27.500394+0000","last_unstale":"2023-11-27T21:22:03.899170+0000","last_undegraded":"2023-11-27T21:22:03.899170+0000","last_fullsized":"2023-11-27T21:22:03.899170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'74","last_scrub_stamp":"2023-11-27T21:22:03.899101+0000","last_deep_scrub":"28'74","last_deep_scrub_stamp":"2023-11-27T21:22:03.899101+0000","last_clean_scrub_stamp":"2023-11-27T21:22:03.899101+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:06.401969+0000","scrub_duration":0.0013881010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"28'91","reported_seq":120,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.393968+0000","last_change":"2023-11-27T20:54:27.515441+0000","last_active":"2023-11-27T21:21:49.393968+0000","last_peered":"2023-11-27T21:21:49.393968+0000","last_clean":"2023-11-27T21:21:49.393968+0000","last_became_active":"2023-11-27T20:54:27.515173+0000","last_became_peered":"2023-11-27T20:54:27.515173+0000","last_unstale":"2023-11-27T21:21:49.393968+0000","last_undegraded":"2023-11-27T21:21:49.393968+0000","last_fullsized":"2023-11-27T21:21:49.393968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:19:36.361734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"28'79","reported_seq":110,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.498732+0000","last_change":"2023-11-27T20:54:27.506358+0000","last_active":"2023-11-27T21:21:49.498732+0000","last_peered":"2023-11-27T21:21:49.498732+0000","last_clean":"2023-11-27T21:21:49.498732+0000","last_became_active":"2023-11-27T20:54:27.506112+0000","last_became_peered":"2023-11-27T20:54:27.506112+0000","last_unstale":"2023-11-27T21:21:49.498732+0000","last_undegraded":"2023-11-27T21:21:49.498732+0000","last_fullsized":"2023-11-27T21:21:49.498732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'73","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.482131+0000","last_change":"2023-11-27T20:54:27.510776+0000","last_active":"2023-11-27T21:21:49.482131+0000","last_peered":"2023-11-27T21:21:49.482131+0000","last_clean":"2023-11-27T21:21:49.482131+0000","last_became_active":"2023-11-27T20:54:27.510532+0000","last_became_peered":"2023-11-27T20:54:27.510532+0000","last_unstale":"2023-11-27T21:21:49.482131+0000","last_undegraded":"2023-11-27T21:21:49.482131+0000","last_fullsized":"2023-11-27T21:21:49.482131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"28'58","reported_seq":87,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.400922+0000","last_change":"2023-11-27T20:54:27.513775+0000","last_active":"2023-11-27T21:21:49.400922+0000","last_peered":"2023-11-27T21:21:49.400922+0000","last_clean":"2023-11-27T21:21:49.400922+0000","last_became_active":"2023-11-27T20:54:27.513517+0000","last_became_peered":"2023-11-27T20:54:27.513517+0000","last_unstale":"2023-11-27T21:21:49.400922+0000","last_undegraded":"2023-11-27T21:21:49.400922+0000","last_fullsized":"2023-11-27T21:21:49.400922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:07:21.815516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'78","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.397802+0000","last_change":"2023-11-27T20:54:27.511798+0000","last_active":"2023-11-27T21:21:49.397802+0000","last_peered":"2023-11-27T21:21:49.397802+0000","last_clean":"2023-11-27T21:21:49.397802+0000","last_became_active":"2023-11-27T20:54:27.511559+0000","last_became_peered":"2023-11-27T20:54:27.511559+0000","last_unstale":"2023-11-27T21:21:49.397802+0000","last_undegraded":"2023-11-27T21:21:49.397802+0000","last_fullsized":"2023-11-27T21:21:49.397802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:41.057877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"28'75","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.527612+0000","last_change":"2023-11-27T20:54:27.499585+0000","last_active":"2023-11-27T21:21:49.527612+0000","last_peered":"2023-11-27T21:21:49.527612+0000","last_clean":"2023-11-27T21:21:49.527612+0000","last_became_active":"2023-11-27T20:54:27.499323+0000","last_became_peered":"2023-11-27T20:54:27.499323+0000","last_unstale":"2023-11-27T21:21:49.527612+0000","last_undegraded":"2023-11-27T21:21:49.527612+0000","last_fullsized":"2023-11-27T21:21:49.527612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"28'64","reported_seq":94,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.476253+0000","last_change":"2023-11-27T20:54:27.508846+0000","last_active":"2023-11-27T21:21:49.476253+0000","last_peered":"2023-11-27T21:21:49.476253+0000","last_clean":"2023-11-27T21:21:49.476253+0000","last_became_active":"2023-11-27T20:54:27.508615+0000","last_became_peered":"2023-11-27T20:54:27.508615+0000","last_unstale":"2023-11-27T21:21:49.476253+0000","last_undegraded":"2023-11-27T21:21:49.476253+0000","last_fullsized":"2023-11-27T21:21:49.476253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'78","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.498130+0000","last_change":"2023-11-27T20:54:27.510920+0000","last_active":"2023-11-27T21:21:49.498130+0000","last_peered":"2023-11-27T21:21:49.498130+0000","last_clean":"2023-11-27T21:21:49.498130+0000","last_became_active":"2023-11-27T20:54:27.510647+0000","last_became_peered":"2023-11-27T20:54:27.510647+0000","last_unstale":"2023-11-27T21:21:49.498130+0000","last_undegraded":"2023-11-27T21:21:49.498130+0000","last_fullsized":"2023-11-27T21:21:49.498130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"28'92","reported_seq":122,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.481796+0000","last_change":"2023-11-27T20:54:27.508596+0000","last_active":"2023-11-27T21:21:49.481796+0000","last_peered":"2023-11-27T21:21:49.481796+0000","last_clean":"2023-11-27T21:21:49.481796+0000","last_became_active":"2023-11-27T20:54:27.508360+0000","last_became_peered":"2023-11-27T20:54:27.508360+0000","last_unstale":"2023-11-27T21:21:49.481796+0000","last_undegraded":"2023-11-27T21:21:49.481796+0000","last_fullsized":"2023-11-27T21:21:49.481796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"28'87","reported_seq":116,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.391467+0000","last_change":"2023-11-27T20:54:27.513374+0000","last_active":"2023-11-27T21:21:49.391467+0000","last_peered":"2023-11-27T21:21:49.391467+0000","last_clean":"2023-11-27T21:21:49.391467+0000","last_became_active":"2023-11-27T20:54:27.513105+0000","last_became_peered":"2023-11-27T20:54:27.513105+0000","last_unstale":"2023-11-27T21:21:49.391467+0000","last_undegraded":"2023-11-27T21:21:49.391467+0000","last_fullsized":"2023-11-27T21:21:49.391467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"28'77","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.504786+0000","last_change":"2023-11-27T20:54:27.433370+0000","last_active":"2023-11-27T21:21:49.504786+0000","last_peered":"2023-11-27T21:21:49.504786+0000","last_clean":"2023-11-27T21:21:49.504786+0000","last_became_active":"2023-11-27T20:54:27.433179+0000","last_became_peered":"2023-11-27T20:54:27.433179+0000","last_unstale":"2023-11-27T21:21:49.504786+0000","last_undegraded":"2023-11-27T21:21:49.504786+0000","last_fullsized":"2023-11-27T21:21:49.504786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'75","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.488885+0000","last_change":"2023-11-27T20:54:27.515324+0000","last_active":"2023-11-27T21:21:49.488885+0000","last_peered":"2023-11-27T21:21:49.488885+0000","last_clean":"2023-11-27T21:21:49.488885+0000","last_became_active":"2023-11-27T20:54:27.515068+0000","last_became_peered":"2023-11-27T20:54:27.515068+0000","last_unstale":"2023-11-27T21:21:49.488885+0000","last_undegraded":"2023-11-27T21:21:49.488885+0000","last_fullsized":"2023-11-27T21:21:49.488885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"28'86","reported_seq":116,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.500468+0000","last_change":"2023-11-27T20:54:27.498621+0000","last_active":"2023-11-27T21:21:49.500468+0000","last_peered":"2023-11-27T21:21:49.500468+0000","last_clean":"2023-11-27T21:21:49.500468+0000","last_became_active":"2023-11-27T20:54:27.498306+0000","last_became_peered":"2023-11-27T20:54:27.498306+0000","last_unstale":"2023-11-27T21:21:49.500468+0000","last_undegraded":"2023-11-27T21:21:49.500468+0000","last_fullsized":"2023-11-27T21:21:49.500468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'91","reported_seq":118,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.405687+0000","last_change":"2023-11-27T20:54:27.513134+0000","last_active":"2023-11-27T21:21:49.405687+0000","last_peered":"2023-11-27T21:21:49.405687+0000","last_clean":"2023-11-27T21:21:49.405687+0000","last_became_active":"2023-11-27T20:54:27.512897+0000","last_became_peered":"2023-11-27T20:54:27.512897+0000","last_unstale":"2023-11-27T21:21:49.405687+0000","last_undegraded":"2023-11-27T21:21:49.405687+0000","last_fullsized":"2023-11-27T21:21:49.405687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:13:40.877792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"28'67","reported_seq":96,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.444722+0000","last_change":"2023-11-27T20:54:27.515196+0000","last_active":"2023-11-27T21:21:49.444722+0000","last_peered":"2023-11-27T21:21:49.444722+0000","last_clean":"2023-11-27T21:21:49.444722+0000","last_became_active":"2023-11-27T20:54:27.514946+0000","last_became_peered":"2023-11-27T20:54:27.514946+0000","last_unstale":"2023-11-27T21:21:49.444722+0000","last_undegraded":"2023-11-27T21:21:49.444722+0000","last_fullsized":"2023-11-27T21:21:49.444722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"28'80","reported_seq":109,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.445900+0000","last_change":"2023-11-27T20:54:27.493565+0000","last_active":"2023-11-27T21:21:49.445900+0000","last_peered":"2023-11-27T21:21:49.445900+0000","last_clean":"2023-11-27T21:21:49.445900+0000","last_became_active":"2023-11-27T20:54:27.493297+0000","last_became_peered":"2023-11-27T20:54:27.493297+0000","last_unstale":"2023-11-27T21:21:49.445900+0000","last_undegraded":"2023-11-27T21:21:49.445900+0000","last_fullsized":"2023-11-27T21:21:49.445900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"28'75","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.496096+0000","last_change":"2023-11-27T20:54:27.512910+0000","last_active":"2023-11-27T21:21:49.496096+0000","last_peered":"2023-11-27T21:21:49.496096+0000","last_clean":"2023-11-27T21:21:49.496096+0000","last_became_active":"2023-11-27T20:54:27.512662+0000","last_became_peered":"2023-11-27T20:54:27.512662+0000","last_unstale":"2023-11-27T21:21:49.496096+0000","last_undegraded":"2023-11-27T21:21:49.496096+0000","last_fullsized":"2023-11-27T21:21:49.496096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'70","reported_seq":98,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.398075+0000","last_change":"2023-11-27T20:54:27.512406+0000","last_active":"2023-11-27T21:21:49.398075+0000","last_peered":"2023-11-27T21:21:49.398075+0000","last_clean":"2023-11-27T21:21:49.398075+0000","last_became_active":"2023-11-27T20:54:27.512124+0000","last_became_peered":"2023-11-27T20:54:27.512124+0000","last_unstale":"2023-11-27T21:21:49.398075+0000","last_undegraded":"2023-11-27T21:21:49.398075+0000","last_fullsized":"2023-11-27T21:21:49.398075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:17:21.736684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"28'82","reported_seq":110,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.401709+0000","last_change":"2023-11-27T20:54:27.517262+0000","last_active":"2023-11-27T21:21:49.401709+0000","last_peered":"2023-11-27T21:21:49.401709+0000","last_clean":"2023-11-27T21:21:49.401709+0000","last_became_active":"2023-11-27T20:54:27.516907+0000","last_became_peered":"2023-11-27T20:54:27.516907+0000","last_unstale":"2023-11-27T21:21:49.401709+0000","last_undegraded":"2023-11-27T21:21:49.401709+0000","last_fullsized":"2023-11-27T21:21:49.401709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:05:09.885169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'68","reported_seq":97,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.492544+0000","last_change":"2023-11-27T20:54:27.515432+0000","last_active":"2023-11-27T21:21:49.492544+0000","last_peered":"2023-11-27T21:21:49.492544+0000","last_clean":"2023-11-27T21:21:49.492544+0000","last_became_active":"2023-11-27T20:54:27.515182+0000","last_became_peered":"2023-11-27T20:54:27.515182+0000","last_unstale":"2023-11-27T21:21:49.492544+0000","last_undegraded":"2023-11-27T21:21:49.492544+0000","last_fullsized":"2023-11-27T21:21:49.492544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'79","reported_seq":100,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.439014+0000","last_change":"2023-11-27T20:55:00.588607+0000","last_active":"2023-11-27T21:21:49.439014+0000","last_peered":"2023-11-27T21:21:49.439014+0000","last_clean":"2023-11-27T21:21:49.439014+0000","last_became_active":"2023-11-27T20:55:00.588298+0000","last_became_peered":"2023-11-27T20:55:00.588298+0000","last_unstale":"2023-11-27T21:21:49.439014+0000","last_undegraded":"2023-11-27T21:21:49.439014+0000","last_fullsized":"2023-11-27T21:21:49.439014+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:32:30.458506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'77","reported_seq":106,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.494026+0000","last_change":"2023-11-27T20:54:27.512956+0000","last_active":"2023-11-27T21:21:49.494026+0000","last_peered":"2023-11-27T21:21:49.494026+0000","last_clean":"2023-11-27T21:21:49.494026+0000","last_became_active":"2023-11-27T20:54:27.512692+0000","last_became_peered":"2023-11-27T20:54:27.512692+0000","last_unstale":"2023-11-27T21:21:49.494026+0000","last_undegraded":"2023-11-27T21:21:49.494026+0000","last_fullsized":"2023-11-27T21:21:49.494026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"28'75","reported_seq":103,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.398796+0000","last_change":"2023-11-27T20:54:27.499043+0000","last_active":"2023-11-27T21:21:49.398796+0000","last_peered":"2023-11-27T21:21:49.398796+0000","last_clean":"2023-11-27T21:21:49.398796+0000","last_became_active":"2023-11-27T20:54:27.498790+0000","last_became_peered":"2023-11-27T20:54:27.498790+0000","last_unstale":"2023-11-27T21:21:49.398796+0000","last_undegraded":"2023-11-27T21:21:49.398796+0000","last_fullsized":"2023-11-27T21:21:49.398796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"28'85","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:59.437409+0000","last_change":"2023-11-27T20:54:27.513089+0000","last_active":"2023-11-27T21:21:59.437409+0000","last_peered":"2023-11-27T21:21:59.437409+0000","last_clean":"2023-11-27T21:21:59.437409+0000","last_became_active":"2023-11-27T20:54:27.512777+0000","last_became_peered":"2023-11-27T20:54:27.512777+0000","last_unstale":"2023-11-27T21:21:59.437409+0000","last_undegraded":"2023-11-27T21:21:59.437409+0000","last_fullsized":"2023-11-27T21:21:59.437409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'65","reported_seq":94,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:59.305251+0000","last_change":"2023-11-27T20:54:27.512691+0000","last_active":"2023-11-27T21:21:59.305251+0000","last_peered":"2023-11-27T21:21:59.305251+0000","last_clean":"2023-11-27T21:21:59.305251+0000","last_became_active":"2023-11-27T20:54:27.512433+0000","last_became_peered":"2023-11-27T20:54:27.512433+0000","last_unstale":"2023-11-27T21:21:59.305251+0000","last_undegraded":"2023-11-27T21:21:59.305251+0000","last_fullsized":"2023-11-27T21:21:59.305251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'62","reported_seq":91,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:59.275825+0000","last_change":"2023-11-27T20:54:27.432322+0000","last_active":"2023-11-27T21:21:59.275825+0000","last_peered":"2023-11-27T21:21:59.275825+0000","last_clean":"2023-11-27T21:21:59.275825+0000","last_became_active":"2023-11-27T20:54:27.432152+0000","last_became_peered":"2023-11-27T20:54:27.432152+0000","last_unstale":"2023-11-27T21:21:59.275825+0000","last_undegraded":"2023-11-27T21:21:59.275825+0000","last_fullsized":"2023-11-27T21:21:59.275825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'69","reported_seq":98,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:59.305297+0000","last_change":"2023-11-27T20:54:27.516081+0000","last_active":"2023-11-27T21:21:59.305297+0000","last_peered":"2023-11-27T21:21:59.305297+0000","last_clean":"2023-11-27T21:21:59.305297+0000","last_became_active":"2023-11-27T20:54:27.515801+0000","last_became_peered":"2023-11-27T20:54:27.515801+0000","last_unstale":"2023-11-27T21:21:59.305297+0000","last_undegraded":"2023-11-27T21:21:59.305297+0000","last_fullsized":"2023-11-27T21:21:59.305297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'75","reported_seq":106,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.527464+0000","last_change":"2023-11-27T20:54:27.432375+0000","last_active":"2023-11-27T21:21:49.527464+0000","last_peered":"2023-11-27T21:21:49.527464+0000","last_clean":"2023-11-27T21:21:49.527464+0000","last_became_active":"2023-11-27T20:54:27.432160+0000","last_became_peered":"2023-11-27T20:54:27.432160+0000","last_unstale":"2023-11-27T21:21:49.527464+0000","last_undegraded":"2023-11-27T21:21:49.527464+0000","last_fullsized":"2023-11-27T21:21:49.527464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'77","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.495390+0000","last_change":"2023-11-27T20:54:27.505374+0000","last_active":"2023-11-27T21:21:49.495390+0000","last_peered":"2023-11-27T21:21:49.495390+0000","last_clean":"2023-11-27T21:21:49.495390+0000","last_became_active":"2023-11-27T20:54:27.505122+0000","last_became_peered":"2023-11-27T20:54:27.505122+0000","last_unstale":"2023-11-27T21:21:49.495390+0000","last_undegraded":"2023-11-27T21:21:49.495390+0000","last_fullsized":"2023-11-27T21:21:49.495390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"28'74","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.479351+0000","last_change":"2023-11-27T20:54:27.505531+0000","last_active":"2023-11-27T21:21:49.479351+0000","last_peered":"2023-11-27T21:21:49.479351+0000","last_clean":"2023-11-27T21:21:49.479351+0000","last_became_active":"2023-11-27T20:54:27.505236+0000","last_became_peered":"2023-11-27T20:54:27.505236+0000","last_unstale":"2023-11-27T21:21:49.479351+0000","last_undegraded":"2023-11-27T21:21:49.479351+0000","last_fullsized":"2023-11-27T21:21:49.479351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"28'79","reported_seq":110,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.495013+0000","last_change":"2023-11-27T20:54:27.515185+0000","last_active":"2023-11-27T21:21:49.495013+0000","last_peered":"2023-11-27T21:21:49.495013+0000","last_clean":"2023-11-27T21:21:49.495013+0000","last_became_active":"2023-11-27T20:54:27.514846+0000","last_became_peered":"2023-11-27T20:54:27.514846+0000","last_unstale":"2023-11-27T21:21:49.495013+0000","last_undegraded":"2023-11-27T21:21:49.495013+0000","last_fullsized":"2023-11-27T21:21:49.495013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":102,"num_write":4200,"num_write_kb":332069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5131,"ondisk_log_size":5131,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4855,"ondisk_log_size":4855,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":44272102,"num_objects":111,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":1673,"num_read_kb":1711,"num_write":16676,"num_write_kb":52124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":88793088,"data_stored":88544204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15189,"ondisk_log_size":15189,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509779,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95988,"kb_used_data":20396,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94275852,"statfs":{"total":96636764160,"available":96538472448,"internally_reserved":0,"allocated":20885504,"data_stored":20696148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.40200000000000002,"15min":0.40699999999999997},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.19900000000000001},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.95599999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46500000000000002,"15min":0.46400000000000002},"min":{"1min":0.30199999999999999,"5min":0.27500000000000002,"15min":0.24199999999999999},"max":{"1min":0.56399999999999995,"5min":0.58899999999999997,"15min":1.1819999999999999},"last":0.52700000000000002}]},{"osd":1,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.42899999999999999,"15min":0.432},"min":{"1min":0.27100000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.78300000000000003},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.40200000000000002,"15min":0.40600000000000003},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.247},"max":{"1min":0.59599999999999997,"5min":0.59899999999999998,"15min":1.2250000000000001},"last":0.34699999999999998}]},{"osd":2,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41599999999999998,"15min":0.40999999999999998},"min":{"1min":0.30399999999999999,"5min":0.27700000000000002,"15min":0.21199999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":1.2549999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.436,"15min":0.436},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.23899999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":1.2450000000000001},"last":0.44800000000000001}]},{"osd":3,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.438},"min":{"1min":0.307,"5min":0.307,"15min":0.26800000000000002},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.87},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.45600000000000002,"15min":0.44400000000000001},"min":{"1min":0.39100000000000001,"5min":0.34699999999999998,"15min":0.307},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":1.2090000000000001},"last":0.46600000000000003}]},{"osd":4,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.41199999999999998,"15min":0.39700000000000002},"min":{"1min":0.25900000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.80600000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.42699999999999999,"15min":0.41899999999999998},"min":{"1min":0.29499999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.64900000000000002,"5min":0.68100000000000005,"15min":0.92800000000000005},"last":0.47999999999999998}]},{"osd":5,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.41799999999999998,"15min":0.40400000000000003},"min":{"1min":0.33000000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.47899999999999998,"15min":0.45900000000000002},"min":{"1min":0.33900000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.77600000000000002},"last":0.498}]},{"osd":7,"last update":"Mon Nov 27 21:21:04 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47199999999999998,"15min":0.46700000000000003},"min":{"1min":0.371,"5min":0.26600000000000001,"15min":0.249},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.95599999999999996},"last":0.432},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.46600000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28199999999999997},"max":{"1min":0.79400000000000004,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.51600000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509779,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94852,"kb_used_data":19260,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94276988,"statfs":{"total":96636764160,"available":96539635712,"internally_reserved":0,"allocated":19722240,"data_stored":19520171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.41199999999999998,"15min":0.40600000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.216},"max":{"1min":0.57799999999999996,"5min":1.331,"15min":1.331},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42199999999999999,"15min":0.41799999999999998},"min":{"1min":0.318,"5min":0.27900000000000003,"15min":0.222},"max":{"1min":0.49199999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.443}]},{"osd":1,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41399999999999998,"15min":0.42399999999999999},"min":{"1min":0.307,"5min":0.224,"15min":0.221},"max":{"1min":0.56100000000000005,"5min":0.624,"15min":0.95999999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42399999999999999,"15min":0.41599999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.28599999999999998},"max":{"1min":0.59399999999999997,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.55200000000000005}]},{"osd":2,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42299999999999999,"15min":0.42999999999999999},"min":{"1min":0.309,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.94599999999999995},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.438,"15min":0.42799999999999999},"min":{"1min":0.33600000000000002,"5min":0.30599999999999999,"15min":0.29899999999999999},"max":{"1min":0.61599999999999999,"5min":1.359,"15min":1.359},"last":0.49399999999999999}]},{"osd":3,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.45500000000000002,"15min":0.45000000000000001},"min":{"1min":0.35999999999999999,"5min":0.32500000000000001,"15min":0.28899999999999998},"max":{"1min":0.59099999999999997,"5min":0.64500000000000002,"15min":0.93300000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.47599999999999998,"15min":0.46000000000000002},"min":{"1min":0.34000000000000002,"5min":0.32600000000000001,"15min":0.30199999999999999},"max":{"1min":0.54800000000000004,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":0.52300000000000002}]},{"osd":4,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.38400000000000001,"15min":0.379},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23100000000000001},"max":{"1min":0.65800000000000003,"5min":0.66300000000000003,"15min":0.69199999999999995},"last":0.31},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.40400000000000003,"15min":0.40300000000000002},"min":{"1min":0.29899999999999999,"5min":0.255,"15min":0.23200000000000001},"max":{"1min":0.61499999999999999,"5min":0.66800000000000004,"15min":0.70299999999999996},"last":0.25}]},{"osd":6,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.41099999999999998,"15min":0.40400000000000003},"min":{"1min":0.28299999999999997,"5min":0.27100000000000002,"15min":0.246},"max":{"1min":0.67600000000000005,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42899999999999999,"15min":0.42799999999999999},"min":{"1min":0.315,"5min":0.27100000000000002,"15min":0.23300000000000001},"max":{"1min":0.68600000000000005,"5min":0.69299999999999995,"15min":0.70399999999999996},"last":0.27300000000000002}]},{"osd":7,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.46400000000000002,"15min":0.45800000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.24199999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.49399999999999999,"15min":0.49099999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.751},"last":0.33000000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509780,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53560,"kb_used_data":8496,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318280,"statfs":{"total":96636764160,"available":96581918720,"internally_reserved":0,"allocated":8699904,"data_stored":8509387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32500000000000001,"15min":0.307},"min":{"1min":0.20899999999999999,"5min":0.19800000000000001,"15min":0.17899999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.307,"5min":0.32200000000000001,"15min":0.316},"min":{"1min":0.216,"5min":0.216,"15min":0.20200000000000001},"max":{"1min":0.45800000000000002,"5min":0.48299999999999998,"15min":0.61899999999999999},"last":0.314}]},{"osd":1,"last update":"Mon Nov 27 21:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36599999999999999,"15min":0.34499999999999997},"min":{"1min":0.23200000000000001,"5min":0.20599999999999999,"15min":0.192},"max":{"1min":0.50700000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.35899999999999999,"15min":0.34899999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.20899999999999999},"max":{"1min":0.51800000000000002,"5min":0.54400000000000004,"15min":0.751},"last":0.249}]},{"osd":3,"last update":"Mon Nov 27 21:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.36099999999999999,"15min":0.34499999999999997},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.224},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.41899999999999998,"15min":0.38900000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26100000000000001},"max":{"1min":0.61699999999999999,"5min":0.62,"15min":0.63700000000000001},"last":0.42299999999999999}]},{"osd":4,"last update":"Mon Nov 27 21:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.505,"15min":0.48599999999999999},"min":{"1min":0.32700000000000001,"5min":0.313,"15min":0.29499999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.48799999999999999,"15min":0.48299999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58599999999999997,"5min":0.78900000000000003,"15min":0.83299999999999996},"last":0.39900000000000002}]},{"osd":5,"last update":"Mon Nov 27 21:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48899999999999999,"15min":0.47799999999999998},"min":{"1min":0.34100000000000003,"5min":0.32800000000000001,"15min":0.30399999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52800000000000002,"15min":0.504},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.38700000000000001}]},{"osd":6,"last update":"Mon Nov 27 21:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51500000000000001,"15min":0.505},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34000000000000002},"max":{"1min":0.70099999999999996,"5min":0.81399999999999995,"15min":0.90900000000000003},"last":0.44},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.50700000000000001,"15min":0.495},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.316},"max":{"1min":0.753,"5min":0.753,"15min":0.76900000000000002},"last":0.40999999999999998}]},{"osd":7,"last update":"Mon Nov 27 21:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53600000000000003,"15min":0.52600000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36399999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52100000000000002,"15min":0.50700000000000001},"min":{"1min":0.373,"5min":0.36099999999999999,"15min":0.34000000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.92400000000000004},"last":0.496}]}]},{"osd":1,"up_from":15,"seq":64424509780,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42852,"kb_used_data":3356,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94328988,"statfs":{"total":96636764160,"available":96592883712,"internally_reserved":0,"allocated":3436544,"data_stored":3238767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30599999999999999,"15min":0.307},"min":{"1min":0.214,"5min":0.20599999999999999,"15min":0.17000000000000001},"max":{"1min":0.47899999999999998,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.311,"5min":0.311,"15min":0.30499999999999999},"min":{"1min":0.222,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.38600000000000001}]},{"osd":2,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.33000000000000002,"15min":0.309},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.188},"max":{"1min":0.54600000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.316},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.33800000000000002,"15min":0.34000000000000002},"min":{"1min":0.25900000000000001,"5min":0.22600000000000001,"15min":0.20499999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.371}]},{"osd":3,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.37,"15min":0.36599999999999999},"min":{"1min":0.27500000000000002,"5min":0.23899999999999999,"15min":0.23300000000000001},"max":{"1min":0.441,"5min":0.626,"15min":0.68200000000000005},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.377,"15min":0.36499999999999999},"min":{"1min":0.26800000000000002,"5min":0.24399999999999999,"15min":0.22600000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.433}]},{"osd":4,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45300000000000001,"15min":0.46999999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.26600000000000001},"max":{"1min":0.60299999999999998,"5min":0.70599999999999996,"15min":1.4510000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.47899999999999998,"15min":0.48399999999999999},"min":{"1min":0.34300000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.61799999999999999,"5min":0.84199999999999997,"15min":0.89900000000000002},"last":0.5}]},{"osd":5,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.35399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.64300000000000002,"5min":0.81799999999999995,"15min":0.82199999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.46999999999999997,"15min":0.49099999999999999},"min":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.29999999999999999},"max":{"1min":0.67600000000000005,"5min":0.70999999999999996,"15min":1.4119999999999999},"last":0.48399999999999999}]},{"osd":6,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.38200000000000001,"5min":0.36499999999999999,"15min":0.33600000000000002},"max":{"1min":0.72199999999999998,"5min":0.79800000000000004,"15min":0.92800000000000005},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.503,"15min":0.51700000000000002},"min":{"1min":0.36199999999999999,"5min":0.35899999999999999,"15min":0.34499999999999997},"max":{"1min":0.60299999999999998,"5min":0.86399999999999999,"15min":1.4239999999999999},"last":0.58599999999999997}]},{"osd":7,"last update":"Mon Nov 27 21:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.51900000000000002,"15min":0.52400000000000002},"min":{"1min":0.39900000000000002,"5min":0.371,"15min":0.33200000000000002},"max":{"1min":0.67600000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.51100000000000001,"15min":0.51600000000000001},"min":{"1min":0.39000000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.64200000000000002,"5min":0.83099999999999996,"15min":1.4399999999999999},"last":0.56899999999999995}]}]},{"osd":0,"up_from":15,"seq":64424509779,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76024,"kb_used_data":8752,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94295816,"statfs":{"total":96636764160,"available":96558915584,"internally_reserved":0,"allocated":8962048,"data_stored":8748777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.315,"15min":0.309},"min":{"1min":0.24199999999999999,"5min":0.20100000000000001,"15min":0.186},"max":{"1min":0.44800000000000001,"5min":0.54600000000000004,"15min":0.57799999999999996},"last":0.315},{"interface":"front","average":{"1min":0.28799999999999998,"5min":0.31,"15min":0.311},"min":{"1min":0.219,"5min":0.219,"15min":0.19},"max":{"1min":0.42299999999999999,"5min":0.503,"15min":0.69699999999999995},"last":0.33600000000000002}]},{"osd":2,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.34399999999999997,"15min":0.34100000000000003},"min":{"1min":0.223,"5min":0.223,"15min":0.189},"max":{"1min":0.48699999999999999,"5min":0.54300000000000004,"15min":0.59299999999999997},"last":0.38},{"interface":"front","average":{"1min":0.315,"5min":0.34999999999999998,"15min":0.34200000000000003},"min":{"1min":0.25900000000000001,"5min":0.223,"15min":0.19900000000000001},"max":{"1min":0.40100000000000002,"5min":0.55500000000000005,"15min":0.66900000000000004},"last":0.30299999999999999}]},{"osd":3,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.36099999999999999,"15min":0.34699999999999998},"min":{"1min":0.25600000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.44900000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39400000000000002,"15min":0.38100000000000001},"min":{"1min":0.25800000000000001,"5min":0.253,"15min":0.21099999999999999},"max":{"1min":0.58399999999999996,"5min":0.59699999999999998,"15min":0.61599999999999999},"last":0.42499999999999999}]},{"osd":4,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.44800000000000001,"15min":0.45900000000000002},"min":{"1min":0.32300000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":1.3009999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46899999999999997,"15min":0.47399999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.27200000000000002},"max":{"1min":0.56599999999999995,"5min":0.71199999999999997,"15min":1.1220000000000001},"last":0.48799999999999999}]},{"osd":5,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.50700000000000001,"15min":0.5},"min":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.32700000000000001},"max":{"1min":0.58499999999999996,"5min":0.81499999999999995,"15min":1.1930000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46600000000000003,"15min":0.46700000000000003},"min":{"1min":0.36099999999999999,"5min":0.35099999999999998,"15min":0.317},"max":{"1min":0.63700000000000001,"5min":0.753,"15min":1.3180000000000001},"last":0.40200000000000002}]},{"osd":6,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.31900000000000001},"max":{"1min":0.73099999999999998,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.52500000000000002,"15min":0.52200000000000002},"min":{"1min":0.41599999999999998,"5min":0.36799999999999999,"15min":0.34499999999999997},"max":{"1min":0.60899999999999999,"5min":0.85699999999999998,"15min":1.282},"last":0.54300000000000004}]},{"osd":7,"last update":"Mon Nov 27 21:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.33500000000000002},"max":{"1min":0.65200000000000002,"5min":0.89300000000000002,"15min":1.171},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48899999999999999,"15min":0.498},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":1.2589999999999999},"last":0.41899999999999998}]}]},{"osd":7,"up_from":14,"seq":60129542484,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52808,"kb_used_data":7744,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94319032,"statfs":{"total":96636764160,"available":96582688768,"internally_reserved":0,"allocated":7929856,"data_stored":7711066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":46135755},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.40699999999999997,"15min":0.40200000000000002},"min":{"1min":0.25700000000000001,"5min":0.25,"15min":0.21199999999999999},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.82899999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41499999999999998,"15min":0.42599999999999999},"min":{"1min":0.29999999999999999,"5min":0.27000000000000002,"15min":0.22900000000000001},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.61399999999999999},"last":0.44}]},{"osd":1,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.436,"15min":0.432},"min":{"1min":0.32500000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.88500000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.44600000000000001,"15min":0.45300000000000001},"min":{"1min":0.32800000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.873},"last":0.52600000000000002}]},{"osd":2,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.42099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28100000000000003},"max":{"1min":0.51800000000000002,"5min":0.65300000000000002,"15min":0.79700000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41499999999999998,"15min":0.41899999999999998},"min":{"1min":0.34899999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.501,"5min":0.55200000000000005,"15min":0.68700000000000006},"last":0.47299999999999998}]},{"osd":3,"last update":"Mon Nov 27 21:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.433,"15min":0.44400000000000001},"min":{"1min":0.318,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.61499999999999999,"5min":0.68700000000000006,"15min":0.77100000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46000000000000002,"15min":0.45100000000000001},"min":{"1min":0.33000000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.61499999999999999,"5min":0.68600000000000005,"15min":0.90200000000000002},"last":0.502}]},{"osd":4,"last update":"Mon Nov 27 21:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.38500000000000001,"15min":0.39600000000000002},"min":{"1min":0.26000000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.47299999999999998,"5min":0.59199999999999997,"15min":0.66600000000000004},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.42299999999999999,"15min":0.41999999999999998},"min":{"1min":0.29499999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61699999999999999,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.36499999999999999}]},{"osd":5,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.45100000000000001,"15min":0.44},"min":{"1min":0.28299999999999997,"5min":0.27700000000000002,"15min":0.27300000000000002},"max":{"1min":0.75,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.42799999999999999,"15min":0.44},"min":{"1min":0.27900000000000003,"5min":0.26400000000000001,"15min":0.248},"max":{"1min":0.50700000000000001,"5min":0.71499999999999997,"15min":0.77700000000000002},"last":0.40899999999999997}]},{"osd":6,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.26600000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.56999999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49399999999999999},"min":{"1min":0.33600000000000002,"5min":0.29099999999999998,"15min":0.28100000000000003},"max":{"1min":0.69199999999999995,"5min":0.751,"15min":0.84999999999999998},"last":0.51500000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542484,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57800,"kb_used_data":8576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94314040,"statfs":{"total":96636764160,"available":96577576960,"internally_reserved":0,"allocated":8781824,"data_stored":8552244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41499999999999998,"15min":0.40600000000000003},"min":{"1min":0.27900000000000003,"5min":0.248,"15min":0.20200000000000001},"max":{"1min":0.58599999999999997,"5min":0.59299999999999997,"15min":0.66100000000000003},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44700000000000001,"15min":0.435},"min":{"1min":0.29399999999999998,"5min":0.28299999999999997,"15min":0.24099999999999999},"max":{"1min":0.60499999999999998,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.54500000000000004}]},{"osd":1,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.41499999999999998,"15min":0.41699999999999998},"min":{"1min":0.309,"5min":0.30199999999999999,"15min":0.24099999999999999},"max":{"1min":0.52800000000000002,"5min":0.626,"15min":0.65100000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42599999999999999,"15min":0.41599999999999998},"min":{"1min":0.33800000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.50600000000000001,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.47099999999999997}]},{"osd":2,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.42599999999999999,"15min":0.42699999999999999},"min":{"1min":0.34000000000000002,"5min":0.29499999999999998,"15min":0.26100000000000001},"max":{"1min":0.622,"5min":0.64300000000000002,"15min":0.745},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.434,"5min":0.441,"15min":0.44600000000000001},"min":{"1min":0.307,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":0.51700000000000002,"5min":0.65200000000000002,"15min":0.78100000000000003},"last":0.38500000000000001}]},{"osd":3,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.47799999999999998,"15min":0.46800000000000003},"min":{"1min":0.38800000000000001,"5min":0.318,"15min":0.29899999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.79200000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46200000000000002,"15min":0.45500000000000002},"min":{"1min":0.35799999999999998,"5min":0.32600000000000001,"15min":0.28499999999999998},"max":{"1min":0.55100000000000005,"5min":0.63400000000000001,"15min":0.68500000000000005},"last":0.442}]},{"osd":5,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41499999999999998,"15min":0.39400000000000002},"min":{"1min":0.26300000000000001,"5min":0.23100000000000001,"15min":0.221},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40799999999999997,"15min":0.41199999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23100000000000001},"max":{"1min":0.55400000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.51100000000000001}]},{"osd":6,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.42999999999999999,"15min":0.41799999999999998},"min":{"1min":0.29899999999999999,"5min":0.26800000000000002,"15min":0.24399999999999999},"max":{"1min":0.60599999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.48999999999999999,"15min":0.46800000000000003},"min":{"1min":0.35099999999999998,"5min":0.28100000000000003,"15min":0.27400000000000002},"max":{"1min":0.66000000000000003,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.52900000000000003}]},{"osd":7,"last update":"Mon Nov 27 21:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46200000000000002,"15min":0.45500000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.64300000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.502},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.434,"5min":0.35199999999999998,"15min":0.33400000000000002},"max":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.58199999999999996}]}]},{"osd":3,"up_from":14,"seq":60129542484,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89188,"kb_used_data":13596,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94282652,"statfs":{"total":96636764160,"available":96545435648,"internally_reserved":0,"allocated":13922304,"data_stored":13708692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.311,"15min":0.312},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.47899999999999998,"5min":0.52400000000000002,"15min":0.56499999999999995},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.31,"15min":0.307},"min":{"1min":0.21099999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.56999999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.311}]},{"osd":1,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.29499999999999998,"5min":0.30099999999999999,"15min":0.309},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.39300000000000002,"5min":0.45800000000000002,"15min":1.0249999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.35899999999999999,"15min":0.34999999999999998},"min":{"1min":0.23999999999999999,"5min":0.23000000000000001,"15min":0.21199999999999999},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":1.0069999999999999},"last":0.41999999999999998}]},{"osd":2,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36699999999999999,"15min":0.36799999999999999},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.22600000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":1.046},"last":0.377},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.371},"min":{"1min":0.27700000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.59899999999999998,"5min":0.623,"15min":0.69999999999999996},"last":0.38600000000000001}]},{"osd":4,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45200000000000001,"15min":0.46200000000000002},"min":{"1min":0.35099999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.59099999999999997,"5min":0.69799999999999995,"15min":0.93799999999999994},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.47599999999999998,"15min":0.48399999999999999},"min":{"1min":0.39400000000000002,"5min":0.34499999999999997,"15min":0.314},"max":{"1min":0.65900000000000003,"5min":0.71199999999999997,"15min":0.73999999999999999},"last":0.72499999999999998}]},{"osd":5,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48399999999999999,"15min":0.48599999999999999},"min":{"1min":0.42099999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.71499999999999997,"5min":0.75,"15min":0.75},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.495,"15min":0.50600000000000001},"min":{"1min":0.373,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67900000000000005,"5min":0.78600000000000003,"15min":1.071},"last":0.71399999999999997}]},{"osd":6,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.495,"15min":0.504},"min":{"1min":0.39100000000000001,"5min":0.36599999999999999,"15min":0.311},"max":{"1min":0.61299999999999999,"5min":0.65400000000000003,"15min":0.97899999999999998},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.49199999999999999,"15min":0.5},"min":{"1min":0.35999999999999999,"5min":0.35599999999999998,"15min":0.314},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.66100000000000003}]},{"osd":7,"last update":"Mon Nov 27 21:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51500000000000001,"15min":0.52200000000000002},"min":{"1min":0.40699999999999997,"5min":0.36099999999999999,"15min":0.35999999999999999},"max":{"1min":0.66800000000000004,"5min":0.75800000000000001,"15min":1.0900000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51900000000000002,"15min":0.52200000000000002},"min":{"1min":0.42199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68999999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.64000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8667136,"data_stored":8628738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2547712,"data_stored":2528360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13627392,"data_stored":13588653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8486912,"data_stored":8432205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18833408,"data_stored":18809764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20590592,"data_stored":20576109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7634944,"data_stored":7591027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T21:22:05.686 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.686 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.686 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.686 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.687 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.687 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.687 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.687 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.687 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.687 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.687 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.687 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.687 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.688 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.688 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.688 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.688 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.688 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.688 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.688 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.688 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.689 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.689 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.689 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.689 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.689 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.689 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.689 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.689 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.689 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.690 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.690 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.690 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.690 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.690 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.690 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.690 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.690 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.691 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.691 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.691 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.691 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.691 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.691 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.691 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.691 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.691 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.692 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.692 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.692 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.692 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.692 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.692 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.692 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.692 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.693 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.693 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.693 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.693 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.693 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.693 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.693 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.693 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.694 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.694 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.694 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.694 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.694 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.694 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.694 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.694 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.695 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.695 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.695 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.695 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.695 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.695 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.695 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.696 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.696 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.696 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.696 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.696 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.696 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.696 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.696 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.697 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.697 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.697 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.697 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.697 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.697 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.697 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.697 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.697 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.698 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.698 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.698 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.698 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.698 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.698 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.698 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.698 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.699 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.699 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.699 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.699 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.699 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.699 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.699 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.699 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.699 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.700 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.700 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.700 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.700 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.700 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.700 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.700 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.700 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.700 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.701 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.701 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.701 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:05.701 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-27T21:22:09.730 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:22:09.733 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:22:25.702 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T21:22:25.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.808+0000 7f23f709b640 1 Processor -- start 2023-11-27T21:22:25.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.808+0000 7f23f709b640 1 -- start start 2023-11-27T21:22:25.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.809+0000 7f23f709b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23f0153620 0x7f23f00723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:25.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.809+0000 7f23f709b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f006fe60 con 0x7f23f006f1d0 2023-11-27T21:22:25.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.809+0000 7f23f709b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f01597d0 con 0x7f23f00c8370 2023-11-27T21:22:25.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.809+0000 7f23f709b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f00c2e00 con 0x7f23f0153620 2023-11-27T21:22:25.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.849+0000 7f23effff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f23f006f1d0 0x7f23f0159c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45658/0 (socket says 172.21.15.88:45658) 2023-11-27T21:22:25.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.849+0000 7f23effff640 1 -- 172.21.15.88:0/1055283411 learned_addr learned my addr 172.21.15.88:0/1055283411 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:22:25.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.851+0000 7f23ef7fe640 1 -- 172.21.15.88:0/1055283411 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150382182 0 0) 0x7f23f006fe60 con 0x7f23f006f1d0 2023-11-27T21:22:25.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.851+0000 7f23ef7fe640 1 -- 172.21.15.88:0/1055283411 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23e0003520 con 0x7f23f006f1d0 2023-11-27T21:22:25.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.855+0000 7f23ef7fe640 1 -- 172.21.15.88:0/1055283411 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2823526291 0 0) 0x7f23e0003520 con 0x7f23f006f1d0 2023-11-27T21:22:25.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.855+0000 7f23ef7fe640 1 -- 172.21.15.88:0/1055283411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23f0153620 msgr2=0x7f23f00723f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:22:25.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.855+0000 7f23ef7fe640 1 --2- 172.21.15.88:0/1055283411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23f0153620 0x7f23f00723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:25.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.855+0000 7f23ef7fe640 1 -- 172.21.15.88:0/1055283411 >> v1:172.21.15.167:6789/0 conn(0x7f23f00c8370 legacy=0x7f23f0163da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:22:25.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.855+0000 7f23ef7fe640 1 -- 172.21.15.88:0/1055283411 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f015a370 con 0x7f23f006f1d0 2023-11-27T21:22:25.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.855+0000 7f23ef7fe640 1 -- 172.21.15.88:0/1055283411 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1067350109 0 0) 0x7f23dc001670 con 0x7f23f006f1d0 2023-11-27T21:22:25.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.855+0000 7f23ef7fe640 1 -- 172.21.15.88:0/1055283411 >> v1:172.21.15.88:6789/0 conn(0x7f23f006f1d0 legacy=0x7f23f0159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:25.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.855+0000 7f23ef7fe640 1 --2- 172.21.15.88:0/1055283411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23f0153620 0x7f23e0003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:25.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.855+0000 7f23ef7fe640 1 --2- 172.21.15.88:0/1055283411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23e0004150 0x7f23e00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:25.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.855+0000 7f23ef7fe640 1 --2- 172.21.15.88:0/1055283411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23e0004e20 0x7f23e000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:25.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.855+0000 7f23ef7fe640 1 -- 172.21.15.88:0/1055283411 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f00c2e00 con 0x7f23e0004150 2023-11-27T21:22:25.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.855+0000 7f23ef7fe640 1 -- 172.21.15.88:0/1055283411 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e0005640 con 0x7f23e0004e20 2023-11-27T21:22:25.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.855+0000 7f23ef7fe640 1 -- 172.21.15.88:0/1055283411 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e000bef0 con 0x7f23f0153620 2023-11-27T21:22:25.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.857+0000 7f23effff640 1 --2- 172.21.15.88:0/1055283411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23e0004150 0x7f23e00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:25.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.861+0000 7f23effff640 1 -- 172.21.15.88:0/1055283411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23f0153620 msgr2=0x7f23e0003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:22:25.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.861+0000 7f23effff640 1 --2- 172.21.15.88:0/1055283411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23f0153620 0x7f23e0003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:25.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.861+0000 7f23effff640 1 -- 172.21.15.88:0/1055283411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23e0004e20 msgr2=0x7f23e000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:22:25.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.861+0000 7f23effff640 1 --2- 172.21.15.88:0/1055283411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23e0004e20 0x7f23e000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:25.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.861+0000 7f23effff640 1 -- 172.21.15.88:0/1055283411 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e0003520 con 0x7f23e0004150 2023-11-27T21:22:25.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.863+0000 7f23effff640 1 --2- 172.21.15.88:0/1055283411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23e0004150 0x7f23e00047c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f23dc00c0e0 tx=0x7f23e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152e4ebd51ae12a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:25.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.868+0000 7f23ef7fe640 1 -- 172.21.15.88:0/1055283411 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc005ad0 con 0x7f23e0004150 2023-11-27T21:22:25.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.868+0000 7f23ef7fe640 1 -- 172.21.15.88:0/1055283411 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23dc005c30 con 0x7f23e0004150 2023-11-27T21:22:25.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.868+0000 7f23ef7fe640 1 -- 172.21.15.88:0/1055283411 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc02ca10 con 0x7f23e0004150 2023-11-27T21:22:25.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.869+0000 7f23f709b640 1 -- 172.21.15.88:0/1055283411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23e0004150 msgr2=0x7f23e00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:25.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.869+0000 7f23f709b640 1 --2- 172.21.15.88:0/1055283411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23e0004150 0x7f23e00047c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f23dc00c0e0 tx=0x7f23e00057f0 comp rx=0 tx=0).stop 2023-11-27T21:22:25.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.869+0000 7f23f5638640 1 -- 172.21.15.88:0/1055283411 reap_dead start 2023-11-27T21:22:25.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.869+0000 7f23f709b640 1 -- 172.21.15.88:0/1055283411 shutdown_connections 2023-11-27T21:22:25.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.869+0000 7f23f709b640 1 -- 172.21.15.88:0/1055283411 >> 172.21.15.88:0/1055283411 conn(0x7f23f006b5c0 msgr2=0x7f23f006b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:25.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.869+0000 7f23f709b640 1 -- 172.21.15.88:0/1055283411 shutdown_connections 2023-11-27T21:22:25.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.869+0000 7f23f709b640 1 -- 172.21.15.88:0/1055283411 wait complete. 2023-11-27T21:22:25.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.870+0000 7f23f709b640 1 Processor -- start 2023-11-27T21:22:25.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.870+0000 7f23f709b640 1 -- start start 2023-11-27T21:22:25.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.871+0000 7f23f709b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23e0004150 0x7f23f01f2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:25.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.871+0000 7f23f709b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23f015c810 0x7f23f0142360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:25.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.871+0000 7f23f709b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23f014a6c0 0x7f23f01eefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:25.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.871+0000 7f23f709b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f00cb000 con 0x7f23f014a6c0 2023-11-27T21:22:25.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.871+0000 7f23f709b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f014bd70 con 0x7f23f015c810 2023-11-27T21:22:25.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.871+0000 7f23f709b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f00caca0 con 0x7f23e0004150 2023-11-27T21:22:25.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.872+0000 7f23effff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23f015c810 0x7f23f0142360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:25.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.872+0000 7f23f4e37640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23e0004150 0x7f23f01f2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:25.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.872+0000 7f23effff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23f015c810 0x7f23f0142360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:40972/0 (socket says 172.21.15.88:40972) 2023-11-27T21:22:25.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.872+0000 7f23effff640 1 -- 172.21.15.88:0/2619233085 learned_addr learned my addr 172.21.15.88:0/2619233085 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:22:25.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.873+0000 7f23f5638640 1 --2- 172.21.15.88:0/2619233085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23f014a6c0 0x7f23f01eefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:25.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.876+0000 7f23f4e37640 1 -- 172.21.15.88:0/2619233085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23f015c810 msgr2=0x7f23f0142360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:25.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.876+0000 7f23f4e37640 1 --2- 172.21.15.88:0/2619233085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23f015c810 0x7f23f0142360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:25.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.876+0000 7f23f4e37640 1 -- 172.21.15.88:0/2619233085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23f014a6c0 msgr2=0x7f23f01eefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:25.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.876+0000 7f23f4e37640 1 --2- 172.21.15.88:0/2619233085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23f014a6c0 0x7f23f01eefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:25.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.876+0000 7f23f4e37640 1 -- 172.21.15.88:0/2619233085 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f014b580 con 0x7f23e0004150 2023-11-27T21:22:25.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.879+0000 7f23f4e37640 1 --2- 172.21.15.88:0/2619233085 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23e0004150 0x7f23f01f2f20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f23e400b410 tx=0x7f23e400b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:25.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.882+0000 7f23ed7fa640 1 -- 172.21.15.88:0/2619233085 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e4011830 con 0x7f23e0004150 2023-11-27T21:22:25.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.883+0000 7f23ed7fa640 1 -- 172.21.15.88:0/2619233085 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e4011990 con 0x7f23e0004150 2023-11-27T21:22:25.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.883+0000 7f23ed7fa640 1 -- 172.21.15.88:0/2619233085 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e4011d40 con 0x7f23e0004150 2023-11-27T21:22:25.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.883+0000 7f23f709b640 1 -- 172.21.15.88:0/2619233085 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f015a9a0 con 0x7f23e0004150 2023-11-27T21:22:25.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.883+0000 7f23f709b640 1 -- 172.21.15.88:0/2619233085 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f014ba90 con 0x7f23e0004150 2023-11-27T21:22:25.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:25.884+0000 7f23f709b640 1 -- 172.21.15.88:0/2619233085 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f0073dc0 con 0x7f23e0004150 2023-11-27T21:22:26.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:26.133+0000 7f23ed7fa640 1 -- 172.21.15.88:0/2619233085 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f23e401a400 con 0x7f23e0004150 2023-11-27T21:22:26.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:26.133+0000 7f23ed7fa640 1 --2- 172.21.15.88:0/2619233085 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f23d406b1c0 0x7f23d406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:26.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:26.134+0000 7f23effff640 1 --2- 172.21.15.88:0/2619233085 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f23d406b1c0 0x7f23d406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:26.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:26.134+0000 7f23effff640 1 --2- 172.21.15.88:0/2619233085 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f23d406b1c0 0x7f23d406d680 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f23f0142d60 tx=0x7f23dc009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:26.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:26.137+0000 7f23ed7fa640 1 -- 172.21.15.88:0/2619233085 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f23e4059290 con 0x7f23e0004150 2023-11-27T21:22:26.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:26.148+0000 7f23ed7fa640 1 -- 172.21.15.88:0/2619233085 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f23e4054ed0 con 0x7f23e0004150 2023-11-27T21:22:26.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:26.315+0000 7f23f709b640 1 -- 172.21.15.88:0/2619233085 --> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f23f015cf00 con 0x7f23d406b1c0 2023-11-27T21:22:26.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:26.325+0000 7f23ed7fa640 1 -- 172.21.15.88:0/2619233085 <== mgr.4105 v2:172.21.15.88:6800/352455703 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369236 (secure 0 0 0) 0x7f23f015cf00 con 0x7f23d406b1c0 2023-11-27T21:22:26.330 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T21:22:26.332 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-11-27T21:22:26.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:26.328+0000 7f23f709b640 1 -- 172.21.15.88:0/2619233085 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f23d406b1c0 msgr2=0x7f23d406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:26.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:26.328+0000 7f23f709b640 1 --2- 172.21.15.88:0/2619233085 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f23d406b1c0 0x7f23d406d680 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f23f0142d60 tx=0x7f23dc009030 comp rx=0 tx=0).stop 2023-11-27T21:22:26.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:26.328+0000 7f23f709b640 1 -- 172.21.15.88:0/2619233085 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23e0004150 msgr2=0x7f23f01f2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:26.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:26.328+0000 7f23f709b640 1 --2- 172.21.15.88:0/2619233085 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23e0004150 0x7f23f01f2f20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f23e400b410 tx=0x7f23e400b8d0 comp rx=0 tx=0).stop 2023-11-27T21:22:26.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:26.328+0000 7f23f709b640 1 -- 172.21.15.88:0/2619233085 shutdown_connections 2023-11-27T21:22:26.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:26.328+0000 7f23f709b640 1 --2- 172.21.15.88:0/2619233085 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f23d406b1c0 0x7f23d406d680 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:26.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:26.328+0000 7f23f709b640 1 --2- 172.21.15.88:0/2619233085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23f014a6c0 0x7f23f01eefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:26.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:26.328+0000 7f23f709b640 1 --2- 172.21.15.88:0/2619233085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23f015c810 0x7f23f0142360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:26.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:26.328+0000 7f23f709b640 1 --2- 172.21.15.88:0/2619233085 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23e0004150 0x7f23f01f2f20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:26.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:26.328+0000 7f23f709b640 1 -- 172.21.15.88:0/2619233085 >> 172.21.15.88:0/2619233085 conn(0x7f23f006b5c0 msgr2=0x7f23f006f660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:26.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:26.328+0000 7f23f709b640 1 -- 172.21.15.88:0/2619233085 shutdown_connections 2023-11-27T21:22:26.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:26.328+0000 7f23f709b640 1 -- 172.21.15.88:0/2619233085 wait complete. 2023-11-27T21:22:26.341 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":871,"stamp":"2023-11-27T21:22:25.273458+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":44862470,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":1793,"num_read_kb":1913,"num_write":21035,"num_write_kb":386609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20000,"num_omap_keys":40,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25349,"ondisk_log_size":25349,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":567232,"kb_used_data":90176,"kb_used_omap":12,"kb_used_meta":476979,"kb_avail":754407488,"statfs":{"total":773094113280,"available":772513267712,"internally_reserved":0,"allocated":92340224,"data_stored":90685252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":488427057},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003031"},"pg_stats":[{"pgid":"2.1f","version":"28'339","reported_seq":379,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.533002+0000","last_change":"2023-11-27T21:22:21.533049+0000","last_active":"2023-11-27T21:22:21.533002+0000","last_peered":"2023-11-27T21:22:21.533002+0000","last_clean":"2023-11-27T21:22:21.533002+0000","last_became_active":"2023-11-27T20:54:26.221715+0000","last_became_peered":"2023-11-27T20:54:26.221715+0000","last_unstale":"2023-11-27T21:22:21.533002+0000","last_undegraded":"2023-11-27T21:22:21.533002+0000","last_fullsized":"2023-11-27T21:22:21.533002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'339","last_scrub_stamp":"2023-11-27T21:22:21.532905+0000","last_deep_scrub":"28'339","last_deep_scrub_stamp":"2023-11-27T21:22:21.532905+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.532905+0000","objects_scrubbed":7,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:03:03.041969+0000","scrub_duration":0.0081144100000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922212,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":1068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"28'71","reported_seq":102,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.479421+0000","last_change":"2023-11-27T20:54:27.508401+0000","last_active":"2023-11-27T21:21:49.479421+0000","last_peered":"2023-11-27T21:21:49.479421+0000","last_clean":"2023-11-27T21:21:49.479421+0000","last_became_active":"2023-11-27T20:54:27.508003+0000","last_became_peered":"2023-11-27T20:54:27.508003+0000","last_unstale":"2023-11-27T21:21:49.479421+0000","last_undegraded":"2023-11-27T21:21:49.479421+0000","last_fullsized":"2023-11-27T21:21:49.479421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"28'159","reported_seq":186,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:14.998937+0000","last_change":"2023-11-27T20:54:31.837226+0000","last_active":"2023-11-27T21:21:14.998937+0000","last_peered":"2023-11-27T21:21:14.998937+0000","last_clean":"2023-11-27T21:21:14.998937+0000","last_became_active":"2023-11-27T20:54:31.836803+0000","last_became_peered":"2023-11-27T20:54:31.836803+0000","last_unstale":"2023-11-27T21:21:14.998937+0000","last_undegraded":"2023-11-27T21:21:14.998937+0000","last_fullsized":"2023-11-27T21:21:14.998937+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":7710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'738","reported_seq":770,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:33.524136+0000","last_change":"2023-11-27T20:54:26.227906+0000","last_active":"2023-11-27T21:21:33.524136+0000","last_peered":"2023-11-27T21:21:33.524136+0000","last_clean":"2023-11-27T21:21:33.524136+0000","last_became_active":"2023-11-27T20:54:26.227620+0000","last_became_peered":"2023-11-27T20:54:26.227620+0000","last_unstale":"2023-11-27T21:21:33.524136+0000","last_undegraded":"2023-11-27T21:21:33.524136+0000","last_fullsized":"2023-11-27T21:21:33.524136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":733,"num_write_kb":4484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"28'77","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.476188+0000","last_change":"2023-11-27T20:54:27.507740+0000","last_active":"2023-11-27T21:21:49.476188+0000","last_peered":"2023-11-27T21:21:49.476188+0000","last_clean":"2023-11-27T21:21:49.476188+0000","last_became_active":"2023-11-27T20:54:27.507460+0000","last_became_peered":"2023-11-27T20:54:27.507460+0000","last_unstale":"2023-11-27T21:21:49.476188+0000","last_undegraded":"2023-11-27T21:21:49.476188+0000","last_fullsized":"2023-11-27T21:21:49.476188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"28'166","reported_seq":210,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:20.702787+0000","last_change":"2023-11-27T21:22:20.702834+0000","last_active":"2023-11-27T21:22:20.702787+0000","last_peered":"2023-11-27T21:22:20.702787+0000","last_clean":"2023-11-27T21:22:20.702787+0000","last_became_active":"2023-11-27T20:55:00.593543+0000","last_became_peered":"2023-11-27T20:55:00.593543+0000","last_unstale":"2023-11-27T21:22:20.702787+0000","last_undegraded":"2023-11-27T21:22:20.702787+0000","last_fullsized":"2023-11-27T21:22:20.702787+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'166","last_scrub_stamp":"2023-11-27T21:22:20.702707+0000","last_deep_scrub":"28'166","last_deep_scrub_stamp":"2023-11-27T21:22:20.702707+0000","last_clean_scrub_stamp":"2023-11-27T21:22:20.702707+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:34.996116+0000","scrub_duration":0.0026403020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":12743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"28'187","reported_seq":225,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:18.415812+0000","last_change":"2023-11-27T21:22:18.415839+0000","last_active":"2023-11-27T21:22:18.415812+0000","last_peered":"2023-11-27T21:22:18.415812+0000","last_clean":"2023-11-27T21:22:18.415812+0000","last_became_active":"2023-11-27T20:54:26.226407+0000","last_became_peered":"2023-11-27T20:54:26.226407+0000","last_unstale":"2023-11-27T21:22:18.415812+0000","last_undegraded":"2023-11-27T21:22:18.415812+0000","last_fullsized":"2023-11-27T21:22:18.415812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'187","last_scrub_stamp":"2023-11-27T21:22:18.415750+0000","last_deep_scrub":"28'187","last_deep_scrub_stamp":"2023-11-27T21:22:18.415750+0000","last_clean_scrub_stamp":"2023-11-27T21:22:18.415750+0000","objects_scrubbed":7,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:09.265948+0000","scrub_duration":0.0049688789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'78","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:19.383288+0000","last_change":"2023-11-27T21:22:19.383307+0000","last_active":"2023-11-27T21:22:19.383288+0000","last_peered":"2023-11-27T21:22:19.383288+0000","last_clean":"2023-11-27T21:22:19.383288+0000","last_became_active":"2023-11-27T20:54:27.512548+0000","last_became_peered":"2023-11-27T20:54:27.512548+0000","last_unstale":"2023-11-27T21:22:19.383288+0000","last_undegraded":"2023-11-27T21:22:19.383288+0000","last_fullsized":"2023-11-27T21:22:19.383288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'78","last_scrub_stamp":"2023-11-27T21:22:19.383221+0000","last_deep_scrub":"28'78","last_deep_scrub_stamp":"2023-11-27T21:22:19.383221+0000","last_clean_scrub_stamp":"2023-11-27T21:22:19.383221+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:56:13.237697+0000","scrub_duration":0.0011829830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"28'164","reported_seq":191,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:01.203495+0000","last_change":"2023-11-27T20:54:31.828391+0000","last_active":"2023-11-27T21:22:01.203495+0000","last_peered":"2023-11-27T21:22:01.203495+0000","last_clean":"2023-11-27T21:22:01.203495+0000","last_became_active":"2023-11-27T20:54:31.828045+0000","last_became_peered":"2023-11-27T20:54:31.828045+0000","last_unstale":"2023-11-27T21:22:01.203495+0000","last_undegraded":"2023-11-27T21:22:01.203495+0000","last_fullsized":"2023-11-27T21:22:01.203495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":12089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"28'9","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:59.305350+0000","last_change":"2023-11-27T20:54:26.226762+0000","last_active":"2023-11-27T21:21:59.305350+0000","last_peered":"2023-11-27T21:21:59.305350+0000","last_clean":"2023-11-27T21:21:59.305350+0000","last_became_active":"2023-11-27T20:54:26.226522+0000","last_became_peered":"2023-11-27T20:54:26.226522+0000","last_unstale":"2023-11-27T21:21:59.305350+0000","last_undegraded":"2023-11-27T21:21:59.305350+0000","last_fullsized":"2023-11-27T21:21:59.305350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"28'85","reported_seq":121,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:57.961750+0000","last_change":"2023-11-27T20:55:00.790042+0000","last_active":"2023-11-27T21:21:57.961750+0000","last_peered":"2023-11-27T21:21:57.961750+0000","last_clean":"2023-11-27T21:21:57.961750+0000","last_became_active":"2023-11-27T20:55:00.789772+0000","last_became_peered":"2023-11-27T20:55:00.789772+0000","last_unstale":"2023-11-27T21:21:57.961750+0000","last_undegraded":"2023-11-27T21:21:57.961750+0000","last_fullsized":"2023-11-27T21:21:57.961750+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"28'169","reported_seq":204,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.736963+0000","last_change":"2023-11-27T21:22:21.736983+0000","last_active":"2023-11-27T21:22:21.736963+0000","last_peered":"2023-11-27T21:22:21.736963+0000","last_clean":"2023-11-27T21:22:21.736963+0000","last_became_active":"2023-11-27T20:54:31.828371+0000","last_became_peered":"2023-11-27T20:54:31.828371+0000","last_unstale":"2023-11-27T21:22:21.736963+0000","last_undegraded":"2023-11-27T21:22:21.736963+0000","last_fullsized":"2023-11-27T21:22:21.736963+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'169","last_scrub_stamp":"2023-11-27T21:22:21.736882+0000","last_deep_scrub":"28'169","last_deep_scrub_stamp":"2023-11-27T21:22:21.736882+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.736882+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:39:05.705679+0000","scrub_duration":0.0027207239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":6774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"28'74","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.445372+0000","last_change":"2023-11-27T20:54:27.498572+0000","last_active":"2023-11-27T21:21:49.445372+0000","last_peered":"2023-11-27T21:21:49.445372+0000","last_clean":"2023-11-27T21:21:49.445372+0000","last_became_active":"2023-11-27T20:54:27.498279+0000","last_became_peered":"2023-11-27T20:54:27.498279+0000","last_unstale":"2023-11-27T21:21:49.445372+0000","last_undegraded":"2023-11-27T21:21:49.445372+0000","last_fullsized":"2023-11-27T21:21:49.445372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'1121","reported_seq":1152,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:38.067554+0000","last_change":"2023-11-27T20:54:26.227734+0000","last_active":"2023-11-27T21:21:38.067554+0000","last_peered":"2023-11-27T21:21:38.067554+0000","last_clean":"2023-11-27T21:21:38.067554+0000","last_became_active":"2023-11-27T20:54:26.227503+0000","last_became_peered":"2023-11-27T20:54:26.227503+0000","last_unstale":"2023-11-27T21:21:38.067554+0000","last_undegraded":"2023-11-27T21:21:38.067554+0000","last_fullsized":"2023-11-27T21:21:38.067554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1121,"log_dups_size":0,"ondisk_log_size":1121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1114,"num_write_kb":4562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"28'173","reported_seq":201,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:32.958848+0000","last_change":"2023-11-27T20:54:31.827976+0000","last_active":"2023-11-27T21:21:32.958848+0000","last_peered":"2023-11-27T21:21:32.958848+0000","last_clean":"2023-11-27T21:21:32.958848+0000","last_became_active":"2023-11-27T20:54:31.827631+0000","last_became_peered":"2023-11-27T20:54:31.827631+0000","last_unstale":"2023-11-27T21:21:32.958848+0000","last_undegraded":"2023-11-27T21:21:32.958848+0000","last_fullsized":"2023-11-27T21:21:32.958848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":8292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"28'70","reported_seq":99,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.390739+0000","last_change":"2023-11-27T20:54:27.510917+0000","last_active":"2023-11-27T21:21:49.390739+0000","last_peered":"2023-11-27T21:21:49.390739+0000","last_clean":"2023-11-27T21:21:49.390739+0000","last_became_active":"2023-11-27T20:54:27.510668+0000","last_became_peered":"2023-11-27T20:54:27.510668+0000","last_unstale":"2023-11-27T21:21:49.390739+0000","last_undegraded":"2023-11-27T21:21:49.390739+0000","last_fullsized":"2023-11-27T21:21:49.390739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'447","reported_seq":486,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:11.006323+0000","last_change":"2023-11-27T21:22:11.006346+0000","last_active":"2023-11-27T21:22:11.006323+0000","last_peered":"2023-11-27T21:22:11.006323+0000","last_clean":"2023-11-27T21:22:11.006323+0000","last_became_active":"2023-11-27T20:54:26.231081+0000","last_became_peered":"2023-11-27T20:54:26.231081+0000","last_unstale":"2023-11-27T21:22:11.006323+0000","last_undegraded":"2023-11-27T21:22:11.006323+0000","last_fullsized":"2023-11-27T21:22:11.006323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'447","last_scrub_stamp":"2023-11-27T21:22:11.006247+0000","last_deep_scrub":"28'447","last_deep_scrub_stamp":"2023-11-27T21:22:11.006247+0000","last_clean_scrub_stamp":"2023-11-27T21:22:11.006247+0000","objects_scrubbed":2,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:24:18.182726+0000","scrub_duration":0.0020915840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"28'191","reported_seq":219,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:34.301255+0000","last_change":"2023-11-27T20:54:31.817058+0000","last_active":"2023-11-27T21:21:34.301255+0000","last_peered":"2023-11-27T21:21:34.301255+0000","last_clean":"2023-11-27T21:21:34.301255+0000","last_became_active":"2023-11-27T20:54:31.816700+0000","last_became_peered":"2023-11-27T20:54:31.816700+0000","last_unstale":"2023-11-27T21:21:34.301255+0000","last_undegraded":"2023-11-27T21:21:34.301255+0000","last_fullsized":"2023-11-27T21:21:34.301255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":12458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"28'73","reported_seq":103,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.481401+0000","last_change":"2023-11-27T20:54:27.510195+0000","last_active":"2023-11-27T21:21:49.481401+0000","last_peered":"2023-11-27T21:21:49.481401+0000","last_clean":"2023-11-27T21:21:49.481401+0000","last_became_active":"2023-11-27T20:54:27.509961+0000","last_became_peered":"2023-11-27T20:54:27.509961+0000","last_unstale":"2023-11-27T21:21:49.481401+0000","last_undegraded":"2023-11-27T21:21:49.481401+0000","last_fullsized":"2023-11-27T21:21:49.481401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'339","reported_seq":378,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:17.537751+0000","last_change":"2023-11-27T21:22:17.537795+0000","last_active":"2023-11-27T21:22:17.537751+0000","last_peered":"2023-11-27T21:22:17.537751+0000","last_clean":"2023-11-27T21:22:17.537751+0000","last_became_active":"2023-11-27T20:54:26.223717+0000","last_became_peered":"2023-11-27T20:54:26.223717+0000","last_unstale":"2023-11-27T21:22:17.537751+0000","last_undegraded":"2023-11-27T21:22:17.537751+0000","last_fullsized":"2023-11-27T21:22:17.537751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'339","last_scrub_stamp":"2023-11-27T21:22:17.537656+0000","last_deep_scrub":"28'339","last_deep_scrub_stamp":"2023-11-27T21:22:17.537656+0000","last_clean_scrub_stamp":"2023-11-27T21:22:17.537656+0000","objects_scrubbed":4,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:35:27.345606+0000","scrub_duration":0.0048066070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":333,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'146","reported_seq":174,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:33.086079+0000","last_change":"2023-11-27T20:54:31.836718+0000","last_active":"2023-11-27T21:21:33.086079+0000","last_peered":"2023-11-27T21:21:33.086079+0000","last_clean":"2023-11-27T21:21:33.086079+0000","last_became_active":"2023-11-27T20:54:31.836346+0000","last_became_peered":"2023-11-27T20:54:31.836346+0000","last_unstale":"2023-11-27T21:21:33.086079+0000","last_undegraded":"2023-11-27T21:21:33.086079+0000","last_fullsized":"2023-11-27T21:21:33.086079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":6504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'66","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:18.554491+0000","last_change":"2023-11-27T21:22:18.554510+0000","last_active":"2023-11-27T21:22:18.554491+0000","last_peered":"2023-11-27T21:22:18.554491+0000","last_clean":"2023-11-27T21:22:18.554491+0000","last_became_active":"2023-11-27T20:54:27.493327+0000","last_became_peered":"2023-11-27T20:54:27.493327+0000","last_unstale":"2023-11-27T21:22:18.554491+0000","last_undegraded":"2023-11-27T21:22:18.554491+0000","last_fullsized":"2023-11-27T21:22:18.554491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'66","last_scrub_stamp":"2023-11-27T21:22:18.554433+0000","last_deep_scrub":"28'66","last_deep_scrub_stamp":"2023-11-27T21:22:18.554433+0000","last_clean_scrub_stamp":"2023-11-27T21:22:18.554433+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:39:55.933857+0000","scrub_duration":0.0016646670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"28'8","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.398352+0000","last_change":"2023-11-27T21:22:02.398392+0000","last_active":"2023-11-27T21:22:02.398352+0000","last_peered":"2023-11-27T21:22:02.398352+0000","last_clean":"2023-11-27T21:22:02.398352+0000","last_became_active":"2023-11-27T20:54:26.227120+0000","last_became_peered":"2023-11-27T20:54:26.227120+0000","last_unstale":"2023-11-27T21:22:02.398352+0000","last_undegraded":"2023-11-27T21:22:02.398352+0000","last_fullsized":"2023-11-27T21:22:02.398352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2023-11-27T21:22:02.398284+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2023-11-27T21:22:02.398284+0000","last_clean_scrub_stamp":"2023-11-27T21:22:02.398284+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:09:04.340440+0000","scrub_duration":0.00264496,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'197","reported_seq":234,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:34.272587+0000","last_change":"2023-11-27T20:55:01.286453+0000","last_active":"2023-11-27T21:21:34.272587+0000","last_peered":"2023-11-27T21:21:34.272587+0000","last_clean":"2023-11-27T21:21:34.272587+0000","last_became_active":"2023-11-27T20:55:01.286057+0000","last_became_peered":"2023-11-27T20:55:01.286057+0000","last_unstale":"2023-11-27T21:21:34.272587+0000","last_undegraded":"2023-11-27T21:21:34.272587+0000","last_fullsized":"2023-11-27T21:21:34.272587+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":17829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5,7],"acting":[2,1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"28'63","reported_seq":101,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:04.544533+0000","last_change":"2023-11-27T21:22:04.544551+0000","last_active":"2023-11-27T21:22:04.544533+0000","last_peered":"2023-11-27T21:22:04.544533+0000","last_clean":"2023-11-27T21:22:04.544533+0000","last_became_active":"2023-11-27T20:54:27.510573+0000","last_became_peered":"2023-11-27T20:54:27.510573+0000","last_unstale":"2023-11-27T21:22:04.544533+0000","last_undegraded":"2023-11-27T21:22:04.544533+0000","last_fullsized":"2023-11-27T21:22:04.544533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'63","last_scrub_stamp":"2023-11-27T21:22:04.544471+0000","last_deep_scrub":"28'63","last_deep_scrub_stamp":"2023-11-27T21:22:04.544471+0000","last_clean_scrub_stamp":"2023-11-27T21:22:04.544471+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:57:01.291364+0000","scrub_duration":0.0011139559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'13","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:42.239022+0000","last_change":"2023-11-27T20:54:26.224703+0000","last_active":"2023-11-27T21:21:42.239022+0000","last_peered":"2023-11-27T21:21:42.239022+0000","last_clean":"2023-11-27T21:21:42.239022+0000","last_became_active":"2023-11-27T20:54:26.224412+0000","last_became_peered":"2023-11-27T20:54:26.224412+0000","last_unstale":"2023-11-27T21:21:42.239022+0000","last_undegraded":"2023-11-27T21:21:42.239022+0000","last_fullsized":"2023-11-27T21:21:42.239022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'174","reported_seq":203,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:39.273075+0000","last_change":"2023-11-27T20:54:31.819739+0000","last_active":"2023-11-27T21:21:39.273075+0000","last_peered":"2023-11-27T21:21:39.273075+0000","last_clean":"2023-11-27T21:21:39.273075+0000","last_became_active":"2023-11-27T20:54:31.819371+0000","last_became_peered":"2023-11-27T20:54:31.819371+0000","last_unstale":"2023-11-27T21:21:39.273075+0000","last_undegraded":"2023-11-27T21:21:39.273075+0000","last_fullsized":"2023-11-27T21:21:39.273075+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":8398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"28'71","reported_seq":109,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:05.539591+0000","last_change":"2023-11-27T21:22:05.539610+0000","last_active":"2023-11-27T21:22:05.539591+0000","last_peered":"2023-11-27T21:22:05.539591+0000","last_clean":"2023-11-27T21:22:05.539591+0000","last_became_active":"2023-11-27T20:54:27.500455+0000","last_became_peered":"2023-11-27T20:54:27.500455+0000","last_unstale":"2023-11-27T21:22:05.539591+0000","last_undegraded":"2023-11-27T21:22:05.539591+0000","last_fullsized":"2023-11-27T21:22:05.539591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'71","last_scrub_stamp":"2023-11-27T21:22:05.539526+0000","last_deep_scrub":"28'71","last_deep_scrub_stamp":"2023-11-27T21:22:05.539526+0000","last_clean_scrub_stamp":"2023-11-27T21:22:05.539526+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:13:29.395135+0000","scrub_duration":0.001413643,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'163","reported_seq":202,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:14.476527+0000","last_change":"2023-11-27T21:22:14.476551+0000","last_active":"2023-11-27T21:22:14.476527+0000","last_peered":"2023-11-27T21:22:14.476527+0000","last_clean":"2023-11-27T21:22:14.476527+0000","last_became_active":"2023-11-27T20:54:26.222981+0000","last_became_peered":"2023-11-27T20:54:26.222981+0000","last_unstale":"2023-11-27T21:22:14.476527+0000","last_undegraded":"2023-11-27T21:22:14.476527+0000","last_fullsized":"2023-11-27T21:22:14.476527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'163","last_scrub_stamp":"2023-11-27T21:22:14.476461+0000","last_deep_scrub":"28'163","last_deep_scrub_stamp":"2023-11-27T21:22:14.476461+0000","last_clean_scrub_stamp":"2023-11-27T21:22:14.476461+0000","objects_scrubbed":4,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:08:10.937295+0000","scrub_duration":0.0035278750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":391,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"28'157","reported_seq":186,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.951048+0000","last_change":"2023-11-27T20:54:31.814118+0000","last_active":"2023-11-27T21:21:12.951048+0000","last_peered":"2023-11-27T21:21:12.951048+0000","last_clean":"2023-11-27T21:21:12.951048+0000","last_became_active":"2023-11-27T20:54:31.813765+0000","last_became_peered":"2023-11-27T20:54:31.813765+0000","last_unstale":"2023-11-27T21:21:12.951048+0000","last_undegraded":"2023-11-27T21:21:12.951048+0000","last_fullsized":"2023-11-27T21:21:12.951048+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":11921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"28'78","reported_seq":117,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.165891+0000","last_change":"2023-11-27T21:22:21.165911+0000","last_active":"2023-11-27T21:22:21.165891+0000","last_peered":"2023-11-27T21:22:21.165891+0000","last_clean":"2023-11-27T21:22:21.165891+0000","last_became_active":"2023-11-27T20:54:27.506210+0000","last_became_peered":"2023-11-27T20:54:27.506210+0000","last_unstale":"2023-11-27T21:22:21.165891+0000","last_undegraded":"2023-11-27T21:22:21.165891+0000","last_fullsized":"2023-11-27T21:22:21.165891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'78","last_scrub_stamp":"2023-11-27T21:22:21.165807+0000","last_deep_scrub":"28'78","last_deep_scrub_stamp":"2023-11-27T21:22:21.165807+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.165807+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:48:07.689268+0000","scrub_duration":0.0012874189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'245","reported_seq":277,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:40.092131+0000","last_change":"2023-11-27T20:54:26.220043+0000","last_active":"2023-11-27T21:21:40.092131+0000","last_peered":"2023-11-27T21:21:40.092131+0000","last_clean":"2023-11-27T21:21:40.092131+0000","last_became_active":"2023-11-27T20:54:26.219775+0000","last_became_peered":"2023-11-27T20:54:26.219775+0000","last_unstale":"2023-11-27T21:21:40.092131+0000","last_undegraded":"2023-11-27T21:21:40.092131+0000","last_fullsized":"2023-11-27T21:21:40.092131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"28'177","reported_seq":206,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:39.177723+0000","last_change":"2023-11-27T20:54:31.825960+0000","last_active":"2023-11-27T21:21:39.177723+0000","last_peered":"2023-11-27T21:21:39.177723+0000","last_clean":"2023-11-27T21:21:39.177723+0000","last_became_active":"2023-11-27T20:54:31.825591+0000","last_became_peered":"2023-11-27T20:54:31.825591+0000","last_unstale":"2023-11-27T21:21:39.177723+0000","last_undegraded":"2023-11-27T21:21:39.177723+0000","last_fullsized":"2023-11-27T21:21:39.177723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":8135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"28'65","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:06.889843+0000","last_change":"2023-11-27T21:22:06.889864+0000","last_active":"2023-11-27T21:22:06.889843+0000","last_peered":"2023-11-27T21:22:06.889843+0000","last_clean":"2023-11-27T21:22:06.889843+0000","last_became_active":"2023-11-27T20:54:27.500677+0000","last_became_peered":"2023-11-27T20:54:27.500677+0000","last_unstale":"2023-11-27T21:22:06.889843+0000","last_undegraded":"2023-11-27T21:22:06.889843+0000","last_fullsized":"2023-11-27T21:22:06.889843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'65","last_scrub_stamp":"2023-11-27T21:22:06.889775+0000","last_deep_scrub":"28'65","last_deep_scrub_stamp":"2023-11-27T21:22:06.889775+0000","last_clean_scrub_stamp":"2023-11-27T21:22:06.889775+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:19:12.052405+0000","scrub_duration":0.0014482970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"28'6","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:38.077429+0000","last_change":"2023-11-27T20:54:26.227877+0000","last_active":"2023-11-27T21:21:38.077429+0000","last_peered":"2023-11-27T21:21:38.077429+0000","last_clean":"2023-11-27T21:21:38.077429+0000","last_became_active":"2023-11-27T20:54:26.227605+0000","last_became_peered":"2023-11-27T20:54:26.227605+0000","last_unstale":"2023-11-27T21:21:38.077429+0000","last_undegraded":"2023-11-27T21:21:38.077429+0000","last_fullsized":"2023-11-27T21:21:38.077429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"28'178","reported_seq":207,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:39.177691+0000","last_change":"2023-11-27T20:54:31.826732+0000","last_active":"2023-11-27T21:21:39.177691+0000","last_peered":"2023-11-27T21:21:39.177691+0000","last_clean":"2023-11-27T21:21:39.177691+0000","last_became_active":"2023-11-27T20:54:31.826406+0000","last_became_peered":"2023-11-27T20:54:31.826406+0000","last_unstale":"2023-11-27T21:21:39.177691+0000","last_undegraded":"2023-11-27T21:21:39.177691+0000","last_fullsized":"2023-11-27T21:21:39.177691+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":6957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"28'85","reported_seq":116,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.493092+0000","last_change":"2023-11-27T20:54:27.517007+0000","last_active":"2023-11-27T21:21:49.493092+0000","last_peered":"2023-11-27T21:21:49.493092+0000","last_clean":"2023-11-27T21:21:49.493092+0000","last_became_active":"2023-11-27T20:54:27.516686+0000","last_became_peered":"2023-11-27T20:54:27.516686+0000","last_unstale":"2023-11-27T21:21:49.493092+0000","last_undegraded":"2023-11-27T21:21:49.493092+0000","last_fullsized":"2023-11-27T21:21:49.493092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'915","reported_seq":947,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.616969+0000","last_change":"2023-11-27T20:54:26.230192+0000","last_active":"2023-11-27T21:21:49.616969+0000","last_peered":"2023-11-27T21:21:49.616969+0000","last_clean":"2023-11-27T21:21:49.616969+0000","last_became_active":"2023-11-27T20:54:26.229985+0000","last_became_peered":"2023-11-27T20:54:26.229985+0000","last_unstale":"2023-11-27T21:21:49.616969+0000","last_undegraded":"2023-11-27T21:21:49.616969+0000","last_fullsized":"2023-11-27T21:21:49.616969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206463,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":911,"num_write_kb":4580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"28'139","reported_seq":165,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:01.203361+0000","last_change":"2023-11-27T20:55:00.588512+0000","last_active":"2023-11-27T21:22:01.203361+0000","last_peered":"2023-11-27T21:22:01.203361+0000","last_clean":"2023-11-27T21:22:01.203361+0000","last_became_active":"2023-11-27T20:55:00.588018+0000","last_became_peered":"2023-11-27T20:55:00.588018+0000","last_unstale":"2023-11-27T21:22:01.203361+0000","last_undegraded":"2023-11-27T21:22:01.203361+0000","last_fullsized":"2023-11-27T21:22:01.203361+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":13169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,0,3],"acting":[2,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'77","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.484590+0000","last_change":"2023-11-27T20:54:27.513378+0000","last_active":"2023-11-27T21:21:49.484590+0000","last_peered":"2023-11-27T21:21:49.484590+0000","last_clean":"2023-11-27T21:21:49.484590+0000","last_became_active":"2023-11-27T20:54:27.512093+0000","last_became_peered":"2023-11-27T20:54:27.512093+0000","last_unstale":"2023-11-27T21:21:49.484590+0000","last_undegraded":"2023-11-27T21:21:49.484590+0000","last_fullsized":"2023-11-27T21:21:49.484590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'273","reported_seq":482,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:15.255928+0000","last_change":"2023-11-27T21:22:15.255951+0000","last_active":"2023-11-27T21:22:15.255928+0000","last_peered":"2023-11-27T21:22:15.255928+0000","last_clean":"2023-11-27T21:22:15.255928+0000","last_became_active":"2023-11-27T20:54:26.230548+0000","last_became_peered":"2023-11-27T20:54:26.230548+0000","last_unstale":"2023-11-27T21:22:15.255928+0000","last_undegraded":"2023-11-27T21:22:15.255928+0000","last_fullsized":"2023-11-27T21:22:15.255928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'273","last_scrub_stamp":"2023-11-27T21:22:15.255867+0000","last_deep_scrub":"28'273","last_deep_scrub_stamp":"2023-11-27T21:22:15.255867+0000","last_clean_scrub_stamp":"2023-11-27T21:22:15.255867+0000","objects_scrubbed":4,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:44:57.904993+0000","scrub_duration":0.003822022,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28446,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":170,"num_read_kb":173,"num_write":266,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"28'141","reported_seq":178,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.936807+0000","last_change":"2023-11-27T20:55:00.595104+0000","last_active":"2023-11-27T21:21:12.936807+0000","last_peered":"2023-11-27T21:21:12.936807+0000","last_clean":"2023-11-27T21:21:12.936807+0000","last_became_active":"2023-11-27T20:55:00.594705+0000","last_became_peered":"2023-11-27T20:55:00.594705+0000","last_unstale":"2023-11-27T21:21:12.936807+0000","last_undegraded":"2023-11-27T21:21:12.936807+0000","last_fullsized":"2023-11-27T21:21:12.936807+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":12035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"28'77","reported_seq":116,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:16.088541+0000","last_change":"2023-11-27T21:22:16.088562+0000","last_active":"2023-11-27T21:22:16.088541+0000","last_peered":"2023-11-27T21:22:16.088541+0000","last_clean":"2023-11-27T21:22:16.088541+0000","last_became_active":"2023-11-27T20:54:27.502941+0000","last_became_peered":"2023-11-27T20:54:27.502941+0000","last_unstale":"2023-11-27T21:22:16.088541+0000","last_undegraded":"2023-11-27T21:22:16.088541+0000","last_fullsized":"2023-11-27T21:22:16.088541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:16.088473+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:16.088473+0000","last_clean_scrub_stamp":"2023-11-27T21:22:16.088473+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:26:26.798459+0000","scrub_duration":0.001453584,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'11","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:40.288019+0000","last_change":"2023-11-27T20:54:26.214419+0000","last_active":"2023-11-27T21:21:40.288019+0000","last_peered":"2023-11-27T21:21:40.288019+0000","last_clean":"2023-11-27T21:21:40.288019+0000","last_became_active":"2023-11-27T20:54:26.214166+0000","last_became_peered":"2023-11-27T20:54:26.214166+0000","last_unstale":"2023-11-27T21:21:40.288019+0000","last_undegraded":"2023-11-27T21:21:40.288019+0000","last_fullsized":"2023-11-27T21:21:40.288019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"28'132","reported_seq":160,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:15.010701+0000","last_change":"2023-11-27T20:54:31.832551+0000","last_active":"2023-11-27T21:21:15.010701+0000","last_peered":"2023-11-27T21:21:15.010701+0000","last_clean":"2023-11-27T21:21:15.010701+0000","last_became_active":"2023-11-27T20:54:31.832196+0000","last_became_peered":"2023-11-27T20:54:31.832196+0000","last_unstale":"2023-11-27T21:21:15.010701+0000","last_undegraded":"2023-11-27T21:21:15.010701+0000","last_fullsized":"2023-11-27T21:21:15.010701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":8461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'69","reported_seq":100,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.481125+0000","last_change":"2023-11-27T20:54:27.433404+0000","last_active":"2023-11-27T21:21:49.481125+0000","last_peered":"2023-11-27T21:21:49.481125+0000","last_clean":"2023-11-27T21:21:49.481125+0000","last_became_active":"2023-11-27T20:54:27.433161+0000","last_became_peered":"2023-11-27T20:54:27.433161+0000","last_unstale":"2023-11-27T21:21:49.481125+0000","last_undegraded":"2023-11-27T21:21:49.481125+0000","last_fullsized":"2023-11-27T21:21:49.481125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'8","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:32.958832+0000","last_change":"2023-11-27T20:54:26.227451+0000","last_active":"2023-11-27T21:21:32.958832+0000","last_peered":"2023-11-27T21:21:32.958832+0000","last_clean":"2023-11-27T21:21:32.958832+0000","last_became_active":"2023-11-27T20:54:26.227133+0000","last_became_peered":"2023-11-27T20:54:26.227133+0000","last_unstale":"2023-11-27T21:21:32.958832+0000","last_undegraded":"2023-11-27T21:21:32.958832+0000","last_fullsized":"2023-11-27T21:21:32.958832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":195,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:03.333433+0000","last_change":"2023-11-27T21:22:03.333433+0000","last_active":"2023-11-27T21:22:03.333433+0000","last_peered":"2023-11-27T21:22:03.333433+0000","last_clean":"2023-11-27T21:22:03.333433+0000","last_became_active":"2023-11-27T20:54:11.452181+0000","last_became_peered":"2023-11-27T20:54:11.452181+0000","last_unstale":"2023-11-27T21:22:03.333433+0000","last_undegraded":"2023-11-27T21:22:03.333433+0000","last_fullsized":"2023-11-27T21:22:03.333433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2023-11-27T21:22:03.333356+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2023-11-27T21:22:03.333356+0000","last_clean_scrub_stamp":"2023-11-27T21:22:03.333356+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:51:11.809770+0000","scrub_duration":0.0045126749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'171","reported_seq":200,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:42.959901+0000","last_change":"2023-11-27T20:54:31.818408+0000","last_active":"2023-11-27T21:21:42.959901+0000","last_peered":"2023-11-27T21:21:42.959901+0000","last_clean":"2023-11-27T21:21:42.959901+0000","last_became_active":"2023-11-27T20:54:31.818048+0000","last_became_peered":"2023-11-27T20:54:31.818048+0000","last_unstale":"2023-11-27T21:21:42.959901+0000","last_undegraded":"2023-11-27T21:21:42.959901+0000","last_fullsized":"2023-11-27T21:21:42.959901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":10034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"28'75","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.521838+0000","last_change":"2023-11-27T21:22:02.521856+0000","last_active":"2023-11-27T21:22:02.521838+0000","last_peered":"2023-11-27T21:22:02.521838+0000","last_clean":"2023-11-27T21:22:02.521838+0000","last_became_active":"2023-11-27T20:54:27.493256+0000","last_became_peered":"2023-11-27T20:54:27.493256+0000","last_unstale":"2023-11-27T21:22:02.521838+0000","last_undegraded":"2023-11-27T21:22:02.521838+0000","last_fullsized":"2023-11-27T21:22:02.521838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:02.521779+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:02.521779+0000","last_clean_scrub_stamp":"2023-11-27T21:22:02.521779+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:35:12.329730+0000","scrub_duration":0.0011699499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'1021","reported_seq":1060,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:09.046981+0000","last_change":"2023-11-27T21:22:09.047006+0000","last_active":"2023-11-27T21:22:09.046981+0000","last_peered":"2023-11-27T21:22:09.046981+0000","last_clean":"2023-11-27T21:22:09.046981+0000","last_became_active":"2023-11-27T20:54:26.229796+0000","last_became_peered":"2023-11-27T20:54:26.229796+0000","last_unstale":"2023-11-27T21:22:09.046981+0000","last_undegraded":"2023-11-27T21:22:09.046981+0000","last_fullsized":"2023-11-27T21:22:09.046981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1021","last_scrub_stamp":"2023-11-27T21:22:09.046925+0000","last_deep_scrub":"28'1021","last_deep_scrub_stamp":"2023-11-27T21:22:09.046925+0000","last_clean_scrub_stamp":"2023-11-27T21:22:09.046925+0000","objects_scrubbed":3,"log_size":1021,"log_dups_size":0,"ondisk_log_size":1021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:11.549792+0000","scrub_duration":0.012870006999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1013,"num_write_kb":4611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'180","reported_seq":208,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:11.944542+0000","last_change":"2023-11-27T20:54:31.825472+0000","last_active":"2023-11-27T21:21:11.944542+0000","last_peered":"2023-11-27T21:21:11.944542+0000","last_clean":"2023-11-27T21:21:11.944542+0000","last_became_active":"2023-11-27T20:54:31.825080+0000","last_became_peered":"2023-11-27T20:54:31.825080+0000","last_unstale":"2023-11-27T21:21:11.944542+0000","last_undegraded":"2023-11-27T21:21:11.944542+0000","last_fullsized":"2023-11-27T21:21:11.944542+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":9643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'78","reported_seq":101,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.769377+0000","last_change":"2023-11-27T20:55:00.593751+0000","last_active":"2023-11-27T21:22:02.769377+0000","last_peered":"2023-11-27T21:22:02.769377+0000","last_clean":"2023-11-27T21:22:02.769377+0000","last_became_active":"2023-11-27T20:55:00.593249+0000","last_became_peered":"2023-11-27T20:55:00.593249+0000","last_unstale":"2023-11-27T21:22:02.769377+0000","last_undegraded":"2023-11-27T21:22:02.769377+0000","last_fullsized":"2023-11-27T21:22:02.769377+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"28'436","reported_seq":467,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.623269+0000","last_change":"2023-11-27T20:54:26.226148+0000","last_active":"2023-11-27T21:21:49.623269+0000","last_peered":"2023-11-27T21:21:49.623269+0000","last_clean":"2023-11-27T21:21:49.623269+0000","last_became_active":"2023-11-27T20:54:26.225886+0000","last_became_peered":"2023-11-27T20:54:26.225886+0000","last_unstale":"2023-11-27T21:21:49.623269+0000","last_undegraded":"2023-11-27T21:21:49.623269+0000","last_fullsized":"2023-11-27T21:21:49.623269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2473984,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":2660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"28'169","reported_seq":197,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:34.314845+0000","last_change":"2023-11-27T20:54:31.828729+0000","last_active":"2023-11-27T21:21:34.314845+0000","last_peered":"2023-11-27T21:21:34.314845+0000","last_clean":"2023-11-27T21:21:34.314845+0000","last_became_active":"2023-11-27T20:54:31.828368+0000","last_became_peered":"2023-11-27T20:54:31.828368+0000","last_unstale":"2023-11-27T21:21:34.314845+0000","last_undegraded":"2023-11-27T21:21:34.314845+0000","last_fullsized":"2023-11-27T21:21:34.314845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":8527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"28'75","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.492674+0000","last_change":"2023-11-27T20:54:27.515800+0000","last_active":"2023-11-27T21:21:49.492674+0000","last_peered":"2023-11-27T21:21:49.492674+0000","last_clean":"2023-11-27T21:21:49.492674+0000","last_became_active":"2023-11-27T20:54:27.515416+0000","last_became_peered":"2023-11-27T20:54:27.515416+0000","last_unstale":"2023-11-27T21:21:49.492674+0000","last_undegraded":"2023-11-27T21:21:49.492674+0000","last_fullsized":"2023-11-27T21:21:49.492674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"28'8","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:31.970513+0000","last_change":"2023-11-27T20:54:26.224880+0000","last_active":"2023-11-27T21:21:31.970513+0000","last_peered":"2023-11-27T21:21:31.970513+0000","last_clean":"2023-11-27T21:21:31.970513+0000","last_became_active":"2023-11-27T20:54:26.224604+0000","last_became_peered":"2023-11-27T20:54:26.224604+0000","last_unstale":"2023-11-27T21:21:31.970513+0000","last_undegraded":"2023-11-27T21:21:31.970513+0000","last_fullsized":"2023-11-27T21:21:31.970513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"28'149","reported_seq":177,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:11.971505+0000","last_change":"2023-11-27T20:54:31.819648+0000","last_active":"2023-11-27T21:21:11.971505+0000","last_peered":"2023-11-27T21:21:11.971505+0000","last_clean":"2023-11-27T21:21:11.971505+0000","last_became_active":"2023-11-27T20:54:31.819294+0000","last_became_peered":"2023-11-27T20:54:31.819294+0000","last_unstale":"2023-11-27T21:21:11.971505+0000","last_undegraded":"2023-11-27T21:21:11.971505+0000","last_fullsized":"2023-11-27T21:21:11.971505+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"28'77","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:19.747454+0000","last_change":"2023-11-27T21:22:19.747472+0000","last_active":"2023-11-27T21:22:19.747454+0000","last_peered":"2023-11-27T21:22:19.747454+0000","last_clean":"2023-11-27T21:22:19.747454+0000","last_became_active":"2023-11-27T20:54:27.512663+0000","last_became_peered":"2023-11-27T20:54:27.512663+0000","last_unstale":"2023-11-27T21:22:19.747454+0000","last_undegraded":"2023-11-27T21:22:19.747454+0000","last_fullsized":"2023-11-27T21:22:19.747454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:19.747391+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:19.747391+0000","last_clean_scrub_stamp":"2023-11-27T21:22:19.747391+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:18.401292+0000","scrub_duration":0.0011077389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"28'240","reported_seq":279,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:07.317223+0000","last_change":"2023-11-27T21:22:07.317246+0000","last_active":"2023-11-27T21:22:07.317223+0000","last_peered":"2023-11-27T21:22:07.317223+0000","last_clean":"2023-11-27T21:22:07.317223+0000","last_became_active":"2023-11-27T20:54:26.225056+0000","last_became_peered":"2023-11-27T20:54:26.225056+0000","last_unstale":"2023-11-27T21:22:07.317223+0000","last_undegraded":"2023-11-27T21:22:07.317223+0000","last_fullsized":"2023-11-27T21:22:07.317223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'240","last_scrub_stamp":"2023-11-27T21:22:07.317149+0000","last_deep_scrub":"28'240","last_deep_scrub_stamp":"2023-11-27T21:22:07.317149+0000","last_clean_scrub_stamp":"2023-11-27T21:22:07.317149+0000","objects_scrubbed":2,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:41:09.468592+0000","scrub_duration":0.0039936490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"28'126","reported_seq":154,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.974610+0000","last_change":"2023-11-27T20:54:31.827590+0000","last_active":"2023-11-27T21:21:12.974610+0000","last_peered":"2023-11-27T21:21:12.974610+0000","last_clean":"2023-11-27T21:21:12.974610+0000","last_became_active":"2023-11-27T20:54:31.827175+0000","last_became_peered":"2023-11-27T20:54:31.827175+0000","last_unstale":"2023-11-27T21:21:12.974610+0000","last_undegraded":"2023-11-27T21:21:12.974610+0000","last_fullsized":"2023-11-27T21:21:12.974610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":7629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"28'69","reported_seq":106,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:09.572808+0000","last_change":"2023-11-27T21:22:09.572831+0000","last_active":"2023-11-27T21:22:09.572808+0000","last_peered":"2023-11-27T21:22:09.572808+0000","last_clean":"2023-11-27T21:22:09.572808+0000","last_became_active":"2023-11-27T20:54:27.498225+0000","last_became_peered":"2023-11-27T20:54:27.498225+0000","last_unstale":"2023-11-27T21:22:09.572808+0000","last_undegraded":"2023-11-27T21:22:09.572808+0000","last_fullsized":"2023-11-27T21:22:09.572808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'69","last_scrub_stamp":"2023-11-27T21:22:09.572724+0000","last_deep_scrub":"28'69","last_deep_scrub_stamp":"2023-11-27T21:22:09.572724+0000","last_clean_scrub_stamp":"2023-11-27T21:22:09.572724+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:13:34.348448+0000","scrub_duration":0.0016942400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'1037","reported_seq":1075,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:11.556827+0000","last_change":"2023-11-27T21:22:11.556868+0000","last_active":"2023-11-27T21:22:11.556827+0000","last_peered":"2023-11-27T21:22:11.556827+0000","last_clean":"2023-11-27T21:22:11.556827+0000","last_became_active":"2023-11-27T20:54:26.225333+0000","last_became_peered":"2023-11-27T20:54:26.225333+0000","last_unstale":"2023-11-27T21:22:11.556827+0000","last_undegraded":"2023-11-27T21:22:11.556827+0000","last_fullsized":"2023-11-27T21:22:11.556827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1037","last_scrub_stamp":"2023-11-27T21:22:11.556754+0000","last_deep_scrub":"28'1037","last_deep_scrub_stamp":"2023-11-27T21:22:11.556754+0000","last_clean_scrub_stamp":"2023-11-27T21:22:11.556754+0000","objects_scrubbed":9,"log_size":1037,"log_dups_size":0,"ondisk_log_size":1037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:14:01.901896+0000","scrub_duration":0.014520241999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3313963,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1025,"num_write_kb":3921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"28'159","reported_seq":186,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:11.926419+0000","last_change":"2023-11-27T20:54:31.836029+0000","last_active":"2023-11-27T21:21:11.926419+0000","last_peered":"2023-11-27T21:21:11.926419+0000","last_clean":"2023-11-27T21:21:11.926419+0000","last_became_active":"2023-11-27T20:54:31.835629+0000","last_became_peered":"2023-11-27T20:54:31.835629+0000","last_unstale":"2023-11-27T21:21:11.926419+0000","last_undegraded":"2023-11-27T21:21:11.926419+0000","last_fullsized":"2023-11-27T21:21:11.926419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":12674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'64","reported_seq":100,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:10.205649+0000","last_change":"2023-11-27T21:22:10.205669+0000","last_active":"2023-11-27T21:22:10.205649+0000","last_peered":"2023-11-27T21:22:10.205649+0000","last_clean":"2023-11-27T21:22:10.205649+0000","last_became_active":"2023-11-27T20:54:27.510775+0000","last_became_peered":"2023-11-27T20:54:27.510775+0000","last_unstale":"2023-11-27T21:22:10.205649+0000","last_undegraded":"2023-11-27T21:22:10.205649+0000","last_fullsized":"2023-11-27T21:22:10.205649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'64","last_scrub_stamp":"2023-11-27T21:22:10.205582+0000","last_deep_scrub":"28'64","last_deep_scrub_stamp":"2023-11-27T21:22:10.205582+0000","last_clean_scrub_stamp":"2023-11-27T21:22:10.205582+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:12:43.950689+0000","scrub_duration":0.001792397,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"28'1191","reported_seq":1229,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:15.427620+0000","last_change":"2023-11-27T21:22:15.427644+0000","last_active":"2023-11-27T21:22:15.427620+0000","last_peered":"2023-11-27T21:22:15.427620+0000","last_clean":"2023-11-27T21:22:15.427620+0000","last_became_active":"2023-11-27T20:54:26.226745+0000","last_became_peered":"2023-11-27T20:54:26.226745+0000","last_unstale":"2023-11-27T21:22:15.427620+0000","last_undegraded":"2023-11-27T21:22:15.427620+0000","last_fullsized":"2023-11-27T21:22:15.427620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1191","last_scrub_stamp":"2023-11-27T21:22:15.427568+0000","last_deep_scrub":"28'1191","last_deep_scrub_stamp":"2023-11-27T21:22:15.427568+0000","last_clean_scrub_stamp":"2023-11-27T21:22:15.427568+0000","objects_scrubbed":3,"log_size":1191,"log_dups_size":0,"ondisk_log_size":1191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:47:37.149646+0000","scrub_duration":0.012877517,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":4695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"28'169","reported_seq":196,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:13.920766+0000","last_change":"2023-11-27T20:54:31.831969+0000","last_active":"2023-11-27T21:21:13.920766+0000","last_peered":"2023-11-27T21:21:13.920766+0000","last_clean":"2023-11-27T21:21:13.920766+0000","last_became_active":"2023-11-27T20:54:31.831620+0000","last_became_peered":"2023-11-27T20:54:31.831620+0000","last_unstale":"2023-11-27T21:21:13.920766+0000","last_undegraded":"2023-11-27T21:21:13.920766+0000","last_fullsized":"2023-11-27T21:21:13.920766+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":13064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'85","reported_seq":122,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:05.528487+0000","last_change":"2023-11-27T21:22:05.528522+0000","last_active":"2023-11-27T21:22:05.528487+0000","last_peered":"2023-11-27T21:22:05.528487+0000","last_clean":"2023-11-27T21:22:05.528487+0000","last_became_active":"2023-11-27T20:54:27.515524+0000","last_became_peered":"2023-11-27T20:54:27.515524+0000","last_unstale":"2023-11-27T21:22:05.528487+0000","last_undegraded":"2023-11-27T21:22:05.528487+0000","last_fullsized":"2023-11-27T21:22:05.528487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'85","last_scrub_stamp":"2023-11-27T21:22:05.528395+0000","last_deep_scrub":"28'85","last_deep_scrub_stamp":"2023-11-27T21:22:05.528395+0000","last_clean_scrub_stamp":"2023-11-27T21:22:05.528395+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:01:39.543628+0000","scrub_duration":0.0014329239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'242","reported_seq":272,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:42.299849+0000","last_change":"2023-11-27T20:54:26.225975+0000","last_active":"2023-11-27T21:21:42.299849+0000","last_peered":"2023-11-27T21:21:42.299849+0000","last_clean":"2023-11-27T21:21:42.299849+0000","last_became_active":"2023-11-27T20:54:26.225691+0000","last_became_peered":"2023-11-27T20:54:26.225691+0000","last_unstale":"2023-11-27T21:21:42.299849+0000","last_undegraded":"2023-11-27T21:21:42.299849+0000","last_fullsized":"2023-11-27T21:21:42.299849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":236,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"28'150","reported_seq":177,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:15.008973+0000","last_change":"2023-11-27T20:54:31.827058+0000","last_active":"2023-11-27T21:21:15.008973+0000","last_peered":"2023-11-27T21:21:15.008973+0000","last_clean":"2023-11-27T21:21:15.008973+0000","last_became_active":"2023-11-27T20:54:31.826669+0000","last_became_peered":"2023-11-27T20:54:31.826669+0000","last_unstale":"2023-11-27T21:21:15.008973+0000","last_undegraded":"2023-11-27T21:21:15.008973+0000","last_fullsized":"2023-11-27T21:21:15.008973+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":7432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"28'77","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:17.078785+0000","last_change":"2023-11-27T21:22:17.078803+0000","last_active":"2023-11-27T21:22:17.078785+0000","last_peered":"2023-11-27T21:22:17.078785+0000","last_clean":"2023-11-27T21:22:17.078785+0000","last_became_active":"2023-11-27T20:54:27.502677+0000","last_became_peered":"2023-11-27T20:54:27.502677+0000","last_unstale":"2023-11-27T21:22:17.078785+0000","last_undegraded":"2023-11-27T21:22:17.078785+0000","last_fullsized":"2023-11-27T21:22:17.078785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:17.078722+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:17.078722+0000","last_clean_scrub_stamp":"2023-11-27T21:22:17.078722+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:59:13.020180+0000","scrub_duration":0.00165175,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'332","reported_seq":683,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:05.423643+0000","last_change":"2023-11-27T21:22:05.423669+0000","last_active":"2023-11-27T21:22:05.423643+0000","last_peered":"2023-11-27T21:22:05.423643+0000","last_clean":"2023-11-27T21:22:05.423643+0000","last_became_active":"2023-11-27T20:54:26.227911+0000","last_became_peered":"2023-11-27T20:54:26.227911+0000","last_unstale":"2023-11-27T21:22:05.423643+0000","last_undegraded":"2023-11-27T21:22:05.423643+0000","last_fullsized":"2023-11-27T21:22:05.423643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'332","last_scrub_stamp":"2023-11-27T21:22:05.423586+0000","last_deep_scrub":"28'332","last_deep_scrub_stamp":"2023-11-27T21:22:05.423586+0000","last_clean_scrub_stamp":"2023-11-27T21:22:05.423586+0000","objects_scrubbed":7,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:36:33.071011+0000","scrub_duration":0.0045666969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53552,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":314,"num_read_kb":325,"num_write":327,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'174","reported_seq":201,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.976359+0000","last_change":"2023-11-27T20:54:31.828136+0000","last_active":"2023-11-27T21:21:12.976359+0000","last_peered":"2023-11-27T21:21:12.976359+0000","last_clean":"2023-11-27T21:21:12.976359+0000","last_became_active":"2023-11-27T20:54:31.827785+0000","last_became_peered":"2023-11-27T20:54:31.827785+0000","last_unstale":"2023-11-27T21:21:12.976359+0000","last_undegraded":"2023-11-27T21:21:12.976359+0000","last_fullsized":"2023-11-27T21:21:12.976359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":11290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'75","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.491397+0000","last_change":"2023-11-27T20:54:27.514185+0000","last_active":"2023-11-27T21:21:49.491397+0000","last_peered":"2023-11-27T21:21:49.491397+0000","last_clean":"2023-11-27T21:21:49.491397+0000","last_became_active":"2023-11-27T20:54:27.513655+0000","last_became_peered":"2023-11-27T20:54:27.513655+0000","last_unstale":"2023-11-27T21:21:49.491397+0000","last_undegraded":"2023-11-27T21:21:49.491397+0000","last_fullsized":"2023-11-27T21:21:49.491397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'1487","reported_seq":1525,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.911935+0000","last_change":"2023-11-27T21:22:02.911976+0000","last_active":"2023-11-27T21:22:02.911935+0000","last_peered":"2023-11-27T21:22:02.911935+0000","last_clean":"2023-11-27T21:22:02.911935+0000","last_became_active":"2023-11-27T20:54:26.230570+0000","last_became_peered":"2023-11-27T20:54:26.230570+0000","last_unstale":"2023-11-27T21:22:02.911935+0000","last_undegraded":"2023-11-27T21:22:02.911935+0000","last_fullsized":"2023-11-27T21:22:02.911935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1487","last_scrub_stamp":"2023-11-27T21:22:02.911868+0000","last_deep_scrub":"28'1487","last_deep_scrub_stamp":"2023-11-27T21:22:02.911868+0000","last_clean_scrub_stamp":"2023-11-27T21:22:02.911868+0000","objects_scrubbed":6,"log_size":1487,"log_dups_size":0,"ondisk_log_size":1487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:31:23.266746+0000","scrub_duration":0.017648026000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1482,"num_write_kb":4539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"28'155","reported_seq":182,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:15.004642+0000","last_change":"2023-11-27T20:54:31.828482+0000","last_active":"2023-11-27T21:21:15.004642+0000","last_peered":"2023-11-27T21:21:15.004642+0000","last_clean":"2023-11-27T21:21:15.004642+0000","last_became_active":"2023-11-27T20:54:31.827872+0000","last_became_peered":"2023-11-27T20:54:31.827872+0000","last_unstale":"2023-11-27T21:21:15.004642+0000","last_undegraded":"2023-11-27T21:21:15.004642+0000","last_fullsized":"2023-11-27T21:21:15.004642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":8855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'67","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.567391+0000","last_change":"2023-11-27T21:22:21.567411+0000","last_active":"2023-11-27T21:22:21.567391+0000","last_peered":"2023-11-27T21:22:21.567391+0000","last_clean":"2023-11-27T21:22:21.567391+0000","last_became_active":"2023-11-27T20:54:27.493257+0000","last_became_peered":"2023-11-27T20:54:27.493257+0000","last_unstale":"2023-11-27T21:22:21.567391+0000","last_undegraded":"2023-11-27T21:22:21.567391+0000","last_fullsized":"2023-11-27T21:22:21.567391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'67","last_scrub_stamp":"2023-11-27T21:22:21.567332+0000","last_deep_scrub":"28'67","last_deep_scrub_stamp":"2023-11-27T21:22:21.567332+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.567332+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:36:06.913352+0000","scrub_duration":0.00118578,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'152","reported_seq":189,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:06.402443+0000","last_change":"2023-11-27T21:22:06.402467+0000","last_active":"2023-11-27T21:22:06.402443+0000","last_peered":"2023-11-27T21:22:06.402443+0000","last_clean":"2023-11-27T21:22:06.402443+0000","last_became_active":"2023-11-27T20:54:26.230963+0000","last_became_peered":"2023-11-27T20:54:26.230963+0000","last_unstale":"2023-11-27T21:22:06.402443+0000","last_undegraded":"2023-11-27T21:22:06.402443+0000","last_fullsized":"2023-11-27T21:22:06.402443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'152","last_scrub_stamp":"2023-11-27T21:22:06.402381+0000","last_deep_scrub":"28'152","last_deep_scrub_stamp":"2023-11-27T21:22:06.402381+0000","last_clean_scrub_stamp":"2023-11-27T21:22:06.402381+0000","objects_scrubbed":4,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:06:17.621457+0000","scrub_duration":0.0033124059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"28'195","reported_seq":226,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:16.056200+0000","last_change":"2023-11-27T20:54:31.825391+0000","last_active":"2023-11-27T21:21:16.056200+0000","last_peered":"2023-11-27T21:21:16.056200+0000","last_clean":"2023-11-27T21:21:16.056200+0000","last_became_active":"2023-11-27T20:54:31.825038+0000","last_became_peered":"2023-11-27T20:54:31.825038+0000","last_unstale":"2023-11-27T21:21:16.056200+0000","last_undegraded":"2023-11-27T21:21:16.056200+0000","last_fullsized":"2023-11-27T21:21:16.056200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":102,"num_write":164,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"28'89","reported_seq":126,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:06.407272+0000","last_change":"2023-11-27T21:22:06.407291+0000","last_active":"2023-11-27T21:22:06.407272+0000","last_peered":"2023-11-27T21:22:06.407272+0000","last_clean":"2023-11-27T21:22:06.407272+0000","last_became_active":"2023-11-27T20:54:27.507805+0000","last_became_peered":"2023-11-27T20:54:27.507805+0000","last_unstale":"2023-11-27T21:22:06.407272+0000","last_undegraded":"2023-11-27T21:22:06.407272+0000","last_fullsized":"2023-11-27T21:22:06.407272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'89","last_scrub_stamp":"2023-11-27T21:22:06.407212+0000","last_deep_scrub":"28'89","last_deep_scrub_stamp":"2023-11-27T21:22:06.407212+0000","last_clean_scrub_stamp":"2023-11-27T21:22:06.407212+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:16:55.047816+0000","scrub_duration":0.0014892390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'331","reported_seq":687,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:10.331795+0000","last_change":"2023-11-27T21:22:10.331834+0000","last_active":"2023-11-27T21:22:10.331795+0000","last_peered":"2023-11-27T21:22:10.331795+0000","last_clean":"2023-11-27T21:22:10.331795+0000","last_became_active":"2023-11-27T20:54:26.226679+0000","last_became_peered":"2023-11-27T20:54:26.226679+0000","last_unstale":"2023-11-27T21:22:10.331795+0000","last_undegraded":"2023-11-27T21:22:10.331795+0000","last_fullsized":"2023-11-27T21:22:10.331795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'331","last_scrub_stamp":"2023-11-27T21:22:10.331701+0000","last_deep_scrub":"28'331","last_deep_scrub_stamp":"2023-11-27T21:22:10.331701+0000","last_clean_scrub_stamp":"2023-11-27T21:22:10.331701+0000","objects_scrubbed":3,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:57:26.919946+0000","scrub_duration":0.0033883049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53032,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":318,"num_read_kb":327,"num_write":324,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"28'159","reported_seq":186,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:16.047781+0000","last_change":"2023-11-27T20:54:31.834934+0000","last_active":"2023-11-27T21:21:16.047781+0000","last_peered":"2023-11-27T21:21:16.047781+0000","last_clean":"2023-11-27T21:21:16.047781+0000","last_became_active":"2023-11-27T20:54:31.834569+0000","last_became_peered":"2023-11-27T20:54:31.834569+0000","last_unstale":"2023-11-27T21:21:16.047781+0000","last_undegraded":"2023-11-27T21:21:16.047781+0000","last_fullsized":"2023-11-27T21:21:16.047781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":7865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'79","reported_seq":116,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:11.809904+0000","last_change":"2023-11-27T21:22:11.809924+0000","last_active":"2023-11-27T21:22:11.809904+0000","last_peered":"2023-11-27T21:22:11.809904+0000","last_clean":"2023-11-27T21:22:11.809904+0000","last_became_active":"2023-11-27T20:54:27.498535+0000","last_became_peered":"2023-11-27T20:54:27.498535+0000","last_unstale":"2023-11-27T21:22:11.809904+0000","last_undegraded":"2023-11-27T21:22:11.809904+0000","last_fullsized":"2023-11-27T21:22:11.809904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'79","last_scrub_stamp":"2023-11-27T21:22:11.809828+0000","last_deep_scrub":"28'79","last_deep_scrub_stamp":"2023-11-27T21:22:11.809828+0000","last_clean_scrub_stamp":"2023-11-27T21:22:11.809828+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:02.660027+0000","scrub_duration":0.001141268,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'177","reported_seq":214,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:04.284387+0000","last_change":"2023-11-27T21:22:04.284409+0000","last_active":"2023-11-27T21:22:04.284387+0000","last_peered":"2023-11-27T21:22:04.284387+0000","last_clean":"2023-11-27T21:22:04.284387+0000","last_became_active":"2023-11-27T20:54:26.227878+0000","last_became_peered":"2023-11-27T20:54:26.227878+0000","last_unstale":"2023-11-27T21:22:04.284387+0000","last_undegraded":"2023-11-27T21:22:04.284387+0000","last_fullsized":"2023-11-27T21:22:04.284387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'177","last_scrub_stamp":"2023-11-27T21:22:04.284332+0000","last_deep_scrub":"28'177","last_deep_scrub_stamp":"2023-11-27T21:22:04.284332+0000","last_clean_scrub_stamp":"2023-11-27T21:22:04.284332+0000","objects_scrubbed":3,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:46:32.962705+0000","scrub_duration":0.0029821639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'104","reported_seq":131,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:16.056237+0000","last_change":"2023-11-27T20:54:31.825264+0000","last_active":"2023-11-27T21:21:16.056237+0000","last_peered":"2023-11-27T21:21:16.056237+0000","last_clean":"2023-11-27T21:21:16.056237+0000","last_became_active":"2023-11-27T20:54:31.824914+0000","last_became_peered":"2023-11-27T20:54:31.824914+0000","last_unstale":"2023-11-27T21:21:16.056237+0000","last_undegraded":"2023-11-27T21:21:16.056237+0000","last_fullsized":"2023-11-27T21:21:16.056237+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":7715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"28'152","reported_seq":181,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.778384+0000","last_change":"2023-11-27T20:54:31.828359+0000","last_active":"2023-11-27T21:21:12.778384+0000","last_peered":"2023-11-27T21:21:12.778384+0000","last_clean":"2023-11-27T21:21:12.778384+0000","last_became_active":"2023-11-27T20:54:31.827971+0000","last_became_peered":"2023-11-27T20:54:31.827971+0000","last_unstale":"2023-11-27T21:21:12.778384+0000","last_undegraded":"2023-11-27T21:21:12.778384+0000","last_fullsized":"2023-11-27T21:21:12.778384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":9456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"28'80","reported_seq":109,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.493005+0000","last_change":"2023-11-27T20:54:27.434914+0000","last_active":"2023-11-27T21:21:49.493005+0000","last_peered":"2023-11-27T21:21:49.493005+0000","last_clean":"2023-11-27T21:21:49.493005+0000","last_became_active":"2023-11-27T20:54:27.434635+0000","last_became_peered":"2023-11-27T20:54:27.434635+0000","last_unstale":"2023-11-27T21:21:49.493005+0000","last_undegraded":"2023-11-27T21:21:49.493005+0000","last_fullsized":"2023-11-27T21:21:49.493005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'6","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:40.087148+0000","last_change":"2023-11-27T20:54:26.224770+0000","last_active":"2023-11-27T21:21:40.087148+0000","last_peered":"2023-11-27T21:21:40.087148+0000","last_clean":"2023-11-27T21:21:40.087148+0000","last_became_active":"2023-11-27T20:54:26.224502+0000","last_became_peered":"2023-11-27T20:54:26.224502+0000","last_unstale":"2023-11-27T21:21:40.087148+0000","last_undegraded":"2023-11-27T21:21:40.087148+0000","last_fullsized":"2023-11-27T21:21:40.087148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"28'177","reported_seq":206,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:37.959439+0000","last_change":"2023-11-27T20:54:31.827147+0000","last_active":"2023-11-27T21:21:37.959439+0000","last_peered":"2023-11-27T21:21:37.959439+0000","last_clean":"2023-11-27T21:21:37.959439+0000","last_became_active":"2023-11-27T20:54:31.826790+0000","last_became_peered":"2023-11-27T20:54:31.826790+0000","last_unstale":"2023-11-27T21:21:37.959439+0000","last_undegraded":"2023-11-27T21:21:37.959439+0000","last_fullsized":"2023-11-27T21:21:37.959439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":15468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'77","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:13.303814+0000","last_change":"2023-11-27T21:22:13.303840+0000","last_active":"2023-11-27T21:22:13.303814+0000","last_peered":"2023-11-27T21:22:13.303814+0000","last_clean":"2023-11-27T21:22:13.303814+0000","last_became_active":"2023-11-27T20:54:27.507698+0000","last_became_peered":"2023-11-27T20:54:27.507698+0000","last_unstale":"2023-11-27T21:22:13.303814+0000","last_undegraded":"2023-11-27T21:22:13.303814+0000","last_fullsized":"2023-11-27T21:22:13.303814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:13.303735+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:13.303735+0000","last_clean_scrub_stamp":"2023-11-27T21:22:13.303735+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:40:38.746430+0000","scrub_duration":0.001443277,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'425","reported_seq":876,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:08.025932+0000","last_change":"2023-11-27T21:22:08.025955+0000","last_active":"2023-11-27T21:22:08.025932+0000","last_peered":"2023-11-27T21:22:08.025932+0000","last_clean":"2023-11-27T21:22:08.025932+0000","last_became_active":"2023-11-27T20:54:26.229725+0000","last_became_peered":"2023-11-27T20:54:26.229725+0000","last_unstale":"2023-11-27T21:22:08.025932+0000","last_undegraded":"2023-11-27T21:22:08.025932+0000","last_fullsized":"2023-11-27T21:22:08.025932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'425","last_scrub_stamp":"2023-11-27T21:22:08.025875+0000","last_deep_scrub":"28'425","last_deep_scrub_stamp":"2023-11-27T21:22:08.025875+0000","last_clean_scrub_stamp":"2023-11-27T21:22:08.025875+0000","objects_scrubbed":3,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:31:28.380754+0000","scrub_duration":0.0038756979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":413,"num_read_kb":420,"num_write":418,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'469","reported_seq":957,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:57.961687+0000","last_change":"2023-11-27T20:54:26.221975+0000","last_active":"2023-11-27T21:21:57.961687+0000","last_peered":"2023-11-27T21:21:57.961687+0000","last_clean":"2023-11-27T21:21:57.961687+0000","last_became_active":"2023-11-27T20:54:26.221715+0000","last_became_peered":"2023-11-27T20:54:26.221715+0000","last_unstale":"2023-11-27T21:21:57.961687+0000","last_undegraded":"2023-11-27T21:21:57.961687+0000","last_fullsized":"2023-11-27T21:21:57.961687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70496,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":458,"num_read_kb":466,"num_write":467,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'78","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:57.859811+0000","last_change":"2023-11-27T20:54:27.517213+0000","last_active":"2023-11-27T21:21:57.859811+0000","last_peered":"2023-11-27T21:21:57.859811+0000","last_clean":"2023-11-27T21:21:57.859811+0000","last_became_active":"2023-11-27T20:54:27.516887+0000","last_became_peered":"2023-11-27T20:54:27.516887+0000","last_unstale":"2023-11-27T21:21:57.859811+0000","last_undegraded":"2023-11-27T21:21:57.859811+0000","last_fullsized":"2023-11-27T21:21:57.859811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'144","reported_seq":171,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.769469+0000","last_change":"2023-11-27T20:54:31.827740+0000","last_active":"2023-11-27T21:22:02.769469+0000","last_peered":"2023-11-27T21:22:02.769469+0000","last_clean":"2023-11-27T21:22:02.769469+0000","last_became_active":"2023-11-27T20:54:31.827395+0000","last_became_peered":"2023-11-27T20:54:31.827395+0000","last_unstale":"2023-11-27T21:22:02.769469+0000","last_undegraded":"2023-11-27T21:22:02.769469+0000","last_fullsized":"2023-11-27T21:22:02.769469+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":4976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'2868","reported_seq":2898,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:59.437468+0000","last_change":"2023-11-27T20:54:26.227971+0000","last_active":"2023-11-27T21:21:59.437468+0000","last_peered":"2023-11-27T21:21:59.437468+0000","last_clean":"2023-11-27T21:21:59.437468+0000","last_became_active":"2023-11-27T20:54:26.227713+0000","last_became_peered":"2023-11-27T20:54:26.227713+0000","last_unstale":"2023-11-27T21:21:59.437468+0000","last_undegraded":"2023-11-27T21:21:59.437468+0000","last_fullsized":"2023-11-27T21:21:59.437468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":2868,"log_dups_size":0,"ondisk_log_size":2868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12113008,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2860,"num_write_kb":13160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"28'94","reported_seq":130,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:12.266321+0000","last_change":"2023-11-27T21:22:12.266341+0000","last_active":"2023-11-27T21:22:12.266321+0000","last_peered":"2023-11-27T21:22:12.266321+0000","last_clean":"2023-11-27T21:22:12.266321+0000","last_became_active":"2023-11-27T20:54:27.506119+0000","last_became_peered":"2023-11-27T20:54:27.506119+0000","last_unstale":"2023-11-27T21:22:12.266321+0000","last_undegraded":"2023-11-27T21:22:12.266321+0000","last_fullsized":"2023-11-27T21:22:12.266321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'94","last_scrub_stamp":"2023-11-27T21:22:12.266264+0000","last_deep_scrub":"28'94","last_deep_scrub_stamp":"2023-11-27T21:22:12.266264+0000","last_clean_scrub_stamp":"2023-11-27T21:22:12.266264+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:50:27.905791+0000","scrub_duration":0.001360986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"28'135","reported_seq":162,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:03.089116+0000","last_change":"2023-11-27T20:54:31.833185+0000","last_active":"2023-11-27T21:22:03.089116+0000","last_peered":"2023-11-27T21:22:03.089116+0000","last_clean":"2023-11-27T21:22:03.089116+0000","last_became_active":"2023-11-27T20:54:31.832813+0000","last_became_peered":"2023-11-27T20:54:31.832813+0000","last_unstale":"2023-11-27T21:22:03.089116+0000","last_undegraded":"2023-11-27T21:22:03.089116+0000","last_fullsized":"2023-11-27T21:22:03.089116+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'74","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:03.899170+0000","last_change":"2023-11-27T21:22:03.899204+0000","last_active":"2023-11-27T21:22:03.899170+0000","last_peered":"2023-11-27T21:22:03.899170+0000","last_clean":"2023-11-27T21:22:03.899170+0000","last_became_active":"2023-11-27T20:54:27.500394+0000","last_became_peered":"2023-11-27T20:54:27.500394+0000","last_unstale":"2023-11-27T21:22:03.899170+0000","last_undegraded":"2023-11-27T21:22:03.899170+0000","last_fullsized":"2023-11-27T21:22:03.899170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'74","last_scrub_stamp":"2023-11-27T21:22:03.899101+0000","last_deep_scrub":"28'74","last_deep_scrub_stamp":"2023-11-27T21:22:03.899101+0000","last_clean_scrub_stamp":"2023-11-27T21:22:03.899101+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:06.401969+0000","scrub_duration":0.0013881010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"28'91","reported_seq":129,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:19.289312+0000","last_change":"2023-11-27T21:22:19.289337+0000","last_active":"2023-11-27T21:22:19.289312+0000","last_peered":"2023-11-27T21:22:19.289312+0000","last_clean":"2023-11-27T21:22:19.289312+0000","last_became_active":"2023-11-27T20:54:27.515173+0000","last_became_peered":"2023-11-27T20:54:27.515173+0000","last_unstale":"2023-11-27T21:22:19.289312+0000","last_undegraded":"2023-11-27T21:22:19.289312+0000","last_fullsized":"2023-11-27T21:22:19.289312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'91","last_scrub_stamp":"2023-11-27T21:22:19.289226+0000","last_deep_scrub":"28'91","last_deep_scrub_stamp":"2023-11-27T21:22:19.289226+0000","last_clean_scrub_stamp":"2023-11-27T21:22:19.289226+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:57:16.036118+0000","scrub_duration":0.0015204750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"28'79","reported_seq":110,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.498732+0000","last_change":"2023-11-27T20:54:27.506358+0000","last_active":"2023-11-27T21:21:49.498732+0000","last_peered":"2023-11-27T21:21:49.498732+0000","last_clean":"2023-11-27T21:21:49.498732+0000","last_became_active":"2023-11-27T20:54:27.506112+0000","last_became_peered":"2023-11-27T20:54:27.506112+0000","last_unstale":"2023-11-27T21:21:49.498732+0000","last_undegraded":"2023-11-27T21:21:49.498732+0000","last_fullsized":"2023-11-27T21:21:49.498732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'73","reported_seq":112,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:15.272647+0000","last_change":"2023-11-27T21:22:15.272669+0000","last_active":"2023-11-27T21:22:15.272647+0000","last_peered":"2023-11-27T21:22:15.272647+0000","last_clean":"2023-11-27T21:22:15.272647+0000","last_became_active":"2023-11-27T20:54:27.510532+0000","last_became_peered":"2023-11-27T20:54:27.510532+0000","last_unstale":"2023-11-27T21:22:15.272647+0000","last_undegraded":"2023-11-27T21:22:15.272647+0000","last_fullsized":"2023-11-27T21:22:15.272647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'73","last_scrub_stamp":"2023-11-27T21:22:15.272584+0000","last_deep_scrub":"28'73","last_deep_scrub_stamp":"2023-11-27T21:22:15.272584+0000","last_clean_scrub_stamp":"2023-11-27T21:22:15.272584+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:23:33.117651+0000","scrub_duration":0.0013038769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"28'58","reported_seq":96,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:24.138319+0000","last_change":"2023-11-27T21:22:24.138340+0000","last_active":"2023-11-27T21:22:24.138319+0000","last_peered":"2023-11-27T21:22:24.138319+0000","last_clean":"2023-11-27T21:22:24.138319+0000","last_became_active":"2023-11-27T20:54:27.513517+0000","last_became_peered":"2023-11-27T20:54:27.513517+0000","last_unstale":"2023-11-27T21:22:24.138319+0000","last_undegraded":"2023-11-27T21:22:24.138319+0000","last_fullsized":"2023-11-27T21:22:24.138319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'58","last_scrub_stamp":"2023-11-27T21:22:24.138248+0000","last_deep_scrub":"28'58","last_deep_scrub_stamp":"2023-11-27T21:22:24.138248+0000","last_clean_scrub_stamp":"2023-11-27T21:22:24.138248+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:38.431656+0000","scrub_duration":0.001948988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'78","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.397969+0000","last_change":"2023-11-27T20:54:27.511798+0000","last_active":"2023-11-27T21:21:49.397969+0000","last_peered":"2023-11-27T21:21:49.397969+0000","last_clean":"2023-11-27T21:21:49.397969+0000","last_became_active":"2023-11-27T20:54:27.511559+0000","last_became_peered":"2023-11-27T20:54:27.511559+0000","last_unstale":"2023-11-27T21:21:49.397969+0000","last_undegraded":"2023-11-27T21:21:49.397969+0000","last_fullsized":"2023-11-27T21:21:49.397969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"28'75","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:07.894616+0000","last_change":"2023-11-27T21:22:07.894649+0000","last_active":"2023-11-27T21:22:07.894616+0000","last_peered":"2023-11-27T21:22:07.894616+0000","last_clean":"2023-11-27T21:22:07.894616+0000","last_became_active":"2023-11-27T20:54:27.499323+0000","last_became_peered":"2023-11-27T20:54:27.499323+0000","last_unstale":"2023-11-27T21:22:07.894616+0000","last_undegraded":"2023-11-27T21:22:07.894616+0000","last_fullsized":"2023-11-27T21:22:07.894616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:07.894529+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:07.894529+0000","last_clean_scrub_stamp":"2023-11-27T21:22:07.894529+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:40:33.337225+0000","scrub_duration":0.001236841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"28'64","reported_seq":94,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.476253+0000","last_change":"2023-11-27T20:54:27.508846+0000","last_active":"2023-11-27T21:21:49.476253+0000","last_peered":"2023-11-27T21:21:49.476253+0000","last_clean":"2023-11-27T21:21:49.476253+0000","last_became_active":"2023-11-27T20:54:27.508615+0000","last_became_peered":"2023-11-27T20:54:27.508615+0000","last_unstale":"2023-11-27T21:21:49.476253+0000","last_undegraded":"2023-11-27T21:21:49.476253+0000","last_fullsized":"2023-11-27T21:21:49.476253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'78","reported_seq":116,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:11.622517+0000","last_change":"2023-11-27T21:22:11.622552+0000","last_active":"2023-11-27T21:22:11.622517+0000","last_peered":"2023-11-27T21:22:11.622517+0000","last_clean":"2023-11-27T21:22:11.622517+0000","last_became_active":"2023-11-27T20:54:27.510647+0000","last_became_peered":"2023-11-27T20:54:27.510647+0000","last_unstale":"2023-11-27T21:22:11.622517+0000","last_undegraded":"2023-11-27T21:22:11.622517+0000","last_fullsized":"2023-11-27T21:22:11.622517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'78","last_scrub_stamp":"2023-11-27T21:22:11.622453+0000","last_deep_scrub":"28'78","last_deep_scrub_stamp":"2023-11-27T21:22:11.622453+0000","last_clean_scrub_stamp":"2023-11-27T21:22:11.622453+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:16:19.252165+0000","scrub_duration":0.0016600790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"28'92","reported_seq":122,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.481796+0000","last_change":"2023-11-27T20:54:27.508596+0000","last_active":"2023-11-27T21:21:49.481796+0000","last_peered":"2023-11-27T21:21:49.481796+0000","last_clean":"2023-11-27T21:21:49.481796+0000","last_became_active":"2023-11-27T20:54:27.508360+0000","last_became_peered":"2023-11-27T20:54:27.508360+0000","last_unstale":"2023-11-27T21:21:49.481796+0000","last_undegraded":"2023-11-27T21:21:49.481796+0000","last_fullsized":"2023-11-27T21:21:49.481796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"28'87","reported_seq":124,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.447734+0000","last_change":"2023-11-27T21:22:21.447755+0000","last_active":"2023-11-27T21:22:21.447734+0000","last_peered":"2023-11-27T21:22:21.447734+0000","last_clean":"2023-11-27T21:22:21.447734+0000","last_became_active":"2023-11-27T20:54:27.513105+0000","last_became_peered":"2023-11-27T20:54:27.513105+0000","last_unstale":"2023-11-27T21:22:21.447734+0000","last_undegraded":"2023-11-27T21:22:21.447734+0000","last_fullsized":"2023-11-27T21:22:21.447734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'87","last_scrub_stamp":"2023-11-27T21:22:21.447667+0000","last_deep_scrub":"28'87","last_deep_scrub_stamp":"2023-11-27T21:22:21.447667+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.447667+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:48.413351+0000","scrub_duration":0.001278429,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"28'77","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.504786+0000","last_change":"2023-11-27T20:54:27.433370+0000","last_active":"2023-11-27T21:21:49.504786+0000","last_peered":"2023-11-27T21:21:49.504786+0000","last_clean":"2023-11-27T21:21:49.504786+0000","last_became_active":"2023-11-27T20:54:27.433179+0000","last_became_peered":"2023-11-27T20:54:27.433179+0000","last_unstale":"2023-11-27T21:21:49.504786+0000","last_undegraded":"2023-11-27T21:21:49.504786+0000","last_fullsized":"2023-11-27T21:21:49.504786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'75","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.488885+0000","last_change":"2023-11-27T20:54:27.515324+0000","last_active":"2023-11-27T21:21:49.488885+0000","last_peered":"2023-11-27T21:21:49.488885+0000","last_clean":"2023-11-27T21:21:49.488885+0000","last_became_active":"2023-11-27T20:54:27.515068+0000","last_became_peered":"2023-11-27T20:54:27.515068+0000","last_unstale":"2023-11-27T21:21:49.488885+0000","last_undegraded":"2023-11-27T21:21:49.488885+0000","last_fullsized":"2023-11-27T21:21:49.488885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"28'86","reported_seq":124,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:15.519346+0000","last_change":"2023-11-27T21:22:15.519379+0000","last_active":"2023-11-27T21:22:15.519346+0000","last_peered":"2023-11-27T21:22:15.519346+0000","last_clean":"2023-11-27T21:22:15.519346+0000","last_became_active":"2023-11-27T20:54:27.498306+0000","last_became_peered":"2023-11-27T20:54:27.498306+0000","last_unstale":"2023-11-27T21:22:15.519346+0000","last_undegraded":"2023-11-27T21:22:15.519346+0000","last_fullsized":"2023-11-27T21:22:15.519346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'86","last_scrub_stamp":"2023-11-27T21:22:15.519229+0000","last_deep_scrub":"28'86","last_deep_scrub_stamp":"2023-11-27T21:22:15.519229+0000","last_clean_scrub_stamp":"2023-11-27T21:22:15.519229+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:50.796346+0000","scrub_duration":0.0016617979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'91","reported_seq":119,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.413399+0000","last_change":"2023-11-27T20:54:27.513134+0000","last_active":"2023-11-27T21:21:49.413399+0000","last_peered":"2023-11-27T21:21:49.413399+0000","last_clean":"2023-11-27T21:21:49.413399+0000","last_became_active":"2023-11-27T20:54:27.512897+0000","last_became_peered":"2023-11-27T20:54:27.512897+0000","last_unstale":"2023-11-27T21:21:49.413399+0000","last_undegraded":"2023-11-27T21:21:49.413399+0000","last_fullsized":"2023-11-27T21:21:49.413399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"28'67","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:16.542669+0000","last_change":"2023-11-27T21:22:16.542687+0000","last_active":"2023-11-27T21:22:16.542669+0000","last_peered":"2023-11-27T21:22:16.542669+0000","last_clean":"2023-11-27T21:22:16.542669+0000","last_became_active":"2023-11-27T20:54:27.514946+0000","last_became_peered":"2023-11-27T20:54:27.514946+0000","last_unstale":"2023-11-27T21:22:16.542669+0000","last_undegraded":"2023-11-27T21:22:16.542669+0000","last_fullsized":"2023-11-27T21:22:16.542669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'67","last_scrub_stamp":"2023-11-27T21:22:16.542611+0000","last_deep_scrub":"28'67","last_deep_scrub_stamp":"2023-11-27T21:22:16.542611+0000","last_clean_scrub_stamp":"2023-11-27T21:22:16.542611+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:43:30.443626+0000","scrub_duration":0.0014583510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"28'80","reported_seq":117,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:22.523959+0000","last_change":"2023-11-27T21:22:22.523993+0000","last_active":"2023-11-27T21:22:22.523959+0000","last_peered":"2023-11-27T21:22:22.523959+0000","last_clean":"2023-11-27T21:22:22.523959+0000","last_became_active":"2023-11-27T20:54:27.493297+0000","last_became_peered":"2023-11-27T20:54:27.493297+0000","last_unstale":"2023-11-27T21:22:22.523959+0000","last_undegraded":"2023-11-27T21:22:22.523959+0000","last_fullsized":"2023-11-27T21:22:22.523959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'80","last_scrub_stamp":"2023-11-27T21:22:22.523857+0000","last_deep_scrub":"28'80","last_deep_scrub_stamp":"2023-11-27T21:22:22.523857+0000","last_clean_scrub_stamp":"2023-11-27T21:22:22.523857+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:17:11.280303+0000","scrub_duration":0.001213053,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"28'75","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.496096+0000","last_change":"2023-11-27T20:54:27.512910+0000","last_active":"2023-11-27T21:21:49.496096+0000","last_peered":"2023-11-27T21:21:49.496096+0000","last_clean":"2023-11-27T21:21:49.496096+0000","last_became_active":"2023-11-27T20:54:27.512662+0000","last_became_peered":"2023-11-27T20:54:27.512662+0000","last_unstale":"2023-11-27T21:21:49.496096+0000","last_undegraded":"2023-11-27T21:21:49.496096+0000","last_fullsized":"2023-11-27T21:21:49.496096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'70","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:14.123442+0000","last_change":"2023-11-27T21:22:14.123478+0000","last_active":"2023-11-27T21:22:14.123442+0000","last_peered":"2023-11-27T21:22:14.123442+0000","last_clean":"2023-11-27T21:22:14.123442+0000","last_became_active":"2023-11-27T20:54:27.512124+0000","last_became_peered":"2023-11-27T20:54:27.512124+0000","last_unstale":"2023-11-27T21:22:14.123442+0000","last_undegraded":"2023-11-27T21:22:14.123442+0000","last_fullsized":"2023-11-27T21:22:14.123442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'70","last_scrub_stamp":"2023-11-27T21:22:14.123330+0000","last_deep_scrub":"28'70","last_deep_scrub_stamp":"2023-11-27T21:22:14.123330+0000","last_clean_scrub_stamp":"2023-11-27T21:22:14.123330+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:17:02.763935+0000","scrub_duration":0.0016588200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"28'82","reported_seq":119,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:22.174123+0000","last_change":"2023-11-27T21:22:22.174144+0000","last_active":"2023-11-27T21:22:22.174123+0000","last_peered":"2023-11-27T21:22:22.174123+0000","last_clean":"2023-11-27T21:22:22.174123+0000","last_became_active":"2023-11-27T20:54:27.516907+0000","last_became_peered":"2023-11-27T20:54:27.516907+0000","last_unstale":"2023-11-27T21:22:22.174123+0000","last_undegraded":"2023-11-27T21:22:22.174123+0000","last_fullsized":"2023-11-27T21:22:22.174123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'82","last_scrub_stamp":"2023-11-27T21:22:22.174050+0000","last_deep_scrub":"28'82","last_deep_scrub_stamp":"2023-11-27T21:22:22.174050+0000","last_clean_scrub_stamp":"2023-11-27T21:22:22.174050+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:58:51.653006+0000","scrub_duration":0.0015457279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'68","reported_seq":97,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.492544+0000","last_change":"2023-11-27T20:54:27.515432+0000","last_active":"2023-11-27T21:21:49.492544+0000","last_peered":"2023-11-27T21:21:49.492544+0000","last_clean":"2023-11-27T21:21:49.492544+0000","last_became_active":"2023-11-27T20:54:27.515182+0000","last_became_peered":"2023-11-27T20:54:27.515182+0000","last_unstale":"2023-11-27T21:21:49.492544+0000","last_undegraded":"2023-11-27T21:21:49.492544+0000","last_fullsized":"2023-11-27T21:21:49.492544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'79","reported_seq":101,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.439148+0000","last_change":"2023-11-27T20:55:00.588607+0000","last_active":"2023-11-27T21:21:49.439148+0000","last_peered":"2023-11-27T21:21:49.439148+0000","last_clean":"2023-11-27T21:21:49.439148+0000","last_became_active":"2023-11-27T20:55:00.588298+0000","last_became_peered":"2023-11-27T20:55:00.588298+0000","last_unstale":"2023-11-27T21:21:49.439148+0000","last_undegraded":"2023-11-27T21:21:49.439148+0000","last_fullsized":"2023-11-27T21:21:49.439148+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'77","reported_seq":106,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.494026+0000","last_change":"2023-11-27T20:54:27.512956+0000","last_active":"2023-11-27T21:21:49.494026+0000","last_peered":"2023-11-27T21:21:49.494026+0000","last_clean":"2023-11-27T21:21:49.494026+0000","last_became_active":"2023-11-27T20:54:27.512692+0000","last_became_peered":"2023-11-27T20:54:27.512692+0000","last_unstale":"2023-11-27T21:21:49.494026+0000","last_undegraded":"2023-11-27T21:21:49.494026+0000","last_fullsized":"2023-11-27T21:21:49.494026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"28'75","reported_seq":111,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:23.471759+0000","last_change":"2023-11-27T21:22:23.471793+0000","last_active":"2023-11-27T21:22:23.471759+0000","last_peered":"2023-11-27T21:22:23.471759+0000","last_clean":"2023-11-27T21:22:23.471759+0000","last_became_active":"2023-11-27T20:54:27.498790+0000","last_became_peered":"2023-11-27T20:54:27.498790+0000","last_unstale":"2023-11-27T21:22:23.471759+0000","last_undegraded":"2023-11-27T21:22:23.471759+0000","last_fullsized":"2023-11-27T21:22:23.471759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:23.471665+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:23.471665+0000","last_clean_scrub_stamp":"2023-11-27T21:22:23.471665+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:09:25.413821+0000","scrub_duration":0.0018897339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"28'85","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:59.437409+0000","last_change":"2023-11-27T20:54:27.513089+0000","last_active":"2023-11-27T21:21:59.437409+0000","last_peered":"2023-11-27T21:21:59.437409+0000","last_clean":"2023-11-27T21:21:59.437409+0000","last_became_active":"2023-11-27T20:54:27.512777+0000","last_became_peered":"2023-11-27T20:54:27.512777+0000","last_unstale":"2023-11-27T21:21:59.437409+0000","last_undegraded":"2023-11-27T21:21:59.437409+0000","last_fullsized":"2023-11-27T21:21:59.437409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'65","reported_seq":94,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:59.305251+0000","last_change":"2023-11-27T20:54:27.512691+0000","last_active":"2023-11-27T21:21:59.305251+0000","last_peered":"2023-11-27T21:21:59.305251+0000","last_clean":"2023-11-27T21:21:59.305251+0000","last_became_active":"2023-11-27T20:54:27.512433+0000","last_became_peered":"2023-11-27T20:54:27.512433+0000","last_unstale":"2023-11-27T21:21:59.305251+0000","last_undegraded":"2023-11-27T21:21:59.305251+0000","last_fullsized":"2023-11-27T21:21:59.305251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'62","reported_seq":99,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:05.879384+0000","last_change":"2023-11-27T21:22:05.879404+0000","last_active":"2023-11-27T21:22:05.879384+0000","last_peered":"2023-11-27T21:22:05.879384+0000","last_clean":"2023-11-27T21:22:05.879384+0000","last_became_active":"2023-11-27T20:54:27.432152+0000","last_became_peered":"2023-11-27T20:54:27.432152+0000","last_unstale":"2023-11-27T21:22:05.879384+0000","last_undegraded":"2023-11-27T21:22:05.879384+0000","last_fullsized":"2023-11-27T21:22:05.879384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'62","last_scrub_stamp":"2023-11-27T21:22:05.879322+0000","last_deep_scrub":"28'62","last_deep_scrub_stamp":"2023-11-27T21:22:05.879322+0000","last_clean_scrub_stamp":"2023-11-27T21:22:05.879322+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:16:54.519926+0000","scrub_duration":0.001294089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'69","reported_seq":98,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:59.305297+0000","last_change":"2023-11-27T20:54:27.516081+0000","last_active":"2023-11-27T21:21:59.305297+0000","last_peered":"2023-11-27T21:21:59.305297+0000","last_clean":"2023-11-27T21:21:59.305297+0000","last_became_active":"2023-11-27T20:54:27.515801+0000","last_became_peered":"2023-11-27T20:54:27.515801+0000","last_unstale":"2023-11-27T21:21:59.305297+0000","last_undegraded":"2023-11-27T21:21:59.305297+0000","last_fullsized":"2023-11-27T21:21:59.305297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'75","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:04.865769+0000","last_change":"2023-11-27T21:22:04.865788+0000","last_active":"2023-11-27T21:22:04.865769+0000","last_peered":"2023-11-27T21:22:04.865769+0000","last_clean":"2023-11-27T21:22:04.865769+0000","last_became_active":"2023-11-27T20:54:27.432160+0000","last_became_peered":"2023-11-27T20:54:27.432160+0000","last_unstale":"2023-11-27T21:22:04.865769+0000","last_undegraded":"2023-11-27T21:22:04.865769+0000","last_fullsized":"2023-11-27T21:22:04.865769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:04.865659+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:04.865659+0000","last_clean_scrub_stamp":"2023-11-27T21:22:04.865659+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:24:12.042139+0000","scrub_duration":0.001425869,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'77","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.495390+0000","last_change":"2023-11-27T20:54:27.505374+0000","last_active":"2023-11-27T21:21:49.495390+0000","last_peered":"2023-11-27T21:21:49.495390+0000","last_clean":"2023-11-27T21:21:49.495390+0000","last_became_active":"2023-11-27T20:54:27.505122+0000","last_became_peered":"2023-11-27T20:54:27.505122+0000","last_unstale":"2023-11-27T21:21:49.495390+0000","last_undegraded":"2023-11-27T21:21:49.495390+0000","last_fullsized":"2023-11-27T21:21:49.495390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"28'74","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.374209+0000","last_change":"2023-11-27T21:22:21.374228+0000","last_active":"2023-11-27T21:22:21.374209+0000","last_peered":"2023-11-27T21:22:21.374209+0000","last_clean":"2023-11-27T21:22:21.374209+0000","last_became_active":"2023-11-27T20:54:27.505236+0000","last_became_peered":"2023-11-27T20:54:27.505236+0000","last_unstale":"2023-11-27T21:22:21.374209+0000","last_undegraded":"2023-11-27T21:22:21.374209+0000","last_fullsized":"2023-11-27T21:22:21.374209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'74","last_scrub_stamp":"2023-11-27T21:22:21.374139+0000","last_deep_scrub":"28'74","last_deep_scrub_stamp":"2023-11-27T21:22:21.374139+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.374139+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:20.028040+0000","scrub_duration":0.0012971980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"28'79","reported_seq":110,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.495013+0000","last_change":"2023-11-27T20:54:27.515185+0000","last_active":"2023-11-27T21:21:49.495013+0000","last_peered":"2023-11-27T21:21:49.495013+0000","last_clean":"2023-11-27T21:21:49.495013+0000","last_became_active":"2023-11-27T20:54:27.514846+0000","last_became_peered":"2023-11-27T20:54:27.514846+0000","last_unstale":"2023-11-27T21:21:49.495013+0000","last_undegraded":"2023-11-27T21:21:49.495013+0000","last_fullsized":"2023-11-27T21:21:49.495013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":102,"num_write":4200,"num_write_kb":332069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5131,"ondisk_log_size":5131,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4855,"ondisk_log_size":4855,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":44272102,"num_objects":111,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":1673,"num_read_kb":1711,"num_write":16676,"num_write_kb":52124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20000,"num_omap_keys":40,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":88793088,"data_stored":88544204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15244,"ondisk_log_size":15244,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509783,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95988,"kb_used_data":20396,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94275852,"statfs":{"total":96636764160,"available":96538472448,"internally_reserved":0,"allocated":20885504,"data_stored":20696148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:22:04 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.42299999999999999,"15min":0.41199999999999998},"min":{"1min":0.35299999999999998,"5min":0.22700000000000001,"15min":0.19900000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.95599999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.47599999999999998,"15min":0.46700000000000003},"min":{"1min":0.37,"5min":0.27500000000000002,"15min":0.24199999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":1.1819999999999999},"last":0.53900000000000003}]},{"osd":1,"last update":"Mon Nov 27 21:22:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.441,"15min":0.434},"min":{"1min":0.33400000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.78300000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.41199999999999998,"15min":0.40999999999999998},"min":{"1min":0.308,"5min":0.25600000000000001,"15min":0.247},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":1.2250000000000001},"last":0.47099999999999997}]},{"osd":2,"last update":"Mon Nov 27 21:22:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42199999999999999,"15min":0.41099999999999998},"min":{"1min":0.28999999999999998,"5min":0.27700000000000002,"15min":0.23599999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":1.2549999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.44700000000000001,"15min":0.437},"min":{"1min":0.35599999999999998,"5min":0.26900000000000002,"15min":0.23899999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":1.2450000000000001},"last":0.55100000000000005}]},{"osd":3,"last update":"Mon Nov 27 21:22:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.44500000000000001,"15min":0.437},"min":{"1min":0.33600000000000002,"5min":0.307,"15min":0.26800000000000002},"max":{"1min":0.64700000000000002,"5min":0.66600000000000004,"15min":0.87},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.5,"5min":0.46899999999999997,"15min":0.44700000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.309},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":1.2090000000000001},"last":0.46200000000000002}]},{"osd":4,"last update":"Mon Nov 27 21:22:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.40600000000000003,"15min":0.39500000000000002},"min":{"1min":0.26900000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.52000000000000002,"5min":0.66600000000000004,"15min":0.80600000000000005},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.42599999999999999,"15min":0.41399999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.22900000000000001},"max":{"1min":0.57899999999999996,"5min":0.64900000000000002,"15min":0.92800000000000005},"last":0.40600000000000003}]},{"osd":5,"last update":"Mon Nov 27 21:22:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42099999999999999,"15min":0.40100000000000002},"min":{"1min":0.27100000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.752,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.374},{"interface":"front","average":{"1min":0.437,"5min":0.47199999999999998,"15min":0.45500000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.25},"max":{"1min":0.56000000000000005,"5min":0.74099999999999999,"15min":0.77600000000000002},"last":0.44500000000000001}]},{"osd":7,"last update":"Mon Nov 27 21:22:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46600000000000003,"15min":0.46100000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.249},"max":{"1min":0.55700000000000005,"5min":0.68200000000000005,"15min":0.95599999999999996},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48799999999999999,"15min":0.46500000000000002},"min":{"1min":0.32000000000000001,"5min":0.28599999999999998,"15min":0.28199999999999997},"max":{"1min":0.80400000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.497}]}]},{"osd":5,"up_from":15,"seq":64424509783,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94852,"kb_used_data":19260,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94276988,"statfs":{"total":96636764160,"available":96539635712,"internally_reserved":0,"allocated":19722240,"data_stored":19520171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42099999999999999,"15min":0.40799999999999997},"min":{"1min":0.29099999999999998,"5min":0.25700000000000001,"15min":0.216},"max":{"1min":0.77700000000000002,"5min":1.331,"15min":1.331},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.43099999999999999,"15min":0.42099999999999999},"min":{"1min":0.33800000000000002,"5min":0.27900000000000003,"15min":0.222},"max":{"1min":0.69399999999999995,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.434}]},{"osd":1,"last update":"Mon Nov 27 21:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.41999999999999998,"15min":0.42399999999999999},"min":{"1min":0.30599999999999999,"5min":0.224,"15min":0.221},"max":{"1min":0.56699999999999995,"5min":0.624,"15min":0.95999999999999996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.42699999999999999,"15min":0.41799999999999998},"min":{"1min":0.315,"5min":0.29699999999999999,"15min":0.28599999999999998},"max":{"1min":0.64700000000000002,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.45300000000000001}]},{"osd":2,"last update":"Mon Nov 27 21:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42299999999999999,"15min":0.42899999999999999},"min":{"1min":0.35799999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53300000000000003,"5min":0.64200000000000002,"15min":0.94599999999999995},"last":0.498},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.45100000000000001,"15min":0.432},"min":{"1min":0.35099999999999998,"5min":0.308,"15min":0.29899999999999999},"max":{"1min":0.73099999999999998,"5min":1.359,"15min":1.359},"last":0.52900000000000003}]},{"osd":3,"last update":"Mon Nov 27 21:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.46000000000000002,"15min":0.45100000000000001},"min":{"1min":0.34899999999999998,"5min":0.32500000000000001,"15min":0.28899999999999998},"max":{"1min":0.63,"5min":0.64500000000000002,"15min":0.93300000000000005},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48599999999999999,"15min":0.46000000000000002},"min":{"1min":0.35799999999999998,"5min":0.33100000000000002,"15min":0.30199999999999999},"max":{"1min":0.67500000000000004,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":0.54600000000000004}]},{"osd":4,"last update":"Mon Nov 27 21:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.377,"15min":0.375},"min":{"1min":0.24199999999999999,"5min":0.23300000000000001,"15min":0.23100000000000001},"max":{"1min":0.58399999999999996,"5min":0.65800000000000003,"15min":0.69199999999999995},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.23200000000000001},"max":{"1min":0.61799999999999999,"5min":0.66800000000000004,"15min":0.70299999999999996},"last":0.376}]},{"osd":6,"last update":"Mon Nov 27 21:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.29399999999999998,"5min":0.27100000000000002,"15min":0.246},"max":{"1min":0.60099999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42299999999999999,"15min":0.42699999999999999},"min":{"1min":0.27300000000000002,"5min":0.27100000000000002,"15min":0.23300000000000001},"max":{"1min":0.55000000000000004,"5min":0.69299999999999995,"15min":0.70399999999999996},"last":0.46400000000000002}]},{"osd":7,"last update":"Mon Nov 27 21:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.24199999999999999},"max":{"1min":0.61599999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.48499999999999999,"15min":0.48799999999999999},"min":{"1min":0.33000000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63500000000000001,"5min":0.71399999999999997,"15min":0.751},"last":0.58299999999999996}]}]},{"osd":2,"up_from":15,"seq":64424509784,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53560,"kb_used_data":8496,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318280,"statfs":{"total":96636764160,"available":96581918720,"internally_reserved":0,"allocated":8699904,"data_stored":8509387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32500000000000001,"15min":0.307},"min":{"1min":0.20899999999999999,"5min":0.19800000000000001,"15min":0.17899999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.252},{"interface":"front","average":{"1min":0.307,"5min":0.32200000000000001,"15min":0.316},"min":{"1min":0.216,"5min":0.216,"15min":0.20200000000000001},"max":{"1min":0.45800000000000002,"5min":0.48299999999999998,"15min":0.61899999999999999},"last":0.308}]},{"osd":1,"last update":"Mon Nov 27 21:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36599999999999999,"15min":0.34499999999999997},"min":{"1min":0.23200000000000001,"5min":0.20599999999999999,"15min":0.192},"max":{"1min":0.50700000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.35899999999999999,"15min":0.34899999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.20899999999999999},"max":{"1min":0.51800000000000002,"5min":0.54400000000000004,"15min":0.751},"last":0.35999999999999999}]},{"osd":3,"last update":"Mon Nov 27 21:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.36099999999999999,"15min":0.34499999999999997},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.224},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.41899999999999998,"15min":0.38900000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26100000000000001},"max":{"1min":0.61699999999999999,"5min":0.62,"15min":0.63700000000000001},"last":0.33100000000000002}]},{"osd":4,"last update":"Mon Nov 27 21:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.505,"15min":0.48599999999999999},"min":{"1min":0.32700000000000001,"5min":0.313,"15min":0.29499999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.48799999999999999,"15min":0.48299999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58599999999999997,"5min":0.78900000000000003,"15min":0.83299999999999996},"last":0.55300000000000005}]},{"osd":5,"last update":"Mon Nov 27 21:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48899999999999999,"15min":0.47799999999999998},"min":{"1min":0.34100000000000003,"5min":0.32800000000000001,"15min":0.30399999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52800000000000002,"15min":0.504},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.623}]},{"osd":6,"last update":"Mon Nov 27 21:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51500000000000001,"15min":0.505},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34000000000000002},"max":{"1min":0.70099999999999996,"5min":0.81399999999999995,"15min":0.90900000000000003},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.50700000000000001,"15min":0.495},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.316},"max":{"1min":0.753,"5min":0.753,"15min":0.76900000000000002},"last":0.53500000000000003}]},{"osd":7,"last update":"Mon Nov 27 21:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53600000000000003,"15min":0.52600000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36399999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52100000000000002,"15min":0.50700000000000001},"min":{"1min":0.373,"5min":0.36099999999999999,"15min":0.34000000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.92400000000000004},"last":0.63200000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509784,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42852,"kb_used_data":3356,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94328988,"statfs":{"total":96636764160,"available":96592883712,"internally_reserved":0,"allocated":3436544,"data_stored":3238767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.314,"15min":0.309},"min":{"1min":0.23499999999999999,"5min":0.20599999999999999,"15min":0.17000000000000001},"max":{"1min":0.503,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.317,"15min":0.308},"min":{"1min":0.23400000000000001,"5min":0.219,"15min":0.19800000000000001},"max":{"1min":0.51900000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.249}]},{"osd":2,"last update":"Mon Nov 27 21:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33100000000000002,"15min":0.313},"min":{"1min":0.216,"5min":0.20799999999999999,"15min":0.192},"max":{"1min":0.45500000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.20300000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34100000000000003,"15min":0.34300000000000003},"min":{"1min":0.29099999999999998,"5min":0.22600000000000001,"15min":0.20499999999999999},"max":{"1min":0.438,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.28699999999999998}]},{"osd":3,"last update":"Mon Nov 27 21:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.37,"15min":0.36799999999999999},"min":{"1min":0.28499999999999998,"5min":0.26800000000000002,"15min":0.23300000000000001},"max":{"1min":0.53300000000000003,"5min":0.626,"15min":0.68200000000000005},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.376,"15min":0.36799999999999999},"min":{"1min":0.252,"5min":0.24399999999999999,"15min":0.23400000000000001},"max":{"1min":0.57999999999999996,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.30299999999999999}]},{"osd":4,"last update":"Mon Nov 27 21:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.46999999999999997,"15min":0.46700000000000003},"min":{"1min":0.35799999999999998,"5min":0.313,"15min":0.26600000000000001},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.49399999999999999,"15min":0.48599999999999999},"min":{"1min":0.35299999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.65100000000000002}]},{"osd":5,"last update":"Mon Nov 27 21:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.504,"15min":0.49199999999999999},"min":{"1min":0.36399999999999999,"5min":0.35399999999999998,"15min":0.313},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.48299999999999998,"15min":0.48899999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.4079999999999999},"last":0.68000000000000005}]},{"osd":6,"last update":"Mon Nov 27 21:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52100000000000002,"15min":0.51200000000000001},"min":{"1min":0.42099999999999999,"5min":0.38200000000000001,"15min":0.33600000000000002},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.746},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.39500000000000002,"5min":0.36199999999999999,"15min":0.34499999999999997},"max":{"1min":1.292,"5min":1.292,"15min":1.4239999999999999},"last":0.53800000000000003}]},{"osd":7,"last update":"Mon Nov 27 21:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.433,"5min":0.371,"15min":0.33200000000000002},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52200000000000002,"15min":0.51800000000000002},"min":{"1min":0.40799999999999997,"5min":0.38700000000000001,"15min":0.35399999999999998},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.4399999999999999},"last":0.77200000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509783,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76024,"kb_used_data":8752,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94295816,"statfs":{"total":96636764160,"available":96558915584,"internally_reserved":0,"allocated":8962048,"data_stored":8748777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 21:22:10 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.316,"15min":0.309},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.48699999999999999,"5min":0.51800000000000002,"15min":0.57799999999999996},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.311,"5min":0.312,"15min":0.311},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.19},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.69699999999999995},"last":0.28299999999999997}]},{"osd":2,"last update":"Mon Nov 27 21:22:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.22,"5min":0.22,"15min":0.189},"max":{"1min":0.52600000000000002,"5min":0.54300000000000004,"15min":0.59299999999999997},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.34499999999999997,"15min":0.34300000000000003},"min":{"1min":0.23699999999999999,"5min":0.223,"15min":0.19900000000000001},"max":{"1min":0.42799999999999999,"5min":0.55500000000000005,"15min":0.66900000000000004},"last":0.35499999999999998}]},{"osd":3,"last update":"Mon Nov 27 21:22:10 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.35299999999999998,"15min":0.34499999999999997},"min":{"1min":0.24299999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.41799999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38400000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.21099999999999999},"max":{"1min":0.55800000000000005,"5min":0.58499999999999996,"15min":0.61599999999999999},"last":0.37}]},{"osd":4,"last update":"Mon Nov 27 21:22:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.318,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.66100000000000003,"5min":0.67000000000000004,"15min":0.81200000000000006},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47699999999999998,"15min":0.46899999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.27200000000000002},"max":{"1min":0.66000000000000003,"5min":0.71199999999999997,"15min":0.71299999999999997},"last":0.55400000000000005}]},{"osd":5,"last update":"Mon Nov 27 21:22:10 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.50600000000000001,"15min":0.495},"min":{"1min":0.39200000000000002,"5min":0.36599999999999999,"15min":0.32700000000000001},"max":{"1min":0.70199999999999996,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46200000000000002,"15min":0.45900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.317},"max":{"1min":0.626,"5min":0.753,"15min":0.85099999999999998},"last":0.63}]},{"osd":6,"last update":"Mon Nov 27 21:22:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.495,"15min":0.48899999999999999},"min":{"1min":0.36799999999999999,"5min":0.35499999999999998,"15min":0.31900000000000001},"max":{"1min":0.67600000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.52100000000000002,"15min":0.51400000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73599999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.51600000000000001}]},{"osd":7,"last update":"Mon Nov 27 21:22:10 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.33500000000000002},"max":{"1min":0.754,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.49199999999999999,"15min":0.49299999999999999},"min":{"1min":0.38100000000000001,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":0.64500000000000002,"5min":0.68899999999999995,"15min":0.78000000000000003},"last":0.496}]}]},{"osd":7,"up_from":14,"seq":60129542488,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56968,"kb_used_data":7744,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94314872,"statfs":{"total":96636764160,"available":96578428928,"internally_reserved":0,"allocated":7929856,"data_stored":7711066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":50395595},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.40699999999999997,"15min":0.40200000000000002},"min":{"1min":0.25700000000000001,"5min":0.25,"15min":0.21199999999999999},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.82899999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41499999999999998,"15min":0.42599999999999999},"min":{"1min":0.29999999999999999,"5min":0.27000000000000002,"15min":0.22900000000000001},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.61399999999999999},"last":0.54200000000000004}]},{"osd":1,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.436,"15min":0.432},"min":{"1min":0.32500000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.88500000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.44600000000000001,"15min":0.45300000000000001},"min":{"1min":0.32800000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.873},"last":0.52100000000000002}]},{"osd":2,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.42099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28100000000000003},"max":{"1min":0.51800000000000002,"5min":0.65300000000000002,"15min":0.79700000000000004},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41499999999999998,"15min":0.41899999999999998},"min":{"1min":0.34899999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.501,"5min":0.55200000000000005,"15min":0.68700000000000006},"last":0.42199999999999999}]},{"osd":3,"last update":"Mon Nov 27 21:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.433,"15min":0.44400000000000001},"min":{"1min":0.318,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.61499999999999999,"5min":0.68700000000000006,"15min":0.77100000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46000000000000002,"15min":0.45100000000000001},"min":{"1min":0.33000000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.61499999999999999,"5min":0.68600000000000005,"15min":0.90200000000000002},"last":0.44400000000000001}]},{"osd":4,"last update":"Mon Nov 27 21:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.38500000000000001,"15min":0.39600000000000002},"min":{"1min":0.26000000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.47299999999999998,"5min":0.59199999999999997,"15min":0.66600000000000004},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.42299999999999999,"15min":0.41999999999999998},"min":{"1min":0.29499999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61699999999999999,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.435}]},{"osd":5,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.45100000000000001,"15min":0.44},"min":{"1min":0.28299999999999997,"5min":0.27700000000000002,"15min":0.27300000000000002},"max":{"1min":0.75,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.42799999999999999,"15min":0.44},"min":{"1min":0.27900000000000003,"5min":0.26400000000000001,"15min":0.248},"max":{"1min":0.50700000000000001,"5min":0.71499999999999997,"15min":0.77700000000000002},"last":0.39200000000000002}]},{"osd":6,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.26600000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.56999999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.499},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49399999999999999},"min":{"1min":0.33600000000000002,"5min":0.29099999999999998,"15min":0.28100000000000003},"max":{"1min":0.69199999999999995,"5min":0.751,"15min":0.84999999999999998},"last":0.41199999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542488,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57800,"kb_used_data":8576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94314040,"statfs":{"total":96636764160,"available":96577576960,"internally_reserved":0,"allocated":8781824,"data_stored":8552244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.42199999999999999,"15min":0.40899999999999997},"min":{"1min":0.28399999999999997,"5min":0.248,"15min":0.20200000000000001},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.49299999999999999,"15min":0.44900000000000001},"min":{"1min":0.35599999999999998,"5min":0.28299999999999997,"15min":0.24099999999999999},"max":{"1min":3.948,"5min":3.948,"15min":3.948},"last":0.496}]},{"osd":1,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.47499999999999998,"15min":0.433},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.24099999999999999},"max":{"1min":5.0410000000000004,"5min":5.0410000000000004,"15min":5.0410000000000004},"last":0.435},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.433,"15min":0.41599999999999998},"min":{"1min":0.29899999999999999,"5min":0.247,"15min":0.247},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.45600000000000002}]},{"osd":2,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.45100000000000001,"15min":0.43099999999999999},"min":{"1min":0.34200000000000003,"5min":0.29499999999999998,"15min":0.26100000000000001},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.48299999999999998,"15min":0.45900000000000002},"min":{"1min":0.373,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":4.008,"5min":4.008,"15min":4.008},"last":0.34899999999999998}]},{"osd":3,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.48899999999999999,"15min":0.47099999999999997},"min":{"1min":0.33800000000000002,"5min":0.318,"15min":0.29899999999999999},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.40999999999999998},{"interface":"front","average":{"1min":1.0940000000000001,"5min":0.58899999999999997,"15min":0.496},"min":{"1min":0.33800000000000002,"5min":0.32600000000000001,"15min":0.28499999999999998},"max":{"1min":10.747999999999999,"5min":10.747999999999999,"15min":10.747999999999999},"last":0.47099999999999997}]},{"osd":5,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":1.6890000000000001,"5min":0.67600000000000005,"15min":0.47899999999999998},"min":{"1min":0.28599999999999998,"5min":0.23100000000000001,"15min":0.221},"max":{"1min":20.847999999999999,"5min":20.847999999999999,"15min":20.847999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.47099999999999997,"15min":0.43099999999999999},"min":{"1min":0.28199999999999997,"5min":0.26000000000000001,"15min":0.23100000000000001},"max":{"1min":5.0800000000000001,"5min":5.0800000000000001,"15min":5.0800000000000001},"last":0.39500000000000002}]},{"osd":6,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.435,"15min":0.41799999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.24399999999999999},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.499,"15min":0.47099999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.38100000000000001}]},{"osd":7,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46500000000000002,"15min":0.45400000000000001},"min":{"1min":0.311,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.55900000000000005,"15min":0.52000000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.33400000000000002},"max":{"1min":3.4649999999999999,"5min":3.4649999999999999,"15min":3.4649999999999999},"last":0.51100000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542488,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89188,"kb_used_data":13596,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94282652,"statfs":{"total":96636764160,"available":96545435648,"internally_reserved":0,"allocated":13922304,"data_stored":13708692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:22:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.34200000000000003,"15min":0.32500000000000001},"min":{"1min":0.254,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.42299999999999999,"15min":0.34499999999999997},"min":{"1min":0.217,"5min":0.21099999999999999,"15min":0.192},"max":{"1min":8.9369999999999994,"5min":8.9369999999999994,"15min":8.9369999999999994},"last":0.25600000000000001}]},{"osd":1,"last update":"Mon Nov 27 21:22:05 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.34100000000000003,"15min":0.32200000000000001},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":3.1230000000000002,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.39100000000000001,"15min":0.36099999999999999},"min":{"1min":0.247,"5min":0.23400000000000001,"15min":0.21199999999999999},"max":{"1min":2.8420000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.32100000000000001}]},{"osd":2,"last update":"Mon Nov 27 21:22:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.45900000000000002,"15min":0.39900000000000002},"min":{"1min":0.29999999999999999,"5min":0.25900000000000001,"15min":0.22600000000000001},"max":{"1min":7.0830000000000002,"5min":7.0830000000000002,"15min":7.0830000000000002},"last":0.372},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.39300000000000002,"15min":0.38},"min":{"1min":0.29499999999999998,"5min":0.25700000000000001,"15min":0.22600000000000001},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.28999999999999998}]},{"osd":4,"last update":"Mon Nov 27 21:22:05 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.48399999999999999,"15min":0.47099999999999997},"min":{"1min":0.35699999999999998,"5min":0.311,"15min":0.311},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.51500000000000001,"15min":0.496},"min":{"1min":0.34699999999999998,"5min":0.34499999999999997,"15min":0.314},"max":{"1min":3.0920000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":0.54400000000000004}]},{"osd":5,"last update":"Mon Nov 27 21:22:05 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.51400000000000001,"15min":0.49299999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.28499999999999998},"max":{"1min":2.5760000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.40500000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.7400000000000002,"5min":2.7400000000000002,"15min":2.7400000000000002},"last":0.40799999999999997}]},{"osd":6,"last update":"Mon Nov 27 21:22:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.55800000000000005,"15min":0.52500000000000002},"min":{"1min":0.41599999999999998,"5min":0.36899999999999999,"15min":0.311},"max":{"1min":4.7169999999999996,"5min":4.7169999999999996,"15min":4.7169999999999996},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.52300000000000002,"15min":0.51000000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.314},"max":{"1min":2.6120000000000001,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.51600000000000001}]},{"osd":7,"last update":"Mon Nov 27 21:22:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.40200000000000002,"5min":0.36099999999999999,"15min":0.35999999999999999},"max":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":0.432},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.54000000000000004,"15min":0.52900000000000003},"min":{"1min":0.379,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.503}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8667136,"data_stored":8628738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2547712,"data_stored":2528360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13627392,"data_stored":13588653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8486912,"data_stored":8432205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18833408,"data_stored":18809764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20590592,"data_stored":20576109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7634944,"data_stored":7591027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T21:22:26.349 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.349 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.349 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.349 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.349 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.350 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.350 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.350 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.350 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.350 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.350 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.350 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.351 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.351 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.351 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.351 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.351 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.351 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.351 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.352 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.352 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.352 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.352 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.352 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.352 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.352 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.352 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.353 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.353 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.353 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.353 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.353 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.353 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.353 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.353 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.354 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.354 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.354 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.354 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.354 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.354 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.354 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.355 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.355 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.355 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.355 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.355 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.355 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.355 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.356 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.356 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.356 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.356 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.356 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.356 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.356 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.356 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.357 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.357 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.357 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.357 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.357 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.358 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.358 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.358 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.358 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.358 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.358 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.358 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.359 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.359 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.359 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.359 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.359 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.359 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:26.359 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-27T21:22:39.889 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:22:39.892 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:22:44.363 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:29:08.272 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:22:44.366 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:29:08.274 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:22:44.372 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:29:08.257 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:22:44.375 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:29:08.260 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:22:44.375 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:29:08.261 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:22:44.377 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:29:08.263 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:22:44.446 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:29:08.355 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:22:44.463 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:29:08.348 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:22:44.464 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:29:08.350 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:22:46.361 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T21:22:46.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.462+0000 7f6a0c4fc640 1 Processor -- start 2023-11-27T21:22:46.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.462+0000 7f6a0c4fc640 1 -- start start 2023-11-27T21:22:46.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.463+0000 7f6a0c4fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a040cc420 0x7f6a04159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:46.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.463+0000 7f6a0c4fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6a04159b50 0x7f6a040c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:46.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.463+0000 7f6a0c4fc640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a040cbda0 con 0x7f6a040cda70 2023-11-27T21:22:46.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.463+0000 7f6a0c4fc640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a040cc230 con 0x7f6a04159b50 2023-11-27T21:22:46.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.463+0000 7f6a0c4fc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a040cea60 con 0x7f6a040cc420 2023-11-27T21:22:46.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.466+0000 7f6a0a298640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f6a040cda70 0x7f6a040ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:44842/0 (socket says 172.21.15.88:44842) 2023-11-27T21:22:46.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.466+0000 7f6a0a298640 1 -- 172.21.15.88:0/2821767114 learned_addr learned my addr 172.21.15.88:0/2821767114 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:22:46.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.467+0000 7f6a09a97640 1 --2- 172.21.15.88:0/2821767114 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a040cc420 0x7f6a04159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:46.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.470+0000 7f6a09a97640 1 -- 172.21.15.88:0/2821767114 >> v2:172.21.15.88:3300/0 conn(0x7f6a04159b50 msgr2=0x7f6a040c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:22:46.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.470+0000 7f6a09a97640 1 --2- 172.21.15.88:0/2821767114 >> v2:172.21.15.88:3300/0 conn(0x7f6a04159b50 0x7f6a040c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:46.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.470+0000 7f6a09a97640 1 -- 172.21.15.88:0/2821767114 >> v1:172.21.15.167:6789/0 conn(0x7f6a040cda70 legacy=0x7f6a040ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:46.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.470+0000 7f6a09a97640 1 -- 172.21.15.88:0/2821767114 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a040cb4e0 con 0x7f6a040cc420 2023-11-27T21:22:46.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.519+0000 7f6a09a97640 1 --2- 172.21.15.88:0/2821767114 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a040cc420 0x7f6a04159610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f69f40097a0 tx=0x7f69f402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed6303a8c9820dd7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:46.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.524+0000 7f6a09296640 1 -- 172.21.15.88:0/2821767114 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f4030610 con 0x7f6a040cc420 2023-11-27T21:22:46.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.524+0000 7f6a09296640 1 -- 172.21.15.88:0/2821767114 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f4030770 con 0x7f6a040cc420 2023-11-27T21:22:46.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.524+0000 7f6a09296640 1 -- 172.21.15.88:0/2821767114 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f4030b00 con 0x7f6a040cc420 2023-11-27T21:22:46.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.525+0000 7f6a0c4fc640 1 -- 172.21.15.88:0/2821767114 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a040cc420 msgr2=0x7f6a04159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:46.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.525+0000 7f6a0c4fc640 1 --2- 172.21.15.88:0/2821767114 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a040cc420 0x7f6a04159610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f69f40097a0 tx=0x7f69f402b960 comp rx=0 tx=0).stop 2023-11-27T21:22:46.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.525+0000 7f6a0c4fc640 1 -- 172.21.15.88:0/2821767114 shutdown_connections 2023-11-27T21:22:46.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.525+0000 7f6a0c4fc640 1 --2- 172.21.15.88:0/2821767114 >> v2:172.21.15.88:3300/0 conn(0x7f6a04159b50 0x7f6a040c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:46.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.525+0000 7f6a0c4fc640 1 --2- 172.21.15.88:0/2821767114 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a040cc420 0x7f6a04159610 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:46.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.525+0000 7f6a0c4fc640 1 -- 172.21.15.88:0/2821767114 >> 172.21.15.88:0/2821767114 conn(0x7f6a040b07b0 msgr2=0x7f6a040b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:46.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.525+0000 7f6a0c4fc640 1 -- 172.21.15.88:0/2821767114 shutdown_connections 2023-11-27T21:22:46.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.525+0000 7f6a0c4fc640 1 -- 172.21.15.88:0/2821767114 wait complete. 2023-11-27T21:22:46.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.526+0000 7f6a0c4fc640 1 Processor -- start 2023-11-27T21:22:46.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.527+0000 7f6a0c4fc640 1 -- start start 2023-11-27T21:22:46.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.527+0000 7f6a0c4fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a040cc420 0x7f6a040b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:46.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.527+0000 7f6a0c4fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a040cda70 0x7f6a041e5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:46.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.527+0000 7f6a0c4fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a04159b50 0x7f6a040b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:46.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.527+0000 7f6a0c4fc640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a041eff00 con 0x7f6a04159b50 2023-11-27T21:22:46.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.527+0000 7f6a0c4fc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a040b1860 con 0x7f6a040cda70 2023-11-27T21:22:46.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.527+0000 7f6a0c4fc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a041ef9a0 con 0x7f6a040cc420 2023-11-27T21:22:46.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.528+0000 7f6a0aa99640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a04159b50 0x7f6a040b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:46.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.528+0000 7f6a0a298640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a040cc420 0x7f6a040b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:46.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.528+0000 7f6a09a97640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a040cda70 0x7f6a041e5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:46.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.528+0000 7f6a0aa99640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a04159b50 0x7f6a040b2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60314/0 (socket says 172.21.15.88:60314) 2023-11-27T21:22:46.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.528+0000 7f6a0aa99640 1 -- 172.21.15.88:0/46515594 learned_addr learned my addr 172.21.15.88:0/46515594 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:22:46.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.531+0000 7f6a0aa99640 1 -- 172.21.15.88:0/46515594 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a040cc420 msgr2=0x7f6a040b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:46.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.531+0000 7f6a0aa99640 1 --2- 172.21.15.88:0/46515594 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a040cc420 0x7f6a040b3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:46.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.531+0000 7f6a0aa99640 1 -- 172.21.15.88:0/46515594 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a040cda70 msgr2=0x7f6a041e5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:46.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.531+0000 7f6a0aa99640 1 --2- 172.21.15.88:0/46515594 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a040cda70 0x7f6a041e5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:46.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.531+0000 7f6a0aa99640 1 -- 172.21.15.88:0/46515594 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f4009400 con 0x7f6a04159b50 2023-11-27T21:22:46.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.533+0000 7f6a0aa99640 1 --2- 172.21.15.88:0/46515594 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a04159b50 0x7f6a040b2d60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00ba10 tx=0x7f69fc00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:46.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.537+0000 7f69faffd640 1 -- 172.21.15.88:0/46515594 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc00cac0 con 0x7f6a04159b50 2023-11-27T21:22:46.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.537+0000 7f69faffd640 1 -- 172.21.15.88:0/46515594 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69fc00cc40 con 0x7f6a04159b50 2023-11-27T21:22:46.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.537+0000 7f6a0c4fc640 1 -- 172.21.15.88:0/46515594 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a040b1a90 con 0x7f6a04159b50 2023-11-27T21:22:46.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.537+0000 7f69faffd640 1 -- 172.21.15.88:0/46515594 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc014440 con 0x7f6a04159b50 2023-11-27T21:22:46.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.537+0000 7f6a0c4fc640 1 -- 172.21.15.88:0/46515594 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a041efc20 con 0x7f6a04159b50 2023-11-27T21:22:46.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.538+0000 7f6a0c4fc640 1 -- 172.21.15.88:0/46515594 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a040b2400 con 0x7f6a04159b50 2023-11-27T21:22:46.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.778+0000 7f69faffd640 1 -- 172.21.15.88:0/46515594 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f69fc01d3b0 con 0x7f6a04159b50 2023-11-27T21:22:46.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.778+0000 7f69faffd640 1 --2- 172.21.15.88:0/46515594 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f69e806b210 0x7f69e806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:22:46.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.778+0000 7f6a0a298640 1 --2- 172.21.15.88:0/46515594 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f69e806b210 0x7f69e806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:22:46.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.778+0000 7f6a0a298640 1 --2- 172.21.15.88:0/46515594 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f69e806b210 0x7f69e806d6d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6a00007fd0 tx=0x7f6a00007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:22:46.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.791+0000 7f69faffd640 1 -- 172.21.15.88:0/46515594 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f69fc0585a0 con 0x7f6a04159b50 2023-11-27T21:22:46.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.792+0000 7f69faffd640 1 -- 172.21.15.88:0/46515594 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f69fc0548e0 con 0x7f6a04159b50 2023-11-27T21:22:46.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.958+0000 7f6a0c4fc640 1 -- 172.21.15.88:0/46515594 --> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6a040cb750 con 0x7f69e806b210 2023-11-27T21:22:46.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.967+0000 7f69faffd640 1 -- 172.21.15.88:0/46515594 <== mgr.4105 v2:172.21.15.88:6800/352455703 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371477 (secure 0 0 0) 0x7f6a00001460 con 0x7f69e806b210 2023-11-27T21:22:46.973 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T21:22:46.975 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-11-27T21:22:46.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.970+0000 7f6a0c4fc640 1 -- 172.21.15.88:0/46515594 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f69e806b210 msgr2=0x7f69e806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:46.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.970+0000 7f6a0c4fc640 1 --2- 172.21.15.88:0/46515594 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f69e806b210 0x7f69e806d6d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6a00007fd0 tx=0x7f6a00007e80 comp rx=0 tx=0).stop 2023-11-27T21:22:46.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.970+0000 7f6a0c4fc640 1 -- 172.21.15.88:0/46515594 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a04159b50 msgr2=0x7f6a040b2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:22:46.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.970+0000 7f6a0c4fc640 1 --2- 172.21.15.88:0/46515594 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a04159b50 0x7f6a040b2d60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00ba10 tx=0x7f69fc00bed0 comp rx=0 tx=0).stop 2023-11-27T21:22:46.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.971+0000 7f6a0c4fc640 1 -- 172.21.15.88:0/46515594 shutdown_connections 2023-11-27T21:22:46.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.971+0000 7f6a0c4fc640 1 --2- 172.21.15.88:0/46515594 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f69e806b210 0x7f69e806d6d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:46.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.971+0000 7f6a0c4fc640 1 --2- 172.21.15.88:0/46515594 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a04159b50 0x7f6a040b2d60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:46.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.971+0000 7f6a0c4fc640 1 --2- 172.21.15.88:0/46515594 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a040cda70 0x7f6a041e5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:46.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.971+0000 7f6a0c4fc640 1 --2- 172.21.15.88:0/46515594 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a040cc420 0x7f6a040b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:22:46.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.971+0000 7f6a0c4fc640 1 -- 172.21.15.88:0/46515594 >> 172.21.15.88:0/46515594 conn(0x7f6a040b07b0 msgr2=0x7f6a040afb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:22:46.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.971+0000 7f6a0c4fc640 1 -- 172.21.15.88:0/46515594 shutdown_connections 2023-11-27T21:22:46.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:22:46.971+0000 7f6a0c4fc640 1 -- 172.21.15.88:0/46515594 wait complete. 2023-11-27T21:22:46.984 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":881,"stamp":"2023-11-27T21:22:45.279050+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":44862470,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":1793,"num_read_kb":1913,"num_write":21035,"num_write_kb":386609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20000,"num_omap_keys":40,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25372,"ondisk_log_size":25372,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":567232,"kb_used_data":90176,"kb_used_omap":12,"kb_used_meta":476979,"kb_avail":754407488,"statfs":{"total":773094113280,"available":772513267712,"internally_reserved":0,"allocated":92340224,"data_stored":90685252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":488427057},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003419"},"pg_stats":[{"pgid":"2.1f","version":"28'339","reported_seq":379,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.533002+0000","last_change":"2023-11-27T21:22:21.533049+0000","last_active":"2023-11-27T21:22:21.533002+0000","last_peered":"2023-11-27T21:22:21.533002+0000","last_clean":"2023-11-27T21:22:21.533002+0000","last_became_active":"2023-11-27T20:54:26.221715+0000","last_became_peered":"2023-11-27T20:54:26.221715+0000","last_unstale":"2023-11-27T21:22:21.533002+0000","last_undegraded":"2023-11-27T21:22:21.533002+0000","last_fullsized":"2023-11-27T21:22:21.533002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'339","last_scrub_stamp":"2023-11-27T21:22:21.532905+0000","last_deep_scrub":"28'339","last_deep_scrub_stamp":"2023-11-27T21:22:21.532905+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.532905+0000","objects_scrubbed":7,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:03:03.041969+0000","scrub_duration":0.0081144100000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922212,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":1068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"28'71","reported_seq":103,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:03.525342+0000","last_change":"2023-11-27T20:54:27.508401+0000","last_active":"2023-11-27T21:22:03.525342+0000","last_peered":"2023-11-27T21:22:03.525342+0000","last_clean":"2023-11-27T21:22:03.525342+0000","last_became_active":"2023-11-27T20:54:27.508003+0000","last_became_peered":"2023-11-27T20:54:27.508003+0000","last_unstale":"2023-11-27T21:22:03.525342+0000","last_undegraded":"2023-11-27T21:22:03.525342+0000","last_fullsized":"2023-11-27T21:22:03.525342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"28'159","reported_seq":194,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:27.322551+0000","last_change":"2023-11-27T21:22:27.322575+0000","last_active":"2023-11-27T21:22:27.322551+0000","last_peered":"2023-11-27T21:22:27.322551+0000","last_clean":"2023-11-27T21:22:27.322551+0000","last_became_active":"2023-11-27T20:54:31.836803+0000","last_became_peered":"2023-11-27T20:54:31.836803+0000","last_unstale":"2023-11-27T21:22:27.322551+0000","last_undegraded":"2023-11-27T21:22:27.322551+0000","last_fullsized":"2023-11-27T21:22:27.322551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'159","last_scrub_stamp":"2023-11-27T21:22:27.322480+0000","last_deep_scrub":"28'159","last_deep_scrub_stamp":"2023-11-27T21:22:27.322480+0000","last_clean_scrub_stamp":"2023-11-27T21:22:27.322480+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:08:23.783315+0000","scrub_duration":0.0022460409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":7710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'739","reported_seq":780,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:28.459705+0000","last_change":"2023-11-27T21:22:28.459705+0000","last_active":"2023-11-27T21:22:28.459705+0000","last_peered":"2023-11-27T21:22:28.459705+0000","last_clean":"2023-11-27T21:22:28.459705+0000","last_became_active":"2023-11-27T20:54:26.227620+0000","last_became_peered":"2023-11-27T20:54:26.227620+0000","last_unstale":"2023-11-27T21:22:28.459705+0000","last_undegraded":"2023-11-27T21:22:28.459705+0000","last_fullsized":"2023-11-27T21:22:28.459705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'739","last_scrub_stamp":"2023-11-27T21:22:28.459580+0000","last_deep_scrub":"28'739","last_deep_scrub_stamp":"2023-11-27T21:22:28.459580+0000","last_clean_scrub_stamp":"2023-11-27T21:22:28.459580+0000","objects_scrubbed":1,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:57:22.369660+0000","scrub_duration":0.011554231,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":733,"num_write_kb":4484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"28'77","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.476188+0000","last_change":"2023-11-27T20:54:27.507740+0000","last_active":"2023-11-27T21:21:49.476188+0000","last_peered":"2023-11-27T21:21:49.476188+0000","last_clean":"2023-11-27T21:21:49.476188+0000","last_became_active":"2023-11-27T20:54:27.507460+0000","last_became_peered":"2023-11-27T20:54:27.507460+0000","last_unstale":"2023-11-27T21:21:49.476188+0000","last_undegraded":"2023-11-27T21:21:49.476188+0000","last_fullsized":"2023-11-27T21:21:49.476188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"28'166","reported_seq":210,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:20.702787+0000","last_change":"2023-11-27T21:22:20.702834+0000","last_active":"2023-11-27T21:22:20.702787+0000","last_peered":"2023-11-27T21:22:20.702787+0000","last_clean":"2023-11-27T21:22:20.702787+0000","last_became_active":"2023-11-27T20:55:00.593543+0000","last_became_peered":"2023-11-27T20:55:00.593543+0000","last_unstale":"2023-11-27T21:22:20.702787+0000","last_undegraded":"2023-11-27T21:22:20.702787+0000","last_fullsized":"2023-11-27T21:22:20.702787+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'166","last_scrub_stamp":"2023-11-27T21:22:20.702707+0000","last_deep_scrub":"28'166","last_deep_scrub_stamp":"2023-11-27T21:22:20.702707+0000","last_clean_scrub_stamp":"2023-11-27T21:22:20.702707+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:34.996116+0000","scrub_duration":0.0026403020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":12743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"28'187","reported_seq":225,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:18.415812+0000","last_change":"2023-11-27T21:22:18.415839+0000","last_active":"2023-11-27T21:22:18.415812+0000","last_peered":"2023-11-27T21:22:18.415812+0000","last_clean":"2023-11-27T21:22:18.415812+0000","last_became_active":"2023-11-27T20:54:26.226407+0000","last_became_peered":"2023-11-27T20:54:26.226407+0000","last_unstale":"2023-11-27T21:22:18.415812+0000","last_undegraded":"2023-11-27T21:22:18.415812+0000","last_fullsized":"2023-11-27T21:22:18.415812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'187","last_scrub_stamp":"2023-11-27T21:22:18.415750+0000","last_deep_scrub":"28'187","last_deep_scrub_stamp":"2023-11-27T21:22:18.415750+0000","last_clean_scrub_stamp":"2023-11-27T21:22:18.415750+0000","objects_scrubbed":7,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:09.265948+0000","scrub_duration":0.0049688789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'78","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:19.383288+0000","last_change":"2023-11-27T21:22:19.383307+0000","last_active":"2023-11-27T21:22:19.383288+0000","last_peered":"2023-11-27T21:22:19.383288+0000","last_clean":"2023-11-27T21:22:19.383288+0000","last_became_active":"2023-11-27T20:54:27.512548+0000","last_became_peered":"2023-11-27T20:54:27.512548+0000","last_unstale":"2023-11-27T21:22:19.383288+0000","last_undegraded":"2023-11-27T21:22:19.383288+0000","last_fullsized":"2023-11-27T21:22:19.383288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'78","last_scrub_stamp":"2023-11-27T21:22:19.383221+0000","last_deep_scrub":"28'78","last_deep_scrub_stamp":"2023-11-27T21:22:19.383221+0000","last_clean_scrub_stamp":"2023-11-27T21:22:19.383221+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:56:13.237697+0000","scrub_duration":0.0011829830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"28'164","reported_seq":191,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:01.203495+0000","last_change":"2023-11-27T20:54:31.828391+0000","last_active":"2023-11-27T21:22:01.203495+0000","last_peered":"2023-11-27T21:22:01.203495+0000","last_clean":"2023-11-27T21:22:01.203495+0000","last_became_active":"2023-11-27T20:54:31.828045+0000","last_became_peered":"2023-11-27T20:54:31.828045+0000","last_unstale":"2023-11-27T21:22:01.203495+0000","last_undegraded":"2023-11-27T21:22:01.203495+0000","last_fullsized":"2023-11-27T21:22:01.203495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":12089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"28'12","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:25.356913+0000","last_change":"2023-11-27T21:22:25.356937+0000","last_active":"2023-11-27T21:22:25.356913+0000","last_peered":"2023-11-27T21:22:25.356913+0000","last_clean":"2023-11-27T21:22:25.356913+0000","last_became_active":"2023-11-27T20:54:26.226522+0000","last_became_peered":"2023-11-27T20:54:26.226522+0000","last_unstale":"2023-11-27T21:22:25.356913+0000","last_undegraded":"2023-11-27T21:22:25.356913+0000","last_fullsized":"2023-11-27T21:22:25.356913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2023-11-27T21:22:25.356853+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2023-11-27T21:22:25.356853+0000","last_clean_scrub_stamp":"2023-11-27T21:22:25.356853+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:24.010754+0000","scrub_duration":0.0030610910000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"28'85","reported_seq":121,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:57.961750+0000","last_change":"2023-11-27T20:55:00.790042+0000","last_active":"2023-11-27T21:21:57.961750+0000","last_peered":"2023-11-27T21:21:57.961750+0000","last_clean":"2023-11-27T21:21:57.961750+0000","last_became_active":"2023-11-27T20:55:00.789772+0000","last_became_peered":"2023-11-27T20:55:00.789772+0000","last_unstale":"2023-11-27T21:21:57.961750+0000","last_undegraded":"2023-11-27T21:21:57.961750+0000","last_fullsized":"2023-11-27T21:21:57.961750+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"28'169","reported_seq":204,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.736963+0000","last_change":"2023-11-27T21:22:21.736983+0000","last_active":"2023-11-27T21:22:21.736963+0000","last_peered":"2023-11-27T21:22:21.736963+0000","last_clean":"2023-11-27T21:22:21.736963+0000","last_became_active":"2023-11-27T20:54:31.828371+0000","last_became_peered":"2023-11-27T20:54:31.828371+0000","last_unstale":"2023-11-27T21:22:21.736963+0000","last_undegraded":"2023-11-27T21:22:21.736963+0000","last_fullsized":"2023-11-27T21:22:21.736963+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'169","last_scrub_stamp":"2023-11-27T21:22:21.736882+0000","last_deep_scrub":"28'169","last_deep_scrub_stamp":"2023-11-27T21:22:21.736882+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.736882+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:39:05.705679+0000","scrub_duration":0.0027207239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":6774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"28'74","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:01.957421+0000","last_change":"2023-11-27T20:54:27.498572+0000","last_active":"2023-11-27T21:22:01.957421+0000","last_peered":"2023-11-27T21:22:01.957421+0000","last_clean":"2023-11-27T21:22:01.957421+0000","last_became_active":"2023-11-27T20:54:27.498279+0000","last_became_peered":"2023-11-27T20:54:27.498279+0000","last_unstale":"2023-11-27T21:22:01.957421+0000","last_undegraded":"2023-11-27T21:22:01.957421+0000","last_fullsized":"2023-11-27T21:22:01.957421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'1121","reported_seq":1152,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:38.067554+0000","last_change":"2023-11-27T20:54:26.227734+0000","last_active":"2023-11-27T21:21:38.067554+0000","last_peered":"2023-11-27T21:21:38.067554+0000","last_clean":"2023-11-27T21:21:38.067554+0000","last_became_active":"2023-11-27T20:54:26.227503+0000","last_became_peered":"2023-11-27T20:54:26.227503+0000","last_unstale":"2023-11-27T21:21:38.067554+0000","last_undegraded":"2023-11-27T21:21:38.067554+0000","last_fullsized":"2023-11-27T21:21:38.067554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":1121,"log_dups_size":0,"ondisk_log_size":1121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1114,"num_write_kb":4562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"28'173","reported_seq":201,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:32.958848+0000","last_change":"2023-11-27T20:54:31.827976+0000","last_active":"2023-11-27T21:21:32.958848+0000","last_peered":"2023-11-27T21:21:32.958848+0000","last_clean":"2023-11-27T21:21:32.958848+0000","last_became_active":"2023-11-27T20:54:31.827631+0000","last_became_peered":"2023-11-27T20:54:31.827631+0000","last_unstale":"2023-11-27T21:21:32.958848+0000","last_undegraded":"2023-11-27T21:21:32.958848+0000","last_fullsized":"2023-11-27T21:21:32.958848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":8292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"28'70","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:24.322940+0000","last_change":"2023-11-27T21:22:24.322960+0000","last_active":"2023-11-27T21:22:24.322940+0000","last_peered":"2023-11-27T21:22:24.322940+0000","last_clean":"2023-11-27T21:22:24.322940+0000","last_became_active":"2023-11-27T20:54:27.510668+0000","last_became_peered":"2023-11-27T20:54:27.510668+0000","last_unstale":"2023-11-27T21:22:24.322940+0000","last_undegraded":"2023-11-27T21:22:24.322940+0000","last_fullsized":"2023-11-27T21:22:24.322940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'70","last_scrub_stamp":"2023-11-27T21:22:24.322871+0000","last_deep_scrub":"28'70","last_deep_scrub_stamp":"2023-11-27T21:22:24.322871+0000","last_clean_scrub_stamp":"2023-11-27T21:22:24.322871+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:12:30.073196+0000","scrub_duration":0.0016321840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'447","reported_seq":487,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:11.006346+0000","last_change":"2023-11-27T21:22:11.006346+0000","last_active":"2023-11-27T21:22:11.006346+0000","last_peered":"2023-11-27T21:22:11.006346+0000","last_clean":"2023-11-27T21:22:11.006346+0000","last_became_active":"2023-11-27T20:54:26.231081+0000","last_became_peered":"2023-11-27T20:54:26.231081+0000","last_unstale":"2023-11-27T21:22:11.006346+0000","last_undegraded":"2023-11-27T21:22:11.006346+0000","last_fullsized":"2023-11-27T21:22:11.006346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'447","last_scrub_stamp":"2023-11-27T21:22:11.006247+0000","last_deep_scrub":"28'447","last_deep_scrub_stamp":"2023-11-27T21:22:11.006247+0000","last_clean_scrub_stamp":"2023-11-27T21:22:11.006247+0000","objects_scrubbed":2,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:24:18.182726+0000","scrub_duration":0.0020915840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"28'191","reported_seq":219,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:34.301255+0000","last_change":"2023-11-27T20:54:31.817058+0000","last_active":"2023-11-27T21:21:34.301255+0000","last_peered":"2023-11-27T21:21:34.301255+0000","last_clean":"2023-11-27T21:21:34.301255+0000","last_became_active":"2023-11-27T20:54:31.816700+0000","last_became_peered":"2023-11-27T20:54:31.816700+0000","last_unstale":"2023-11-27T21:21:34.301255+0000","last_undegraded":"2023-11-27T21:21:34.301255+0000","last_fullsized":"2023-11-27T21:21:34.301255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":12458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"28'73","reported_seq":112,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:39.536435+0000","last_change":"2023-11-27T21:22:39.536481+0000","last_active":"2023-11-27T21:22:39.536435+0000","last_peered":"2023-11-27T21:22:39.536435+0000","last_clean":"2023-11-27T21:22:39.536435+0000","last_became_active":"2023-11-27T20:54:27.509961+0000","last_became_peered":"2023-11-27T20:54:27.509961+0000","last_unstale":"2023-11-27T21:22:39.536435+0000","last_undegraded":"2023-11-27T21:22:39.536435+0000","last_fullsized":"2023-11-27T21:22:39.536435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'73","last_scrub_stamp":"2023-11-27T21:22:39.536306+0000","last_deep_scrub":"28'73","last_deep_scrub_stamp":"2023-11-27T21:22:39.536306+0000","last_clean_scrub_stamp":"2023-11-27T21:22:39.536306+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:15:26.032520+0000","scrub_duration":0.001632695,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'339","reported_seq":379,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:17.537795+0000","last_change":"2023-11-27T21:22:17.537795+0000","last_active":"2023-11-27T21:22:17.537795+0000","last_peered":"2023-11-27T21:22:17.537795+0000","last_clean":"2023-11-27T21:22:17.537795+0000","last_became_active":"2023-11-27T20:54:26.223717+0000","last_became_peered":"2023-11-27T20:54:26.223717+0000","last_unstale":"2023-11-27T21:22:17.537795+0000","last_undegraded":"2023-11-27T21:22:17.537795+0000","last_fullsized":"2023-11-27T21:22:17.537795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'339","last_scrub_stamp":"2023-11-27T21:22:17.537656+0000","last_deep_scrub":"28'339","last_deep_scrub_stamp":"2023-11-27T21:22:17.537656+0000","last_clean_scrub_stamp":"2023-11-27T21:22:17.537656+0000","objects_scrubbed":4,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:35:27.345606+0000","scrub_duration":0.0048066070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":333,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'146","reported_seq":182,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:31.285973+0000","last_change":"2023-11-27T21:22:31.285997+0000","last_active":"2023-11-27T21:22:31.285973+0000","last_peered":"2023-11-27T21:22:31.285973+0000","last_clean":"2023-11-27T21:22:31.285973+0000","last_became_active":"2023-11-27T20:54:31.836346+0000","last_became_peered":"2023-11-27T20:54:31.836346+0000","last_unstale":"2023-11-27T21:22:31.285973+0000","last_undegraded":"2023-11-27T21:22:31.285973+0000","last_fullsized":"2023-11-27T21:22:31.285973+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'146","last_scrub_stamp":"2023-11-27T21:22:31.285890+0000","last_deep_scrub":"28'146","last_deep_scrub_stamp":"2023-11-27T21:22:31.285890+0000","last_clean_scrub_stamp":"2023-11-27T21:22:31.285890+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:35:41.093841+0000","scrub_duration":0.0026461219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":6504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'66","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:18.554510+0000","last_change":"2023-11-27T21:22:18.554510+0000","last_active":"2023-11-27T21:22:18.554510+0000","last_peered":"2023-11-27T21:22:18.554510+0000","last_clean":"2023-11-27T21:22:18.554510+0000","last_became_active":"2023-11-27T20:54:27.493327+0000","last_became_peered":"2023-11-27T20:54:27.493327+0000","last_unstale":"2023-11-27T21:22:18.554510+0000","last_undegraded":"2023-11-27T21:22:18.554510+0000","last_fullsized":"2023-11-27T21:22:18.554510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'66","last_scrub_stamp":"2023-11-27T21:22:18.554433+0000","last_deep_scrub":"28'66","last_deep_scrub_stamp":"2023-11-27T21:22:18.554433+0000","last_clean_scrub_stamp":"2023-11-27T21:22:18.554433+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:39:55.933857+0000","scrub_duration":0.0016646670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"28'8","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.398392+0000","last_change":"2023-11-27T21:22:02.398392+0000","last_active":"2023-11-27T21:22:02.398392+0000","last_peered":"2023-11-27T21:22:02.398392+0000","last_clean":"2023-11-27T21:22:02.398392+0000","last_became_active":"2023-11-27T20:54:26.227120+0000","last_became_peered":"2023-11-27T20:54:26.227120+0000","last_unstale":"2023-11-27T21:22:02.398392+0000","last_undegraded":"2023-11-27T21:22:02.398392+0000","last_fullsized":"2023-11-27T21:22:02.398392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2023-11-27T21:22:02.398284+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2023-11-27T21:22:02.398284+0000","last_clean_scrub_stamp":"2023-11-27T21:22:02.398284+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:09:04.340440+0000","scrub_duration":0.00264496,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'197","reported_seq":234,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:34.272587+0000","last_change":"2023-11-27T20:55:01.286453+0000","last_active":"2023-11-27T21:21:34.272587+0000","last_peered":"2023-11-27T21:21:34.272587+0000","last_clean":"2023-11-27T21:21:34.272587+0000","last_became_active":"2023-11-27T20:55:01.286057+0000","last_became_peered":"2023-11-27T20:55:01.286057+0000","last_unstale":"2023-11-27T21:21:34.272587+0000","last_undegraded":"2023-11-27T21:21:34.272587+0000","last_fullsized":"2023-11-27T21:21:34.272587+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":17829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5,7],"acting":[2,1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"28'63","reported_seq":102,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:04.544551+0000","last_change":"2023-11-27T21:22:04.544551+0000","last_active":"2023-11-27T21:22:04.544551+0000","last_peered":"2023-11-27T21:22:04.544551+0000","last_clean":"2023-11-27T21:22:04.544551+0000","last_became_active":"2023-11-27T20:54:27.510573+0000","last_became_peered":"2023-11-27T20:54:27.510573+0000","last_unstale":"2023-11-27T21:22:04.544551+0000","last_undegraded":"2023-11-27T21:22:04.544551+0000","last_fullsized":"2023-11-27T21:22:04.544551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'63","last_scrub_stamp":"2023-11-27T21:22:04.544471+0000","last_deep_scrub":"28'63","last_deep_scrub_stamp":"2023-11-27T21:22:04.544471+0000","last_clean_scrub_stamp":"2023-11-27T21:22:04.544471+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:57:01.291364+0000","scrub_duration":0.0011139559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'13","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:01.957253+0000","last_change":"2023-11-27T20:54:26.224703+0000","last_active":"2023-11-27T21:22:01.957253+0000","last_peered":"2023-11-27T21:22:01.957253+0000","last_clean":"2023-11-27T21:22:01.957253+0000","last_became_active":"2023-11-27T20:54:26.224412+0000","last_became_peered":"2023-11-27T20:54:26.224412+0000","last_unstale":"2023-11-27T21:22:01.957253+0000","last_undegraded":"2023-11-27T21:22:01.957253+0000","last_fullsized":"2023-11-27T21:22:01.957253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'174","reported_seq":211,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:24.777115+0000","last_change":"2023-11-27T21:22:24.777150+0000","last_active":"2023-11-27T21:22:24.777115+0000","last_peered":"2023-11-27T21:22:24.777115+0000","last_clean":"2023-11-27T21:22:24.777115+0000","last_became_active":"2023-11-27T20:54:31.819371+0000","last_became_peered":"2023-11-27T20:54:31.819371+0000","last_unstale":"2023-11-27T21:22:24.777115+0000","last_undegraded":"2023-11-27T21:22:24.777115+0000","last_fullsized":"2023-11-27T21:22:24.777115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'174","last_scrub_stamp":"2023-11-27T21:22:24.777034+0000","last_deep_scrub":"28'174","last_deep_scrub_stamp":"2023-11-27T21:22:24.777034+0000","last_clean_scrub_stamp":"2023-11-27T21:22:24.777034+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:57:18.687113+0000","scrub_duration":0.0029222290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":8398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"28'71","reported_seq":110,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:05.539610+0000","last_change":"2023-11-27T21:22:05.539610+0000","last_active":"2023-11-27T21:22:05.539610+0000","last_peered":"2023-11-27T21:22:05.539610+0000","last_clean":"2023-11-27T21:22:05.539610+0000","last_became_active":"2023-11-27T20:54:27.500455+0000","last_became_peered":"2023-11-27T20:54:27.500455+0000","last_unstale":"2023-11-27T21:22:05.539610+0000","last_undegraded":"2023-11-27T21:22:05.539610+0000","last_fullsized":"2023-11-27T21:22:05.539610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'71","last_scrub_stamp":"2023-11-27T21:22:05.539526+0000","last_deep_scrub":"28'71","last_deep_scrub_stamp":"2023-11-27T21:22:05.539526+0000","last_clean_scrub_stamp":"2023-11-27T21:22:05.539526+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:13:29.395135+0000","scrub_duration":0.001413643,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'163","reported_seq":203,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:14.476551+0000","last_change":"2023-11-27T21:22:14.476551+0000","last_active":"2023-11-27T21:22:14.476551+0000","last_peered":"2023-11-27T21:22:14.476551+0000","last_clean":"2023-11-27T21:22:14.476551+0000","last_became_active":"2023-11-27T20:54:26.222981+0000","last_became_peered":"2023-11-27T20:54:26.222981+0000","last_unstale":"2023-11-27T21:22:14.476551+0000","last_undegraded":"2023-11-27T21:22:14.476551+0000","last_fullsized":"2023-11-27T21:22:14.476551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'163","last_scrub_stamp":"2023-11-27T21:22:14.476461+0000","last_deep_scrub":"28'163","last_deep_scrub_stamp":"2023-11-27T21:22:14.476461+0000","last_clean_scrub_stamp":"2023-11-27T21:22:14.476461+0000","objects_scrubbed":4,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:08:10.937295+0000","scrub_duration":0.0035278750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":391,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"28'157","reported_seq":187,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.769437+0000","last_change":"2023-11-27T20:54:31.814118+0000","last_active":"2023-11-27T21:22:02.769437+0000","last_peered":"2023-11-27T21:22:02.769437+0000","last_clean":"2023-11-27T21:22:02.769437+0000","last_became_active":"2023-11-27T20:54:31.813765+0000","last_became_peered":"2023-11-27T20:54:31.813765+0000","last_unstale":"2023-11-27T21:22:02.769437+0000","last_undegraded":"2023-11-27T21:22:02.769437+0000","last_fullsized":"2023-11-27T21:22:02.769437+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":11921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"28'78","reported_seq":117,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.165891+0000","last_change":"2023-11-27T21:22:21.165911+0000","last_active":"2023-11-27T21:22:21.165891+0000","last_peered":"2023-11-27T21:22:21.165891+0000","last_clean":"2023-11-27T21:22:21.165891+0000","last_became_active":"2023-11-27T20:54:27.506210+0000","last_became_peered":"2023-11-27T20:54:27.506210+0000","last_unstale":"2023-11-27T21:22:21.165891+0000","last_undegraded":"2023-11-27T21:22:21.165891+0000","last_fullsized":"2023-11-27T21:22:21.165891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'78","last_scrub_stamp":"2023-11-27T21:22:21.165807+0000","last_deep_scrub":"28'78","last_deep_scrub_stamp":"2023-11-27T21:22:21.165807+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.165807+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:48:07.689268+0000","scrub_duration":0.0012874189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'248","reported_seq":288,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:27.576119+0000","last_change":"2023-11-27T21:22:27.576142+0000","last_active":"2023-11-27T21:22:27.576119+0000","last_peered":"2023-11-27T21:22:27.576119+0000","last_clean":"2023-11-27T21:22:27.576119+0000","last_became_active":"2023-11-27T20:54:26.219775+0000","last_became_peered":"2023-11-27T20:54:26.219775+0000","last_unstale":"2023-11-27T21:22:27.576119+0000","last_undegraded":"2023-11-27T21:22:27.576119+0000","last_fullsized":"2023-11-27T21:22:27.576119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'248","last_scrub_stamp":"2023-11-27T21:22:27.576061+0000","last_deep_scrub":"28'248","last_deep_scrub_stamp":"2023-11-27T21:22:27.576061+0000","last_clean_scrub_stamp":"2023-11-27T21:22:27.576061+0000","objects_scrubbed":3,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:13:50.937641+0000","scrub_duration":0.004309823,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"28'177","reported_seq":214,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:30.072341+0000","last_change":"2023-11-27T21:22:30.072362+0000","last_active":"2023-11-27T21:22:30.072341+0000","last_peered":"2023-11-27T21:22:30.072341+0000","last_clean":"2023-11-27T21:22:30.072341+0000","last_became_active":"2023-11-27T20:54:31.825591+0000","last_became_peered":"2023-11-27T20:54:31.825591+0000","last_unstale":"2023-11-27T21:22:30.072341+0000","last_undegraded":"2023-11-27T21:22:30.072341+0000","last_fullsized":"2023-11-27T21:22:30.072341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'177","last_scrub_stamp":"2023-11-27T21:22:30.072272+0000","last_deep_scrub":"28'177","last_deep_scrub_stamp":"2023-11-27T21:22:30.072272+0000","last_clean_scrub_stamp":"2023-11-27T21:22:30.072272+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:48:50.193448+0000","scrub_duration":0.002828517,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":8135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"28'65","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:06.889843+0000","last_change":"2023-11-27T21:22:06.889864+0000","last_active":"2023-11-27T21:22:06.889843+0000","last_peered":"2023-11-27T21:22:06.889843+0000","last_clean":"2023-11-27T21:22:06.889843+0000","last_became_active":"2023-11-27T20:54:27.500677+0000","last_became_peered":"2023-11-27T20:54:27.500677+0000","last_unstale":"2023-11-27T21:22:06.889843+0000","last_undegraded":"2023-11-27T21:22:06.889843+0000","last_fullsized":"2023-11-27T21:22:06.889843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'65","last_scrub_stamp":"2023-11-27T21:22:06.889775+0000","last_deep_scrub":"28'65","last_deep_scrub_stamp":"2023-11-27T21:22:06.889775+0000","last_clean_scrub_stamp":"2023-11-27T21:22:06.889775+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:19:12.052405+0000","scrub_duration":0.0014482970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"28'6","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:26.399700+0000","last_change":"2023-11-27T21:22:26.399718+0000","last_active":"2023-11-27T21:22:26.399700+0000","last_peered":"2023-11-27T21:22:26.399700+0000","last_clean":"2023-11-27T21:22:26.399700+0000","last_became_active":"2023-11-27T20:54:26.227605+0000","last_became_peered":"2023-11-27T20:54:26.227605+0000","last_unstale":"2023-11-27T21:22:26.399700+0000","last_undegraded":"2023-11-27T21:22:26.399700+0000","last_fullsized":"2023-11-27T21:22:26.399700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2023-11-27T21:22:26.399642+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2023-11-27T21:22:26.399642+0000","last_clean_scrub_stamp":"2023-11-27T21:22:26.399642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:39:10.368439+0000","scrub_duration":0.0011058719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"28'178","reported_seq":215,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:27.137341+0000","last_change":"2023-11-27T21:22:27.137378+0000","last_active":"2023-11-27T21:22:27.137341+0000","last_peered":"2023-11-27T21:22:27.137341+0000","last_clean":"2023-11-27T21:22:27.137341+0000","last_became_active":"2023-11-27T20:54:31.826406+0000","last_became_peered":"2023-11-27T20:54:31.826406+0000","last_unstale":"2023-11-27T21:22:27.137341+0000","last_undegraded":"2023-11-27T21:22:27.137341+0000","last_fullsized":"2023-11-27T21:22:27.137341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'178","last_scrub_stamp":"2023-11-27T21:22:27.137245+0000","last_deep_scrub":"28'178","last_deep_scrub_stamp":"2023-11-27T21:22:27.137245+0000","last_clean_scrub_stamp":"2023-11-27T21:22:27.137245+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:57:21.047325+0000","scrub_duration":0.0027180899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":6957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"28'85","reported_seq":116,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.493092+0000","last_change":"2023-11-27T20:54:27.517007+0000","last_active":"2023-11-27T21:21:49.493092+0000","last_peered":"2023-11-27T21:21:49.493092+0000","last_clean":"2023-11-27T21:21:49.493092+0000","last_became_active":"2023-11-27T20:54:27.516686+0000","last_became_peered":"2023-11-27T20:54:27.516686+0000","last_unstale":"2023-11-27T21:21:49.493092+0000","last_undegraded":"2023-11-27T21:21:49.493092+0000","last_fullsized":"2023-11-27T21:21:49.493092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'918","reported_seq":958,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:23.574077+0000","last_change":"2023-11-27T21:22:23.574100+0000","last_active":"2023-11-27T21:22:23.574077+0000","last_peered":"2023-11-27T21:22:23.574077+0000","last_clean":"2023-11-27T21:22:23.574077+0000","last_became_active":"2023-11-27T20:54:26.229985+0000","last_became_peered":"2023-11-27T20:54:26.229985+0000","last_unstale":"2023-11-27T21:22:23.574077+0000","last_undegraded":"2023-11-27T21:22:23.574077+0000","last_fullsized":"2023-11-27T21:22:23.574077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'918","last_scrub_stamp":"2023-11-27T21:22:23.574017+0000","last_deep_scrub":"28'918","last_deep_scrub_stamp":"2023-11-27T21:22:23.574017+0000","last_clean_scrub_stamp":"2023-11-27T21:22:23.574017+0000","objects_scrubbed":3,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:34:39.196551+0000","scrub_duration":0.013397599,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206463,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":911,"num_write_kb":4580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"28'139","reported_seq":165,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:01.203361+0000","last_change":"2023-11-27T20:55:00.588512+0000","last_active":"2023-11-27T21:22:01.203361+0000","last_peered":"2023-11-27T21:22:01.203361+0000","last_clean":"2023-11-27T21:22:01.203361+0000","last_became_active":"2023-11-27T20:55:00.588018+0000","last_became_peered":"2023-11-27T20:55:00.588018+0000","last_unstale":"2023-11-27T21:22:01.203361+0000","last_undegraded":"2023-11-27T21:22:01.203361+0000","last_fullsized":"2023-11-27T21:22:01.203361+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":13169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,0,3],"acting":[2,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'77","reported_seq":109,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:03.525404+0000","last_change":"2023-11-27T20:54:27.513378+0000","last_active":"2023-11-27T21:22:03.525404+0000","last_peered":"2023-11-27T21:22:03.525404+0000","last_clean":"2023-11-27T21:22:03.525404+0000","last_became_active":"2023-11-27T20:54:27.512093+0000","last_became_peered":"2023-11-27T20:54:27.512093+0000","last_unstale":"2023-11-27T21:22:03.525404+0000","last_undegraded":"2023-11-27T21:22:03.525404+0000","last_fullsized":"2023-11-27T21:22:03.525404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'273","reported_seq":482,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:15.255928+0000","last_change":"2023-11-27T21:22:15.255951+0000","last_active":"2023-11-27T21:22:15.255928+0000","last_peered":"2023-11-27T21:22:15.255928+0000","last_clean":"2023-11-27T21:22:15.255928+0000","last_became_active":"2023-11-27T20:54:26.230548+0000","last_became_peered":"2023-11-27T20:54:26.230548+0000","last_unstale":"2023-11-27T21:22:15.255928+0000","last_undegraded":"2023-11-27T21:22:15.255928+0000","last_fullsized":"2023-11-27T21:22:15.255928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'273","last_scrub_stamp":"2023-11-27T21:22:15.255867+0000","last_deep_scrub":"28'273","last_deep_scrub_stamp":"2023-11-27T21:22:15.255867+0000","last_clean_scrub_stamp":"2023-11-27T21:22:15.255867+0000","objects_scrubbed":4,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:44:57.904993+0000","scrub_duration":0.003822022,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28446,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":170,"num_read_kb":173,"num_write":266,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"28'141","reported_seq":187,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:35.088318+0000","last_change":"2023-11-27T21:22:35.088318+0000","last_active":"2023-11-27T21:22:35.088318+0000","last_peered":"2023-11-27T21:22:35.088318+0000","last_clean":"2023-11-27T21:22:35.088318+0000","last_became_active":"2023-11-27T20:55:00.594705+0000","last_became_peered":"2023-11-27T20:55:00.594705+0000","last_unstale":"2023-11-27T21:22:35.088318+0000","last_undegraded":"2023-11-27T21:22:35.088318+0000","last_fullsized":"2023-11-27T21:22:35.088318+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'141","last_scrub_stamp":"2023-11-27T21:22:35.088216+0000","last_deep_scrub":"28'141","last_deep_scrub_stamp":"2023-11-27T21:22:35.088216+0000","last_clean_scrub_stamp":"2023-11-27T21:22:35.088216+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:06:09.356209+0000","scrub_duration":0.002816444,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":12035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"28'77","reported_seq":116,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:16.088541+0000","last_change":"2023-11-27T21:22:16.088562+0000","last_active":"2023-11-27T21:22:16.088541+0000","last_peered":"2023-11-27T21:22:16.088541+0000","last_clean":"2023-11-27T21:22:16.088541+0000","last_became_active":"2023-11-27T20:54:27.502941+0000","last_became_peered":"2023-11-27T20:54:27.502941+0000","last_unstale":"2023-11-27T21:22:16.088541+0000","last_undegraded":"2023-11-27T21:22:16.088541+0000","last_fullsized":"2023-11-27T21:22:16.088541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:16.088473+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:16.088473+0000","last_clean_scrub_stamp":"2023-11-27T21:22:16.088473+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:26:26.798459+0000","scrub_duration":0.001453584,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'11","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:01.957211+0000","last_change":"2023-11-27T20:54:26.214419+0000","last_active":"2023-11-27T21:22:01.957211+0000","last_peered":"2023-11-27T21:22:01.957211+0000","last_clean":"2023-11-27T21:22:01.957211+0000","last_became_active":"2023-11-27T20:54:26.214166+0000","last_became_peered":"2023-11-27T20:54:26.214166+0000","last_unstale":"2023-11-27T21:22:01.957211+0000","last_undegraded":"2023-11-27T21:22:01.957211+0000","last_fullsized":"2023-11-27T21:22:01.957211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"28'132","reported_seq":161,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:03.525521+0000","last_change":"2023-11-27T20:54:31.832551+0000","last_active":"2023-11-27T21:22:03.525521+0000","last_peered":"2023-11-27T21:22:03.525521+0000","last_clean":"2023-11-27T21:22:03.525521+0000","last_became_active":"2023-11-27T20:54:31.832196+0000","last_became_peered":"2023-11-27T20:54:31.832196+0000","last_unstale":"2023-11-27T21:22:03.525521+0000","last_undegraded":"2023-11-27T21:22:03.525521+0000","last_fullsized":"2023-11-27T21:22:03.525521+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":8461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'69","reported_seq":100,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.481125+0000","last_change":"2023-11-27T20:54:27.433404+0000","last_active":"2023-11-27T21:21:49.481125+0000","last_peered":"2023-11-27T21:21:49.481125+0000","last_clean":"2023-11-27T21:21:49.481125+0000","last_became_active":"2023-11-27T20:54:27.433161+0000","last_became_peered":"2023-11-27T20:54:27.433161+0000","last_unstale":"2023-11-27T21:21:49.481125+0000","last_undegraded":"2023-11-27T21:21:49.481125+0000","last_fullsized":"2023-11-27T21:21:49.481125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'8","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:32.958832+0000","last_change":"2023-11-27T20:54:26.227451+0000","last_active":"2023-11-27T21:21:32.958832+0000","last_peered":"2023-11-27T21:21:32.958832+0000","last_clean":"2023-11-27T21:21:32.958832+0000","last_became_active":"2023-11-27T20:54:26.227133+0000","last_became_peered":"2023-11-27T20:54:26.227133+0000","last_unstale":"2023-11-27T21:21:32.958832+0000","last_undegraded":"2023-11-27T21:21:32.958832+0000","last_fullsized":"2023-11-27T21:21:32.958832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":195,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:03.333433+0000","last_change":"2023-11-27T21:22:03.333433+0000","last_active":"2023-11-27T21:22:03.333433+0000","last_peered":"2023-11-27T21:22:03.333433+0000","last_clean":"2023-11-27T21:22:03.333433+0000","last_became_active":"2023-11-27T20:54:11.452181+0000","last_became_peered":"2023-11-27T20:54:11.452181+0000","last_unstale":"2023-11-27T21:22:03.333433+0000","last_undegraded":"2023-11-27T21:22:03.333433+0000","last_fullsized":"2023-11-27T21:22:03.333433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2023-11-27T21:22:03.333356+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2023-11-27T21:22:03.333356+0000","last_clean_scrub_stamp":"2023-11-27T21:22:03.333356+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:51:11.809770+0000","scrub_duration":0.0045126749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'171","reported_seq":200,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:42.959901+0000","last_change":"2023-11-27T20:54:31.818408+0000","last_active":"2023-11-27T21:21:42.959901+0000","last_peered":"2023-11-27T21:21:42.959901+0000","last_clean":"2023-11-27T21:21:42.959901+0000","last_became_active":"2023-11-27T20:54:31.818048+0000","last_became_peered":"2023-11-27T20:54:31.818048+0000","last_unstale":"2023-11-27T21:21:42.959901+0000","last_undegraded":"2023-11-27T21:21:42.959901+0000","last_fullsized":"2023-11-27T21:21:42.959901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":10034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"28'75","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.521838+0000","last_change":"2023-11-27T21:22:02.521856+0000","last_active":"2023-11-27T21:22:02.521838+0000","last_peered":"2023-11-27T21:22:02.521838+0000","last_clean":"2023-11-27T21:22:02.521838+0000","last_became_active":"2023-11-27T20:54:27.493256+0000","last_became_peered":"2023-11-27T20:54:27.493256+0000","last_unstale":"2023-11-27T21:22:02.521838+0000","last_undegraded":"2023-11-27T21:22:02.521838+0000","last_fullsized":"2023-11-27T21:22:02.521838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:02.521779+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:02.521779+0000","last_clean_scrub_stamp":"2023-11-27T21:22:02.521779+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:35:12.329730+0000","scrub_duration":0.0011699499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'1021","reported_seq":1060,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:09.046981+0000","last_change":"2023-11-27T21:22:09.047006+0000","last_active":"2023-11-27T21:22:09.046981+0000","last_peered":"2023-11-27T21:22:09.046981+0000","last_clean":"2023-11-27T21:22:09.046981+0000","last_became_active":"2023-11-27T20:54:26.229796+0000","last_became_peered":"2023-11-27T20:54:26.229796+0000","last_unstale":"2023-11-27T21:22:09.046981+0000","last_undegraded":"2023-11-27T21:22:09.046981+0000","last_fullsized":"2023-11-27T21:22:09.046981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1021","last_scrub_stamp":"2023-11-27T21:22:09.046925+0000","last_deep_scrub":"28'1021","last_deep_scrub_stamp":"2023-11-27T21:22:09.046925+0000","last_clean_scrub_stamp":"2023-11-27T21:22:09.046925+0000","objects_scrubbed":3,"log_size":1021,"log_dups_size":0,"ondisk_log_size":1021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:11.549792+0000","scrub_duration":0.012870006999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1013,"num_write_kb":4611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'180","reported_seq":216,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:34.732355+0000","last_change":"2023-11-27T21:22:34.732400+0000","last_active":"2023-11-27T21:22:34.732355+0000","last_peered":"2023-11-27T21:22:34.732355+0000","last_clean":"2023-11-27T21:22:34.732355+0000","last_became_active":"2023-11-27T20:54:31.825080+0000","last_became_peered":"2023-11-27T20:54:31.825080+0000","last_unstale":"2023-11-27T21:22:34.732355+0000","last_undegraded":"2023-11-27T21:22:34.732355+0000","last_fullsized":"2023-11-27T21:22:34.732355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'180","last_scrub_stamp":"2023-11-27T21:22:34.732270+0000","last_deep_scrub":"28'180","last_deep_scrub_stamp":"2023-11-27T21:22:34.732270+0000","last_clean_scrub_stamp":"2023-11-27T21:22:34.732270+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:57.356294+0000","scrub_duration":0.0029486389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":9643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'78","reported_seq":101,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.769377+0000","last_change":"2023-11-27T20:55:00.593751+0000","last_active":"2023-11-27T21:22:02.769377+0000","last_peered":"2023-11-27T21:22:02.769377+0000","last_clean":"2023-11-27T21:22:02.769377+0000","last_became_active":"2023-11-27T20:55:00.593249+0000","last_became_peered":"2023-11-27T20:55:00.593249+0000","last_unstale":"2023-11-27T21:22:02.769377+0000","last_undegraded":"2023-11-27T21:22:02.769377+0000","last_fullsized":"2023-11-27T21:22:02.769377+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"28'438","reported_seq":477,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:25.368474+0000","last_change":"2023-11-27T21:22:25.368503+0000","last_active":"2023-11-27T21:22:25.368474+0000","last_peered":"2023-11-27T21:22:25.368474+0000","last_clean":"2023-11-27T21:22:25.368474+0000","last_became_active":"2023-11-27T20:54:26.225886+0000","last_became_peered":"2023-11-27T20:54:26.225886+0000","last_unstale":"2023-11-27T21:22:25.368474+0000","last_undegraded":"2023-11-27T21:22:25.368474+0000","last_fullsized":"2023-11-27T21:22:25.368474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'438","last_scrub_stamp":"2023-11-27T21:22:25.368401+0000","last_deep_scrub":"28'438","last_deep_scrub_stamp":"2023-11-27T21:22:25.368401+0000","last_clean_scrub_stamp":"2023-11-27T21:22:25.368401+0000","objects_scrubbed":2,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:38:39.549160+0000","scrub_duration":0.0081653509999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2473984,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":2660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"28'169","reported_seq":197,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:34.314845+0000","last_change":"2023-11-27T20:54:31.828729+0000","last_active":"2023-11-27T21:21:34.314845+0000","last_peered":"2023-11-27T21:21:34.314845+0000","last_clean":"2023-11-27T21:21:34.314845+0000","last_became_active":"2023-11-27T20:54:31.828368+0000","last_became_peered":"2023-11-27T20:54:31.828368+0000","last_unstale":"2023-11-27T21:21:34.314845+0000","last_undegraded":"2023-11-27T21:21:34.314845+0000","last_fullsized":"2023-11-27T21:21:34.314845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":8527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"28'75","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:39.327209+0000","last_change":"2023-11-27T21:22:39.327230+0000","last_active":"2023-11-27T21:22:39.327209+0000","last_peered":"2023-11-27T21:22:39.327209+0000","last_clean":"2023-11-27T21:22:39.327209+0000","last_became_active":"2023-11-27T20:54:27.515416+0000","last_became_peered":"2023-11-27T20:54:27.515416+0000","last_unstale":"2023-11-27T21:22:39.327209+0000","last_undegraded":"2023-11-27T21:22:39.327209+0000","last_fullsized":"2023-11-27T21:22:39.327209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:39.327132+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:39.327132+0000","last_clean_scrub_stamp":"2023-11-27T21:22:39.327132+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:54:09.127655+0000","scrub_duration":0.001546927,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"28'10","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:36.534862+0000","last_change":"2023-11-27T21:22:36.534919+0000","last_active":"2023-11-27T21:22:36.534862+0000","last_peered":"2023-11-27T21:22:36.534862+0000","last_clean":"2023-11-27T21:22:36.534862+0000","last_became_active":"2023-11-27T20:54:26.224604+0000","last_became_peered":"2023-11-27T20:54:26.224604+0000","last_unstale":"2023-11-27T21:22:36.534862+0000","last_undegraded":"2023-11-27T21:22:36.534862+0000","last_fullsized":"2023-11-27T21:22:36.534862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2023-11-27T21:22:36.534769+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2023-11-27T21:22:36.534769+0000","last_clean_scrub_stamp":"2023-11-27T21:22:36.534769+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:16:44.164481+0000","scrub_duration":0.0029681949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"28'149","reported_seq":178,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:01.957531+0000","last_change":"2023-11-27T20:54:31.819648+0000","last_active":"2023-11-27T21:22:01.957531+0000","last_peered":"2023-11-27T21:22:01.957531+0000","last_clean":"2023-11-27T21:22:01.957531+0000","last_became_active":"2023-11-27T20:54:31.819294+0000","last_became_peered":"2023-11-27T20:54:31.819294+0000","last_unstale":"2023-11-27T21:22:01.957531+0000","last_undegraded":"2023-11-27T21:22:01.957531+0000","last_fullsized":"2023-11-27T21:22:01.957531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"28'77","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:19.747454+0000","last_change":"2023-11-27T21:22:19.747472+0000","last_active":"2023-11-27T21:22:19.747454+0000","last_peered":"2023-11-27T21:22:19.747454+0000","last_clean":"2023-11-27T21:22:19.747454+0000","last_became_active":"2023-11-27T20:54:27.512663+0000","last_became_peered":"2023-11-27T20:54:27.512663+0000","last_unstale":"2023-11-27T21:22:19.747454+0000","last_undegraded":"2023-11-27T21:22:19.747454+0000","last_fullsized":"2023-11-27T21:22:19.747454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:19.747391+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:19.747391+0000","last_clean_scrub_stamp":"2023-11-27T21:22:19.747391+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:18.401292+0000","scrub_duration":0.0011077389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"28'240","reported_seq":279,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:07.317223+0000","last_change":"2023-11-27T21:22:07.317246+0000","last_active":"2023-11-27T21:22:07.317223+0000","last_peered":"2023-11-27T21:22:07.317223+0000","last_clean":"2023-11-27T21:22:07.317223+0000","last_became_active":"2023-11-27T20:54:26.225056+0000","last_became_peered":"2023-11-27T20:54:26.225056+0000","last_unstale":"2023-11-27T21:22:07.317223+0000","last_undegraded":"2023-11-27T21:22:07.317223+0000","last_fullsized":"2023-11-27T21:22:07.317223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'240","last_scrub_stamp":"2023-11-27T21:22:07.317149+0000","last_deep_scrub":"28'240","last_deep_scrub_stamp":"2023-11-27T21:22:07.317149+0000","last_clean_scrub_stamp":"2023-11-27T21:22:07.317149+0000","objects_scrubbed":2,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:41:09.468592+0000","scrub_duration":0.0039936490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"28'126","reported_seq":163,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:27.495544+0000","last_change":"2023-11-27T21:22:27.495544+0000","last_active":"2023-11-27T21:22:27.495544+0000","last_peered":"2023-11-27T21:22:27.495544+0000","last_clean":"2023-11-27T21:22:27.495544+0000","last_became_active":"2023-11-27T20:54:31.827175+0000","last_became_peered":"2023-11-27T20:54:31.827175+0000","last_unstale":"2023-11-27T21:22:27.495544+0000","last_undegraded":"2023-11-27T21:22:27.495544+0000","last_fullsized":"2023-11-27T21:22:27.495544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'126","last_scrub_stamp":"2023-11-27T21:22:27.495457+0000","last_deep_scrub":"28'126","last_deep_scrub_stamp":"2023-11-27T21:22:27.495457+0000","last_clean_scrub_stamp":"2023-11-27T21:22:27.495457+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:41:29.646900+0000","scrub_duration":0.0023736809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":7629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"28'69","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:09.572831+0000","last_change":"2023-11-27T21:22:09.572831+0000","last_active":"2023-11-27T21:22:09.572831+0000","last_peered":"2023-11-27T21:22:09.572831+0000","last_clean":"2023-11-27T21:22:09.572831+0000","last_became_active":"2023-11-27T20:54:27.498225+0000","last_became_peered":"2023-11-27T20:54:27.498225+0000","last_unstale":"2023-11-27T21:22:09.572831+0000","last_undegraded":"2023-11-27T21:22:09.572831+0000","last_fullsized":"2023-11-27T21:22:09.572831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'69","last_scrub_stamp":"2023-11-27T21:22:09.572724+0000","last_deep_scrub":"28'69","last_deep_scrub_stamp":"2023-11-27T21:22:09.572724+0000","last_clean_scrub_stamp":"2023-11-27T21:22:09.572724+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:13:34.348448+0000","scrub_duration":0.0016942400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'1037","reported_seq":1076,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:11.556868+0000","last_change":"2023-11-27T21:22:11.556868+0000","last_active":"2023-11-27T21:22:11.556868+0000","last_peered":"2023-11-27T21:22:11.556868+0000","last_clean":"2023-11-27T21:22:11.556868+0000","last_became_active":"2023-11-27T20:54:26.225333+0000","last_became_peered":"2023-11-27T20:54:26.225333+0000","last_unstale":"2023-11-27T21:22:11.556868+0000","last_undegraded":"2023-11-27T21:22:11.556868+0000","last_fullsized":"2023-11-27T21:22:11.556868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1037","last_scrub_stamp":"2023-11-27T21:22:11.556754+0000","last_deep_scrub":"28'1037","last_deep_scrub_stamp":"2023-11-27T21:22:11.556754+0000","last_clean_scrub_stamp":"2023-11-27T21:22:11.556754+0000","objects_scrubbed":9,"log_size":1037,"log_dups_size":0,"ondisk_log_size":1037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:14:01.901896+0000","scrub_duration":0.014520241999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3313963,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1025,"num_write_kb":3921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"28'159","reported_seq":186,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:11.926419+0000","last_change":"2023-11-27T20:54:31.836029+0000","last_active":"2023-11-27T21:21:11.926419+0000","last_peered":"2023-11-27T21:21:11.926419+0000","last_clean":"2023-11-27T21:21:11.926419+0000","last_became_active":"2023-11-27T20:54:31.835629+0000","last_became_peered":"2023-11-27T20:54:31.835629+0000","last_unstale":"2023-11-27T21:21:11.926419+0000","last_undegraded":"2023-11-27T21:21:11.926419+0000","last_fullsized":"2023-11-27T21:21:11.926419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":12674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'64","reported_seq":101,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:10.205669+0000","last_change":"2023-11-27T21:22:10.205669+0000","last_active":"2023-11-27T21:22:10.205669+0000","last_peered":"2023-11-27T21:22:10.205669+0000","last_clean":"2023-11-27T21:22:10.205669+0000","last_became_active":"2023-11-27T20:54:27.510775+0000","last_became_peered":"2023-11-27T20:54:27.510775+0000","last_unstale":"2023-11-27T21:22:10.205669+0000","last_undegraded":"2023-11-27T21:22:10.205669+0000","last_fullsized":"2023-11-27T21:22:10.205669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'64","last_scrub_stamp":"2023-11-27T21:22:10.205582+0000","last_deep_scrub":"28'64","last_deep_scrub_stamp":"2023-11-27T21:22:10.205582+0000","last_clean_scrub_stamp":"2023-11-27T21:22:10.205582+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:12:43.950689+0000","scrub_duration":0.001792397,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"28'1191","reported_seq":1230,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:15.427644+0000","last_change":"2023-11-27T21:22:15.427644+0000","last_active":"2023-11-27T21:22:15.427644+0000","last_peered":"2023-11-27T21:22:15.427644+0000","last_clean":"2023-11-27T21:22:15.427644+0000","last_became_active":"2023-11-27T20:54:26.226745+0000","last_became_peered":"2023-11-27T20:54:26.226745+0000","last_unstale":"2023-11-27T21:22:15.427644+0000","last_undegraded":"2023-11-27T21:22:15.427644+0000","last_fullsized":"2023-11-27T21:22:15.427644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1191","last_scrub_stamp":"2023-11-27T21:22:15.427568+0000","last_deep_scrub":"28'1191","last_deep_scrub_stamp":"2023-11-27T21:22:15.427568+0000","last_clean_scrub_stamp":"2023-11-27T21:22:15.427568+0000","objects_scrubbed":3,"log_size":1191,"log_dups_size":0,"ondisk_log_size":1191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:47:37.149646+0000","scrub_duration":0.012877517,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":4695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"28'169","reported_seq":196,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:13.920766+0000","last_change":"2023-11-27T20:54:31.831969+0000","last_active":"2023-11-27T21:21:13.920766+0000","last_peered":"2023-11-27T21:21:13.920766+0000","last_clean":"2023-11-27T21:21:13.920766+0000","last_became_active":"2023-11-27T20:54:31.831620+0000","last_became_peered":"2023-11-27T20:54:31.831620+0000","last_unstale":"2023-11-27T21:21:13.920766+0000","last_undegraded":"2023-11-27T21:21:13.920766+0000","last_fullsized":"2023-11-27T21:21:13.920766+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":13064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'85","reported_seq":123,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:05.528522+0000","last_change":"2023-11-27T21:22:05.528522+0000","last_active":"2023-11-27T21:22:05.528522+0000","last_peered":"2023-11-27T21:22:05.528522+0000","last_clean":"2023-11-27T21:22:05.528522+0000","last_became_active":"2023-11-27T20:54:27.515524+0000","last_became_peered":"2023-11-27T20:54:27.515524+0000","last_unstale":"2023-11-27T21:22:05.528522+0000","last_undegraded":"2023-11-27T21:22:05.528522+0000","last_fullsized":"2023-11-27T21:22:05.528522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'85","last_scrub_stamp":"2023-11-27T21:22:05.528395+0000","last_deep_scrub":"28'85","last_deep_scrub_stamp":"2023-11-27T21:22:05.528395+0000","last_clean_scrub_stamp":"2023-11-27T21:22:05.528395+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:01:39.543628+0000","scrub_duration":0.0014329239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'242","reported_seq":273,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:01.957353+0000","last_change":"2023-11-27T20:54:26.225975+0000","last_active":"2023-11-27T21:22:01.957353+0000","last_peered":"2023-11-27T21:22:01.957353+0000","last_clean":"2023-11-27T21:22:01.957353+0000","last_became_active":"2023-11-27T20:54:26.225691+0000","last_became_peered":"2023-11-27T20:54:26.225691+0000","last_unstale":"2023-11-27T21:22:01.957353+0000","last_undegraded":"2023-11-27T21:22:01.957353+0000","last_fullsized":"2023-11-27T21:22:01.957353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:24.994499+0000","last_clean_scrub_stamp":"2023-11-27T20:54:24.994499+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":236,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"28'150","reported_seq":186,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:31.069109+0000","last_change":"2023-11-27T21:22:31.069109+0000","last_active":"2023-11-27T21:22:31.069109+0000","last_peered":"2023-11-27T21:22:31.069109+0000","last_clean":"2023-11-27T21:22:31.069109+0000","last_became_active":"2023-11-27T20:54:31.826669+0000","last_became_peered":"2023-11-27T20:54:31.826669+0000","last_unstale":"2023-11-27T21:22:31.069109+0000","last_undegraded":"2023-11-27T21:22:31.069109+0000","last_fullsized":"2023-11-27T21:22:31.069109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'150","last_scrub_stamp":"2023-11-27T21:22:31.068996+0000","last_deep_scrub":"28'150","last_deep_scrub_stamp":"2023-11-27T21:22:31.068996+0000","last_clean_scrub_stamp":"2023-11-27T21:22:31.068996+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:53.693019+0000","scrub_duration":0.003059254,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":7432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"28'77","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:17.078803+0000","last_change":"2023-11-27T21:22:17.078803+0000","last_active":"2023-11-27T21:22:17.078803+0000","last_peered":"2023-11-27T21:22:17.078803+0000","last_clean":"2023-11-27T21:22:17.078803+0000","last_became_active":"2023-11-27T20:54:27.502677+0000","last_became_peered":"2023-11-27T20:54:27.502677+0000","last_unstale":"2023-11-27T21:22:17.078803+0000","last_undegraded":"2023-11-27T21:22:17.078803+0000","last_fullsized":"2023-11-27T21:22:17.078803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:17.078722+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:17.078722+0000","last_clean_scrub_stamp":"2023-11-27T21:22:17.078722+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:59:13.020180+0000","scrub_duration":0.00165175,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'332","reported_seq":684,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:05.423669+0000","last_change":"2023-11-27T21:22:05.423669+0000","last_active":"2023-11-27T21:22:05.423669+0000","last_peered":"2023-11-27T21:22:05.423669+0000","last_clean":"2023-11-27T21:22:05.423669+0000","last_became_active":"2023-11-27T20:54:26.227911+0000","last_became_peered":"2023-11-27T20:54:26.227911+0000","last_unstale":"2023-11-27T21:22:05.423669+0000","last_undegraded":"2023-11-27T21:22:05.423669+0000","last_fullsized":"2023-11-27T21:22:05.423669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'332","last_scrub_stamp":"2023-11-27T21:22:05.423586+0000","last_deep_scrub":"28'332","last_deep_scrub_stamp":"2023-11-27T21:22:05.423586+0000","last_clean_scrub_stamp":"2023-11-27T21:22:05.423586+0000","objects_scrubbed":7,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:36:33.071011+0000","scrub_duration":0.0045666969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53552,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":314,"num_read_kb":325,"num_write":327,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'174","reported_seq":201,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:12.976359+0000","last_change":"2023-11-27T20:54:31.828136+0000","last_active":"2023-11-27T21:21:12.976359+0000","last_peered":"2023-11-27T21:21:12.976359+0000","last_clean":"2023-11-27T21:21:12.976359+0000","last_became_active":"2023-11-27T20:54:31.827785+0000","last_became_peered":"2023-11-27T20:54:31.827785+0000","last_unstale":"2023-11-27T21:21:12.976359+0000","last_undegraded":"2023-11-27T21:21:12.976359+0000","last_fullsized":"2023-11-27T21:21:12.976359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":11290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'75","reported_seq":112,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:32.375542+0000","last_change":"2023-11-27T21:22:32.375562+0000","last_active":"2023-11-27T21:22:32.375542+0000","last_peered":"2023-11-27T21:22:32.375542+0000","last_clean":"2023-11-27T21:22:32.375542+0000","last_became_active":"2023-11-27T20:54:27.513655+0000","last_became_peered":"2023-11-27T20:54:27.513655+0000","last_unstale":"2023-11-27T21:22:32.375542+0000","last_undegraded":"2023-11-27T21:22:32.375542+0000","last_fullsized":"2023-11-27T21:22:32.375542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:32.375477+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:32.375477+0000","last_clean_scrub_stamp":"2023-11-27T21:22:32.375477+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:48:52.496653+0000","scrub_duration":0.0020109640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'1487","reported_seq":1526,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.911976+0000","last_change":"2023-11-27T21:22:02.911976+0000","last_active":"2023-11-27T21:22:02.911976+0000","last_peered":"2023-11-27T21:22:02.911976+0000","last_clean":"2023-11-27T21:22:02.911976+0000","last_became_active":"2023-11-27T20:54:26.230570+0000","last_became_peered":"2023-11-27T20:54:26.230570+0000","last_unstale":"2023-11-27T21:22:02.911976+0000","last_undegraded":"2023-11-27T21:22:02.911976+0000","last_fullsized":"2023-11-27T21:22:02.911976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1487","last_scrub_stamp":"2023-11-27T21:22:02.911868+0000","last_deep_scrub":"28'1487","last_deep_scrub_stamp":"2023-11-27T21:22:02.911868+0000","last_clean_scrub_stamp":"2023-11-27T21:22:02.911868+0000","objects_scrubbed":6,"log_size":1487,"log_dups_size":0,"ondisk_log_size":1487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:31:23.266746+0000","scrub_duration":0.017648026000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1482,"num_write_kb":4539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"28'155","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.769460+0000","last_change":"2023-11-27T20:54:31.828482+0000","last_active":"2023-11-27T21:22:02.769460+0000","last_peered":"2023-11-27T21:22:02.769460+0000","last_clean":"2023-11-27T21:22:02.769460+0000","last_became_active":"2023-11-27T20:54:31.827872+0000","last_became_peered":"2023-11-27T20:54:31.827872+0000","last_unstale":"2023-11-27T21:22:02.769460+0000","last_undegraded":"2023-11-27T21:22:02.769460+0000","last_fullsized":"2023-11-27T21:22:02.769460+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":8855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'67","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.567411+0000","last_change":"2023-11-27T21:22:21.567411+0000","last_active":"2023-11-27T21:22:21.567411+0000","last_peered":"2023-11-27T21:22:21.567411+0000","last_clean":"2023-11-27T21:22:21.567411+0000","last_became_active":"2023-11-27T20:54:27.493257+0000","last_became_peered":"2023-11-27T20:54:27.493257+0000","last_unstale":"2023-11-27T21:22:21.567411+0000","last_undegraded":"2023-11-27T21:22:21.567411+0000","last_fullsized":"2023-11-27T21:22:21.567411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'67","last_scrub_stamp":"2023-11-27T21:22:21.567332+0000","last_deep_scrub":"28'67","last_deep_scrub_stamp":"2023-11-27T21:22:21.567332+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.567332+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:36:06.913352+0000","scrub_duration":0.00118578,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'152","reported_seq":189,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:06.402443+0000","last_change":"2023-11-27T21:22:06.402467+0000","last_active":"2023-11-27T21:22:06.402443+0000","last_peered":"2023-11-27T21:22:06.402443+0000","last_clean":"2023-11-27T21:22:06.402443+0000","last_became_active":"2023-11-27T20:54:26.230963+0000","last_became_peered":"2023-11-27T20:54:26.230963+0000","last_unstale":"2023-11-27T21:22:06.402443+0000","last_undegraded":"2023-11-27T21:22:06.402443+0000","last_fullsized":"2023-11-27T21:22:06.402443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'152","last_scrub_stamp":"2023-11-27T21:22:06.402381+0000","last_deep_scrub":"28'152","last_deep_scrub_stamp":"2023-11-27T21:22:06.402381+0000","last_clean_scrub_stamp":"2023-11-27T21:22:06.402381+0000","objects_scrubbed":4,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:06:17.621457+0000","scrub_duration":0.0033124059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"28'195","reported_seq":235,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:40.656772+0000","last_change":"2023-11-27T21:22:40.656797+0000","last_active":"2023-11-27T21:22:40.656772+0000","last_peered":"2023-11-27T21:22:40.656772+0000","last_clean":"2023-11-27T21:22:40.656772+0000","last_became_active":"2023-11-27T20:54:31.825038+0000","last_became_peered":"2023-11-27T20:54:31.825038+0000","last_unstale":"2023-11-27T21:22:40.656772+0000","last_undegraded":"2023-11-27T21:22:40.656772+0000","last_fullsized":"2023-11-27T21:22:40.656772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'195","last_scrub_stamp":"2023-11-27T21:22:40.656695+0000","last_deep_scrub":"28'195","last_deep_scrub_stamp":"2023-11-27T21:22:40.656695+0000","last_clean_scrub_stamp":"2023-11-27T21:22:40.656695+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:54:10.457218+0000","scrub_duration":0.0031266419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":102,"num_write":164,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"28'89","reported_seq":126,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:06.407272+0000","last_change":"2023-11-27T21:22:06.407291+0000","last_active":"2023-11-27T21:22:06.407272+0000","last_peered":"2023-11-27T21:22:06.407272+0000","last_clean":"2023-11-27T21:22:06.407272+0000","last_became_active":"2023-11-27T20:54:27.507805+0000","last_became_peered":"2023-11-27T20:54:27.507805+0000","last_unstale":"2023-11-27T21:22:06.407272+0000","last_undegraded":"2023-11-27T21:22:06.407272+0000","last_fullsized":"2023-11-27T21:22:06.407272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'89","last_scrub_stamp":"2023-11-27T21:22:06.407212+0000","last_deep_scrub":"28'89","last_deep_scrub_stamp":"2023-11-27T21:22:06.407212+0000","last_clean_scrub_stamp":"2023-11-27T21:22:06.407212+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:16:55.047816+0000","scrub_duration":0.0014892390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'331","reported_seq":687,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:10.331795+0000","last_change":"2023-11-27T21:22:10.331834+0000","last_active":"2023-11-27T21:22:10.331795+0000","last_peered":"2023-11-27T21:22:10.331795+0000","last_clean":"2023-11-27T21:22:10.331795+0000","last_became_active":"2023-11-27T20:54:26.226679+0000","last_became_peered":"2023-11-27T20:54:26.226679+0000","last_unstale":"2023-11-27T21:22:10.331795+0000","last_undegraded":"2023-11-27T21:22:10.331795+0000","last_fullsized":"2023-11-27T21:22:10.331795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'331","last_scrub_stamp":"2023-11-27T21:22:10.331701+0000","last_deep_scrub":"28'331","last_deep_scrub_stamp":"2023-11-27T21:22:10.331701+0000","last_clean_scrub_stamp":"2023-11-27T21:22:10.331701+0000","objects_scrubbed":3,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:57:26.919946+0000","scrub_duration":0.0033883049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53032,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":318,"num_read_kb":327,"num_write":324,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"28'159","reported_seq":195,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:34.234760+0000","last_change":"2023-11-27T21:22:34.234783+0000","last_active":"2023-11-27T21:22:34.234760+0000","last_peered":"2023-11-27T21:22:34.234760+0000","last_clean":"2023-11-27T21:22:34.234760+0000","last_became_active":"2023-11-27T20:54:31.834569+0000","last_became_peered":"2023-11-27T20:54:31.834569+0000","last_unstale":"2023-11-27T21:22:34.234760+0000","last_undegraded":"2023-11-27T21:22:34.234760+0000","last_fullsized":"2023-11-27T21:22:34.234760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'159","last_scrub_stamp":"2023-11-27T21:22:34.234686+0000","last_deep_scrub":"28'159","last_deep_scrub_stamp":"2023-11-27T21:22:34.234686+0000","last_clean_scrub_stamp":"2023-11-27T21:22:34.234686+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:03:33.554205+0000","scrub_duration":0.0028385089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":7865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'79","reported_seq":116,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:11.809904+0000","last_change":"2023-11-27T21:22:11.809924+0000","last_active":"2023-11-27T21:22:11.809904+0000","last_peered":"2023-11-27T21:22:11.809904+0000","last_clean":"2023-11-27T21:22:11.809904+0000","last_became_active":"2023-11-27T20:54:27.498535+0000","last_became_peered":"2023-11-27T20:54:27.498535+0000","last_unstale":"2023-11-27T21:22:11.809904+0000","last_undegraded":"2023-11-27T21:22:11.809904+0000","last_fullsized":"2023-11-27T21:22:11.809904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'79","last_scrub_stamp":"2023-11-27T21:22:11.809828+0000","last_deep_scrub":"28'79","last_deep_scrub_stamp":"2023-11-27T21:22:11.809828+0000","last_clean_scrub_stamp":"2023-11-27T21:22:11.809828+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:02.660027+0000","scrub_duration":0.001141268,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'177","reported_seq":214,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:04.284387+0000","last_change":"2023-11-27T21:22:04.284409+0000","last_active":"2023-11-27T21:22:04.284387+0000","last_peered":"2023-11-27T21:22:04.284387+0000","last_clean":"2023-11-27T21:22:04.284387+0000","last_became_active":"2023-11-27T20:54:26.227878+0000","last_became_peered":"2023-11-27T20:54:26.227878+0000","last_unstale":"2023-11-27T21:22:04.284387+0000","last_undegraded":"2023-11-27T21:22:04.284387+0000","last_fullsized":"2023-11-27T21:22:04.284387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'177","last_scrub_stamp":"2023-11-27T21:22:04.284332+0000","last_deep_scrub":"28'177","last_deep_scrub_stamp":"2023-11-27T21:22:04.284332+0000","last_clean_scrub_stamp":"2023-11-27T21:22:04.284332+0000","objects_scrubbed":3,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:46:32.962705+0000","scrub_duration":0.0029821639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'104","reported_seq":132,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.769437+0000","last_change":"2023-11-27T20:54:31.825264+0000","last_active":"2023-11-27T21:22:02.769437+0000","last_peered":"2023-11-27T21:22:02.769437+0000","last_clean":"2023-11-27T21:22:02.769437+0000","last_became_active":"2023-11-27T20:54:31.824914+0000","last_became_peered":"2023-11-27T20:54:31.824914+0000","last_unstale":"2023-11-27T21:22:02.769437+0000","last_undegraded":"2023-11-27T21:22:02.769437+0000","last_fullsized":"2023-11-27T21:22:02.769437+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":7715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"28'152","reported_seq":182,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.769473+0000","last_change":"2023-11-27T20:54:31.828359+0000","last_active":"2023-11-27T21:22:02.769473+0000","last_peered":"2023-11-27T21:22:02.769473+0000","last_clean":"2023-11-27T21:22:02.769473+0000","last_became_active":"2023-11-27T20:54:31.827971+0000","last_became_peered":"2023-11-27T20:54:31.827971+0000","last_unstale":"2023-11-27T21:22:02.769473+0000","last_undegraded":"2023-11-27T21:22:02.769473+0000","last_fullsized":"2023-11-27T21:22:02.769473+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":9456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"28'80","reported_seq":117,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:37.569804+0000","last_change":"2023-11-27T21:22:37.569827+0000","last_active":"2023-11-27T21:22:37.569804+0000","last_peered":"2023-11-27T21:22:37.569804+0000","last_clean":"2023-11-27T21:22:37.569804+0000","last_became_active":"2023-11-27T20:54:27.434635+0000","last_became_peered":"2023-11-27T20:54:27.434635+0000","last_unstale":"2023-11-27T21:22:37.569804+0000","last_undegraded":"2023-11-27T21:22:37.569804+0000","last_fullsized":"2023-11-27T21:22:37.569804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'80","last_scrub_stamp":"2023-11-27T21:22:37.569720+0000","last_deep_scrub":"28'80","last_deep_scrub_stamp":"2023-11-27T21:22:37.569720+0000","last_clean_scrub_stamp":"2023-11-27T21:22:37.569720+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:31:12.846837+0000","scrub_duration":0.0021142689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'7","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:24.573595+0000","last_change":"2023-11-27T21:22:24.573621+0000","last_active":"2023-11-27T21:22:24.573595+0000","last_peered":"2023-11-27T21:22:24.573595+0000","last_clean":"2023-11-27T21:22:24.573595+0000","last_became_active":"2023-11-27T20:54:26.224502+0000","last_became_peered":"2023-11-27T20:54:26.224502+0000","last_unstale":"2023-11-27T21:22:24.573595+0000","last_undegraded":"2023-11-27T21:22:24.573595+0000","last_fullsized":"2023-11-27T21:22:24.573595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2023-11-27T21:22:24.573521+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2023-11-27T21:22:24.573521+0000","last_clean_scrub_stamp":"2023-11-27T21:22:24.573521+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:05:05.366117+0000","scrub_duration":0.0025318630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"28'177","reported_seq":206,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:37.959439+0000","last_change":"2023-11-27T20:54:31.827147+0000","last_active":"2023-11-27T21:21:37.959439+0000","last_peered":"2023-11-27T21:21:37.959439+0000","last_clean":"2023-11-27T21:21:37.959439+0000","last_became_active":"2023-11-27T20:54:31.826790+0000","last_became_peered":"2023-11-27T20:54:31.826790+0000","last_unstale":"2023-11-27T21:21:37.959439+0000","last_undegraded":"2023-11-27T21:21:37.959439+0000","last_fullsized":"2023-11-27T21:21:37.959439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":15468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'77","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:13.303814+0000","last_change":"2023-11-27T21:22:13.303840+0000","last_active":"2023-11-27T21:22:13.303814+0000","last_peered":"2023-11-27T21:22:13.303814+0000","last_clean":"2023-11-27T21:22:13.303814+0000","last_became_active":"2023-11-27T20:54:27.507698+0000","last_became_peered":"2023-11-27T20:54:27.507698+0000","last_unstale":"2023-11-27T21:22:13.303814+0000","last_undegraded":"2023-11-27T21:22:13.303814+0000","last_fullsized":"2023-11-27T21:22:13.303814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:13.303735+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:13.303735+0000","last_clean_scrub_stamp":"2023-11-27T21:22:13.303735+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:40:38.746430+0000","scrub_duration":0.001443277,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'425","reported_seq":876,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:08.025932+0000","last_change":"2023-11-27T21:22:08.025955+0000","last_active":"2023-11-27T21:22:08.025932+0000","last_peered":"2023-11-27T21:22:08.025932+0000","last_clean":"2023-11-27T21:22:08.025932+0000","last_became_active":"2023-11-27T20:54:26.229725+0000","last_became_peered":"2023-11-27T20:54:26.229725+0000","last_unstale":"2023-11-27T21:22:08.025932+0000","last_undegraded":"2023-11-27T21:22:08.025932+0000","last_fullsized":"2023-11-27T21:22:08.025932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'425","last_scrub_stamp":"2023-11-27T21:22:08.025875+0000","last_deep_scrub":"28'425","last_deep_scrub_stamp":"2023-11-27T21:22:08.025875+0000","last_clean_scrub_stamp":"2023-11-27T21:22:08.025875+0000","objects_scrubbed":3,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:31:28.380754+0000","scrub_duration":0.0038756979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":413,"num_read_kb":420,"num_write":418,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'473","reported_seq":969,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:40.726895+0000","last_change":"2023-11-27T21:22:40.726930+0000","last_active":"2023-11-27T21:22:40.726895+0000","last_peered":"2023-11-27T21:22:40.726895+0000","last_clean":"2023-11-27T21:22:40.726895+0000","last_became_active":"2023-11-27T20:54:26.221715+0000","last_became_peered":"2023-11-27T20:54:26.221715+0000","last_unstale":"2023-11-27T21:22:40.726895+0000","last_undegraded":"2023-11-27T21:22:40.726895+0000","last_fullsized":"2023-11-27T21:22:40.726895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'473","last_scrub_stamp":"2023-11-27T21:22:40.726814+0000","last_deep_scrub":"28'473","last_deep_scrub_stamp":"2023-11-27T21:22:40.726814+0000","last_clean_scrub_stamp":"2023-11-27T21:22:40.726814+0000","objects_scrubbed":4,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:47:25.931117+0000","scrub_duration":0.0047592770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70496,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":458,"num_read_kb":466,"num_write":467,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'78","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:57.859811+0000","last_change":"2023-11-27T20:54:27.517213+0000","last_active":"2023-11-27T21:21:57.859811+0000","last_peered":"2023-11-27T21:21:57.859811+0000","last_clean":"2023-11-27T21:21:57.859811+0000","last_became_active":"2023-11-27T20:54:27.516887+0000","last_became_peered":"2023-11-27T20:54:27.516887+0000","last_unstale":"2023-11-27T21:21:57.859811+0000","last_undegraded":"2023-11-27T21:21:57.859811+0000","last_fullsized":"2023-11-27T21:21:57.859811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'144","reported_seq":171,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.769469+0000","last_change":"2023-11-27T20:54:31.827740+0000","last_active":"2023-11-27T21:22:02.769469+0000","last_peered":"2023-11-27T21:22:02.769469+0000","last_clean":"2023-11-27T21:22:02.769469+0000","last_became_active":"2023-11-27T20:54:31.827395+0000","last_became_peered":"2023-11-27T20:54:31.827395+0000","last_unstale":"2023-11-27T21:22:02.769469+0000","last_undegraded":"2023-11-27T21:22:02.769469+0000","last_fullsized":"2023-11-27T21:22:02.769469+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":4976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'2872","reported_seq":2910,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:31.493285+0000","last_change":"2023-11-27T21:22:31.493337+0000","last_active":"2023-11-27T21:22:31.493285+0000","last_peered":"2023-11-27T21:22:31.493285+0000","last_clean":"2023-11-27T21:22:31.493285+0000","last_became_active":"2023-11-27T20:54:26.227713+0000","last_became_peered":"2023-11-27T20:54:26.227713+0000","last_unstale":"2023-11-27T21:22:31.493285+0000","last_undegraded":"2023-11-27T21:22:31.493285+0000","last_fullsized":"2023-11-27T21:22:31.493285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2872","last_scrub_stamp":"2023-11-27T21:22:31.493188+0000","last_deep_scrub":"28'2872","last_deep_scrub_stamp":"2023-11-27T21:22:31.493188+0000","last_clean_scrub_stamp":"2023-11-27T21:22:31.493188+0000","objects_scrubbed":4,"log_size":2872,"log_dups_size":0,"ondisk_log_size":2872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:48:51.614364+0000","scrub_duration":0.037435849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12113008,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2860,"num_write_kb":13160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"28'94","reported_seq":130,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:12.266321+0000","last_change":"2023-11-27T21:22:12.266341+0000","last_active":"2023-11-27T21:22:12.266321+0000","last_peered":"2023-11-27T21:22:12.266321+0000","last_clean":"2023-11-27T21:22:12.266321+0000","last_became_active":"2023-11-27T20:54:27.506119+0000","last_became_peered":"2023-11-27T20:54:27.506119+0000","last_unstale":"2023-11-27T21:22:12.266321+0000","last_undegraded":"2023-11-27T21:22:12.266321+0000","last_fullsized":"2023-11-27T21:22:12.266321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'94","last_scrub_stamp":"2023-11-27T21:22:12.266264+0000","last_deep_scrub":"28'94","last_deep_scrub_stamp":"2023-11-27T21:22:12.266264+0000","last_clean_scrub_stamp":"2023-11-27T21:22:12.266264+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:50:27.905791+0000","scrub_duration":0.001360986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"28'135","reported_seq":170,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:33.278803+0000","last_change":"2023-11-27T21:22:33.278826+0000","last_active":"2023-11-27T21:22:33.278803+0000","last_peered":"2023-11-27T21:22:33.278803+0000","last_clean":"2023-11-27T21:22:33.278803+0000","last_became_active":"2023-11-27T20:54:31.832813+0000","last_became_peered":"2023-11-27T20:54:31.832813+0000","last_unstale":"2023-11-27T21:22:33.278803+0000","last_undegraded":"2023-11-27T21:22:33.278803+0000","last_fullsized":"2023-11-27T21:22:33.278803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'135","last_scrub_stamp":"2023-11-27T21:22:33.278716+0000","last_deep_scrub":"28'135","last_deep_scrub_stamp":"2023-11-27T21:22:33.278716+0000","last_clean_scrub_stamp":"2023-11-27T21:22:33.278716+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:03:14.787780+0000","scrub_duration":0.0030595430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'74","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:03.899170+0000","last_change":"2023-11-27T21:22:03.899204+0000","last_active":"2023-11-27T21:22:03.899170+0000","last_peered":"2023-11-27T21:22:03.899170+0000","last_clean":"2023-11-27T21:22:03.899170+0000","last_became_active":"2023-11-27T20:54:27.500394+0000","last_became_peered":"2023-11-27T20:54:27.500394+0000","last_unstale":"2023-11-27T21:22:03.899170+0000","last_undegraded":"2023-11-27T21:22:03.899170+0000","last_fullsized":"2023-11-27T21:22:03.899170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'74","last_scrub_stamp":"2023-11-27T21:22:03.899101+0000","last_deep_scrub":"28'74","last_deep_scrub_stamp":"2023-11-27T21:22:03.899101+0000","last_clean_scrub_stamp":"2023-11-27T21:22:03.899101+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:06.401969+0000","scrub_duration":0.0013881010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"28'91","reported_seq":129,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:19.289312+0000","last_change":"2023-11-27T21:22:19.289337+0000","last_active":"2023-11-27T21:22:19.289312+0000","last_peered":"2023-11-27T21:22:19.289312+0000","last_clean":"2023-11-27T21:22:19.289312+0000","last_became_active":"2023-11-27T20:54:27.515173+0000","last_became_peered":"2023-11-27T20:54:27.515173+0000","last_unstale":"2023-11-27T21:22:19.289312+0000","last_undegraded":"2023-11-27T21:22:19.289312+0000","last_fullsized":"2023-11-27T21:22:19.289312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'91","last_scrub_stamp":"2023-11-27T21:22:19.289226+0000","last_deep_scrub":"28'91","last_deep_scrub_stamp":"2023-11-27T21:22:19.289226+0000","last_clean_scrub_stamp":"2023-11-27T21:22:19.289226+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:57:16.036118+0000","scrub_duration":0.0015204750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"28'79","reported_seq":110,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.498732+0000","last_change":"2023-11-27T20:54:27.506358+0000","last_active":"2023-11-27T21:21:49.498732+0000","last_peered":"2023-11-27T21:21:49.498732+0000","last_clean":"2023-11-27T21:21:49.498732+0000","last_became_active":"2023-11-27T20:54:27.506112+0000","last_became_peered":"2023-11-27T20:54:27.506112+0000","last_unstale":"2023-11-27T21:21:49.498732+0000","last_undegraded":"2023-11-27T21:21:49.498732+0000","last_fullsized":"2023-11-27T21:21:49.498732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'73","reported_seq":112,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:15.272647+0000","last_change":"2023-11-27T21:22:15.272669+0000","last_active":"2023-11-27T21:22:15.272647+0000","last_peered":"2023-11-27T21:22:15.272647+0000","last_clean":"2023-11-27T21:22:15.272647+0000","last_became_active":"2023-11-27T20:54:27.510532+0000","last_became_peered":"2023-11-27T20:54:27.510532+0000","last_unstale":"2023-11-27T21:22:15.272647+0000","last_undegraded":"2023-11-27T21:22:15.272647+0000","last_fullsized":"2023-11-27T21:22:15.272647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'73","last_scrub_stamp":"2023-11-27T21:22:15.272584+0000","last_deep_scrub":"28'73","last_deep_scrub_stamp":"2023-11-27T21:22:15.272584+0000","last_clean_scrub_stamp":"2023-11-27T21:22:15.272584+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:23:33.117651+0000","scrub_duration":0.0013038769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"28'58","reported_seq":97,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:24.138340+0000","last_change":"2023-11-27T21:22:24.138340+0000","last_active":"2023-11-27T21:22:24.138340+0000","last_peered":"2023-11-27T21:22:24.138340+0000","last_clean":"2023-11-27T21:22:24.138340+0000","last_became_active":"2023-11-27T20:54:27.513517+0000","last_became_peered":"2023-11-27T20:54:27.513517+0000","last_unstale":"2023-11-27T21:22:24.138340+0000","last_undegraded":"2023-11-27T21:22:24.138340+0000","last_fullsized":"2023-11-27T21:22:24.138340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'58","last_scrub_stamp":"2023-11-27T21:22:24.138248+0000","last_deep_scrub":"28'58","last_deep_scrub_stamp":"2023-11-27T21:22:24.138248+0000","last_clean_scrub_stamp":"2023-11-27T21:22:24.138248+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:38.431656+0000","scrub_duration":0.001948988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'78","reported_seq":117,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:25.136381+0000","last_change":"2023-11-27T21:22:25.136381+0000","last_active":"2023-11-27T21:22:25.136381+0000","last_peered":"2023-11-27T21:22:25.136381+0000","last_clean":"2023-11-27T21:22:25.136381+0000","last_became_active":"2023-11-27T20:54:27.511559+0000","last_became_peered":"2023-11-27T20:54:27.511559+0000","last_unstale":"2023-11-27T21:22:25.136381+0000","last_undegraded":"2023-11-27T21:22:25.136381+0000","last_fullsized":"2023-11-27T21:22:25.136381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'78","last_scrub_stamp":"2023-11-27T21:22:25.136275+0000","last_deep_scrub":"28'78","last_deep_scrub_stamp":"2023-11-27T21:22:25.136275+0000","last_clean_scrub_stamp":"2023-11-27T21:22:25.136275+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:39:09.105072+0000","scrub_duration":0.0013808659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"28'75","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:07.894649+0000","last_change":"2023-11-27T21:22:07.894649+0000","last_active":"2023-11-27T21:22:07.894649+0000","last_peered":"2023-11-27T21:22:07.894649+0000","last_clean":"2023-11-27T21:22:07.894649+0000","last_became_active":"2023-11-27T20:54:27.499323+0000","last_became_peered":"2023-11-27T20:54:27.499323+0000","last_unstale":"2023-11-27T21:22:07.894649+0000","last_undegraded":"2023-11-27T21:22:07.894649+0000","last_fullsized":"2023-11-27T21:22:07.894649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:07.894529+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:07.894529+0000","last_clean_scrub_stamp":"2023-11-27T21:22:07.894529+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:40:33.337225+0000","scrub_duration":0.001236841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"28'64","reported_seq":95,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:03.525405+0000","last_change":"2023-11-27T20:54:27.508846+0000","last_active":"2023-11-27T21:22:03.525405+0000","last_peered":"2023-11-27T21:22:03.525405+0000","last_clean":"2023-11-27T21:22:03.525405+0000","last_became_active":"2023-11-27T20:54:27.508615+0000","last_became_peered":"2023-11-27T20:54:27.508615+0000","last_unstale":"2023-11-27T21:22:03.525405+0000","last_undegraded":"2023-11-27T21:22:03.525405+0000","last_fullsized":"2023-11-27T21:22:03.525405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'78","reported_seq":117,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:11.622552+0000","last_change":"2023-11-27T21:22:11.622552+0000","last_active":"2023-11-27T21:22:11.622552+0000","last_peered":"2023-11-27T21:22:11.622552+0000","last_clean":"2023-11-27T21:22:11.622552+0000","last_became_active":"2023-11-27T20:54:27.510647+0000","last_became_peered":"2023-11-27T20:54:27.510647+0000","last_unstale":"2023-11-27T21:22:11.622552+0000","last_undegraded":"2023-11-27T21:22:11.622552+0000","last_fullsized":"2023-11-27T21:22:11.622552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'78","last_scrub_stamp":"2023-11-27T21:22:11.622453+0000","last_deep_scrub":"28'78","last_deep_scrub_stamp":"2023-11-27T21:22:11.622453+0000","last_clean_scrub_stamp":"2023-11-27T21:22:11.622453+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:16:19.252165+0000","scrub_duration":0.0016600790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"28'92","reported_seq":130,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:42.284848+0000","last_change":"2023-11-27T21:22:42.284869+0000","last_active":"2023-11-27T21:22:42.284848+0000","last_peered":"2023-11-27T21:22:42.284848+0000","last_clean":"2023-11-27T21:22:42.284848+0000","last_became_active":"2023-11-27T20:54:27.508360+0000","last_became_peered":"2023-11-27T20:54:27.508360+0000","last_unstale":"2023-11-27T21:22:42.284848+0000","last_undegraded":"2023-11-27T21:22:42.284848+0000","last_fullsized":"2023-11-27T21:22:42.284848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'92","last_scrub_stamp":"2023-11-27T21:22:42.284775+0000","last_deep_scrub":"28'92","last_deep_scrub_stamp":"2023-11-27T21:22:42.284775+0000","last_clean_scrub_stamp":"2023-11-27T21:22:42.284775+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:06:16.552768+0000","scrub_duration":0.0016812800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"28'87","reported_seq":124,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.447734+0000","last_change":"2023-11-27T21:22:21.447755+0000","last_active":"2023-11-27T21:22:21.447734+0000","last_peered":"2023-11-27T21:22:21.447734+0000","last_clean":"2023-11-27T21:22:21.447734+0000","last_became_active":"2023-11-27T20:54:27.513105+0000","last_became_peered":"2023-11-27T20:54:27.513105+0000","last_unstale":"2023-11-27T21:22:21.447734+0000","last_undegraded":"2023-11-27T21:22:21.447734+0000","last_fullsized":"2023-11-27T21:22:21.447734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'87","last_scrub_stamp":"2023-11-27T21:22:21.447667+0000","last_deep_scrub":"28'87","last_deep_scrub_stamp":"2023-11-27T21:22:21.447667+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.447667+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:48.413351+0000","scrub_duration":0.001278429,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"28'77","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.504786+0000","last_change":"2023-11-27T20:54:27.433370+0000","last_active":"2023-11-27T21:21:49.504786+0000","last_peered":"2023-11-27T21:21:49.504786+0000","last_clean":"2023-11-27T21:21:49.504786+0000","last_became_active":"2023-11-27T20:54:27.433179+0000","last_became_peered":"2023-11-27T20:54:27.433179+0000","last_unstale":"2023-11-27T21:21:49.504786+0000","last_undegraded":"2023-11-27T21:21:49.504786+0000","last_fullsized":"2023-11-27T21:21:49.504786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'75","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:27.380380+0000","last_change":"2023-11-27T21:22:27.380399+0000","last_active":"2023-11-27T21:22:27.380380+0000","last_peered":"2023-11-27T21:22:27.380380+0000","last_clean":"2023-11-27T21:22:27.380380+0000","last_became_active":"2023-11-27T20:54:27.515068+0000","last_became_peered":"2023-11-27T20:54:27.515068+0000","last_unstale":"2023-11-27T21:22:27.380380+0000","last_undegraded":"2023-11-27T21:22:27.380380+0000","last_fullsized":"2023-11-27T21:22:27.380380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:27.380315+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:27.380315+0000","last_clean_scrub_stamp":"2023-11-27T21:22:27.380315+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:39:11.349112+0000","scrub_duration":0.0012371560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"28'86","reported_seq":124,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:15.519346+0000","last_change":"2023-11-27T21:22:15.519379+0000","last_active":"2023-11-27T21:22:15.519346+0000","last_peered":"2023-11-27T21:22:15.519346+0000","last_clean":"2023-11-27T21:22:15.519346+0000","last_became_active":"2023-11-27T20:54:27.498306+0000","last_became_peered":"2023-11-27T20:54:27.498306+0000","last_unstale":"2023-11-27T21:22:15.519346+0000","last_undegraded":"2023-11-27T21:22:15.519346+0000","last_fullsized":"2023-11-27T21:22:15.519346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'86","last_scrub_stamp":"2023-11-27T21:22:15.519229+0000","last_deep_scrub":"28'86","last_deep_scrub_stamp":"2023-11-27T21:22:15.519229+0000","last_clean_scrub_stamp":"2023-11-27T21:22:15.519229+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:50.796346+0000","scrub_duration":0.0016617979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'91","reported_seq":128,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:26.319123+0000","last_change":"2023-11-27T21:22:26.319123+0000","last_active":"2023-11-27T21:22:26.319123+0000","last_peered":"2023-11-27T21:22:26.319123+0000","last_clean":"2023-11-27T21:22:26.319123+0000","last_became_active":"2023-11-27T20:54:27.512897+0000","last_became_peered":"2023-11-27T20:54:27.512897+0000","last_unstale":"2023-11-27T21:22:26.319123+0000","last_undegraded":"2023-11-27T21:22:26.319123+0000","last_fullsized":"2023-11-27T21:22:26.319123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'91","last_scrub_stamp":"2023-11-27T21:22:26.319005+0000","last_deep_scrub":"28'91","last_deep_scrub_stamp":"2023-11-27T21:22:26.319005+0000","last_clean_scrub_stamp":"2023-11-27T21:22:26.319005+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:15.398244+0000","scrub_duration":0.0013480289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"28'67","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:16.542687+0000","last_change":"2023-11-27T21:22:16.542687+0000","last_active":"2023-11-27T21:22:16.542687+0000","last_peered":"2023-11-27T21:22:16.542687+0000","last_clean":"2023-11-27T21:22:16.542687+0000","last_became_active":"2023-11-27T20:54:27.514946+0000","last_became_peered":"2023-11-27T20:54:27.514946+0000","last_unstale":"2023-11-27T21:22:16.542687+0000","last_undegraded":"2023-11-27T21:22:16.542687+0000","last_fullsized":"2023-11-27T21:22:16.542687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'67","last_scrub_stamp":"2023-11-27T21:22:16.542611+0000","last_deep_scrub":"28'67","last_deep_scrub_stamp":"2023-11-27T21:22:16.542611+0000","last_clean_scrub_stamp":"2023-11-27T21:22:16.542611+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:43:30.443626+0000","scrub_duration":0.0014583510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"28'80","reported_seq":118,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:22.523993+0000","last_change":"2023-11-27T21:22:22.523993+0000","last_active":"2023-11-27T21:22:22.523993+0000","last_peered":"2023-11-27T21:22:22.523993+0000","last_clean":"2023-11-27T21:22:22.523993+0000","last_became_active":"2023-11-27T20:54:27.493297+0000","last_became_peered":"2023-11-27T20:54:27.493297+0000","last_unstale":"2023-11-27T21:22:22.523993+0000","last_undegraded":"2023-11-27T21:22:22.523993+0000","last_fullsized":"2023-11-27T21:22:22.523993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'80","last_scrub_stamp":"2023-11-27T21:22:22.523857+0000","last_deep_scrub":"28'80","last_deep_scrub_stamp":"2023-11-27T21:22:22.523857+0000","last_clean_scrub_stamp":"2023-11-27T21:22:22.523857+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:17:11.280303+0000","scrub_duration":0.001213053,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"28'75","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:44.285666+0000","last_change":"2023-11-27T21:22:44.285689+0000","last_active":"2023-11-27T21:22:44.285666+0000","last_peered":"2023-11-27T21:22:44.285666+0000","last_clean":"2023-11-27T21:22:44.285666+0000","last_became_active":"2023-11-27T20:54:27.512662+0000","last_became_peered":"2023-11-27T20:54:27.512662+0000","last_unstale":"2023-11-27T21:22:44.285666+0000","last_undegraded":"2023-11-27T21:22:44.285666+0000","last_fullsized":"2023-11-27T21:22:44.285666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:44.285586+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:44.285586+0000","last_clean_scrub_stamp":"2023-11-27T21:22:44.285586+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:13:02.644103+0000","scrub_duration":0.0017812570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'70","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:14.123478+0000","last_change":"2023-11-27T21:22:14.123478+0000","last_active":"2023-11-27T21:22:14.123478+0000","last_peered":"2023-11-27T21:22:14.123478+0000","last_clean":"2023-11-27T21:22:14.123478+0000","last_became_active":"2023-11-27T20:54:27.512124+0000","last_became_peered":"2023-11-27T20:54:27.512124+0000","last_unstale":"2023-11-27T21:22:14.123478+0000","last_undegraded":"2023-11-27T21:22:14.123478+0000","last_fullsized":"2023-11-27T21:22:14.123478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'70","last_scrub_stamp":"2023-11-27T21:22:14.123330+0000","last_deep_scrub":"28'70","last_deep_scrub_stamp":"2023-11-27T21:22:14.123330+0000","last_clean_scrub_stamp":"2023-11-27T21:22:14.123330+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:17:02.763935+0000","scrub_duration":0.0016588200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"28'82","reported_seq":119,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:22.174123+0000","last_change":"2023-11-27T21:22:22.174144+0000","last_active":"2023-11-27T21:22:22.174123+0000","last_peered":"2023-11-27T21:22:22.174123+0000","last_clean":"2023-11-27T21:22:22.174123+0000","last_became_active":"2023-11-27T20:54:27.516907+0000","last_became_peered":"2023-11-27T20:54:27.516907+0000","last_unstale":"2023-11-27T21:22:22.174123+0000","last_undegraded":"2023-11-27T21:22:22.174123+0000","last_fullsized":"2023-11-27T21:22:22.174123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'82","last_scrub_stamp":"2023-11-27T21:22:22.174050+0000","last_deep_scrub":"28'82","last_deep_scrub_stamp":"2023-11-27T21:22:22.174050+0000","last_clean_scrub_stamp":"2023-11-27T21:22:22.174050+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:58:51.653006+0000","scrub_duration":0.0015457279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'68","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:29.387344+0000","last_change":"2023-11-27T21:22:29.387384+0000","last_active":"2023-11-27T21:22:29.387344+0000","last_peered":"2023-11-27T21:22:29.387344+0000","last_clean":"2023-11-27T21:22:29.387344+0000","last_became_active":"2023-11-27T20:54:27.515182+0000","last_became_peered":"2023-11-27T20:54:27.515182+0000","last_unstale":"2023-11-27T21:22:29.387344+0000","last_undegraded":"2023-11-27T21:22:29.387344+0000","last_fullsized":"2023-11-27T21:22:29.387344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'68","last_scrub_stamp":"2023-11-27T21:22:29.387232+0000","last_deep_scrub":"28'68","last_deep_scrub_stamp":"2023-11-27T21:22:29.387232+0000","last_clean_scrub_stamp":"2023-11-27T21:22:29.387232+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:57:23.297311+0000","scrub_duration":0.001412979,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'79","reported_seq":109,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:39.384082+0000","last_change":"2023-11-27T21:22:39.384105+0000","last_active":"2023-11-27T21:22:39.384082+0000","last_peered":"2023-11-27T21:22:39.384082+0000","last_clean":"2023-11-27T21:22:39.384082+0000","last_became_active":"2023-11-27T20:55:00.588298+0000","last_became_peered":"2023-11-27T20:55:00.588298+0000","last_unstale":"2023-11-27T21:22:39.384082+0000","last_undegraded":"2023-11-27T21:22:39.384082+0000","last_fullsized":"2023-11-27T21:22:39.384082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'79","last_scrub_stamp":"2023-11-27T21:22:39.384006+0000","last_deep_scrub":"28'79","last_deep_scrub_stamp":"2023-11-27T21:22:39.384006+0000","last_clean_scrub_stamp":"2023-11-27T21:22:39.384006+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:16:47.013718+0000","scrub_duration":0.001936828,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'77","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:26.381531+0000","last_change":"2023-11-27T21:22:26.381549+0000","last_active":"2023-11-27T21:22:26.381531+0000","last_peered":"2023-11-27T21:22:26.381531+0000","last_clean":"2023-11-27T21:22:26.381531+0000","last_became_active":"2023-11-27T20:54:27.512692+0000","last_became_peered":"2023-11-27T20:54:27.512692+0000","last_unstale":"2023-11-27T21:22:26.381531+0000","last_undegraded":"2023-11-27T21:22:26.381531+0000","last_fullsized":"2023-11-27T21:22:26.381531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:26.381465+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:26.381465+0000","last_clean_scrub_stamp":"2023-11-27T21:22:26.381465+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:38:40.562224+0000","scrub_duration":0.0012122050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"28'75","reported_seq":111,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:23.471759+0000","last_change":"2023-11-27T21:22:23.471793+0000","last_active":"2023-11-27T21:22:23.471759+0000","last_peered":"2023-11-27T21:22:23.471759+0000","last_clean":"2023-11-27T21:22:23.471759+0000","last_became_active":"2023-11-27T20:54:27.498790+0000","last_became_peered":"2023-11-27T20:54:27.498790+0000","last_unstale":"2023-11-27T21:22:23.471759+0000","last_undegraded":"2023-11-27T21:22:23.471759+0000","last_fullsized":"2023-11-27T21:22:23.471759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:23.471665+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:23.471665+0000","last_clean_scrub_stamp":"2023-11-27T21:22:23.471665+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:09:25.413821+0000","scrub_duration":0.0018897339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"28'85","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:59.437409+0000","last_change":"2023-11-27T20:54:27.513089+0000","last_active":"2023-11-27T21:21:59.437409+0000","last_peered":"2023-11-27T21:21:59.437409+0000","last_clean":"2023-11-27T21:21:59.437409+0000","last_became_active":"2023-11-27T20:54:27.512777+0000","last_became_peered":"2023-11-27T20:54:27.512777+0000","last_unstale":"2023-11-27T21:21:59.437409+0000","last_undegraded":"2023-11-27T21:21:59.437409+0000","last_fullsized":"2023-11-27T21:21:59.437409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'65","reported_seq":102,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:33.381938+0000","last_change":"2023-11-27T21:22:33.381969+0000","last_active":"2023-11-27T21:22:33.381938+0000","last_peered":"2023-11-27T21:22:33.381938+0000","last_clean":"2023-11-27T21:22:33.381938+0000","last_became_active":"2023-11-27T20:54:27.512433+0000","last_became_peered":"2023-11-27T20:54:27.512433+0000","last_unstale":"2023-11-27T21:22:33.381938+0000","last_undegraded":"2023-11-27T21:22:33.381938+0000","last_fullsized":"2023-11-27T21:22:33.381938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'65","last_scrub_stamp":"2023-11-27T21:22:33.381875+0000","last_deep_scrub":"28'65","last_deep_scrub_stamp":"2023-11-27T21:22:33.381875+0000","last_clean_scrub_stamp":"2023-11-27T21:22:33.381875+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:56.005899+0000","scrub_duration":0.0018361009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'62","reported_seq":99,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:05.879384+0000","last_change":"2023-11-27T21:22:05.879404+0000","last_active":"2023-11-27T21:22:05.879384+0000","last_peered":"2023-11-27T21:22:05.879384+0000","last_clean":"2023-11-27T21:22:05.879384+0000","last_became_active":"2023-11-27T20:54:27.432152+0000","last_became_peered":"2023-11-27T20:54:27.432152+0000","last_unstale":"2023-11-27T21:22:05.879384+0000","last_undegraded":"2023-11-27T21:22:05.879384+0000","last_fullsized":"2023-11-27T21:22:05.879384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'62","last_scrub_stamp":"2023-11-27T21:22:05.879322+0000","last_deep_scrub":"28'62","last_deep_scrub_stamp":"2023-11-27T21:22:05.879322+0000","last_clean_scrub_stamp":"2023-11-27T21:22:05.879322+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:16:54.519926+0000","scrub_duration":0.001294089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'69","reported_seq":98,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:59.305297+0000","last_change":"2023-11-27T20:54:27.516081+0000","last_active":"2023-11-27T21:21:59.305297+0000","last_peered":"2023-11-27T21:21:59.305297+0000","last_clean":"2023-11-27T21:21:59.305297+0000","last_became_active":"2023-11-27T20:54:27.515801+0000","last_became_peered":"2023-11-27T20:54:27.515801+0000","last_unstale":"2023-11-27T21:21:59.305297+0000","last_undegraded":"2023-11-27T21:21:59.305297+0000","last_fullsized":"2023-11-27T21:21:59.305297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'75","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:04.865788+0000","last_change":"2023-11-27T21:22:04.865788+0000","last_active":"2023-11-27T21:22:04.865788+0000","last_peered":"2023-11-27T21:22:04.865788+0000","last_clean":"2023-11-27T21:22:04.865788+0000","last_became_active":"2023-11-27T20:54:27.432160+0000","last_became_peered":"2023-11-27T20:54:27.432160+0000","last_unstale":"2023-11-27T21:22:04.865788+0000","last_undegraded":"2023-11-27T21:22:04.865788+0000","last_fullsized":"2023-11-27T21:22:04.865788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:04.865659+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:04.865659+0000","last_clean_scrub_stamp":"2023-11-27T21:22:04.865659+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:24:12.042139+0000","scrub_duration":0.001425869,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'77","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:49.495390+0000","last_change":"2023-11-27T20:54:27.505374+0000","last_active":"2023-11-27T21:21:49.495390+0000","last_peered":"2023-11-27T21:21:49.495390+0000","last_clean":"2023-11-27T21:21:49.495390+0000","last_became_active":"2023-11-27T20:54:27.505122+0000","last_became_peered":"2023-11-27T20:54:27.505122+0000","last_unstale":"2023-11-27T21:21:49.495390+0000","last_undegraded":"2023-11-27T21:21:49.495390+0000","last_fullsized":"2023-11-27T21:21:49.495390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"28'74","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.374209+0000","last_change":"2023-11-27T21:22:21.374228+0000","last_active":"2023-11-27T21:22:21.374209+0000","last_peered":"2023-11-27T21:22:21.374209+0000","last_clean":"2023-11-27T21:22:21.374209+0000","last_became_active":"2023-11-27T20:54:27.505236+0000","last_became_peered":"2023-11-27T20:54:27.505236+0000","last_unstale":"2023-11-27T21:22:21.374209+0000","last_undegraded":"2023-11-27T21:22:21.374209+0000","last_fullsized":"2023-11-27T21:22:21.374209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'74","last_scrub_stamp":"2023-11-27T21:22:21.374139+0000","last_deep_scrub":"28'74","last_deep_scrub_stamp":"2023-11-27T21:22:21.374139+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.374139+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:20.028040+0000","scrub_duration":0.0012971980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"28'79","reported_seq":118,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:42.386685+0000","last_change":"2023-11-27T21:22:42.386720+0000","last_active":"2023-11-27T21:22:42.386685+0000","last_peered":"2023-11-27T21:22:42.386685+0000","last_clean":"2023-11-27T21:22:42.386685+0000","last_became_active":"2023-11-27T20:54:27.514846+0000","last_became_peered":"2023-11-27T20:54:27.514846+0000","last_unstale":"2023-11-27T21:22:42.386685+0000","last_undegraded":"2023-11-27T21:22:42.386685+0000","last_fullsized":"2023-11-27T21:22:42.386685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'79","last_scrub_stamp":"2023-11-27T21:22:42.386592+0000","last_deep_scrub":"28'79","last_deep_scrub_stamp":"2023-11-27T21:22:42.386592+0000","last_clean_scrub_stamp":"2023-11-27T21:22:42.386592+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:29:28.775340+0000","scrub_duration":0.00163594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":102,"num_write":4200,"num_write_kb":332069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5131,"ondisk_log_size":5131,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4855,"ondisk_log_size":4855,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":44272102,"num_objects":111,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":1673,"num_read_kb":1711,"num_write":16676,"num_write_kb":52124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20000,"num_omap_keys":40,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":88793088,"data_stored":88544204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15267,"ondisk_log_size":15267,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509787,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95988,"kb_used_data":20396,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94275852,"statfs":{"total":96636764160,"available":96538472448,"internally_reserved":0,"allocated":20885504,"data_stored":20696148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:22:04 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.42299999999999999,"15min":0.41199999999999998},"min":{"1min":0.35299999999999998,"5min":0.22700000000000001,"15min":0.19900000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.95599999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.47599999999999998,"15min":0.46700000000000003},"min":{"1min":0.37,"5min":0.27500000000000002,"15min":0.24199999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":1.1819999999999999},"last":0.50600000000000001}]},{"osd":1,"last update":"Mon Nov 27 21:22:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.441,"15min":0.434},"min":{"1min":0.33400000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.78300000000000003},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.41199999999999998,"15min":0.40999999999999998},"min":{"1min":0.308,"5min":0.25600000000000001,"15min":0.247},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":1.2250000000000001},"last":0.47099999999999997}]},{"osd":2,"last update":"Mon Nov 27 21:22:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42199999999999999,"15min":0.41099999999999998},"min":{"1min":0.28999999999999998,"5min":0.27700000000000002,"15min":0.23599999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":1.2549999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.44700000000000001,"15min":0.437},"min":{"1min":0.35599999999999998,"5min":0.26900000000000002,"15min":0.23899999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":1.2450000000000001},"last":0.45900000000000002}]},{"osd":3,"last update":"Mon Nov 27 21:22:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.44500000000000001,"15min":0.437},"min":{"1min":0.33600000000000002,"5min":0.307,"15min":0.26800000000000002},"max":{"1min":0.64700000000000002,"5min":0.66600000000000004,"15min":0.87},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.46899999999999997,"15min":0.44700000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.309},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":1.2090000000000001},"last":0.44800000000000001}]},{"osd":4,"last update":"Mon Nov 27 21:22:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.40600000000000003,"15min":0.39500000000000002},"min":{"1min":0.26900000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.52000000000000002,"5min":0.66600000000000004,"15min":0.80600000000000005},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.42599999999999999,"15min":0.41399999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.22900000000000001},"max":{"1min":0.57899999999999996,"5min":0.64900000000000002,"15min":0.92800000000000005},"last":0.437}]},{"osd":5,"last update":"Mon Nov 27 21:22:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42099999999999999,"15min":0.40100000000000002},"min":{"1min":0.27100000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.752,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.38},{"interface":"front","average":{"1min":0.437,"5min":0.47199999999999998,"15min":0.45500000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.25},"max":{"1min":0.56000000000000005,"5min":0.74099999999999999,"15min":0.77600000000000002},"last":0.36399999999999999}]},{"osd":7,"last update":"Mon Nov 27 21:22:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46600000000000003,"15min":0.46100000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.249},"max":{"1min":0.55700000000000005,"5min":0.68200000000000005,"15min":0.95599999999999996},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48799999999999999,"15min":0.46500000000000002},"min":{"1min":0.32000000000000001,"5min":0.28599999999999998,"15min":0.28199999999999997},"max":{"1min":0.80400000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.41299999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509787,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94852,"kb_used_data":19260,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94276988,"statfs":{"total":96636764160,"available":96539635712,"internally_reserved":0,"allocated":19722240,"data_stored":19520171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42099999999999999,"15min":0.40799999999999997},"min":{"1min":0.29099999999999998,"5min":0.25700000000000001,"15min":0.216},"max":{"1min":0.77700000000000002,"5min":1.331,"15min":1.331},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.43099999999999999,"15min":0.42099999999999999},"min":{"1min":0.33800000000000002,"5min":0.27900000000000003,"15min":0.222},"max":{"1min":0.69399999999999995,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.57499999999999996}]},{"osd":1,"last update":"Mon Nov 27 21:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.41999999999999998,"15min":0.42399999999999999},"min":{"1min":0.30599999999999999,"5min":0.224,"15min":0.221},"max":{"1min":0.56699999999999995,"5min":0.624,"15min":0.95999999999999996},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.42699999999999999,"15min":0.41799999999999998},"min":{"1min":0.315,"5min":0.29699999999999999,"15min":0.28599999999999998},"max":{"1min":0.64700000000000002,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.436}]},{"osd":2,"last update":"Mon Nov 27 21:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42299999999999999,"15min":0.42899999999999999},"min":{"1min":0.35799999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53300000000000003,"5min":0.64200000000000002,"15min":0.94599999999999995},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.45100000000000001,"15min":0.432},"min":{"1min":0.35099999999999998,"5min":0.308,"15min":0.29899999999999999},"max":{"1min":0.73099999999999998,"5min":1.359,"15min":1.359},"last":0.55500000000000005}]},{"osd":3,"last update":"Mon Nov 27 21:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.46000000000000002,"15min":0.45100000000000001},"min":{"1min":0.34899999999999998,"5min":0.32500000000000001,"15min":0.28899999999999998},"max":{"1min":0.63,"5min":0.64500000000000002,"15min":0.93300000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48599999999999999,"15min":0.46000000000000002},"min":{"1min":0.35799999999999998,"5min":0.33100000000000002,"15min":0.30199999999999999},"max":{"1min":0.67500000000000004,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":0.53800000000000003}]},{"osd":4,"last update":"Mon Nov 27 21:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.377,"15min":0.375},"min":{"1min":0.24199999999999999,"5min":0.23300000000000001,"15min":0.23100000000000001},"max":{"1min":0.58399999999999996,"5min":0.65800000000000003,"15min":0.69199999999999995},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.23200000000000001},"max":{"1min":0.61799999999999999,"5min":0.66800000000000004,"15min":0.70299999999999996},"last":0.38}]},{"osd":6,"last update":"Mon Nov 27 21:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.29399999999999998,"5min":0.27100000000000002,"15min":0.246},"max":{"1min":0.60099999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42299999999999999,"15min":0.42699999999999999},"min":{"1min":0.27300000000000002,"5min":0.27100000000000002,"15min":0.23300000000000001},"max":{"1min":0.55000000000000004,"5min":0.69299999999999995,"15min":0.70399999999999996},"last":0.60499999999999998}]},{"osd":7,"last update":"Mon Nov 27 21:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.24199999999999999},"max":{"1min":0.61599999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.48499999999999999,"15min":0.48799999999999999},"min":{"1min":0.33000000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63500000000000001,"5min":0.71399999999999997,"15min":0.751},"last":0.58699999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509788,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53560,"kb_used_data":8496,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318280,"statfs":{"total":96636764160,"available":96581918720,"internally_reserved":0,"allocated":8699904,"data_stored":8509387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32500000000000001,"15min":0.307},"min":{"1min":0.20899999999999999,"5min":0.19800000000000001,"15min":0.17899999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.307,"5min":0.32200000000000001,"15min":0.316},"min":{"1min":0.216,"5min":0.216,"15min":0.20200000000000001},"max":{"1min":0.45800000000000002,"5min":0.48299999999999998,"15min":0.61899999999999999},"last":0.34799999999999998}]},{"osd":1,"last update":"Mon Nov 27 21:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36599999999999999,"15min":0.34499999999999997},"min":{"1min":0.23200000000000001,"5min":0.20599999999999999,"15min":0.192},"max":{"1min":0.50700000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.378},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.35899999999999999,"15min":0.34899999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.20899999999999999},"max":{"1min":0.51800000000000002,"5min":0.54400000000000004,"15min":0.751},"last":0.441}]},{"osd":3,"last update":"Mon Nov 27 21:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.36099999999999999,"15min":0.34499999999999997},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.224},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.41899999999999998,"15min":0.38900000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26100000000000001},"max":{"1min":0.61699999999999999,"5min":0.62,"15min":0.63700000000000001},"last":0.41799999999999998}]},{"osd":4,"last update":"Mon Nov 27 21:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.505,"15min":0.48599999999999999},"min":{"1min":0.32700000000000001,"5min":0.313,"15min":0.29499999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.745},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.48799999999999999,"15min":0.48299999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58599999999999997,"5min":0.78900000000000003,"15min":0.83299999999999996},"last":0.58999999999999997}]},{"osd":5,"last update":"Mon Nov 27 21:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48899999999999999,"15min":0.47799999999999998},"min":{"1min":0.34100000000000003,"5min":0.32800000000000001,"15min":0.30399999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52800000000000002,"15min":0.504},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.69899999999999995}]},{"osd":6,"last update":"Mon Nov 27 21:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51500000000000001,"15min":0.505},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34000000000000002},"max":{"1min":0.70099999999999996,"5min":0.81399999999999995,"15min":0.90900000000000003},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.50700000000000001,"15min":0.495},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.316},"max":{"1min":0.753,"5min":0.753,"15min":0.76900000000000002},"last":0.66300000000000003}]},{"osd":7,"last update":"Mon Nov 27 21:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53600000000000003,"15min":0.52600000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36399999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52100000000000002,"15min":0.50700000000000001},"min":{"1min":0.373,"5min":0.36099999999999999,"15min":0.34000000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.92400000000000004},"last":0.57499999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509788,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42852,"kb_used_data":3356,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94328988,"statfs":{"total":96636764160,"available":96592883712,"internally_reserved":0,"allocated":3436544,"data_stored":3238767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.314,"15min":0.309},"min":{"1min":0.23499999999999999,"5min":0.20599999999999999,"15min":0.17000000000000001},"max":{"1min":0.503,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.317,"15min":0.308},"min":{"1min":0.23400000000000001,"5min":0.219,"15min":0.19800000000000001},"max":{"1min":0.51900000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.46300000000000002}]},{"osd":2,"last update":"Mon Nov 27 21:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33100000000000002,"15min":0.313},"min":{"1min":0.216,"5min":0.20799999999999999,"15min":0.192},"max":{"1min":0.45500000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34100000000000003,"15min":0.34300000000000003},"min":{"1min":0.29099999999999998,"5min":0.22600000000000001,"15min":0.20499999999999999},"max":{"1min":0.438,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.40699999999999997}]},{"osd":3,"last update":"Mon Nov 27 21:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.37,"15min":0.36799999999999999},"min":{"1min":0.28499999999999998,"5min":0.26800000000000002,"15min":0.23300000000000001},"max":{"1min":0.53300000000000003,"5min":0.626,"15min":0.68200000000000005},"last":0.5},{"interface":"front","average":{"1min":0.372,"5min":0.376,"15min":0.36799999999999999},"min":{"1min":0.252,"5min":0.24399999999999999,"15min":0.23400000000000001},"max":{"1min":0.57999999999999996,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.37}]},{"osd":4,"last update":"Mon Nov 27 21:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.46999999999999997,"15min":0.46700000000000003},"min":{"1min":0.35799999999999998,"5min":0.313,"15min":0.26600000000000001},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.49399999999999999,"15min":0.48599999999999999},"min":{"1min":0.35299999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.44700000000000001}]},{"osd":5,"last update":"Mon Nov 27 21:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.504,"15min":0.49199999999999999},"min":{"1min":0.36399999999999999,"5min":0.35399999999999998,"15min":0.313},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.48299999999999998,"15min":0.48899999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.4079999999999999},"last":0.64900000000000002}]},{"osd":6,"last update":"Mon Nov 27 21:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52100000000000002,"15min":0.51200000000000001},"min":{"1min":0.42099999999999999,"5min":0.38200000000000001,"15min":0.33600000000000002},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.39500000000000002,"5min":0.36199999999999999,"15min":0.34499999999999997},"max":{"1min":1.292,"5min":1.292,"15min":1.4239999999999999},"last":0.52100000000000002}]},{"osd":7,"last update":"Mon Nov 27 21:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.433,"5min":0.371,"15min":0.33200000000000002},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52200000000000002,"15min":0.51800000000000002},"min":{"1min":0.40799999999999997,"5min":0.38700000000000001,"15min":0.35399999999999998},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.4399999999999999},"last":0.67600000000000005}]}]},{"osd":0,"up_from":15,"seq":64424509787,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76024,"kb_used_data":8752,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94295816,"statfs":{"total":96636764160,"available":96558915584,"internally_reserved":0,"allocated":8962048,"data_stored":8748777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 21:22:10 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.316,"15min":0.309},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.48699999999999999,"5min":0.51800000000000002,"15min":0.57799999999999996},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.311,"5min":0.312,"15min":0.311},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.19},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.69699999999999995},"last":0.32700000000000001}]},{"osd":2,"last update":"Mon Nov 27 21:22:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.22,"5min":0.22,"15min":0.189},"max":{"1min":0.52600000000000002,"5min":0.54300000000000004,"15min":0.59299999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.34499999999999997,"15min":0.34300000000000003},"min":{"1min":0.23699999999999999,"5min":0.223,"15min":0.19900000000000001},"max":{"1min":0.42799999999999999,"5min":0.55500000000000005,"15min":0.66900000000000004},"last":0.44500000000000001}]},{"osd":3,"last update":"Mon Nov 27 21:22:10 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.35299999999999998,"15min":0.34499999999999997},"min":{"1min":0.24299999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.41799999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38400000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.21099999999999999},"max":{"1min":0.55800000000000005,"5min":0.58499999999999996,"15min":0.61599999999999999},"last":0.36099999999999999}]},{"osd":4,"last update":"Mon Nov 27 21:22:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.318,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.66100000000000003,"5min":0.67000000000000004,"15min":0.81200000000000006},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47699999999999998,"15min":0.46899999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.27200000000000002},"max":{"1min":0.66000000000000003,"5min":0.71199999999999997,"15min":0.71299999999999997},"last":0.59499999999999997}]},{"osd":5,"last update":"Mon Nov 27 21:22:10 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.50600000000000001,"15min":0.495},"min":{"1min":0.39200000000000002,"5min":0.36599999999999999,"15min":0.32700000000000001},"max":{"1min":0.70199999999999996,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46200000000000002,"15min":0.45900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.317},"max":{"1min":0.626,"5min":0.753,"15min":0.85099999999999998},"last":0.55100000000000005}]},{"osd":6,"last update":"Mon Nov 27 21:22:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.495,"15min":0.48899999999999999},"min":{"1min":0.36799999999999999,"5min":0.35499999999999998,"15min":0.31900000000000001},"max":{"1min":0.67600000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.52100000000000002,"15min":0.51400000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73599999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.622}]},{"osd":7,"last update":"Mon Nov 27 21:22:10 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.33500000000000002},"max":{"1min":0.754,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.49199999999999999,"15min":0.49299999999999999},"min":{"1min":0.38100000000000001,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":0.64500000000000002,"5min":0.68899999999999995,"15min":0.78000000000000003},"last":0.60899999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542492,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56968,"kb_used_data":7744,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94314872,"statfs":{"total":96636764160,"available":96578428928,"internally_reserved":0,"allocated":7929856,"data_stored":7711066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":50395595},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.40699999999999997,"15min":0.40200000000000002},"min":{"1min":0.25700000000000001,"5min":0.25,"15min":0.21199999999999999},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.82899999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41499999999999998,"15min":0.42599999999999999},"min":{"1min":0.29999999999999999,"5min":0.27000000000000002,"15min":0.22900000000000001},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.61399999999999999},"last":0.46999999999999997}]},{"osd":1,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.436,"15min":0.432},"min":{"1min":0.32500000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.88500000000000001},"last":0.498},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.44600000000000001,"15min":0.45300000000000001},"min":{"1min":0.32800000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.873},"last":0.54000000000000004}]},{"osd":2,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.42099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28100000000000003},"max":{"1min":0.51800000000000002,"5min":0.65300000000000002,"15min":0.79700000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41499999999999998,"15min":0.41899999999999998},"min":{"1min":0.34899999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.501,"5min":0.55200000000000005,"15min":0.68700000000000006},"last":0.41699999999999998}]},{"osd":3,"last update":"Mon Nov 27 21:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.433,"15min":0.44400000000000001},"min":{"1min":0.318,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.61499999999999999,"5min":0.68700000000000006,"15min":0.77100000000000002},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46000000000000002,"15min":0.45100000000000001},"min":{"1min":0.33000000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.61499999999999999,"5min":0.68600000000000005,"15min":0.90200000000000002},"last":0.50900000000000001}]},{"osd":4,"last update":"Mon Nov 27 21:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.38500000000000001,"15min":0.39600000000000002},"min":{"1min":0.26000000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.47299999999999998,"5min":0.59199999999999997,"15min":0.66600000000000004},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.42299999999999999,"15min":0.41999999999999998},"min":{"1min":0.29499999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61699999999999999,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.371}]},{"osd":5,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.45100000000000001,"15min":0.44},"min":{"1min":0.28299999999999997,"5min":0.27700000000000002,"15min":0.27300000000000002},"max":{"1min":0.75,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.42799999999999999,"15min":0.44},"min":{"1min":0.27900000000000003,"5min":0.26400000000000001,"15min":0.248},"max":{"1min":0.50700000000000001,"5min":0.71499999999999997,"15min":0.77700000000000002},"last":0.32900000000000001}]},{"osd":6,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.26600000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.56999999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49399999999999999},"min":{"1min":0.33600000000000002,"5min":0.29099999999999998,"15min":0.28100000000000003},"max":{"1min":0.69199999999999995,"5min":0.751,"15min":0.84999999999999998},"last":0.39000000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542492,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57800,"kb_used_data":8576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94314040,"statfs":{"total":96636764160,"available":96577576960,"internally_reserved":0,"allocated":8781824,"data_stored":8552244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.42199999999999999,"15min":0.40899999999999997},"min":{"1min":0.28399999999999997,"5min":0.248,"15min":0.20200000000000001},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.49299999999999999,"15min":0.44900000000000001},"min":{"1min":0.35599999999999998,"5min":0.28299999999999997,"15min":0.24099999999999999},"max":{"1min":3.948,"5min":3.948,"15min":3.948},"last":0.48899999999999999}]},{"osd":1,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.47499999999999998,"15min":0.433},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.24099999999999999},"max":{"1min":5.0410000000000004,"5min":5.0410000000000004,"15min":5.0410000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.433,"15min":0.41599999999999998},"min":{"1min":0.29899999999999999,"5min":0.247,"15min":0.247},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.45100000000000001}]},{"osd":2,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.45100000000000001,"15min":0.43099999999999999},"min":{"1min":0.34200000000000003,"5min":0.29499999999999998,"15min":0.26100000000000001},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.48299999999999998,"15min":0.45900000000000002},"min":{"1min":0.373,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":4.008,"5min":4.008,"15min":4.008},"last":0.438}]},{"osd":3,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.48899999999999999,"15min":0.47099999999999997},"min":{"1min":0.33800000000000002,"5min":0.318,"15min":0.29899999999999999},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.36299999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":0.58899999999999997,"15min":0.496},"min":{"1min":0.33800000000000002,"5min":0.32600000000000001,"15min":0.28499999999999998},"max":{"1min":10.747999999999999,"5min":10.747999999999999,"15min":10.747999999999999},"last":0.35299999999999998}]},{"osd":5,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":1.6890000000000001,"5min":0.67600000000000005,"15min":0.47899999999999998},"min":{"1min":0.28599999999999998,"5min":0.23100000000000001,"15min":0.221},"max":{"1min":20.847999999999999,"5min":20.847999999999999,"15min":20.847999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.47099999999999997,"15min":0.43099999999999999},"min":{"1min":0.28199999999999997,"5min":0.26000000000000001,"15min":0.23100000000000001},"max":{"1min":5.0800000000000001,"5min":5.0800000000000001,"15min":5.0800000000000001},"last":0.30199999999999999}]},{"osd":6,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.435,"15min":0.41799999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.24399999999999999},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.499,"15min":0.47099999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.33600000000000002}]},{"osd":7,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46500000000000002,"15min":0.45400000000000001},"min":{"1min":0.311,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.55900000000000005,"15min":0.52000000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.33400000000000002},"max":{"1min":3.4649999999999999,"5min":3.4649999999999999,"15min":3.4649999999999999},"last":0.46300000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542492,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89188,"kb_used_data":13596,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94282652,"statfs":{"total":96636764160,"available":96545435648,"internally_reserved":0,"allocated":13922304,"data_stored":13708692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:22:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.34200000000000003,"15min":0.32500000000000001},"min":{"1min":0.254,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.42299999999999999,"15min":0.34499999999999997},"min":{"1min":0.217,"5min":0.21099999999999999,"15min":0.192},"max":{"1min":8.9369999999999994,"5min":8.9369999999999994,"15min":8.9369999999999994},"last":0.36899999999999999}]},{"osd":1,"last update":"Mon Nov 27 21:22:05 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.34100000000000003,"15min":0.32200000000000001},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":3.1230000000000002,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.44},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.39100000000000001,"15min":0.36099999999999999},"min":{"1min":0.247,"5min":0.23400000000000001,"15min":0.21199999999999999},"max":{"1min":2.8420000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.45600000000000002}]},{"osd":2,"last update":"Mon Nov 27 21:22:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.45900000000000002,"15min":0.39900000000000002},"min":{"1min":0.29999999999999999,"5min":0.25900000000000001,"15min":0.22600000000000001},"max":{"1min":7.0830000000000002,"5min":7.0830000000000002,"15min":7.0830000000000002},"last":0.502},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.39300000000000002,"15min":0.38},"min":{"1min":0.29499999999999998,"5min":0.25700000000000001,"15min":0.22600000000000001},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.47699999999999998}]},{"osd":4,"last update":"Mon Nov 27 21:22:05 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.48399999999999999,"15min":0.47099999999999997},"min":{"1min":0.35699999999999998,"5min":0.311,"15min":0.311},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.51500000000000001,"15min":0.496},"min":{"1min":0.34699999999999998,"5min":0.34499999999999997,"15min":0.314},"max":{"1min":3.0920000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":0.66200000000000003}]},{"osd":5,"last update":"Mon Nov 27 21:22:05 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.51400000000000001,"15min":0.49299999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.28499999999999998},"max":{"1min":2.5760000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.40500000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.7400000000000002,"5min":2.7400000000000002,"15min":2.7400000000000002},"last":0.69299999999999995}]},{"osd":6,"last update":"Mon Nov 27 21:22:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.55800000000000005,"15min":0.52500000000000002},"min":{"1min":0.41599999999999998,"5min":0.36899999999999999,"15min":0.311},"max":{"1min":4.7169999999999996,"5min":4.7169999999999996,"15min":4.7169999999999996},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.52300000000000002,"15min":0.51000000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.314},"max":{"1min":2.6120000000000001,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.72899999999999998}]},{"osd":7,"last update":"Mon Nov 27 21:22:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.40200000000000002,"5min":0.36099999999999999,"15min":0.35999999999999999},"max":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.54000000000000004,"15min":0.52900000000000003},"min":{"1min":0.379,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.71599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8667136,"data_stored":8628738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2547712,"data_stored":2528360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13627392,"data_stored":13588653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8486912,"data_stored":8432205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18833408,"data_stored":18809764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20590592,"data_stored":20576109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7634944,"data_stored":7591027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T21:22:46.990 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.991 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.991 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.991 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.991 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.991 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.991 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.992 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.992 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.992 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.992 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.992 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.992 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.993 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.993 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.993 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.993 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.993 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.993 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.993 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.994 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.994 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.994 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.994 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.994 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-11-27T20:54:24.994499+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=24, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.994 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.995 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.995 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.995 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.995 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.995 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.995 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.996 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.996 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.996 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.996 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.997 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.997 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:22:46.997 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-27T21:23:06.998 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T21:23:07.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.096+0000 7fd33fd25640 1 Processor -- start 2023-11-27T21:23:07.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.096+0000 7fd33fd25640 1 -- start start 2023-11-27T21:23:07.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.097+0000 7fd33fd25640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd338151900 0x7fd3380c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:07.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.097+0000 7fd33fd25640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd33815a8e0 0x7fd33815ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:07.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.097+0000 7fd33fd25640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3380713b0 con 0x7fd338151520 2023-11-27T21:23:07.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.097+0000 7fd33fd25640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd33806dbc0 con 0x7fd33815a8e0 2023-11-27T21:23:07.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.097+0000 7fd33fd25640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd338071f50 con 0x7fd338151900 2023-11-27T21:23:07.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.097+0000 7fd33e2c2640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd33815a8e0 0x7fd33815ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:07.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.097+0000 7fd33dac1640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fd338151520 0x7fd338071840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:44020/0 (socket says 172.21.15.88:44020) 2023-11-27T21:23:07.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.097+0000 7fd33dac1640 1 -- 172.21.15.88:0/2940069907 learned_addr learned my addr 172.21.15.88:0/2940069907 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:23:07.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.098+0000 7fd33d2c0640 1 --2- 172.21.15.88:0/2940069907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd338151900 0x7fd3380c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:07.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.100+0000 7fd33e2c2640 1 -- 172.21.15.88:0/2940069907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd338151900 msgr2=0x7fd3380c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:23:07.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.100+0000 7fd33e2c2640 1 --2- 172.21.15.88:0/2940069907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd338151900 0x7fd3380c5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:07.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.100+0000 7fd33e2c2640 1 -- 172.21.15.88:0/2940069907 >> v1:172.21.15.167:6789/0 conn(0x7fd338151520 legacy=0x7fd338071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:07.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.100+0000 7fd33e2c2640 1 -- 172.21.15.88:0/2940069907 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3380c8840 con 0x7fd33815a8e0 2023-11-27T21:23:07.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.102+0000 7fd33e2c2640 1 --2- 172.21.15.88:0/2940069907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd33815a8e0 0x7fd33815ad60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd330009d90 tx=0x7fd33002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca7b8d3b40ff643d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:07.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.105+0000 7fd33cabf640 1 -- 172.21.15.88:0/2940069907 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33002cc50 con 0x7fd33815a8e0 2023-11-27T21:23:07.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.107+0000 7fd33cabf640 1 -- 172.21.15.88:0/2940069907 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33002cdb0 con 0x7fd33815a8e0 2023-11-27T21:23:07.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.107+0000 7fd33cabf640 1 -- 172.21.15.88:0/2940069907 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd330034660 con 0x7fd33815a8e0 2023-11-27T21:23:07.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.107+0000 7fd33fd25640 1 -- 172.21.15.88:0/2940069907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd33815a8e0 msgr2=0x7fd33815ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:07.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.107+0000 7fd33fd25640 1 --2- 172.21.15.88:0/2940069907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd33815a8e0 0x7fd33815ad60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd330009d90 tx=0x7fd33002bea0 comp rx=0 tx=0).stop 2023-11-27T21:23:07.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.107+0000 7fd33fd25640 1 -- 172.21.15.88:0/2940069907 shutdown_connections 2023-11-27T21:23:07.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.107+0000 7fd33fd25640 1 --2- 172.21.15.88:0/2940069907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd33815a8e0 0x7fd33815ad60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:07.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.107+0000 7fd33fd25640 1 --2- 172.21.15.88:0/2940069907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd338151900 0x7fd3380c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:07.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.107+0000 7fd33fd25640 1 -- 172.21.15.88:0/2940069907 >> 172.21.15.88:0/2940069907 conn(0x7fd3380c79a0 msgr2=0x7fd3380c7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:23:07.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.107+0000 7fd33fd25640 1 -- 172.21.15.88:0/2940069907 shutdown_connections 2023-11-27T21:23:07.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.107+0000 7fd33fd25640 1 -- 172.21.15.88:0/2940069907 wait complete. 2023-11-27T21:23:07.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.109+0000 7fd33fd25640 1 Processor -- start 2023-11-27T21:23:07.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.109+0000 7fd33fd25640 1 -- start start 2023-11-27T21:23:07.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.109+0000 7fd33fd25640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd338151520 0x7fd338159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:07.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.109+0000 7fd33fd25640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd338151900 0x7fd3381f0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:07.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.109+0000 7fd33fd25640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd33815a8e0 0x7fd3381f05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:07.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.109+0000 7fd33fd25640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd338155a20 con 0x7fd33815a8e0 2023-11-27T21:23:07.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.109+0000 7fd33fd25640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33814c5f0 con 0x7fd338151520 2023-11-27T21:23:07.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.109+0000 7fd33fd25640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3381ed6c0 con 0x7fd338151900 2023-11-27T21:23:07.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.110+0000 7fd33e2c2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd33815a8e0 0x7fd3381f05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:07.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.110+0000 7fd33d2c0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd338151900 0x7fd3381f0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:07.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.110+0000 7fd33dac1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd338151520 0x7fd338159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:07.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.110+0000 7fd33e2c2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd33815a8e0 0x7fd3381f05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59288/0 (socket says 172.21.15.88:59288) 2023-11-27T21:23:07.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.110+0000 7fd33e2c2640 1 -- 172.21.15.88:0/44187795 learned_addr learned my addr 172.21.15.88:0/44187795 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:23:07.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.113+0000 7fd33e2c2640 1 -- 172.21.15.88:0/44187795 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd338151900 msgr2=0x7fd3381f0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:07.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.113+0000 7fd33e2c2640 1 --2- 172.21.15.88:0/44187795 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd338151900 0x7fd3381f0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:07.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.113+0000 7fd33e2c2640 1 -- 172.21.15.88:0/44187795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd338151520 msgr2=0x7fd338159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:07.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.113+0000 7fd33e2c2640 1 --2- 172.21.15.88:0/44187795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd338151520 0x7fd338159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:07.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.113+0000 7fd33e2c2640 1 -- 172.21.15.88:0/44187795 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd330009a70 con 0x7fd33815a8e0 2023-11-27T21:23:07.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.116+0000 7fd33e2c2640 1 --2- 172.21.15.88:0/44187795 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd33815a8e0 0x7fd3381f05c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd330009eb0 tx=0x7fd330004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:07.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.121+0000 7fd32e7fc640 1 -- 172.21.15.88:0/44187795 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33003e610 con 0x7fd33815a8e0 2023-11-27T21:23:07.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.121+0000 7fd33fd25640 1 -- 172.21.15.88:0/44187795 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3381ed980 con 0x7fd33815a8e0 2023-11-27T21:23:07.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.121+0000 7fd33fd25640 1 -- 172.21.15.88:0/44187795 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd33814bcc0 con 0x7fd33815a8e0 2023-11-27T21:23:07.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.121+0000 7fd32e7fc640 1 -- 172.21.15.88:0/44187795 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd330009450 con 0x7fd33815a8e0 2023-11-27T21:23:07.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.121+0000 7fd32e7fc640 1 -- 172.21.15.88:0/44187795 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33003e970 con 0x7fd33815a8e0 2023-11-27T21:23:07.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.122+0000 7fd33fd25640 1 -- 172.21.15.88:0/44187795 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd320005250 con 0x7fd33815a8e0 2023-11-27T21:23:07.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.360+0000 7fd32e7fc640 1 -- 172.21.15.88:0/44187795 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd33003b050 con 0x7fd33815a8e0 2023-11-27T21:23:07.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.361+0000 7fd32e7fc640 1 --2- 172.21.15.88:0/44187795 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd31c06b1c0 0x7fd31c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:07.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.361+0000 7fd33dac1640 1 --2- 172.21.15.88:0/44187795 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd31c06b1c0 0x7fd31c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:07.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.361+0000 7fd33dac1640 1 --2- 172.21.15.88:0/44187795 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd31c06b1c0 0x7fd31c06d680 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd334007fd0 tx=0x7fd334007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:07.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.376+0000 7fd32e7fc640 1 -- 172.21.15.88:0/44187795 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd33007aea0 con 0x7fd33815a8e0 2023-11-27T21:23:07.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.376+0000 7fd32e7fc640 1 -- 172.21.15.88:0/44187795 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd3300771e0 con 0x7fd33815a8e0 2023-11-27T21:23:07.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.555+0000 7fd33fd25640 1 -- 172.21.15.88:0/44187795 --> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd320000bc0 con 0x7fd31c06b1c0 2023-11-27T21:23:07.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.564+0000 7fd32e7fc640 1 -- 172.21.15.88:0/44187795 <== mgr.4105 v2:172.21.15.88:6800/352455703 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+372960 (secure 0 0 0) 0x7fd320000bc0 con 0x7fd31c06b1c0 2023-11-27T21:23:07.571 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T21:23:07.573 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-11-27T21:23:07.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.568+0000 7fd33fd25640 1 -- 172.21.15.88:0/44187795 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd31c06b1c0 msgr2=0x7fd31c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:07.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.568+0000 7fd33fd25640 1 --2- 172.21.15.88:0/44187795 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd31c06b1c0 0x7fd31c06d680 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd334007fd0 tx=0x7fd334007e80 comp rx=0 tx=0).stop 2023-11-27T21:23:07.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.568+0000 7fd33fd25640 1 -- 172.21.15.88:0/44187795 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd33815a8e0 msgr2=0x7fd3381f05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:07.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.568+0000 7fd33fd25640 1 --2- 172.21.15.88:0/44187795 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd33815a8e0 0x7fd3381f05c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd330009eb0 tx=0x7fd330004a40 comp rx=0 tx=0).stop 2023-11-27T21:23:07.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.568+0000 7fd33fd25640 1 -- 172.21.15.88:0/44187795 shutdown_connections 2023-11-27T21:23:07.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.568+0000 7fd33fd25640 1 --2- 172.21.15.88:0/44187795 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd31c06b1c0 0x7fd31c06d680 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:07.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.568+0000 7fd33fd25640 1 --2- 172.21.15.88:0/44187795 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd33815a8e0 0x7fd3381f05c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:07.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.568+0000 7fd33fd25640 1 --2- 172.21.15.88:0/44187795 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd338151900 0x7fd3381f0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:07.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.568+0000 7fd33fd25640 1 --2- 172.21.15.88:0/44187795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd338151520 0x7fd338159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:07.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.568+0000 7fd33fd25640 1 -- 172.21.15.88:0/44187795 >> 172.21.15.88:0/44187795 conn(0x7fd3380c79a0 msgr2=0x7fd3380c40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:23:07.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.568+0000 7fd33fd25640 1 -- 172.21.15.88:0/44187795 shutdown_connections 2023-11-27T21:23:07.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:07.568+0000 7fd33fd25640 1 -- 172.21.15.88:0/44187795 wait complete. 2023-11-27T21:23:07.581 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":892,"stamp":"2023-11-27T21:23:07.284539+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":44862470,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":1793,"num_read_kb":1913,"num_write":21035,"num_write_kb":386609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25388,"ondisk_log_size":25388,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":567232,"kb_used_data":90176,"kb_used_omap":12,"kb_used_meta":476979,"kb_avail":754407488,"statfs":{"total":773094113280,"available":772513267712,"internally_reserved":0,"allocated":92340224,"data_stored":90685252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":488427057},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003106"},"pg_stats":[{"pgid":"2.1f","version":"28'339","reported_seq":379,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.533002+0000","last_change":"2023-11-27T21:22:21.533049+0000","last_active":"2023-11-27T21:22:21.533002+0000","last_peered":"2023-11-27T21:22:21.533002+0000","last_clean":"2023-11-27T21:22:21.533002+0000","last_became_active":"2023-11-27T20:54:26.221715+0000","last_became_peered":"2023-11-27T20:54:26.221715+0000","last_unstale":"2023-11-27T21:22:21.533002+0000","last_undegraded":"2023-11-27T21:22:21.533002+0000","last_fullsized":"2023-11-27T21:22:21.533002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'339","last_scrub_stamp":"2023-11-27T21:22:21.532905+0000","last_deep_scrub":"28'339","last_deep_scrub_stamp":"2023-11-27T21:22:21.532905+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.532905+0000","objects_scrubbed":7,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:03:03.041969+0000","scrub_duration":0.0081144100000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922212,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":1068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"28'71","reported_seq":111,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:51.278893+0000","last_change":"2023-11-27T21:22:51.278914+0000","last_active":"2023-11-27T21:22:51.278893+0000","last_peered":"2023-11-27T21:22:51.278893+0000","last_clean":"2023-11-27T21:22:51.278893+0000","last_became_active":"2023-11-27T20:54:27.508003+0000","last_became_peered":"2023-11-27T20:54:27.508003+0000","last_unstale":"2023-11-27T21:22:51.278893+0000","last_undegraded":"2023-11-27T21:22:51.278893+0000","last_fullsized":"2023-11-27T21:22:51.278893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'71","last_scrub_stamp":"2023-11-27T21:22:51.278824+0000","last_deep_scrub":"28'71","last_deep_scrub_stamp":"2023-11-27T21:22:51.278824+0000","last_clean_scrub_stamp":"2023-11-27T21:22:51.278824+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:46.619465+0000","scrub_duration":0.001581952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"28'159","reported_seq":194,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:27.322551+0000","last_change":"2023-11-27T21:22:27.322575+0000","last_active":"2023-11-27T21:22:27.322551+0000","last_peered":"2023-11-27T21:22:27.322551+0000","last_clean":"2023-11-27T21:22:27.322551+0000","last_became_active":"2023-11-27T20:54:31.836803+0000","last_became_peered":"2023-11-27T20:54:31.836803+0000","last_unstale":"2023-11-27T21:22:27.322551+0000","last_undegraded":"2023-11-27T21:22:27.322551+0000","last_fullsized":"2023-11-27T21:22:27.322551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'159","last_scrub_stamp":"2023-11-27T21:22:27.322480+0000","last_deep_scrub":"28'159","last_deep_scrub_stamp":"2023-11-27T21:22:27.322480+0000","last_clean_scrub_stamp":"2023-11-27T21:22:27.322480+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:08:23.783315+0000","scrub_duration":0.0022460409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":7710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'739","reported_seq":780,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:28.459705+0000","last_change":"2023-11-27T21:22:28.459705+0000","last_active":"2023-11-27T21:22:28.459705+0000","last_peered":"2023-11-27T21:22:28.459705+0000","last_clean":"2023-11-27T21:22:28.459705+0000","last_became_active":"2023-11-27T20:54:26.227620+0000","last_became_peered":"2023-11-27T20:54:26.227620+0000","last_unstale":"2023-11-27T21:22:28.459705+0000","last_undegraded":"2023-11-27T21:22:28.459705+0000","last_fullsized":"2023-11-27T21:22:28.459705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'739","last_scrub_stamp":"2023-11-27T21:22:28.459580+0000","last_deep_scrub":"28'739","last_deep_scrub_stamp":"2023-11-27T21:22:28.459580+0000","last_clean_scrub_stamp":"2023-11-27T21:22:28.459580+0000","objects_scrubbed":1,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:57:22.369660+0000","scrub_duration":0.011554231,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":733,"num_write_kb":4484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"28'77","reported_seq":116,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:56.340634+0000","last_change":"2023-11-27T21:22:56.340668+0000","last_active":"2023-11-27T21:22:56.340634+0000","last_peered":"2023-11-27T21:22:56.340634+0000","last_clean":"2023-11-27T21:22:56.340634+0000","last_became_active":"2023-11-27T20:54:27.507460+0000","last_became_peered":"2023-11-27T20:54:27.507460+0000","last_unstale":"2023-11-27T21:22:56.340634+0000","last_undegraded":"2023-11-27T21:22:56.340634+0000","last_fullsized":"2023-11-27T21:22:56.340634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:56.340545+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:56.340545+0000","last_clean_scrub_stamp":"2023-11-27T21:22:56.340545+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:20:58.429371+0000","scrub_duration":0.0021526409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"28'166","reported_seq":210,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:20.702787+0000","last_change":"2023-11-27T21:22:20.702834+0000","last_active":"2023-11-27T21:22:20.702787+0000","last_peered":"2023-11-27T21:22:20.702787+0000","last_clean":"2023-11-27T21:22:20.702787+0000","last_became_active":"2023-11-27T20:55:00.593543+0000","last_became_peered":"2023-11-27T20:55:00.593543+0000","last_unstale":"2023-11-27T21:22:20.702787+0000","last_undegraded":"2023-11-27T21:22:20.702787+0000","last_fullsized":"2023-11-27T21:22:20.702787+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'166","last_scrub_stamp":"2023-11-27T21:22:20.702707+0000","last_deep_scrub":"28'166","last_deep_scrub_stamp":"2023-11-27T21:22:20.702707+0000","last_clean_scrub_stamp":"2023-11-27T21:22:20.702707+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:34.996116+0000","scrub_duration":0.0026403020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":12743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"28'187","reported_seq":225,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:18.415812+0000","last_change":"2023-11-27T21:22:18.415839+0000","last_active":"2023-11-27T21:22:18.415812+0000","last_peered":"2023-11-27T21:22:18.415812+0000","last_clean":"2023-11-27T21:22:18.415812+0000","last_became_active":"2023-11-27T20:54:26.226407+0000","last_became_peered":"2023-11-27T20:54:26.226407+0000","last_unstale":"2023-11-27T21:22:18.415812+0000","last_undegraded":"2023-11-27T21:22:18.415812+0000","last_fullsized":"2023-11-27T21:22:18.415812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'187","last_scrub_stamp":"2023-11-27T21:22:18.415750+0000","last_deep_scrub":"28'187","last_deep_scrub_stamp":"2023-11-27T21:22:18.415750+0000","last_clean_scrub_stamp":"2023-11-27T21:22:18.415750+0000","objects_scrubbed":7,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:09.265948+0000","scrub_duration":0.0049688789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'78","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:19.383288+0000","last_change":"2023-11-27T21:22:19.383307+0000","last_active":"2023-11-27T21:22:19.383288+0000","last_peered":"2023-11-27T21:22:19.383288+0000","last_clean":"2023-11-27T21:22:19.383288+0000","last_became_active":"2023-11-27T20:54:27.512548+0000","last_became_peered":"2023-11-27T20:54:27.512548+0000","last_unstale":"2023-11-27T21:22:19.383288+0000","last_undegraded":"2023-11-27T21:22:19.383288+0000","last_fullsized":"2023-11-27T21:22:19.383288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'78","last_scrub_stamp":"2023-11-27T21:22:19.383221+0000","last_deep_scrub":"28'78","last_deep_scrub_stamp":"2023-11-27T21:22:19.383221+0000","last_clean_scrub_stamp":"2023-11-27T21:22:19.383221+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:56:13.237697+0000","scrub_duration":0.0011829830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"28'164","reported_seq":199,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:44.720580+0000","last_change":"2023-11-27T21:22:44.720599+0000","last_active":"2023-11-27T21:22:44.720580+0000","last_peered":"2023-11-27T21:22:44.720580+0000","last_clean":"2023-11-27T21:22:44.720580+0000","last_became_active":"2023-11-27T20:54:31.828045+0000","last_became_peered":"2023-11-27T20:54:31.828045+0000","last_unstale":"2023-11-27T21:22:44.720580+0000","last_undegraded":"2023-11-27T21:22:44.720580+0000","last_fullsized":"2023-11-27T21:22:44.720580+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'164","last_scrub_stamp":"2023-11-27T21:22:44.720523+0000","last_deep_scrub":"28'164","last_deep_scrub_stamp":"2023-11-27T21:22:44.720523+0000","last_clean_scrub_stamp":"2023-11-27T21:22:44.720523+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:29:31.109271+0000","scrub_duration":0.0023621649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":12089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"28'12","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:25.356913+0000","last_change":"2023-11-27T21:22:25.356937+0000","last_active":"2023-11-27T21:22:25.356913+0000","last_peered":"2023-11-27T21:22:25.356913+0000","last_clean":"2023-11-27T21:22:25.356913+0000","last_became_active":"2023-11-27T20:54:26.226522+0000","last_became_peered":"2023-11-27T20:54:26.226522+0000","last_unstale":"2023-11-27T21:22:25.356913+0000","last_undegraded":"2023-11-27T21:22:25.356913+0000","last_fullsized":"2023-11-27T21:22:25.356913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2023-11-27T21:22:25.356853+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2023-11-27T21:22:25.356853+0000","last_clean_scrub_stamp":"2023-11-27T21:22:25.356853+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:24.010754+0000","scrub_duration":0.0030610910000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"28'85","reported_seq":129,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:51.494966+0000","last_change":"2023-11-27T21:22:51.494988+0000","last_active":"2023-11-27T21:22:51.494966+0000","last_peered":"2023-11-27T21:22:51.494966+0000","last_clean":"2023-11-27T21:22:51.494966+0000","last_became_active":"2023-11-27T20:55:00.789772+0000","last_became_peered":"2023-11-27T20:55:00.789772+0000","last_unstale":"2023-11-27T21:22:51.494966+0000","last_undegraded":"2023-11-27T21:22:51.494966+0000","last_fullsized":"2023-11-27T21:22:51.494966+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'85","last_scrub_stamp":"2023-11-27T21:22:51.494889+0000","last_deep_scrub":"28'85","last_deep_scrub_stamp":"2023-11-27T21:22:51.494889+0000","last_clean_scrub_stamp":"2023-11-27T21:22:51.494889+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:34:42.390103+0000","scrub_duration":0.0013219589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"28'169","reported_seq":204,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.736963+0000","last_change":"2023-11-27T21:22:21.736983+0000","last_active":"2023-11-27T21:22:21.736963+0000","last_peered":"2023-11-27T21:22:21.736963+0000","last_clean":"2023-11-27T21:22:21.736963+0000","last_became_active":"2023-11-27T20:54:31.828371+0000","last_became_peered":"2023-11-27T20:54:31.828371+0000","last_unstale":"2023-11-27T21:22:21.736963+0000","last_undegraded":"2023-11-27T21:22:21.736963+0000","last_fullsized":"2023-11-27T21:22:21.736963+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'169","last_scrub_stamp":"2023-11-27T21:22:21.736882+0000","last_deep_scrub":"28'169","last_deep_scrub_stamp":"2023-11-27T21:22:21.736882+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.736882+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:39:05.705679+0000","scrub_duration":0.0027207239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":6774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"28'74","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:52.514077+0000","last_change":"2023-11-27T21:22:52.514095+0000","last_active":"2023-11-27T21:22:52.514077+0000","last_peered":"2023-11-27T21:22:52.514077+0000","last_clean":"2023-11-27T21:22:52.514077+0000","last_became_active":"2023-11-27T20:54:27.498279+0000","last_became_peered":"2023-11-27T20:54:27.498279+0000","last_unstale":"2023-11-27T21:22:52.514077+0000","last_undegraded":"2023-11-27T21:22:52.514077+0000","last_fullsized":"2023-11-27T21:22:52.514077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'74","last_scrub_stamp":"2023-11-27T21:22:52.514018+0000","last_deep_scrub":"28'74","last_deep_scrub_stamp":"2023-11-27T21:22:52.514018+0000","last_clean_scrub_stamp":"2023-11-27T21:22:52.514018+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:32.165678+0000","scrub_duration":0.001193483,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'1124","reported_seq":1163,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:43.632211+0000","last_change":"2023-11-27T21:22:43.632238+0000","last_active":"2023-11-27T21:22:43.632211+0000","last_peered":"2023-11-27T21:22:43.632211+0000","last_clean":"2023-11-27T21:22:43.632211+0000","last_became_active":"2023-11-27T20:54:26.227503+0000","last_became_peered":"2023-11-27T20:54:26.227503+0000","last_unstale":"2023-11-27T21:22:43.632211+0000","last_undegraded":"2023-11-27T21:22:43.632211+0000","last_fullsized":"2023-11-27T21:22:43.632211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1124","last_scrub_stamp":"2023-11-27T21:22:43.632146+0000","last_deep_scrub":"28'1124","last_deep_scrub_stamp":"2023-11-27T21:22:43.632146+0000","last_clean_scrub_stamp":"2023-11-27T21:22:43.632146+0000","objects_scrubbed":3,"log_size":1124,"log_dups_size":0,"ondisk_log_size":1124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:17.249089+0000","scrub_duration":0.013154749,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1114,"num_write_kb":4562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"28'173","reported_seq":209,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:00.478094+0000","last_change":"2023-11-27T21:23:00.478130+0000","last_active":"2023-11-27T21:23:00.478094+0000","last_peered":"2023-11-27T21:23:00.478094+0000","last_clean":"2023-11-27T21:23:00.478094+0000","last_became_active":"2023-11-27T20:54:31.827631+0000","last_became_peered":"2023-11-27T20:54:31.827631+0000","last_unstale":"2023-11-27T21:23:00.478094+0000","last_undegraded":"2023-11-27T21:23:00.478094+0000","last_fullsized":"2023-11-27T21:23:00.478094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'173","last_scrub_stamp":"2023-11-27T21:23:00.478024+0000","last_deep_scrub":"28'173","last_deep_scrub_stamp":"2023-11-27T21:23:00.478024+0000","last_clean_scrub_stamp":"2023-11-27T21:23:00.478024+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:28:40.365877+0000","scrub_duration":0.0024979619999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":8292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"28'70","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:24.322940+0000","last_change":"2023-11-27T21:22:24.322960+0000","last_active":"2023-11-27T21:22:24.322940+0000","last_peered":"2023-11-27T21:22:24.322940+0000","last_clean":"2023-11-27T21:22:24.322940+0000","last_became_active":"2023-11-27T20:54:27.510668+0000","last_became_peered":"2023-11-27T20:54:27.510668+0000","last_unstale":"2023-11-27T21:22:24.322940+0000","last_undegraded":"2023-11-27T21:22:24.322940+0000","last_fullsized":"2023-11-27T21:22:24.322940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'70","last_scrub_stamp":"2023-11-27T21:22:24.322871+0000","last_deep_scrub":"28'70","last_deep_scrub_stamp":"2023-11-27T21:22:24.322871+0000","last_clean_scrub_stamp":"2023-11-27T21:22:24.322871+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:12:30.073196+0000","scrub_duration":0.0016321840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'447","reported_seq":487,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:11.006346+0000","last_change":"2023-11-27T21:22:11.006346+0000","last_active":"2023-11-27T21:22:11.006346+0000","last_peered":"2023-11-27T21:22:11.006346+0000","last_clean":"2023-11-27T21:22:11.006346+0000","last_became_active":"2023-11-27T20:54:26.231081+0000","last_became_peered":"2023-11-27T20:54:26.231081+0000","last_unstale":"2023-11-27T21:22:11.006346+0000","last_undegraded":"2023-11-27T21:22:11.006346+0000","last_fullsized":"2023-11-27T21:22:11.006346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'447","last_scrub_stamp":"2023-11-27T21:22:11.006247+0000","last_deep_scrub":"28'447","last_deep_scrub_stamp":"2023-11-27T21:22:11.006247+0000","last_clean_scrub_stamp":"2023-11-27T21:22:11.006247+0000","objects_scrubbed":2,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:24:18.182726+0000","scrub_duration":0.0020915840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"28'191","reported_seq":227,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:52.442803+0000","last_change":"2023-11-27T21:22:52.442823+0000","last_active":"2023-11-27T21:22:52.442803+0000","last_peered":"2023-11-27T21:22:52.442803+0000","last_clean":"2023-11-27T21:22:52.442803+0000","last_became_active":"2023-11-27T20:54:31.816700+0000","last_became_peered":"2023-11-27T20:54:31.816700+0000","last_unstale":"2023-11-27T21:22:52.442803+0000","last_undegraded":"2023-11-27T21:22:52.442803+0000","last_fullsized":"2023-11-27T21:22:52.442803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'191","last_scrub_stamp":"2023-11-27T21:22:52.442732+0000","last_deep_scrub":"28'191","last_deep_scrub_stamp":"2023-11-27T21:22:52.442732+0000","last_clean_scrub_stamp":"2023-11-27T21:22:52.442732+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:05:38.633591+0000","scrub_duration":0.0028160640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":12458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"28'73","reported_seq":112,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:39.536435+0000","last_change":"2023-11-27T21:22:39.536481+0000","last_active":"2023-11-27T21:22:39.536435+0000","last_peered":"2023-11-27T21:22:39.536435+0000","last_clean":"2023-11-27T21:22:39.536435+0000","last_became_active":"2023-11-27T20:54:27.509961+0000","last_became_peered":"2023-11-27T20:54:27.509961+0000","last_unstale":"2023-11-27T21:22:39.536435+0000","last_undegraded":"2023-11-27T21:22:39.536435+0000","last_fullsized":"2023-11-27T21:22:39.536435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'73","last_scrub_stamp":"2023-11-27T21:22:39.536306+0000","last_deep_scrub":"28'73","last_deep_scrub_stamp":"2023-11-27T21:22:39.536306+0000","last_clean_scrub_stamp":"2023-11-27T21:22:39.536306+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:15:26.032520+0000","scrub_duration":0.001632695,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'339","reported_seq":379,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:17.537795+0000","last_change":"2023-11-27T21:22:17.537795+0000","last_active":"2023-11-27T21:22:17.537795+0000","last_peered":"2023-11-27T21:22:17.537795+0000","last_clean":"2023-11-27T21:22:17.537795+0000","last_became_active":"2023-11-27T20:54:26.223717+0000","last_became_peered":"2023-11-27T20:54:26.223717+0000","last_unstale":"2023-11-27T21:22:17.537795+0000","last_undegraded":"2023-11-27T21:22:17.537795+0000","last_fullsized":"2023-11-27T21:22:17.537795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'339","last_scrub_stamp":"2023-11-27T21:22:17.537656+0000","last_deep_scrub":"28'339","last_deep_scrub_stamp":"2023-11-27T21:22:17.537656+0000","last_clean_scrub_stamp":"2023-11-27T21:22:17.537656+0000","objects_scrubbed":4,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:35:27.345606+0000","scrub_duration":0.0048066070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":333,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'146","reported_seq":182,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:31.285973+0000","last_change":"2023-11-27T21:22:31.285997+0000","last_active":"2023-11-27T21:22:31.285973+0000","last_peered":"2023-11-27T21:22:31.285973+0000","last_clean":"2023-11-27T21:22:31.285973+0000","last_became_active":"2023-11-27T20:54:31.836346+0000","last_became_peered":"2023-11-27T20:54:31.836346+0000","last_unstale":"2023-11-27T21:22:31.285973+0000","last_undegraded":"2023-11-27T21:22:31.285973+0000","last_fullsized":"2023-11-27T21:22:31.285973+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'146","last_scrub_stamp":"2023-11-27T21:22:31.285890+0000","last_deep_scrub":"28'146","last_deep_scrub_stamp":"2023-11-27T21:22:31.285890+0000","last_clean_scrub_stamp":"2023-11-27T21:22:31.285890+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:35:41.093841+0000","scrub_duration":0.0026461219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":6504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'66","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:18.554510+0000","last_change":"2023-11-27T21:22:18.554510+0000","last_active":"2023-11-27T21:22:18.554510+0000","last_peered":"2023-11-27T21:22:18.554510+0000","last_clean":"2023-11-27T21:22:18.554510+0000","last_became_active":"2023-11-27T20:54:27.493327+0000","last_became_peered":"2023-11-27T20:54:27.493327+0000","last_unstale":"2023-11-27T21:22:18.554510+0000","last_undegraded":"2023-11-27T21:22:18.554510+0000","last_fullsized":"2023-11-27T21:22:18.554510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'66","last_scrub_stamp":"2023-11-27T21:22:18.554433+0000","last_deep_scrub":"28'66","last_deep_scrub_stamp":"2023-11-27T21:22:18.554433+0000","last_clean_scrub_stamp":"2023-11-27T21:22:18.554433+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:39:55.933857+0000","scrub_duration":0.0016646670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"28'8","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.398392+0000","last_change":"2023-11-27T21:22:02.398392+0000","last_active":"2023-11-27T21:22:02.398392+0000","last_peered":"2023-11-27T21:22:02.398392+0000","last_clean":"2023-11-27T21:22:02.398392+0000","last_became_active":"2023-11-27T20:54:26.227120+0000","last_became_peered":"2023-11-27T20:54:26.227120+0000","last_unstale":"2023-11-27T21:22:02.398392+0000","last_undegraded":"2023-11-27T21:22:02.398392+0000","last_fullsized":"2023-11-27T21:22:02.398392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2023-11-27T21:22:02.398284+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2023-11-27T21:22:02.398284+0000","last_clean_scrub_stamp":"2023-11-27T21:22:02.398284+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:09:04.340440+0000","scrub_duration":0.00264496,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'197","reported_seq":242,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:46.762074+0000","last_change":"2023-11-27T21:22:46.762092+0000","last_active":"2023-11-27T21:22:46.762074+0000","last_peered":"2023-11-27T21:22:46.762074+0000","last_clean":"2023-11-27T21:22:46.762074+0000","last_became_active":"2023-11-27T20:55:01.286057+0000","last_became_peered":"2023-11-27T20:55:01.286057+0000","last_unstale":"2023-11-27T21:22:46.762074+0000","last_undegraded":"2023-11-27T21:22:46.762074+0000","last_fullsized":"2023-11-27T21:22:46.762074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'197","last_scrub_stamp":"2023-11-27T21:22:46.762011+0000","last_deep_scrub":"28'197","last_deep_scrub_stamp":"2023-11-27T21:22:46.762011+0000","last_clean_scrub_stamp":"2023-11-27T21:22:46.762011+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:05:20.380594+0000","scrub_duration":0.0026407079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":17829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5,7],"acting":[2,1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"28'63","reported_seq":102,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:04.544551+0000","last_change":"2023-11-27T21:22:04.544551+0000","last_active":"2023-11-27T21:22:04.544551+0000","last_peered":"2023-11-27T21:22:04.544551+0000","last_clean":"2023-11-27T21:22:04.544551+0000","last_became_active":"2023-11-27T20:54:27.510573+0000","last_became_peered":"2023-11-27T20:54:27.510573+0000","last_unstale":"2023-11-27T21:22:04.544551+0000","last_undegraded":"2023-11-27T21:22:04.544551+0000","last_fullsized":"2023-11-27T21:22:04.544551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'63","last_scrub_stamp":"2023-11-27T21:22:04.544471+0000","last_deep_scrub":"28'63","last_deep_scrub_stamp":"2023-11-27T21:22:04.544471+0000","last_clean_scrub_stamp":"2023-11-27T21:22:04.544471+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:57:01.291364+0000","scrub_duration":0.0011139559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'17","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:50.541112+0000","last_change":"2023-11-27T21:22:50.541155+0000","last_active":"2023-11-27T21:22:50.541112+0000","last_peered":"2023-11-27T21:22:50.541112+0000","last_clean":"2023-11-27T21:22:50.541112+0000","last_became_active":"2023-11-27T20:54:26.224412+0000","last_became_peered":"2023-11-27T20:54:26.224412+0000","last_unstale":"2023-11-27T21:22:50.541112+0000","last_undegraded":"2023-11-27T21:22:50.541112+0000","last_fullsized":"2023-11-27T21:22:50.541112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'17","last_scrub_stamp":"2023-11-27T21:22:50.541037+0000","last_deep_scrub":"28'17","last_deep_scrub_stamp":"2023-11-27T21:22:50.541037+0000","last_clean_scrub_stamp":"2023-11-27T21:22:50.541037+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:21:53.747491+0000","scrub_duration":0.003553072,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'174","reported_seq":211,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:24.777115+0000","last_change":"2023-11-27T21:22:24.777150+0000","last_active":"2023-11-27T21:22:24.777115+0000","last_peered":"2023-11-27T21:22:24.777115+0000","last_clean":"2023-11-27T21:22:24.777115+0000","last_became_active":"2023-11-27T20:54:31.819371+0000","last_became_peered":"2023-11-27T20:54:31.819371+0000","last_unstale":"2023-11-27T21:22:24.777115+0000","last_undegraded":"2023-11-27T21:22:24.777115+0000","last_fullsized":"2023-11-27T21:22:24.777115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'174","last_scrub_stamp":"2023-11-27T21:22:24.777034+0000","last_deep_scrub":"28'174","last_deep_scrub_stamp":"2023-11-27T21:22:24.777034+0000","last_clean_scrub_stamp":"2023-11-27T21:22:24.777034+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:57:18.687113+0000","scrub_duration":0.0029222290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":8398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"28'71","reported_seq":110,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:05.539610+0000","last_change":"2023-11-27T21:22:05.539610+0000","last_active":"2023-11-27T21:22:05.539610+0000","last_peered":"2023-11-27T21:22:05.539610+0000","last_clean":"2023-11-27T21:22:05.539610+0000","last_became_active":"2023-11-27T20:54:27.500455+0000","last_became_peered":"2023-11-27T20:54:27.500455+0000","last_unstale":"2023-11-27T21:22:05.539610+0000","last_undegraded":"2023-11-27T21:22:05.539610+0000","last_fullsized":"2023-11-27T21:22:05.539610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'71","last_scrub_stamp":"2023-11-27T21:22:05.539526+0000","last_deep_scrub":"28'71","last_deep_scrub_stamp":"2023-11-27T21:22:05.539526+0000","last_clean_scrub_stamp":"2023-11-27T21:22:05.539526+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:13:29.395135+0000","scrub_duration":0.001413643,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'163","reported_seq":203,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:14.476551+0000","last_change":"2023-11-27T21:22:14.476551+0000","last_active":"2023-11-27T21:22:14.476551+0000","last_peered":"2023-11-27T21:22:14.476551+0000","last_clean":"2023-11-27T21:22:14.476551+0000","last_became_active":"2023-11-27T20:54:26.222981+0000","last_became_peered":"2023-11-27T20:54:26.222981+0000","last_unstale":"2023-11-27T21:22:14.476551+0000","last_undegraded":"2023-11-27T21:22:14.476551+0000","last_fullsized":"2023-11-27T21:22:14.476551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'163","last_scrub_stamp":"2023-11-27T21:22:14.476461+0000","last_deep_scrub":"28'163","last_deep_scrub_stamp":"2023-11-27T21:22:14.476461+0000","last_clean_scrub_stamp":"2023-11-27T21:22:14.476461+0000","objects_scrubbed":4,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:08:10.937295+0000","scrub_duration":0.0035278750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":391,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"28'157","reported_seq":187,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.769437+0000","last_change":"2023-11-27T20:54:31.814118+0000","last_active":"2023-11-27T21:22:02.769437+0000","last_peered":"2023-11-27T21:22:02.769437+0000","last_clean":"2023-11-27T21:22:02.769437+0000","last_became_active":"2023-11-27T20:54:31.813765+0000","last_became_peered":"2023-11-27T20:54:31.813765+0000","last_unstale":"2023-11-27T21:22:02.769437+0000","last_undegraded":"2023-11-27T21:22:02.769437+0000","last_fullsized":"2023-11-27T21:22:02.769437+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":11921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"28'78","reported_seq":117,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.165891+0000","last_change":"2023-11-27T21:22:21.165911+0000","last_active":"2023-11-27T21:22:21.165891+0000","last_peered":"2023-11-27T21:22:21.165891+0000","last_clean":"2023-11-27T21:22:21.165891+0000","last_became_active":"2023-11-27T20:54:27.506210+0000","last_became_peered":"2023-11-27T20:54:27.506210+0000","last_unstale":"2023-11-27T21:22:21.165891+0000","last_undegraded":"2023-11-27T21:22:21.165891+0000","last_fullsized":"2023-11-27T21:22:21.165891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'78","last_scrub_stamp":"2023-11-27T21:22:21.165807+0000","last_deep_scrub":"28'78","last_deep_scrub_stamp":"2023-11-27T21:22:21.165807+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.165807+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:48:07.689268+0000","scrub_duration":0.0012874189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'248","reported_seq":288,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:27.576119+0000","last_change":"2023-11-27T21:22:27.576142+0000","last_active":"2023-11-27T21:22:27.576119+0000","last_peered":"2023-11-27T21:22:27.576119+0000","last_clean":"2023-11-27T21:22:27.576119+0000","last_became_active":"2023-11-27T20:54:26.219775+0000","last_became_peered":"2023-11-27T20:54:26.219775+0000","last_unstale":"2023-11-27T21:22:27.576119+0000","last_undegraded":"2023-11-27T21:22:27.576119+0000","last_fullsized":"2023-11-27T21:22:27.576119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'248","last_scrub_stamp":"2023-11-27T21:22:27.576061+0000","last_deep_scrub":"28'248","last_deep_scrub_stamp":"2023-11-27T21:22:27.576061+0000","last_clean_scrub_stamp":"2023-11-27T21:22:27.576061+0000","objects_scrubbed":3,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:13:50.937641+0000","scrub_duration":0.004309823,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"28'177","reported_seq":214,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:30.072341+0000","last_change":"2023-11-27T21:22:30.072362+0000","last_active":"2023-11-27T21:22:30.072341+0000","last_peered":"2023-11-27T21:22:30.072341+0000","last_clean":"2023-11-27T21:22:30.072341+0000","last_became_active":"2023-11-27T20:54:31.825591+0000","last_became_peered":"2023-11-27T20:54:31.825591+0000","last_unstale":"2023-11-27T21:22:30.072341+0000","last_undegraded":"2023-11-27T21:22:30.072341+0000","last_fullsized":"2023-11-27T21:22:30.072341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'177","last_scrub_stamp":"2023-11-27T21:22:30.072272+0000","last_deep_scrub":"28'177","last_deep_scrub_stamp":"2023-11-27T21:22:30.072272+0000","last_clean_scrub_stamp":"2023-11-27T21:22:30.072272+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:48:50.193448+0000","scrub_duration":0.002828517,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":8135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"28'65","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:06.889843+0000","last_change":"2023-11-27T21:22:06.889864+0000","last_active":"2023-11-27T21:22:06.889843+0000","last_peered":"2023-11-27T21:22:06.889843+0000","last_clean":"2023-11-27T21:22:06.889843+0000","last_became_active":"2023-11-27T20:54:27.500677+0000","last_became_peered":"2023-11-27T20:54:27.500677+0000","last_unstale":"2023-11-27T21:22:06.889843+0000","last_undegraded":"2023-11-27T21:22:06.889843+0000","last_fullsized":"2023-11-27T21:22:06.889843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'65","last_scrub_stamp":"2023-11-27T21:22:06.889775+0000","last_deep_scrub":"28'65","last_deep_scrub_stamp":"2023-11-27T21:22:06.889775+0000","last_clean_scrub_stamp":"2023-11-27T21:22:06.889775+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:19:12.052405+0000","scrub_duration":0.0014482970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"28'6","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:26.399700+0000","last_change":"2023-11-27T21:22:26.399718+0000","last_active":"2023-11-27T21:22:26.399700+0000","last_peered":"2023-11-27T21:22:26.399700+0000","last_clean":"2023-11-27T21:22:26.399700+0000","last_became_active":"2023-11-27T20:54:26.227605+0000","last_became_peered":"2023-11-27T20:54:26.227605+0000","last_unstale":"2023-11-27T21:22:26.399700+0000","last_undegraded":"2023-11-27T21:22:26.399700+0000","last_fullsized":"2023-11-27T21:22:26.399700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2023-11-27T21:22:26.399642+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2023-11-27T21:22:26.399642+0000","last_clean_scrub_stamp":"2023-11-27T21:22:26.399642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:39:10.368439+0000","scrub_duration":0.0011058719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"28'178","reported_seq":215,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:27.137341+0000","last_change":"2023-11-27T21:22:27.137378+0000","last_active":"2023-11-27T21:22:27.137341+0000","last_peered":"2023-11-27T21:22:27.137341+0000","last_clean":"2023-11-27T21:22:27.137341+0000","last_became_active":"2023-11-27T20:54:31.826406+0000","last_became_peered":"2023-11-27T20:54:31.826406+0000","last_unstale":"2023-11-27T21:22:27.137341+0000","last_undegraded":"2023-11-27T21:22:27.137341+0000","last_fullsized":"2023-11-27T21:22:27.137341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'178","last_scrub_stamp":"2023-11-27T21:22:27.137245+0000","last_deep_scrub":"28'178","last_deep_scrub_stamp":"2023-11-27T21:22:27.137245+0000","last_clean_scrub_stamp":"2023-11-27T21:22:27.137245+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:57:21.047325+0000","scrub_duration":0.0027180899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":6957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"28'85","reported_seq":124,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:48.468746+0000","last_change":"2023-11-27T21:22:48.468768+0000","last_active":"2023-11-27T21:22:48.468746+0000","last_peered":"2023-11-27T21:22:48.468746+0000","last_clean":"2023-11-27T21:22:48.468746+0000","last_became_active":"2023-11-27T20:54:27.516686+0000","last_became_peered":"2023-11-27T20:54:27.516686+0000","last_unstale":"2023-11-27T21:22:48.468746+0000","last_undegraded":"2023-11-27T21:22:48.468746+0000","last_fullsized":"2023-11-27T21:22:48.468746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'85","last_scrub_stamp":"2023-11-27T21:22:48.468674+0000","last_deep_scrub":"28'85","last_deep_scrub_stamp":"2023-11-27T21:22:48.468674+0000","last_clean_scrub_stamp":"2023-11-27T21:22:48.468674+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:49:18.145204+0000","scrub_duration":0.0012105060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'918","reported_seq":958,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:23.574077+0000","last_change":"2023-11-27T21:22:23.574100+0000","last_active":"2023-11-27T21:22:23.574077+0000","last_peered":"2023-11-27T21:22:23.574077+0000","last_clean":"2023-11-27T21:22:23.574077+0000","last_became_active":"2023-11-27T20:54:26.229985+0000","last_became_peered":"2023-11-27T20:54:26.229985+0000","last_unstale":"2023-11-27T21:22:23.574077+0000","last_undegraded":"2023-11-27T21:22:23.574077+0000","last_fullsized":"2023-11-27T21:22:23.574077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'918","last_scrub_stamp":"2023-11-27T21:22:23.574017+0000","last_deep_scrub":"28'918","last_deep_scrub_stamp":"2023-11-27T21:22:23.574017+0000","last_clean_scrub_stamp":"2023-11-27T21:22:23.574017+0000","objects_scrubbed":3,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:34:39.196551+0000","scrub_duration":0.013397599,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206463,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":911,"num_write_kb":4580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"28'139","reported_seq":173,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:47.755242+0000","last_change":"2023-11-27T21:22:47.755262+0000","last_active":"2023-11-27T21:22:47.755242+0000","last_peered":"2023-11-27T21:22:47.755242+0000","last_clean":"2023-11-27T21:22:47.755242+0000","last_became_active":"2023-11-27T20:55:00.588018+0000","last_became_peered":"2023-11-27T20:55:00.588018+0000","last_unstale":"2023-11-27T21:22:47.755242+0000","last_undegraded":"2023-11-27T21:22:47.755242+0000","last_fullsized":"2023-11-27T21:22:47.755242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'139","last_scrub_stamp":"2023-11-27T21:22:47.755175+0000","last_deep_scrub":"28'139","last_deep_scrub_stamp":"2023-11-27T21:22:47.755175+0000","last_clean_scrub_stamp":"2023-11-27T21:22:47.755175+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:43.095816+0000","scrub_duration":0.003086409,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":13169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,0,3],"acting":[2,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'77","reported_seq":117,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:59.348680+0000","last_change":"2023-11-27T21:22:59.348724+0000","last_active":"2023-11-27T21:22:59.348680+0000","last_peered":"2023-11-27T21:22:59.348680+0000","last_clean":"2023-11-27T21:22:59.348680+0000","last_became_active":"2023-11-27T20:54:27.512093+0000","last_became_peered":"2023-11-27T20:54:27.512093+0000","last_unstale":"2023-11-27T21:22:59.348680+0000","last_undegraded":"2023-11-27T21:22:59.348680+0000","last_fullsized":"2023-11-27T21:22:59.348680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:59.348610+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:59.348610+0000","last_clean_scrub_stamp":"2023-11-27T21:22:59.348610+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:15:13.167920+0000","scrub_duration":0.001147002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'273","reported_seq":482,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:15.255928+0000","last_change":"2023-11-27T21:22:15.255951+0000","last_active":"2023-11-27T21:22:15.255928+0000","last_peered":"2023-11-27T21:22:15.255928+0000","last_clean":"2023-11-27T21:22:15.255928+0000","last_became_active":"2023-11-27T20:54:26.230548+0000","last_became_peered":"2023-11-27T20:54:26.230548+0000","last_unstale":"2023-11-27T21:22:15.255928+0000","last_undegraded":"2023-11-27T21:22:15.255928+0000","last_fullsized":"2023-11-27T21:22:15.255928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'273","last_scrub_stamp":"2023-11-27T21:22:15.255867+0000","last_deep_scrub":"28'273","last_deep_scrub_stamp":"2023-11-27T21:22:15.255867+0000","last_clean_scrub_stamp":"2023-11-27T21:22:15.255867+0000","objects_scrubbed":4,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:44:57.904993+0000","scrub_duration":0.003822022,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28446,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":170,"num_read_kb":173,"num_write":266,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"28'141","reported_seq":187,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:35.088318+0000","last_change":"2023-11-27T21:22:35.088318+0000","last_active":"2023-11-27T21:22:35.088318+0000","last_peered":"2023-11-27T21:22:35.088318+0000","last_clean":"2023-11-27T21:22:35.088318+0000","last_became_active":"2023-11-27T20:55:00.594705+0000","last_became_peered":"2023-11-27T20:55:00.594705+0000","last_unstale":"2023-11-27T21:22:35.088318+0000","last_undegraded":"2023-11-27T21:22:35.088318+0000","last_fullsized":"2023-11-27T21:22:35.088318+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'141","last_scrub_stamp":"2023-11-27T21:22:35.088216+0000","last_deep_scrub":"28'141","last_deep_scrub_stamp":"2023-11-27T21:22:35.088216+0000","last_clean_scrub_stamp":"2023-11-27T21:22:35.088216+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:06:09.356209+0000","scrub_duration":0.002816444,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":12035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"28'77","reported_seq":116,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:16.088541+0000","last_change":"2023-11-27T21:22:16.088562+0000","last_active":"2023-11-27T21:22:16.088541+0000","last_peered":"2023-11-27T21:22:16.088541+0000","last_clean":"2023-11-27T21:22:16.088541+0000","last_became_active":"2023-11-27T20:54:27.502941+0000","last_became_peered":"2023-11-27T20:54:27.502941+0000","last_unstale":"2023-11-27T21:22:16.088541+0000","last_undegraded":"2023-11-27T21:22:16.088541+0000","last_fullsized":"2023-11-27T21:22:16.088541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:16.088473+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:16.088473+0000","last_clean_scrub_stamp":"2023-11-27T21:22:16.088473+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:26:26.798459+0000","scrub_duration":0.001453584,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'12","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:44.601666+0000","last_change":"2023-11-27T21:22:44.601690+0000","last_active":"2023-11-27T21:22:44.601666+0000","last_peered":"2023-11-27T21:22:44.601666+0000","last_clean":"2023-11-27T21:22:44.601666+0000","last_became_active":"2023-11-27T20:54:26.214166+0000","last_became_peered":"2023-11-27T20:54:26.214166+0000","last_unstale":"2023-11-27T21:22:44.601666+0000","last_undegraded":"2023-11-27T21:22:44.601666+0000","last_fullsized":"2023-11-27T21:22:44.601666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2023-11-27T21:22:44.601613+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2023-11-27T21:22:44.601613+0000","last_clean_scrub_stamp":"2023-11-27T21:22:44.601613+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:37:36.382160+0000","scrub_duration":0.0026042959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"28'132","reported_seq":161,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:03.525521+0000","last_change":"2023-11-27T20:54:31.832551+0000","last_active":"2023-11-27T21:22:03.525521+0000","last_peered":"2023-11-27T21:22:03.525521+0000","last_clean":"2023-11-27T21:22:03.525521+0000","last_became_active":"2023-11-27T20:54:31.832196+0000","last_became_peered":"2023-11-27T20:54:31.832196+0000","last_unstale":"2023-11-27T21:22:03.525521+0000","last_undegraded":"2023-11-27T21:22:03.525521+0000","last_fullsized":"2023-11-27T21:22:03.525521+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":8461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'69","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:00.632140+0000","last_change":"2023-11-27T21:23:00.632159+0000","last_active":"2023-11-27T21:23:00.632140+0000","last_peered":"2023-11-27T21:23:00.632140+0000","last_clean":"2023-11-27T21:23:00.632140+0000","last_became_active":"2023-11-27T20:54:27.433161+0000","last_became_peered":"2023-11-27T20:54:27.433161+0000","last_unstale":"2023-11-27T21:23:00.632140+0000","last_undegraded":"2023-11-27T21:23:00.632140+0000","last_fullsized":"2023-11-27T21:23:00.632140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'69","last_scrub_stamp":"2023-11-27T21:23:00.632077+0000","last_deep_scrub":"28'69","last_deep_scrub_stamp":"2023-11-27T21:23:00.632077+0000","last_clean_scrub_stamp":"2023-11-27T21:23:00.632077+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:09:39.733645+0000","scrub_duration":0.0012750789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'13","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:45.560157+0000","last_change":"2023-11-27T21:22:45.560181+0000","last_active":"2023-11-27T21:22:45.560157+0000","last_peered":"2023-11-27T21:22:45.560157+0000","last_clean":"2023-11-27T21:22:45.560157+0000","last_became_active":"2023-11-27T20:54:26.227133+0000","last_became_peered":"2023-11-27T20:54:26.227133+0000","last_unstale":"2023-11-27T21:22:45.560157+0000","last_undegraded":"2023-11-27T21:22:45.560157+0000","last_fullsized":"2023-11-27T21:22:45.560157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2023-11-27T21:22:45.560102+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2023-11-27T21:22:45.560102+0000","last_clean_scrub_stamp":"2023-11-27T21:22:45.560102+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:50:13.671235+0000","scrub_duration":0.0038425709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":195,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:03.333433+0000","last_change":"2023-11-27T21:22:03.333433+0000","last_active":"2023-11-27T21:22:03.333433+0000","last_peered":"2023-11-27T21:22:03.333433+0000","last_clean":"2023-11-27T21:22:03.333433+0000","last_became_active":"2023-11-27T20:54:11.452181+0000","last_became_peered":"2023-11-27T20:54:11.452181+0000","last_unstale":"2023-11-27T21:22:03.333433+0000","last_undegraded":"2023-11-27T21:22:03.333433+0000","last_fullsized":"2023-11-27T21:22:03.333433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2023-11-27T21:22:03.333356+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2023-11-27T21:22:03.333356+0000","last_clean_scrub_stamp":"2023-11-27T21:22:03.333356+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:51:11.809770+0000","scrub_duration":0.0045126749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'171","reported_seq":208,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:58.455643+0000","last_change":"2023-11-27T21:22:58.455677+0000","last_active":"2023-11-27T21:22:58.455643+0000","last_peered":"2023-11-27T21:22:58.455643+0000","last_clean":"2023-11-27T21:22:58.455643+0000","last_became_active":"2023-11-27T20:54:31.818048+0000","last_became_peered":"2023-11-27T20:54:31.818048+0000","last_unstale":"2023-11-27T21:22:58.455643+0000","last_undegraded":"2023-11-27T21:22:58.455643+0000","last_fullsized":"2023-11-27T21:22:58.455643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'171","last_scrub_stamp":"2023-11-27T21:22:58.455571+0000","last_deep_scrub":"28'171","last_deep_scrub_stamp":"2023-11-27T21:22:58.455571+0000","last_clean_scrub_stamp":"2023-11-27T21:22:58.455571+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:48:52.771160+0000","scrub_duration":0.0021714260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":10034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"28'75","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.521838+0000","last_change":"2023-11-27T21:22:02.521856+0000","last_active":"2023-11-27T21:22:02.521838+0000","last_peered":"2023-11-27T21:22:02.521838+0000","last_clean":"2023-11-27T21:22:02.521838+0000","last_became_active":"2023-11-27T20:54:27.493256+0000","last_became_peered":"2023-11-27T20:54:27.493256+0000","last_unstale":"2023-11-27T21:22:02.521838+0000","last_undegraded":"2023-11-27T21:22:02.521838+0000","last_fullsized":"2023-11-27T21:22:02.521838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:02.521779+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:02.521779+0000","last_clean_scrub_stamp":"2023-11-27T21:22:02.521779+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:35:12.329730+0000","scrub_duration":0.0011699499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'1021","reported_seq":1060,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:09.046981+0000","last_change":"2023-11-27T21:22:09.047006+0000","last_active":"2023-11-27T21:22:09.046981+0000","last_peered":"2023-11-27T21:22:09.046981+0000","last_clean":"2023-11-27T21:22:09.046981+0000","last_became_active":"2023-11-27T20:54:26.229796+0000","last_became_peered":"2023-11-27T20:54:26.229796+0000","last_unstale":"2023-11-27T21:22:09.046981+0000","last_undegraded":"2023-11-27T21:22:09.046981+0000","last_fullsized":"2023-11-27T21:22:09.046981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1021","last_scrub_stamp":"2023-11-27T21:22:09.046925+0000","last_deep_scrub":"28'1021","last_deep_scrub_stamp":"2023-11-27T21:22:09.046925+0000","last_clean_scrub_stamp":"2023-11-27T21:22:09.046925+0000","objects_scrubbed":3,"log_size":1021,"log_dups_size":0,"ondisk_log_size":1021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:11.549792+0000","scrub_duration":0.012870006999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1013,"num_write_kb":4611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'180","reported_seq":217,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:34.732400+0000","last_change":"2023-11-27T21:22:34.732400+0000","last_active":"2023-11-27T21:22:34.732400+0000","last_peered":"2023-11-27T21:22:34.732400+0000","last_clean":"2023-11-27T21:22:34.732400+0000","last_became_active":"2023-11-27T20:54:31.825080+0000","last_became_peered":"2023-11-27T20:54:31.825080+0000","last_unstale":"2023-11-27T21:22:34.732400+0000","last_undegraded":"2023-11-27T21:22:34.732400+0000","last_fullsized":"2023-11-27T21:22:34.732400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'180","last_scrub_stamp":"2023-11-27T21:22:34.732270+0000","last_deep_scrub":"28'180","last_deep_scrub_stamp":"2023-11-27T21:22:34.732270+0000","last_clean_scrub_stamp":"2023-11-27T21:22:34.732270+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:57.356294+0000","scrub_duration":0.0029486389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":9643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'78","reported_seq":101,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.769377+0000","last_change":"2023-11-27T20:55:00.593751+0000","last_active":"2023-11-27T21:22:02.769377+0000","last_peered":"2023-11-27T21:22:02.769377+0000","last_clean":"2023-11-27T21:22:02.769377+0000","last_became_active":"2023-11-27T20:55:00.593249+0000","last_became_peered":"2023-11-27T20:55:00.593249+0000","last_unstale":"2023-11-27T21:22:02.769377+0000","last_undegraded":"2023-11-27T21:22:02.769377+0000","last_fullsized":"2023-11-27T21:22:02.769377+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"28'438","reported_seq":477,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:25.368474+0000","last_change":"2023-11-27T21:22:25.368503+0000","last_active":"2023-11-27T21:22:25.368474+0000","last_peered":"2023-11-27T21:22:25.368474+0000","last_clean":"2023-11-27T21:22:25.368474+0000","last_became_active":"2023-11-27T20:54:26.225886+0000","last_became_peered":"2023-11-27T20:54:26.225886+0000","last_unstale":"2023-11-27T21:22:25.368474+0000","last_undegraded":"2023-11-27T21:22:25.368474+0000","last_fullsized":"2023-11-27T21:22:25.368474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'438","last_scrub_stamp":"2023-11-27T21:22:25.368401+0000","last_deep_scrub":"28'438","last_deep_scrub_stamp":"2023-11-27T21:22:25.368401+0000","last_clean_scrub_stamp":"2023-11-27T21:22:25.368401+0000","objects_scrubbed":2,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:38:39.549160+0000","scrub_duration":0.0081653509999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2473984,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":2660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"28'169","reported_seq":197,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:34.314845+0000","last_change":"2023-11-27T20:54:31.828729+0000","last_active":"2023-11-27T21:21:34.314845+0000","last_peered":"2023-11-27T21:21:34.314845+0000","last_clean":"2023-11-27T21:21:34.314845+0000","last_became_active":"2023-11-27T20:54:31.828368+0000","last_became_peered":"2023-11-27T20:54:31.828368+0000","last_unstale":"2023-11-27T21:21:34.314845+0000","last_undegraded":"2023-11-27T21:21:34.314845+0000","last_fullsized":"2023-11-27T21:21:34.314845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":8527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"28'75","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:39.327209+0000","last_change":"2023-11-27T21:22:39.327230+0000","last_active":"2023-11-27T21:22:39.327209+0000","last_peered":"2023-11-27T21:22:39.327209+0000","last_clean":"2023-11-27T21:22:39.327209+0000","last_became_active":"2023-11-27T20:54:27.515416+0000","last_became_peered":"2023-11-27T20:54:27.515416+0000","last_unstale":"2023-11-27T21:22:39.327209+0000","last_undegraded":"2023-11-27T21:22:39.327209+0000","last_fullsized":"2023-11-27T21:22:39.327209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:39.327132+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:39.327132+0000","last_clean_scrub_stamp":"2023-11-27T21:22:39.327132+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:54:09.127655+0000","scrub_duration":0.001546927,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"28'10","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:36.534862+0000","last_change":"2023-11-27T21:22:36.534919+0000","last_active":"2023-11-27T21:22:36.534862+0000","last_peered":"2023-11-27T21:22:36.534862+0000","last_clean":"2023-11-27T21:22:36.534862+0000","last_became_active":"2023-11-27T20:54:26.224604+0000","last_became_peered":"2023-11-27T20:54:26.224604+0000","last_unstale":"2023-11-27T21:22:36.534862+0000","last_undegraded":"2023-11-27T21:22:36.534862+0000","last_fullsized":"2023-11-27T21:22:36.534862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2023-11-27T21:22:36.534769+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2023-11-27T21:22:36.534769+0000","last_clean_scrub_stamp":"2023-11-27T21:22:36.534769+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:16:44.164481+0000","scrub_duration":0.0029681949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"28'149","reported_seq":178,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:01.957531+0000","last_change":"2023-11-27T20:54:31.819648+0000","last_active":"2023-11-27T21:22:01.957531+0000","last_peered":"2023-11-27T21:22:01.957531+0000","last_clean":"2023-11-27T21:22:01.957531+0000","last_became_active":"2023-11-27T20:54:31.819294+0000","last_became_peered":"2023-11-27T20:54:31.819294+0000","last_unstale":"2023-11-27T21:22:01.957531+0000","last_undegraded":"2023-11-27T21:22:01.957531+0000","last_fullsized":"2023-11-27T21:22:01.957531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"28'77","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:19.747454+0000","last_change":"2023-11-27T21:22:19.747472+0000","last_active":"2023-11-27T21:22:19.747454+0000","last_peered":"2023-11-27T21:22:19.747454+0000","last_clean":"2023-11-27T21:22:19.747454+0000","last_became_active":"2023-11-27T20:54:27.512663+0000","last_became_peered":"2023-11-27T20:54:27.512663+0000","last_unstale":"2023-11-27T21:22:19.747454+0000","last_undegraded":"2023-11-27T21:22:19.747454+0000","last_fullsized":"2023-11-27T21:22:19.747454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:19.747391+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:19.747391+0000","last_clean_scrub_stamp":"2023-11-27T21:22:19.747391+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:18.401292+0000","scrub_duration":0.0011077389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"28'240","reported_seq":279,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:07.317223+0000","last_change":"2023-11-27T21:22:07.317246+0000","last_active":"2023-11-27T21:22:07.317223+0000","last_peered":"2023-11-27T21:22:07.317223+0000","last_clean":"2023-11-27T21:22:07.317223+0000","last_became_active":"2023-11-27T20:54:26.225056+0000","last_became_peered":"2023-11-27T20:54:26.225056+0000","last_unstale":"2023-11-27T21:22:07.317223+0000","last_undegraded":"2023-11-27T21:22:07.317223+0000","last_fullsized":"2023-11-27T21:22:07.317223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'240","last_scrub_stamp":"2023-11-27T21:22:07.317149+0000","last_deep_scrub":"28'240","last_deep_scrub_stamp":"2023-11-27T21:22:07.317149+0000","last_clean_scrub_stamp":"2023-11-27T21:22:07.317149+0000","objects_scrubbed":2,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:41:09.468592+0000","scrub_duration":0.0039936490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"28'126","reported_seq":163,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:27.495544+0000","last_change":"2023-11-27T21:22:27.495544+0000","last_active":"2023-11-27T21:22:27.495544+0000","last_peered":"2023-11-27T21:22:27.495544+0000","last_clean":"2023-11-27T21:22:27.495544+0000","last_became_active":"2023-11-27T20:54:31.827175+0000","last_became_peered":"2023-11-27T20:54:31.827175+0000","last_unstale":"2023-11-27T21:22:27.495544+0000","last_undegraded":"2023-11-27T21:22:27.495544+0000","last_fullsized":"2023-11-27T21:22:27.495544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'126","last_scrub_stamp":"2023-11-27T21:22:27.495457+0000","last_deep_scrub":"28'126","last_deep_scrub_stamp":"2023-11-27T21:22:27.495457+0000","last_clean_scrub_stamp":"2023-11-27T21:22:27.495457+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:41:29.646900+0000","scrub_duration":0.0023736809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":7629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"28'69","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:09.572831+0000","last_change":"2023-11-27T21:22:09.572831+0000","last_active":"2023-11-27T21:22:09.572831+0000","last_peered":"2023-11-27T21:22:09.572831+0000","last_clean":"2023-11-27T21:22:09.572831+0000","last_became_active":"2023-11-27T20:54:27.498225+0000","last_became_peered":"2023-11-27T20:54:27.498225+0000","last_unstale":"2023-11-27T21:22:09.572831+0000","last_undegraded":"2023-11-27T21:22:09.572831+0000","last_fullsized":"2023-11-27T21:22:09.572831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'69","last_scrub_stamp":"2023-11-27T21:22:09.572724+0000","last_deep_scrub":"28'69","last_deep_scrub_stamp":"2023-11-27T21:22:09.572724+0000","last_clean_scrub_stamp":"2023-11-27T21:22:09.572724+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:13:34.348448+0000","scrub_duration":0.0016942400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'1037","reported_seq":1076,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:11.556868+0000","last_change":"2023-11-27T21:22:11.556868+0000","last_active":"2023-11-27T21:22:11.556868+0000","last_peered":"2023-11-27T21:22:11.556868+0000","last_clean":"2023-11-27T21:22:11.556868+0000","last_became_active":"2023-11-27T20:54:26.225333+0000","last_became_peered":"2023-11-27T20:54:26.225333+0000","last_unstale":"2023-11-27T21:22:11.556868+0000","last_undegraded":"2023-11-27T21:22:11.556868+0000","last_fullsized":"2023-11-27T21:22:11.556868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1037","last_scrub_stamp":"2023-11-27T21:22:11.556754+0000","last_deep_scrub":"28'1037","last_deep_scrub_stamp":"2023-11-27T21:22:11.556754+0000","last_clean_scrub_stamp":"2023-11-27T21:22:11.556754+0000","objects_scrubbed":9,"log_size":1037,"log_dups_size":0,"ondisk_log_size":1037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:14:01.901896+0000","scrub_duration":0.014520241999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3313963,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1025,"num_write_kb":3921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"28'159","reported_seq":186,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:11.926419+0000","last_change":"2023-11-27T20:54:31.836029+0000","last_active":"2023-11-27T21:21:11.926419+0000","last_peered":"2023-11-27T21:21:11.926419+0000","last_clean":"2023-11-27T21:21:11.926419+0000","last_became_active":"2023-11-27T20:54:31.835629+0000","last_became_peered":"2023-11-27T20:54:31.835629+0000","last_unstale":"2023-11-27T21:21:11.926419+0000","last_undegraded":"2023-11-27T21:21:11.926419+0000","last_fullsized":"2023-11-27T21:21:11.926419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":12674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'64","reported_seq":101,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:10.205669+0000","last_change":"2023-11-27T21:22:10.205669+0000","last_active":"2023-11-27T21:22:10.205669+0000","last_peered":"2023-11-27T21:22:10.205669+0000","last_clean":"2023-11-27T21:22:10.205669+0000","last_became_active":"2023-11-27T20:54:27.510775+0000","last_became_peered":"2023-11-27T20:54:27.510775+0000","last_unstale":"2023-11-27T21:22:10.205669+0000","last_undegraded":"2023-11-27T21:22:10.205669+0000","last_fullsized":"2023-11-27T21:22:10.205669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'64","last_scrub_stamp":"2023-11-27T21:22:10.205582+0000","last_deep_scrub":"28'64","last_deep_scrub_stamp":"2023-11-27T21:22:10.205582+0000","last_clean_scrub_stamp":"2023-11-27T21:22:10.205582+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:12:43.950689+0000","scrub_duration":0.001792397,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"28'1191","reported_seq":1230,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:15.427644+0000","last_change":"2023-11-27T21:22:15.427644+0000","last_active":"2023-11-27T21:22:15.427644+0000","last_peered":"2023-11-27T21:22:15.427644+0000","last_clean":"2023-11-27T21:22:15.427644+0000","last_became_active":"2023-11-27T20:54:26.226745+0000","last_became_peered":"2023-11-27T20:54:26.226745+0000","last_unstale":"2023-11-27T21:22:15.427644+0000","last_undegraded":"2023-11-27T21:22:15.427644+0000","last_fullsized":"2023-11-27T21:22:15.427644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1191","last_scrub_stamp":"2023-11-27T21:22:15.427568+0000","last_deep_scrub":"28'1191","last_deep_scrub_stamp":"2023-11-27T21:22:15.427568+0000","last_clean_scrub_stamp":"2023-11-27T21:22:15.427568+0000","objects_scrubbed":3,"log_size":1191,"log_dups_size":0,"ondisk_log_size":1191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:47:37.149646+0000","scrub_duration":0.012877517,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":4695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"28'169","reported_seq":196,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:13.920766+0000","last_change":"2023-11-27T20:54:31.831969+0000","last_active":"2023-11-27T21:21:13.920766+0000","last_peered":"2023-11-27T21:21:13.920766+0000","last_clean":"2023-11-27T21:21:13.920766+0000","last_became_active":"2023-11-27T20:54:31.831620+0000","last_became_peered":"2023-11-27T20:54:31.831620+0000","last_unstale":"2023-11-27T21:21:13.920766+0000","last_undegraded":"2023-11-27T21:21:13.920766+0000","last_fullsized":"2023-11-27T21:21:13.920766+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":13064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'85","reported_seq":123,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:05.528522+0000","last_change":"2023-11-27T21:22:05.528522+0000","last_active":"2023-11-27T21:22:05.528522+0000","last_peered":"2023-11-27T21:22:05.528522+0000","last_clean":"2023-11-27T21:22:05.528522+0000","last_became_active":"2023-11-27T20:54:27.515524+0000","last_became_peered":"2023-11-27T20:54:27.515524+0000","last_unstale":"2023-11-27T21:22:05.528522+0000","last_undegraded":"2023-11-27T21:22:05.528522+0000","last_fullsized":"2023-11-27T21:22:05.528522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'85","last_scrub_stamp":"2023-11-27T21:22:05.528395+0000","last_deep_scrub":"28'85","last_deep_scrub_stamp":"2023-11-27T21:22:05.528395+0000","last_clean_scrub_stamp":"2023-11-27T21:22:05.528395+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:01:39.543628+0000","scrub_duration":0.0014329239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'245","reported_seq":284,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:49.515716+0000","last_change":"2023-11-27T21:22:49.515740+0000","last_active":"2023-11-27T21:22:49.515716+0000","last_peered":"2023-11-27T21:22:49.515716+0000","last_clean":"2023-11-27T21:22:49.515716+0000","last_became_active":"2023-11-27T20:54:26.225691+0000","last_became_peered":"2023-11-27T20:54:26.225691+0000","last_unstale":"2023-11-27T21:22:49.515716+0000","last_undegraded":"2023-11-27T21:22:49.515716+0000","last_fullsized":"2023-11-27T21:22:49.515716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'245","last_scrub_stamp":"2023-11-27T21:22:49.515658+0000","last_deep_scrub":"28'245","last_deep_scrub_stamp":"2023-11-27T21:22:49.515658+0000","last_clean_scrub_stamp":"2023-11-27T21:22:49.515658+0000","objects_scrubbed":3,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:36:26.863877+0000","scrub_duration":0.003801076,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":236,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"28'150","reported_seq":186,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:31.069109+0000","last_change":"2023-11-27T21:22:31.069109+0000","last_active":"2023-11-27T21:22:31.069109+0000","last_peered":"2023-11-27T21:22:31.069109+0000","last_clean":"2023-11-27T21:22:31.069109+0000","last_became_active":"2023-11-27T20:54:31.826669+0000","last_became_peered":"2023-11-27T20:54:31.826669+0000","last_unstale":"2023-11-27T21:22:31.069109+0000","last_undegraded":"2023-11-27T21:22:31.069109+0000","last_fullsized":"2023-11-27T21:22:31.069109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'150","last_scrub_stamp":"2023-11-27T21:22:31.068996+0000","last_deep_scrub":"28'150","last_deep_scrub_stamp":"2023-11-27T21:22:31.068996+0000","last_clean_scrub_stamp":"2023-11-27T21:22:31.068996+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:53.693019+0000","scrub_duration":0.003059254,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":7432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"28'77","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:17.078803+0000","last_change":"2023-11-27T21:22:17.078803+0000","last_active":"2023-11-27T21:22:17.078803+0000","last_peered":"2023-11-27T21:22:17.078803+0000","last_clean":"2023-11-27T21:22:17.078803+0000","last_became_active":"2023-11-27T20:54:27.502677+0000","last_became_peered":"2023-11-27T20:54:27.502677+0000","last_unstale":"2023-11-27T21:22:17.078803+0000","last_undegraded":"2023-11-27T21:22:17.078803+0000","last_fullsized":"2023-11-27T21:22:17.078803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:17.078722+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:17.078722+0000","last_clean_scrub_stamp":"2023-11-27T21:22:17.078722+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:59:13.020180+0000","scrub_duration":0.00165175,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'332","reported_seq":684,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:05.423669+0000","last_change":"2023-11-27T21:22:05.423669+0000","last_active":"2023-11-27T21:22:05.423669+0000","last_peered":"2023-11-27T21:22:05.423669+0000","last_clean":"2023-11-27T21:22:05.423669+0000","last_became_active":"2023-11-27T20:54:26.227911+0000","last_became_peered":"2023-11-27T20:54:26.227911+0000","last_unstale":"2023-11-27T21:22:05.423669+0000","last_undegraded":"2023-11-27T21:22:05.423669+0000","last_fullsized":"2023-11-27T21:22:05.423669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'332","last_scrub_stamp":"2023-11-27T21:22:05.423586+0000","last_deep_scrub":"28'332","last_deep_scrub_stamp":"2023-11-27T21:22:05.423586+0000","last_clean_scrub_stamp":"2023-11-27T21:22:05.423586+0000","objects_scrubbed":7,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:36:33.071011+0000","scrub_duration":0.0045666969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53552,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":314,"num_read_kb":325,"num_write":327,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'174","reported_seq":209,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:59.437159+0000","last_change":"2023-11-27T21:22:59.437179+0000","last_active":"2023-11-27T21:22:59.437159+0000","last_peered":"2023-11-27T21:22:59.437159+0000","last_clean":"2023-11-27T21:22:59.437159+0000","last_became_active":"2023-11-27T20:54:31.827785+0000","last_became_peered":"2023-11-27T20:54:31.827785+0000","last_unstale":"2023-11-27T21:22:59.437159+0000","last_undegraded":"2023-11-27T21:22:59.437159+0000","last_fullsized":"2023-11-27T21:22:59.437159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'174","last_scrub_stamp":"2023-11-27T21:22:59.437092+0000","last_deep_scrub":"28'174","last_deep_scrub_stamp":"2023-11-27T21:22:59.437092+0000","last_clean_scrub_stamp":"2023-11-27T21:22:59.437092+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:55:18.896366+0000","scrub_duration":0.0024566380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":11290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'75","reported_seq":112,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:32.375542+0000","last_change":"2023-11-27T21:22:32.375562+0000","last_active":"2023-11-27T21:22:32.375542+0000","last_peered":"2023-11-27T21:22:32.375542+0000","last_clean":"2023-11-27T21:22:32.375542+0000","last_became_active":"2023-11-27T20:54:27.513655+0000","last_became_peered":"2023-11-27T20:54:27.513655+0000","last_unstale":"2023-11-27T21:22:32.375542+0000","last_undegraded":"2023-11-27T21:22:32.375542+0000","last_fullsized":"2023-11-27T21:22:32.375542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:32.375477+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:32.375477+0000","last_clean_scrub_stamp":"2023-11-27T21:22:32.375477+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:48:52.496653+0000","scrub_duration":0.0020109640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'1487","reported_seq":1526,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.911976+0000","last_change":"2023-11-27T21:22:02.911976+0000","last_active":"2023-11-27T21:22:02.911976+0000","last_peered":"2023-11-27T21:22:02.911976+0000","last_clean":"2023-11-27T21:22:02.911976+0000","last_became_active":"2023-11-27T20:54:26.230570+0000","last_became_peered":"2023-11-27T20:54:26.230570+0000","last_unstale":"2023-11-27T21:22:02.911976+0000","last_undegraded":"2023-11-27T21:22:02.911976+0000","last_fullsized":"2023-11-27T21:22:02.911976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1487","last_scrub_stamp":"2023-11-27T21:22:02.911868+0000","last_deep_scrub":"28'1487","last_deep_scrub_stamp":"2023-11-27T21:22:02.911868+0000","last_clean_scrub_stamp":"2023-11-27T21:22:02.911868+0000","objects_scrubbed":6,"log_size":1487,"log_dups_size":0,"ondisk_log_size":1487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:31:23.266746+0000","scrub_duration":0.017648026000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1482,"num_write_kb":4539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"28'155","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.769460+0000","last_change":"2023-11-27T20:54:31.828482+0000","last_active":"2023-11-27T21:22:02.769460+0000","last_peered":"2023-11-27T21:22:02.769460+0000","last_clean":"2023-11-27T21:22:02.769460+0000","last_became_active":"2023-11-27T20:54:31.827872+0000","last_became_peered":"2023-11-27T20:54:31.827872+0000","last_unstale":"2023-11-27T21:22:02.769460+0000","last_undegraded":"2023-11-27T21:22:02.769460+0000","last_fullsized":"2023-11-27T21:22:02.769460+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":8855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'67","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.567411+0000","last_change":"2023-11-27T21:22:21.567411+0000","last_active":"2023-11-27T21:22:21.567411+0000","last_peered":"2023-11-27T21:22:21.567411+0000","last_clean":"2023-11-27T21:22:21.567411+0000","last_became_active":"2023-11-27T20:54:27.493257+0000","last_became_peered":"2023-11-27T20:54:27.493257+0000","last_unstale":"2023-11-27T21:22:21.567411+0000","last_undegraded":"2023-11-27T21:22:21.567411+0000","last_fullsized":"2023-11-27T21:22:21.567411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'67","last_scrub_stamp":"2023-11-27T21:22:21.567332+0000","last_deep_scrub":"28'67","last_deep_scrub_stamp":"2023-11-27T21:22:21.567332+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.567332+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:36:06.913352+0000","scrub_duration":0.00118578,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'152","reported_seq":189,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:06.402443+0000","last_change":"2023-11-27T21:22:06.402467+0000","last_active":"2023-11-27T21:22:06.402443+0000","last_peered":"2023-11-27T21:22:06.402443+0000","last_clean":"2023-11-27T21:22:06.402443+0000","last_became_active":"2023-11-27T20:54:26.230963+0000","last_became_peered":"2023-11-27T20:54:26.230963+0000","last_unstale":"2023-11-27T21:22:06.402443+0000","last_undegraded":"2023-11-27T21:22:06.402443+0000","last_fullsized":"2023-11-27T21:22:06.402443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'152","last_scrub_stamp":"2023-11-27T21:22:06.402381+0000","last_deep_scrub":"28'152","last_deep_scrub_stamp":"2023-11-27T21:22:06.402381+0000","last_clean_scrub_stamp":"2023-11-27T21:22:06.402381+0000","objects_scrubbed":4,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:06:17.621457+0000","scrub_duration":0.0033124059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"28'195","reported_seq":235,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:40.656772+0000","last_change":"2023-11-27T21:22:40.656797+0000","last_active":"2023-11-27T21:22:40.656772+0000","last_peered":"2023-11-27T21:22:40.656772+0000","last_clean":"2023-11-27T21:22:40.656772+0000","last_became_active":"2023-11-27T20:54:31.825038+0000","last_became_peered":"2023-11-27T20:54:31.825038+0000","last_unstale":"2023-11-27T21:22:40.656772+0000","last_undegraded":"2023-11-27T21:22:40.656772+0000","last_fullsized":"2023-11-27T21:22:40.656772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'195","last_scrub_stamp":"2023-11-27T21:22:40.656695+0000","last_deep_scrub":"28'195","last_deep_scrub_stamp":"2023-11-27T21:22:40.656695+0000","last_clean_scrub_stamp":"2023-11-27T21:22:40.656695+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:54:10.457218+0000","scrub_duration":0.0031266419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":102,"num_write":164,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"28'89","reported_seq":126,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:06.407272+0000","last_change":"2023-11-27T21:22:06.407291+0000","last_active":"2023-11-27T21:22:06.407272+0000","last_peered":"2023-11-27T21:22:06.407272+0000","last_clean":"2023-11-27T21:22:06.407272+0000","last_became_active":"2023-11-27T20:54:27.507805+0000","last_became_peered":"2023-11-27T20:54:27.507805+0000","last_unstale":"2023-11-27T21:22:06.407272+0000","last_undegraded":"2023-11-27T21:22:06.407272+0000","last_fullsized":"2023-11-27T21:22:06.407272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'89","last_scrub_stamp":"2023-11-27T21:22:06.407212+0000","last_deep_scrub":"28'89","last_deep_scrub_stamp":"2023-11-27T21:22:06.407212+0000","last_clean_scrub_stamp":"2023-11-27T21:22:06.407212+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:16:55.047816+0000","scrub_duration":0.0014892390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'331","reported_seq":687,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:10.331795+0000","last_change":"2023-11-27T21:22:10.331834+0000","last_active":"2023-11-27T21:22:10.331795+0000","last_peered":"2023-11-27T21:22:10.331795+0000","last_clean":"2023-11-27T21:22:10.331795+0000","last_became_active":"2023-11-27T20:54:26.226679+0000","last_became_peered":"2023-11-27T20:54:26.226679+0000","last_unstale":"2023-11-27T21:22:10.331795+0000","last_undegraded":"2023-11-27T21:22:10.331795+0000","last_fullsized":"2023-11-27T21:22:10.331795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'331","last_scrub_stamp":"2023-11-27T21:22:10.331701+0000","last_deep_scrub":"28'331","last_deep_scrub_stamp":"2023-11-27T21:22:10.331701+0000","last_clean_scrub_stamp":"2023-11-27T21:22:10.331701+0000","objects_scrubbed":3,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:57:26.919946+0000","scrub_duration":0.0033883049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53032,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":318,"num_read_kb":327,"num_write":324,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"28'159","reported_seq":195,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:34.234760+0000","last_change":"2023-11-27T21:22:34.234783+0000","last_active":"2023-11-27T21:22:34.234760+0000","last_peered":"2023-11-27T21:22:34.234760+0000","last_clean":"2023-11-27T21:22:34.234760+0000","last_became_active":"2023-11-27T20:54:31.834569+0000","last_became_peered":"2023-11-27T20:54:31.834569+0000","last_unstale":"2023-11-27T21:22:34.234760+0000","last_undegraded":"2023-11-27T21:22:34.234760+0000","last_fullsized":"2023-11-27T21:22:34.234760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'159","last_scrub_stamp":"2023-11-27T21:22:34.234686+0000","last_deep_scrub":"28'159","last_deep_scrub_stamp":"2023-11-27T21:22:34.234686+0000","last_clean_scrub_stamp":"2023-11-27T21:22:34.234686+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:03:33.554205+0000","scrub_duration":0.0028385089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":7865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'79","reported_seq":116,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:11.809904+0000","last_change":"2023-11-27T21:22:11.809924+0000","last_active":"2023-11-27T21:22:11.809904+0000","last_peered":"2023-11-27T21:22:11.809904+0000","last_clean":"2023-11-27T21:22:11.809904+0000","last_became_active":"2023-11-27T20:54:27.498535+0000","last_became_peered":"2023-11-27T20:54:27.498535+0000","last_unstale":"2023-11-27T21:22:11.809904+0000","last_undegraded":"2023-11-27T21:22:11.809904+0000","last_fullsized":"2023-11-27T21:22:11.809904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'79","last_scrub_stamp":"2023-11-27T21:22:11.809828+0000","last_deep_scrub":"28'79","last_deep_scrub_stamp":"2023-11-27T21:22:11.809828+0000","last_clean_scrub_stamp":"2023-11-27T21:22:11.809828+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:02.660027+0000","scrub_duration":0.001141268,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'177","reported_seq":214,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:04.284387+0000","last_change":"2023-11-27T21:22:04.284409+0000","last_active":"2023-11-27T21:22:04.284387+0000","last_peered":"2023-11-27T21:22:04.284387+0000","last_clean":"2023-11-27T21:22:04.284387+0000","last_became_active":"2023-11-27T20:54:26.227878+0000","last_became_peered":"2023-11-27T20:54:26.227878+0000","last_unstale":"2023-11-27T21:22:04.284387+0000","last_undegraded":"2023-11-27T21:22:04.284387+0000","last_fullsized":"2023-11-27T21:22:04.284387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'177","last_scrub_stamp":"2023-11-27T21:22:04.284332+0000","last_deep_scrub":"28'177","last_deep_scrub_stamp":"2023-11-27T21:22:04.284332+0000","last_clean_scrub_stamp":"2023-11-27T21:22:04.284332+0000","objects_scrubbed":3,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:46:32.962705+0000","scrub_duration":0.0029821639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'104","reported_seq":132,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.769437+0000","last_change":"2023-11-27T20:54:31.825264+0000","last_active":"2023-11-27T21:22:02.769437+0000","last_peered":"2023-11-27T21:22:02.769437+0000","last_clean":"2023-11-27T21:22:02.769437+0000","last_became_active":"2023-11-27T20:54:31.824914+0000","last_became_peered":"2023-11-27T20:54:31.824914+0000","last_unstale":"2023-11-27T21:22:02.769437+0000","last_undegraded":"2023-11-27T21:22:02.769437+0000","last_fullsized":"2023-11-27T21:22:02.769437+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":7715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"28'152","reported_seq":182,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.769473+0000","last_change":"2023-11-27T20:54:31.828359+0000","last_active":"2023-11-27T21:22:02.769473+0000","last_peered":"2023-11-27T21:22:02.769473+0000","last_clean":"2023-11-27T21:22:02.769473+0000","last_became_active":"2023-11-27T20:54:31.827971+0000","last_became_peered":"2023-11-27T20:54:31.827971+0000","last_unstale":"2023-11-27T21:22:02.769473+0000","last_undegraded":"2023-11-27T21:22:02.769473+0000","last_fullsized":"2023-11-27T21:22:02.769473+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":9456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"28'80","reported_seq":117,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:37.569804+0000","last_change":"2023-11-27T21:22:37.569827+0000","last_active":"2023-11-27T21:22:37.569804+0000","last_peered":"2023-11-27T21:22:37.569804+0000","last_clean":"2023-11-27T21:22:37.569804+0000","last_became_active":"2023-11-27T20:54:27.434635+0000","last_became_peered":"2023-11-27T20:54:27.434635+0000","last_unstale":"2023-11-27T21:22:37.569804+0000","last_undegraded":"2023-11-27T21:22:37.569804+0000","last_fullsized":"2023-11-27T21:22:37.569804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'80","last_scrub_stamp":"2023-11-27T21:22:37.569720+0000","last_deep_scrub":"28'80","last_deep_scrub_stamp":"2023-11-27T21:22:37.569720+0000","last_clean_scrub_stamp":"2023-11-27T21:22:37.569720+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:31:12.846837+0000","scrub_duration":0.0021142689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'7","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:24.573595+0000","last_change":"2023-11-27T21:22:24.573621+0000","last_active":"2023-11-27T21:22:24.573595+0000","last_peered":"2023-11-27T21:22:24.573595+0000","last_clean":"2023-11-27T21:22:24.573595+0000","last_became_active":"2023-11-27T20:54:26.224502+0000","last_became_peered":"2023-11-27T20:54:26.224502+0000","last_unstale":"2023-11-27T21:22:24.573595+0000","last_undegraded":"2023-11-27T21:22:24.573595+0000","last_fullsized":"2023-11-27T21:22:24.573595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2023-11-27T21:22:24.573521+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2023-11-27T21:22:24.573521+0000","last_clean_scrub_stamp":"2023-11-27T21:22:24.573521+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:05:05.366117+0000","scrub_duration":0.0025318630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"28'177","reported_seq":206,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:21:37.959439+0000","last_change":"2023-11-27T20:54:31.827147+0000","last_active":"2023-11-27T21:21:37.959439+0000","last_peered":"2023-11-27T21:21:37.959439+0000","last_clean":"2023-11-27T21:21:37.959439+0000","last_became_active":"2023-11-27T20:54:31.826790+0000","last_became_peered":"2023-11-27T20:54:31.826790+0000","last_unstale":"2023-11-27T21:21:37.959439+0000","last_undegraded":"2023-11-27T21:21:37.959439+0000","last_fullsized":"2023-11-27T21:21:37.959439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":15468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'77","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:13.303814+0000","last_change":"2023-11-27T21:22:13.303840+0000","last_active":"2023-11-27T21:22:13.303814+0000","last_peered":"2023-11-27T21:22:13.303814+0000","last_clean":"2023-11-27T21:22:13.303814+0000","last_became_active":"2023-11-27T20:54:27.507698+0000","last_became_peered":"2023-11-27T20:54:27.507698+0000","last_unstale":"2023-11-27T21:22:13.303814+0000","last_undegraded":"2023-11-27T21:22:13.303814+0000","last_fullsized":"2023-11-27T21:22:13.303814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:13.303735+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:13.303735+0000","last_clean_scrub_stamp":"2023-11-27T21:22:13.303735+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:40:38.746430+0000","scrub_duration":0.001443277,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'425","reported_seq":876,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:08.025932+0000","last_change":"2023-11-27T21:22:08.025955+0000","last_active":"2023-11-27T21:22:08.025932+0000","last_peered":"2023-11-27T21:22:08.025932+0000","last_clean":"2023-11-27T21:22:08.025932+0000","last_became_active":"2023-11-27T20:54:26.229725+0000","last_became_peered":"2023-11-27T20:54:26.229725+0000","last_unstale":"2023-11-27T21:22:08.025932+0000","last_undegraded":"2023-11-27T21:22:08.025932+0000","last_fullsized":"2023-11-27T21:22:08.025932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'425","last_scrub_stamp":"2023-11-27T21:22:08.025875+0000","last_deep_scrub":"28'425","last_deep_scrub_stamp":"2023-11-27T21:22:08.025875+0000","last_clean_scrub_stamp":"2023-11-27T21:22:08.025875+0000","objects_scrubbed":3,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:31:28.380754+0000","scrub_duration":0.0038756979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":413,"num_read_kb":420,"num_write":418,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'473","reported_seq":969,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:40.726895+0000","last_change":"2023-11-27T21:22:40.726930+0000","last_active":"2023-11-27T21:22:40.726895+0000","last_peered":"2023-11-27T21:22:40.726895+0000","last_clean":"2023-11-27T21:22:40.726895+0000","last_became_active":"2023-11-27T20:54:26.221715+0000","last_became_peered":"2023-11-27T20:54:26.221715+0000","last_unstale":"2023-11-27T21:22:40.726895+0000","last_undegraded":"2023-11-27T21:22:40.726895+0000","last_fullsized":"2023-11-27T21:22:40.726895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'473","last_scrub_stamp":"2023-11-27T21:22:40.726814+0000","last_deep_scrub":"28'473","last_deep_scrub_stamp":"2023-11-27T21:22:40.726814+0000","last_clean_scrub_stamp":"2023-11-27T21:22:40.726814+0000","objects_scrubbed":4,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:47:25.931117+0000","scrub_duration":0.0047592770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70496,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":458,"num_read_kb":466,"num_write":467,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'78","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:55.598552+0000","last_change":"2023-11-27T21:22:55.598572+0000","last_active":"2023-11-27T21:22:55.598552+0000","last_peered":"2023-11-27T21:22:55.598552+0000","last_clean":"2023-11-27T21:22:55.598552+0000","last_became_active":"2023-11-27T20:54:27.516887+0000","last_became_peered":"2023-11-27T20:54:27.516887+0000","last_unstale":"2023-11-27T21:22:55.598552+0000","last_undegraded":"2023-11-27T21:22:55.598552+0000","last_fullsized":"2023-11-27T21:22:55.598552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'78","last_scrub_stamp":"2023-11-27T21:22:55.598489+0000","last_deep_scrub":"28'78","last_deep_scrub_stamp":"2023-11-27T21:22:55.598489+0000","last_clean_scrub_stamp":"2023-11-27T21:22:55.598489+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:17:44.354934+0000","scrub_duration":0.0014136470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'144","reported_seq":171,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.769469+0000","last_change":"2023-11-27T20:54:31.827740+0000","last_active":"2023-11-27T21:22:02.769469+0000","last_peered":"2023-11-27T21:22:02.769469+0000","last_clean":"2023-11-27T21:22:02.769469+0000","last_became_active":"2023-11-27T20:54:31.827395+0000","last_became_peered":"2023-11-27T20:54:31.827395+0000","last_unstale":"2023-11-27T21:22:02.769469+0000","last_undegraded":"2023-11-27T21:22:02.769469+0000","last_fullsized":"2023-11-27T21:22:02.769469+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:30.644117+0000","last_clean_scrub_stamp":"2023-11-27T20:54:30.644117+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":4976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'2872","reported_seq":2910,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:31.493285+0000","last_change":"2023-11-27T21:22:31.493337+0000","last_active":"2023-11-27T21:22:31.493285+0000","last_peered":"2023-11-27T21:22:31.493285+0000","last_clean":"2023-11-27T21:22:31.493285+0000","last_became_active":"2023-11-27T20:54:26.227713+0000","last_became_peered":"2023-11-27T20:54:26.227713+0000","last_unstale":"2023-11-27T21:22:31.493285+0000","last_undegraded":"2023-11-27T21:22:31.493285+0000","last_fullsized":"2023-11-27T21:22:31.493285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2872","last_scrub_stamp":"2023-11-27T21:22:31.493188+0000","last_deep_scrub":"28'2872","last_deep_scrub_stamp":"2023-11-27T21:22:31.493188+0000","last_clean_scrub_stamp":"2023-11-27T21:22:31.493188+0000","objects_scrubbed":4,"log_size":2872,"log_dups_size":0,"ondisk_log_size":2872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:48:51.614364+0000","scrub_duration":0.037435849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12113008,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2860,"num_write_kb":13160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"28'94","reported_seq":130,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:12.266321+0000","last_change":"2023-11-27T21:22:12.266341+0000","last_active":"2023-11-27T21:22:12.266321+0000","last_peered":"2023-11-27T21:22:12.266321+0000","last_clean":"2023-11-27T21:22:12.266321+0000","last_became_active":"2023-11-27T20:54:27.506119+0000","last_became_peered":"2023-11-27T20:54:27.506119+0000","last_unstale":"2023-11-27T21:22:12.266321+0000","last_undegraded":"2023-11-27T21:22:12.266321+0000","last_fullsized":"2023-11-27T21:22:12.266321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'94","last_scrub_stamp":"2023-11-27T21:22:12.266264+0000","last_deep_scrub":"28'94","last_deep_scrub_stamp":"2023-11-27T21:22:12.266264+0000","last_clean_scrub_stamp":"2023-11-27T21:22:12.266264+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:50:27.905791+0000","scrub_duration":0.001360986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"28'135","reported_seq":170,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:33.278803+0000","last_change":"2023-11-27T21:22:33.278826+0000","last_active":"2023-11-27T21:22:33.278803+0000","last_peered":"2023-11-27T21:22:33.278803+0000","last_clean":"2023-11-27T21:22:33.278803+0000","last_became_active":"2023-11-27T20:54:31.832813+0000","last_became_peered":"2023-11-27T20:54:31.832813+0000","last_unstale":"2023-11-27T21:22:33.278803+0000","last_undegraded":"2023-11-27T21:22:33.278803+0000","last_fullsized":"2023-11-27T21:22:33.278803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'135","last_scrub_stamp":"2023-11-27T21:22:33.278716+0000","last_deep_scrub":"28'135","last_deep_scrub_stamp":"2023-11-27T21:22:33.278716+0000","last_clean_scrub_stamp":"2023-11-27T21:22:33.278716+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:03:14.787780+0000","scrub_duration":0.0030595430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'74","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:03.899170+0000","last_change":"2023-11-27T21:22:03.899204+0000","last_active":"2023-11-27T21:22:03.899170+0000","last_peered":"2023-11-27T21:22:03.899170+0000","last_clean":"2023-11-27T21:22:03.899170+0000","last_became_active":"2023-11-27T20:54:27.500394+0000","last_became_peered":"2023-11-27T20:54:27.500394+0000","last_unstale":"2023-11-27T21:22:03.899170+0000","last_undegraded":"2023-11-27T21:22:03.899170+0000","last_fullsized":"2023-11-27T21:22:03.899170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'74","last_scrub_stamp":"2023-11-27T21:22:03.899101+0000","last_deep_scrub":"28'74","last_deep_scrub_stamp":"2023-11-27T21:22:03.899101+0000","last_clean_scrub_stamp":"2023-11-27T21:22:03.899101+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:06.401969+0000","scrub_duration":0.0013881010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"28'91","reported_seq":129,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:19.289312+0000","last_change":"2023-11-27T21:22:19.289337+0000","last_active":"2023-11-27T21:22:19.289312+0000","last_peered":"2023-11-27T21:22:19.289312+0000","last_clean":"2023-11-27T21:22:19.289312+0000","last_became_active":"2023-11-27T20:54:27.515173+0000","last_became_peered":"2023-11-27T20:54:27.515173+0000","last_unstale":"2023-11-27T21:22:19.289312+0000","last_undegraded":"2023-11-27T21:22:19.289312+0000","last_fullsized":"2023-11-27T21:22:19.289312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'91","last_scrub_stamp":"2023-11-27T21:22:19.289226+0000","last_deep_scrub":"28'91","last_deep_scrub_stamp":"2023-11-27T21:22:19.289226+0000","last_clean_scrub_stamp":"2023-11-27T21:22:19.289226+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:57:16.036118+0000","scrub_duration":0.0015204750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"28'79","reported_seq":118,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:53.534571+0000","last_change":"2023-11-27T21:22:53.534589+0000","last_active":"2023-11-27T21:22:53.534571+0000","last_peered":"2023-11-27T21:22:53.534571+0000","last_clean":"2023-11-27T21:22:53.534571+0000","last_became_active":"2023-11-27T20:54:27.506112+0000","last_became_peered":"2023-11-27T20:54:27.506112+0000","last_unstale":"2023-11-27T21:22:53.534571+0000","last_undegraded":"2023-11-27T21:22:53.534571+0000","last_fullsized":"2023-11-27T21:22:53.534571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'79","last_scrub_stamp":"2023-11-27T21:22:53.534507+0000","last_deep_scrub":"28'79","last_deep_scrub_stamp":"2023-11-27T21:22:53.534507+0000","last_clean_scrub_stamp":"2023-11-27T21:22:53.534507+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:16:12.287715+0000","scrub_duration":0.00155865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'73","reported_seq":112,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:15.272647+0000","last_change":"2023-11-27T21:22:15.272669+0000","last_active":"2023-11-27T21:22:15.272647+0000","last_peered":"2023-11-27T21:22:15.272647+0000","last_clean":"2023-11-27T21:22:15.272647+0000","last_became_active":"2023-11-27T20:54:27.510532+0000","last_became_peered":"2023-11-27T20:54:27.510532+0000","last_unstale":"2023-11-27T21:22:15.272647+0000","last_undegraded":"2023-11-27T21:22:15.272647+0000","last_fullsized":"2023-11-27T21:22:15.272647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'73","last_scrub_stamp":"2023-11-27T21:22:15.272584+0000","last_deep_scrub":"28'73","last_deep_scrub_stamp":"2023-11-27T21:22:15.272584+0000","last_clean_scrub_stamp":"2023-11-27T21:22:15.272584+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:23:33.117651+0000","scrub_duration":0.0013038769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"28'58","reported_seq":97,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:24.138340+0000","last_change":"2023-11-27T21:22:24.138340+0000","last_active":"2023-11-27T21:22:24.138340+0000","last_peered":"2023-11-27T21:22:24.138340+0000","last_clean":"2023-11-27T21:22:24.138340+0000","last_became_active":"2023-11-27T20:54:27.513517+0000","last_became_peered":"2023-11-27T20:54:27.513517+0000","last_unstale":"2023-11-27T21:22:24.138340+0000","last_undegraded":"2023-11-27T21:22:24.138340+0000","last_fullsized":"2023-11-27T21:22:24.138340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'58","last_scrub_stamp":"2023-11-27T21:22:24.138248+0000","last_deep_scrub":"28'58","last_deep_scrub_stamp":"2023-11-27T21:22:24.138248+0000","last_clean_scrub_stamp":"2023-11-27T21:22:24.138248+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:38.431656+0000","scrub_duration":0.001948988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'78","reported_seq":117,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:25.136381+0000","last_change":"2023-11-27T21:22:25.136381+0000","last_active":"2023-11-27T21:22:25.136381+0000","last_peered":"2023-11-27T21:22:25.136381+0000","last_clean":"2023-11-27T21:22:25.136381+0000","last_became_active":"2023-11-27T20:54:27.511559+0000","last_became_peered":"2023-11-27T20:54:27.511559+0000","last_unstale":"2023-11-27T21:22:25.136381+0000","last_undegraded":"2023-11-27T21:22:25.136381+0000","last_fullsized":"2023-11-27T21:22:25.136381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'78","last_scrub_stamp":"2023-11-27T21:22:25.136275+0000","last_deep_scrub":"28'78","last_deep_scrub_stamp":"2023-11-27T21:22:25.136275+0000","last_clean_scrub_stamp":"2023-11-27T21:22:25.136275+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:39:09.105072+0000","scrub_duration":0.0013808659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"28'75","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:07.894649+0000","last_change":"2023-11-27T21:22:07.894649+0000","last_active":"2023-11-27T21:22:07.894649+0000","last_peered":"2023-11-27T21:22:07.894649+0000","last_clean":"2023-11-27T21:22:07.894649+0000","last_became_active":"2023-11-27T20:54:27.499323+0000","last_became_peered":"2023-11-27T20:54:27.499323+0000","last_unstale":"2023-11-27T21:22:07.894649+0000","last_undegraded":"2023-11-27T21:22:07.894649+0000","last_fullsized":"2023-11-27T21:22:07.894649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:07.894529+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:07.894529+0000","last_clean_scrub_stamp":"2023-11-27T21:22:07.894529+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:40:33.337225+0000","scrub_duration":0.001236841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"28'64","reported_seq":103,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:58.299289+0000","last_change":"2023-11-27T21:22:58.299309+0000","last_active":"2023-11-27T21:22:58.299289+0000","last_peered":"2023-11-27T21:22:58.299289+0000","last_clean":"2023-11-27T21:22:58.299289+0000","last_became_active":"2023-11-27T20:54:27.508615+0000","last_became_peered":"2023-11-27T20:54:27.508615+0000","last_unstale":"2023-11-27T21:22:58.299289+0000","last_undegraded":"2023-11-27T21:22:58.299289+0000","last_fullsized":"2023-11-27T21:22:58.299289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'64","last_scrub_stamp":"2023-11-27T21:22:58.299224+0000","last_deep_scrub":"28'64","last_deep_scrub_stamp":"2023-11-27T21:22:58.299224+0000","last_clean_scrub_stamp":"2023-11-27T21:22:58.299224+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:58:28.149758+0000","scrub_duration":0.0015916179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'78","reported_seq":117,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:11.622552+0000","last_change":"2023-11-27T21:22:11.622552+0000","last_active":"2023-11-27T21:22:11.622552+0000","last_peered":"2023-11-27T21:22:11.622552+0000","last_clean":"2023-11-27T21:22:11.622552+0000","last_became_active":"2023-11-27T20:54:27.510647+0000","last_became_peered":"2023-11-27T20:54:27.510647+0000","last_unstale":"2023-11-27T21:22:11.622552+0000","last_undegraded":"2023-11-27T21:22:11.622552+0000","last_fullsized":"2023-11-27T21:22:11.622552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'78","last_scrub_stamp":"2023-11-27T21:22:11.622453+0000","last_deep_scrub":"28'78","last_deep_scrub_stamp":"2023-11-27T21:22:11.622453+0000","last_clean_scrub_stamp":"2023-11-27T21:22:11.622453+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:16:19.252165+0000","scrub_duration":0.0016600790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"28'92","reported_seq":130,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:42.284848+0000","last_change":"2023-11-27T21:22:42.284869+0000","last_active":"2023-11-27T21:22:42.284848+0000","last_peered":"2023-11-27T21:22:42.284848+0000","last_clean":"2023-11-27T21:22:42.284848+0000","last_became_active":"2023-11-27T20:54:27.508360+0000","last_became_peered":"2023-11-27T20:54:27.508360+0000","last_unstale":"2023-11-27T21:22:42.284848+0000","last_undegraded":"2023-11-27T21:22:42.284848+0000","last_fullsized":"2023-11-27T21:22:42.284848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'92","last_scrub_stamp":"2023-11-27T21:22:42.284775+0000","last_deep_scrub":"28'92","last_deep_scrub_stamp":"2023-11-27T21:22:42.284775+0000","last_clean_scrub_stamp":"2023-11-27T21:22:42.284775+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:06:16.552768+0000","scrub_duration":0.0016812800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"28'87","reported_seq":124,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.447734+0000","last_change":"2023-11-27T21:22:21.447755+0000","last_active":"2023-11-27T21:22:21.447734+0000","last_peered":"2023-11-27T21:22:21.447734+0000","last_clean":"2023-11-27T21:22:21.447734+0000","last_became_active":"2023-11-27T20:54:27.513105+0000","last_became_peered":"2023-11-27T20:54:27.513105+0000","last_unstale":"2023-11-27T21:22:21.447734+0000","last_undegraded":"2023-11-27T21:22:21.447734+0000","last_fullsized":"2023-11-27T21:22:21.447734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'87","last_scrub_stamp":"2023-11-27T21:22:21.447667+0000","last_deep_scrub":"28'87","last_deep_scrub_stamp":"2023-11-27T21:22:21.447667+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.447667+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:48.413351+0000","scrub_duration":0.001278429,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"28'77","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:44.548617+0000","last_change":"2023-11-27T21:22:44.548636+0000","last_active":"2023-11-27T21:22:44.548617+0000","last_peered":"2023-11-27T21:22:44.548617+0000","last_clean":"2023-11-27T21:22:44.548617+0000","last_became_active":"2023-11-27T20:54:27.433179+0000","last_became_peered":"2023-11-27T20:54:27.433179+0000","last_unstale":"2023-11-27T21:22:44.548617+0000","last_undegraded":"2023-11-27T21:22:44.548617+0000","last_fullsized":"2023-11-27T21:22:44.548617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:44.548559+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:44.548559+0000","last_clean_scrub_stamp":"2023-11-27T21:22:44.548559+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:27:07.329368+0000","scrub_duration":0.0014271970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'75","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:27.380380+0000","last_change":"2023-11-27T21:22:27.380399+0000","last_active":"2023-11-27T21:22:27.380380+0000","last_peered":"2023-11-27T21:22:27.380380+0000","last_clean":"2023-11-27T21:22:27.380380+0000","last_became_active":"2023-11-27T20:54:27.515068+0000","last_became_peered":"2023-11-27T20:54:27.515068+0000","last_unstale":"2023-11-27T21:22:27.380380+0000","last_undegraded":"2023-11-27T21:22:27.380380+0000","last_fullsized":"2023-11-27T21:22:27.380380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:27.380315+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:27.380315+0000","last_clean_scrub_stamp":"2023-11-27T21:22:27.380315+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:39:11.349112+0000","scrub_duration":0.0012371560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"28'86","reported_seq":124,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:15.519346+0000","last_change":"2023-11-27T21:22:15.519379+0000","last_active":"2023-11-27T21:22:15.519346+0000","last_peered":"2023-11-27T21:22:15.519346+0000","last_clean":"2023-11-27T21:22:15.519346+0000","last_became_active":"2023-11-27T20:54:27.498306+0000","last_became_peered":"2023-11-27T20:54:27.498306+0000","last_unstale":"2023-11-27T21:22:15.519346+0000","last_undegraded":"2023-11-27T21:22:15.519346+0000","last_fullsized":"2023-11-27T21:22:15.519346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'86","last_scrub_stamp":"2023-11-27T21:22:15.519229+0000","last_deep_scrub":"28'86","last_deep_scrub_stamp":"2023-11-27T21:22:15.519229+0000","last_clean_scrub_stamp":"2023-11-27T21:22:15.519229+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:50.796346+0000","scrub_duration":0.0016617979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'91","reported_seq":128,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:26.319123+0000","last_change":"2023-11-27T21:22:26.319123+0000","last_active":"2023-11-27T21:22:26.319123+0000","last_peered":"2023-11-27T21:22:26.319123+0000","last_clean":"2023-11-27T21:22:26.319123+0000","last_became_active":"2023-11-27T20:54:27.512897+0000","last_became_peered":"2023-11-27T20:54:27.512897+0000","last_unstale":"2023-11-27T21:22:26.319123+0000","last_undegraded":"2023-11-27T21:22:26.319123+0000","last_fullsized":"2023-11-27T21:22:26.319123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'91","last_scrub_stamp":"2023-11-27T21:22:26.319005+0000","last_deep_scrub":"28'91","last_deep_scrub_stamp":"2023-11-27T21:22:26.319005+0000","last_clean_scrub_stamp":"2023-11-27T21:22:26.319005+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:15.398244+0000","scrub_duration":0.0013480289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"28'67","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:16.542687+0000","last_change":"2023-11-27T21:22:16.542687+0000","last_active":"2023-11-27T21:22:16.542687+0000","last_peered":"2023-11-27T21:22:16.542687+0000","last_clean":"2023-11-27T21:22:16.542687+0000","last_became_active":"2023-11-27T20:54:27.514946+0000","last_became_peered":"2023-11-27T20:54:27.514946+0000","last_unstale":"2023-11-27T21:22:16.542687+0000","last_undegraded":"2023-11-27T21:22:16.542687+0000","last_fullsized":"2023-11-27T21:22:16.542687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'67","last_scrub_stamp":"2023-11-27T21:22:16.542611+0000","last_deep_scrub":"28'67","last_deep_scrub_stamp":"2023-11-27T21:22:16.542611+0000","last_clean_scrub_stamp":"2023-11-27T21:22:16.542611+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:43:30.443626+0000","scrub_duration":0.0014583510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"28'80","reported_seq":118,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:22.523993+0000","last_change":"2023-11-27T21:22:22.523993+0000","last_active":"2023-11-27T21:22:22.523993+0000","last_peered":"2023-11-27T21:22:22.523993+0000","last_clean":"2023-11-27T21:22:22.523993+0000","last_became_active":"2023-11-27T20:54:27.493297+0000","last_became_peered":"2023-11-27T20:54:27.493297+0000","last_unstale":"2023-11-27T21:22:22.523993+0000","last_undegraded":"2023-11-27T21:22:22.523993+0000","last_fullsized":"2023-11-27T21:22:22.523993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'80","last_scrub_stamp":"2023-11-27T21:22:22.523857+0000","last_deep_scrub":"28'80","last_deep_scrub_stamp":"2023-11-27T21:22:22.523857+0000","last_clean_scrub_stamp":"2023-11-27T21:22:22.523857+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:17:11.280303+0000","scrub_duration":0.001213053,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"28'75","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:44.285666+0000","last_change":"2023-11-27T21:22:44.285689+0000","last_active":"2023-11-27T21:22:44.285666+0000","last_peered":"2023-11-27T21:22:44.285666+0000","last_clean":"2023-11-27T21:22:44.285666+0000","last_became_active":"2023-11-27T20:54:27.512662+0000","last_became_peered":"2023-11-27T20:54:27.512662+0000","last_unstale":"2023-11-27T21:22:44.285666+0000","last_undegraded":"2023-11-27T21:22:44.285666+0000","last_fullsized":"2023-11-27T21:22:44.285666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:44.285586+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:44.285586+0000","last_clean_scrub_stamp":"2023-11-27T21:22:44.285586+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:13:02.644103+0000","scrub_duration":0.0017812570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'70","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:14.123478+0000","last_change":"2023-11-27T21:22:14.123478+0000","last_active":"2023-11-27T21:22:14.123478+0000","last_peered":"2023-11-27T21:22:14.123478+0000","last_clean":"2023-11-27T21:22:14.123478+0000","last_became_active":"2023-11-27T20:54:27.512124+0000","last_became_peered":"2023-11-27T20:54:27.512124+0000","last_unstale":"2023-11-27T21:22:14.123478+0000","last_undegraded":"2023-11-27T21:22:14.123478+0000","last_fullsized":"2023-11-27T21:22:14.123478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'70","last_scrub_stamp":"2023-11-27T21:22:14.123330+0000","last_deep_scrub":"28'70","last_deep_scrub_stamp":"2023-11-27T21:22:14.123330+0000","last_clean_scrub_stamp":"2023-11-27T21:22:14.123330+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:17:02.763935+0000","scrub_duration":0.0016588200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"28'82","reported_seq":119,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:22.174123+0000","last_change":"2023-11-27T21:22:22.174144+0000","last_active":"2023-11-27T21:22:22.174123+0000","last_peered":"2023-11-27T21:22:22.174123+0000","last_clean":"2023-11-27T21:22:22.174123+0000","last_became_active":"2023-11-27T20:54:27.516907+0000","last_became_peered":"2023-11-27T20:54:27.516907+0000","last_unstale":"2023-11-27T21:22:22.174123+0000","last_undegraded":"2023-11-27T21:22:22.174123+0000","last_fullsized":"2023-11-27T21:22:22.174123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'82","last_scrub_stamp":"2023-11-27T21:22:22.174050+0000","last_deep_scrub":"28'82","last_deep_scrub_stamp":"2023-11-27T21:22:22.174050+0000","last_clean_scrub_stamp":"2023-11-27T21:22:22.174050+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:58:51.653006+0000","scrub_duration":0.0015457279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'68","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:29.387344+0000","last_change":"2023-11-27T21:22:29.387384+0000","last_active":"2023-11-27T21:22:29.387344+0000","last_peered":"2023-11-27T21:22:29.387344+0000","last_clean":"2023-11-27T21:22:29.387344+0000","last_became_active":"2023-11-27T20:54:27.515182+0000","last_became_peered":"2023-11-27T20:54:27.515182+0000","last_unstale":"2023-11-27T21:22:29.387344+0000","last_undegraded":"2023-11-27T21:22:29.387344+0000","last_fullsized":"2023-11-27T21:22:29.387344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'68","last_scrub_stamp":"2023-11-27T21:22:29.387232+0000","last_deep_scrub":"28'68","last_deep_scrub_stamp":"2023-11-27T21:22:29.387232+0000","last_clean_scrub_stamp":"2023-11-27T21:22:29.387232+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:57:23.297311+0000","scrub_duration":0.001412979,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'79","reported_seq":109,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:39.384082+0000","last_change":"2023-11-27T21:22:39.384105+0000","last_active":"2023-11-27T21:22:39.384082+0000","last_peered":"2023-11-27T21:22:39.384082+0000","last_clean":"2023-11-27T21:22:39.384082+0000","last_became_active":"2023-11-27T20:55:00.588298+0000","last_became_peered":"2023-11-27T20:55:00.588298+0000","last_unstale":"2023-11-27T21:22:39.384082+0000","last_undegraded":"2023-11-27T21:22:39.384082+0000","last_fullsized":"2023-11-27T21:22:39.384082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'79","last_scrub_stamp":"2023-11-27T21:22:39.384006+0000","last_deep_scrub":"28'79","last_deep_scrub_stamp":"2023-11-27T21:22:39.384006+0000","last_clean_scrub_stamp":"2023-11-27T21:22:39.384006+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:16:47.013718+0000","scrub_duration":0.001936828,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'77","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:26.381531+0000","last_change":"2023-11-27T21:22:26.381549+0000","last_active":"2023-11-27T21:22:26.381531+0000","last_peered":"2023-11-27T21:22:26.381531+0000","last_clean":"2023-11-27T21:22:26.381531+0000","last_became_active":"2023-11-27T20:54:27.512692+0000","last_became_peered":"2023-11-27T20:54:27.512692+0000","last_unstale":"2023-11-27T21:22:26.381531+0000","last_undegraded":"2023-11-27T21:22:26.381531+0000","last_fullsized":"2023-11-27T21:22:26.381531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:26.381465+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:26.381465+0000","last_clean_scrub_stamp":"2023-11-27T21:22:26.381465+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:38:40.562224+0000","scrub_duration":0.0012122050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"28'75","reported_seq":111,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:23.471759+0000","last_change":"2023-11-27T21:22:23.471793+0000","last_active":"2023-11-27T21:22:23.471759+0000","last_peered":"2023-11-27T21:22:23.471759+0000","last_clean":"2023-11-27T21:22:23.471759+0000","last_became_active":"2023-11-27T20:54:27.498790+0000","last_became_peered":"2023-11-27T20:54:27.498790+0000","last_unstale":"2023-11-27T21:22:23.471759+0000","last_undegraded":"2023-11-27T21:22:23.471759+0000","last_fullsized":"2023-11-27T21:22:23.471759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:23.471665+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:23.471665+0000","last_clean_scrub_stamp":"2023-11-27T21:22:23.471665+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:09:25.413821+0000","scrub_duration":0.0018897339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"28'85","reported_seq":122,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:04.318846+0000","last_change":"2023-11-27T21:23:04.318866+0000","last_active":"2023-11-27T21:23:04.318846+0000","last_peered":"2023-11-27T21:23:04.318846+0000","last_clean":"2023-11-27T21:23:04.318846+0000","last_became_active":"2023-11-27T20:54:27.512777+0000","last_became_peered":"2023-11-27T20:54:27.512777+0000","last_unstale":"2023-11-27T21:23:04.318846+0000","last_undegraded":"2023-11-27T21:23:04.318846+0000","last_fullsized":"2023-11-27T21:23:04.318846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'85","last_scrub_stamp":"2023-11-27T21:23:04.318773+0000","last_deep_scrub":"28'85","last_deep_scrub_stamp":"2023-11-27T21:23:04.318773+0000","last_clean_scrub_stamp":"2023-11-27T21:23:04.318773+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:50:12.048143+0000","scrub_duration":0.0014528500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'65","reported_seq":102,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:33.381938+0000","last_change":"2023-11-27T21:22:33.381969+0000","last_active":"2023-11-27T21:22:33.381938+0000","last_peered":"2023-11-27T21:22:33.381938+0000","last_clean":"2023-11-27T21:22:33.381938+0000","last_became_active":"2023-11-27T20:54:27.512433+0000","last_became_peered":"2023-11-27T20:54:27.512433+0000","last_unstale":"2023-11-27T21:22:33.381938+0000","last_undegraded":"2023-11-27T21:22:33.381938+0000","last_fullsized":"2023-11-27T21:22:33.381938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'65","last_scrub_stamp":"2023-11-27T21:22:33.381875+0000","last_deep_scrub":"28'65","last_deep_scrub_stamp":"2023-11-27T21:22:33.381875+0000","last_clean_scrub_stamp":"2023-11-27T21:22:33.381875+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:56.005899+0000","scrub_duration":0.0018361009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'62","reported_seq":99,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:05.879384+0000","last_change":"2023-11-27T21:22:05.879404+0000","last_active":"2023-11-27T21:22:05.879384+0000","last_peered":"2023-11-27T21:22:05.879384+0000","last_clean":"2023-11-27T21:22:05.879384+0000","last_became_active":"2023-11-27T20:54:27.432152+0000","last_became_peered":"2023-11-27T20:54:27.432152+0000","last_unstale":"2023-11-27T21:22:05.879384+0000","last_undegraded":"2023-11-27T21:22:05.879384+0000","last_fullsized":"2023-11-27T21:22:05.879384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'62","last_scrub_stamp":"2023-11-27T21:22:05.879322+0000","last_deep_scrub":"28'62","last_deep_scrub_stamp":"2023-11-27T21:22:05.879322+0000","last_clean_scrub_stamp":"2023-11-27T21:22:05.879322+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:16:54.519926+0000","scrub_duration":0.001294089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'69","reported_seq":106,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:45.385813+0000","last_change":"2023-11-27T21:22:45.385832+0000","last_active":"2023-11-27T21:22:45.385813+0000","last_peered":"2023-11-27T21:22:45.385813+0000","last_clean":"2023-11-27T21:22:45.385813+0000","last_became_active":"2023-11-27T20:54:27.515801+0000","last_became_peered":"2023-11-27T20:54:27.515801+0000","last_unstale":"2023-11-27T21:22:45.385813+0000","last_undegraded":"2023-11-27T21:22:45.385813+0000","last_fullsized":"2023-11-27T21:22:45.385813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'69","last_scrub_stamp":"2023-11-27T21:22:45.385744+0000","last_deep_scrub":"28'69","last_deep_scrub_stamp":"2023-11-27T21:22:45.385744+0000","last_clean_scrub_stamp":"2023-11-27T21:22:45.385744+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:05:19.004327+0000","scrub_duration":0.001632571,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'75","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:04.865788+0000","last_change":"2023-11-27T21:22:04.865788+0000","last_active":"2023-11-27T21:22:04.865788+0000","last_peered":"2023-11-27T21:22:04.865788+0000","last_clean":"2023-11-27T21:22:04.865788+0000","last_became_active":"2023-11-27T20:54:27.432160+0000","last_became_peered":"2023-11-27T20:54:27.432160+0000","last_unstale":"2023-11-27T21:22:04.865788+0000","last_undegraded":"2023-11-27T21:22:04.865788+0000","last_fullsized":"2023-11-27T21:22:04.865788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:04.865659+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:04.865659+0000","last_clean_scrub_stamp":"2023-11-27T21:22:04.865659+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:24:12.042139+0000","scrub_duration":0.001425869,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'77","reported_seq":116,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:47.341314+0000","last_change":"2023-11-27T21:22:47.341333+0000","last_active":"2023-11-27T21:22:47.341314+0000","last_peered":"2023-11-27T21:22:47.341314+0000","last_clean":"2023-11-27T21:22:47.341314+0000","last_became_active":"2023-11-27T20:54:27.505122+0000","last_became_peered":"2023-11-27T20:54:27.505122+0000","last_unstale":"2023-11-27T21:22:47.341314+0000","last_undegraded":"2023-11-27T21:22:47.341314+0000","last_fullsized":"2023-11-27T21:22:47.341314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:47.341245+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:47.341245+0000","last_clean_scrub_stamp":"2023-11-27T21:22:47.341245+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:10:10.862371+0000","scrub_duration":0.0011517109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"28'74","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.374209+0000","last_change":"2023-11-27T21:22:21.374228+0000","last_active":"2023-11-27T21:22:21.374209+0000","last_peered":"2023-11-27T21:22:21.374209+0000","last_clean":"2023-11-27T21:22:21.374209+0000","last_became_active":"2023-11-27T20:54:27.505236+0000","last_became_peered":"2023-11-27T20:54:27.505236+0000","last_unstale":"2023-11-27T21:22:21.374209+0000","last_undegraded":"2023-11-27T21:22:21.374209+0000","last_fullsized":"2023-11-27T21:22:21.374209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'74","last_scrub_stamp":"2023-11-27T21:22:21.374139+0000","last_deep_scrub":"28'74","last_deep_scrub_stamp":"2023-11-27T21:22:21.374139+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.374139+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:20.028040+0000","scrub_duration":0.0012971980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"28'79","reported_seq":118,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:42.386685+0000","last_change":"2023-11-27T21:22:42.386720+0000","last_active":"2023-11-27T21:22:42.386685+0000","last_peered":"2023-11-27T21:22:42.386685+0000","last_clean":"2023-11-27T21:22:42.386685+0000","last_became_active":"2023-11-27T20:54:27.514846+0000","last_became_peered":"2023-11-27T20:54:27.514846+0000","last_unstale":"2023-11-27T21:22:42.386685+0000","last_undegraded":"2023-11-27T21:22:42.386685+0000","last_fullsized":"2023-11-27T21:22:42.386685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'79","last_scrub_stamp":"2023-11-27T21:22:42.386592+0000","last_deep_scrub":"28'79","last_deep_scrub_stamp":"2023-11-27T21:22:42.386592+0000","last_clean_scrub_stamp":"2023-11-27T21:22:42.386592+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:29:28.775340+0000","scrub_duration":0.00163594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":102,"num_write":4200,"num_write_kb":332069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5131,"ondisk_log_size":5131,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4855,"ondisk_log_size":4855,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":44272102,"num_objects":111,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":1673,"num_read_kb":1711,"num_write":16676,"num_write_kb":52124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":88793088,"data_stored":88544204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15283,"ondisk_log_size":15283,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509791,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95988,"kb_used_data":20396,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94275852,"statfs":{"total":96636764160,"available":96538472448,"internally_reserved":0,"allocated":20885504,"data_stored":20696148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:22:04 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.42299999999999999,"15min":0.41199999999999998},"min":{"1min":0.35299999999999998,"5min":0.22700000000000001,"15min":0.19900000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.95599999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.47599999999999998,"15min":0.46700000000000003},"min":{"1min":0.37,"5min":0.27500000000000002,"15min":0.24199999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":1.1819999999999999},"last":0.45700000000000002}]},{"osd":1,"last update":"Mon Nov 27 21:22:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.441,"15min":0.434},"min":{"1min":0.33400000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.78300000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.41199999999999998,"15min":0.40999999999999998},"min":{"1min":0.308,"5min":0.25600000000000001,"15min":0.247},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":1.2250000000000001},"last":0.433}]},{"osd":2,"last update":"Mon Nov 27 21:22:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42199999999999999,"15min":0.41099999999999998},"min":{"1min":0.28999999999999998,"5min":0.27700000000000002,"15min":0.23599999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":1.2549999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.44700000000000001,"15min":0.437},"min":{"1min":0.35599999999999998,"5min":0.26900000000000002,"15min":0.23899999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":1.2450000000000001},"last":0.39600000000000002}]},{"osd":3,"last update":"Mon Nov 27 21:22:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.44500000000000001,"15min":0.437},"min":{"1min":0.33600000000000002,"5min":0.307,"15min":0.26800000000000002},"max":{"1min":0.64700000000000002,"5min":0.66600000000000004,"15min":0.87},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.5,"5min":0.46899999999999997,"15min":0.44700000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.309},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":1.2090000000000001},"last":0.41999999999999998}]},{"osd":4,"last update":"Mon Nov 27 21:22:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.40600000000000003,"15min":0.39500000000000002},"min":{"1min":0.26900000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.52000000000000002,"5min":0.66600000000000004,"15min":0.80600000000000005},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.42599999999999999,"15min":0.41399999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.22900000000000001},"max":{"1min":0.57899999999999996,"5min":0.64900000000000002,"15min":0.92800000000000005},"last":0.38}]},{"osd":5,"last update":"Mon Nov 27 21:22:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42099999999999999,"15min":0.40100000000000002},"min":{"1min":0.27100000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.752,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.47199999999999998,"15min":0.45500000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.25},"max":{"1min":0.56000000000000005,"5min":0.74099999999999999,"15min":0.77600000000000002},"last":0.32700000000000001}]},{"osd":7,"last update":"Mon Nov 27 21:22:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46600000000000003,"15min":0.46100000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.249},"max":{"1min":0.55700000000000005,"5min":0.68200000000000005,"15min":0.95599999999999996},"last":0.31},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48799999999999999,"15min":0.46500000000000002},"min":{"1min":0.32000000000000001,"5min":0.28599999999999998,"15min":0.28199999999999997},"max":{"1min":0.80400000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.49399999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509791,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94852,"kb_used_data":19260,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94276988,"statfs":{"total":96636764160,"available":96539635712,"internally_reserved":0,"allocated":19722240,"data_stored":19520171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42099999999999999,"15min":0.40799999999999997},"min":{"1min":0.29099999999999998,"5min":0.25700000000000001,"15min":0.216},"max":{"1min":0.77700000000000002,"5min":1.331,"15min":1.331},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.43099999999999999,"15min":0.42099999999999999},"min":{"1min":0.33800000000000002,"5min":0.27900000000000003,"15min":0.222},"max":{"1min":0.69399999999999995,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.66500000000000004}]},{"osd":1,"last update":"Mon Nov 27 21:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.41999999999999998,"15min":0.42399999999999999},"min":{"1min":0.30599999999999999,"5min":0.224,"15min":0.221},"max":{"1min":0.56699999999999995,"5min":0.624,"15min":0.95999999999999996},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.42699999999999999,"15min":0.41799999999999998},"min":{"1min":0.315,"5min":0.29699999999999999,"15min":0.28599999999999998},"max":{"1min":0.64700000000000002,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.65500000000000003}]},{"osd":2,"last update":"Mon Nov 27 21:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42299999999999999,"15min":0.42899999999999999},"min":{"1min":0.35799999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53300000000000003,"5min":0.64200000000000002,"15min":0.94599999999999995},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.45100000000000001,"15min":0.432},"min":{"1min":0.35099999999999998,"5min":0.308,"15min":0.29899999999999999},"max":{"1min":0.73099999999999998,"5min":1.359,"15min":1.359},"last":0.59699999999999998}]},{"osd":3,"last update":"Mon Nov 27 21:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.46000000000000002,"15min":0.45100000000000001},"min":{"1min":0.34899999999999998,"5min":0.32500000000000001,"15min":0.28899999999999998},"max":{"1min":0.63,"5min":0.64500000000000002,"15min":0.93300000000000005},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48599999999999999,"15min":0.46000000000000002},"min":{"1min":0.35799999999999998,"5min":0.33100000000000002,"15min":0.30199999999999999},"max":{"1min":0.67500000000000004,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":0.63}]},{"osd":4,"last update":"Mon Nov 27 21:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.377,"15min":0.375},"min":{"1min":0.24199999999999999,"5min":0.23300000000000001,"15min":0.23100000000000001},"max":{"1min":0.58399999999999996,"5min":0.65800000000000003,"15min":0.69199999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.23200000000000001},"max":{"1min":0.61799999999999999,"5min":0.66800000000000004,"15min":0.70299999999999996},"last":0.47199999999999998}]},{"osd":6,"last update":"Mon Nov 27 21:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.29399999999999998,"5min":0.27100000000000002,"15min":0.246},"max":{"1min":0.60099999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.442},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42299999999999999,"15min":0.42699999999999999},"min":{"1min":0.27300000000000002,"5min":0.27100000000000002,"15min":0.23300000000000001},"max":{"1min":0.55000000000000004,"5min":0.69299999999999995,"15min":0.70399999999999996},"last":0.49399999999999999}]},{"osd":7,"last update":"Mon Nov 27 21:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.24199999999999999},"max":{"1min":0.61599999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.48499999999999999,"15min":0.48799999999999999},"min":{"1min":0.33000000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63500000000000001,"5min":0.71399999999999997,"15min":0.751},"last":0.52000000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509792,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53560,"kb_used_data":8496,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318280,"statfs":{"total":96636764160,"available":96581918720,"internally_reserved":0,"allocated":8699904,"data_stored":8509387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.32800000000000001,"15min":0.308},"min":{"1min":0.216,"5min":0.19800000000000001,"15min":0.17899999999999999},"max":{"1min":0.433,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.308},{"interface":"front","average":{"1min":0.314,"5min":0.32000000000000001,"15min":0.318},"min":{"1min":0.219,"5min":0.216,"15min":0.20200000000000001},"max":{"1min":0.45700000000000002,"5min":0.48299999999999998,"15min":0.61899999999999999},"last":0.29899999999999999}]},{"osd":1,"last update":"Mon Nov 27 21:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.36199999999999999,"15min":0.34699999999999998},"min":{"1min":0.26000000000000001,"5min":0.20599999999999999,"15min":0.19800000000000001},"max":{"1min":0.45600000000000002,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35599999999999998,"15min":0.35099999999999998},"min":{"1min":0.28999999999999998,"5min":0.249,"15min":0.20899999999999999},"max":{"1min":0.48899999999999999,"5min":0.54400000000000004,"15min":0.751},"last":0.36399999999999999}]},{"osd":3,"last update":"Mon Nov 27 21:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.35799999999999998,"15min":0.34699999999999998},"min":{"1min":0.26200000000000001,"5min":0.23999999999999999,"15min":0.224},"max":{"1min":0.46000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.41499999999999998,"15min":0.39200000000000002},"min":{"1min":0.30399999999999999,"5min":0.26200000000000001,"15min":0.26100000000000001},"max":{"1min":0.52700000000000002,"5min":0.62,"15min":0.63700000000000001},"last":0.378}]},{"osd":4,"last update":"Mon Nov 27 21:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51900000000000002,"15min":0.49099999999999999},"min":{"1min":0.35199999999999998,"5min":0.313,"15min":0.29499999999999998},"max":{"1min":0.755,"5min":1.044,"15min":1.044},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.497,"15min":0.48599999999999999},"min":{"1min":0.35999999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76400000000000001,"5min":0.78900000000000003,"15min":0.83299999999999996},"last":0.58499999999999996}]},{"osd":5,"last update":"Mon Nov 27 21:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.33000000000000002,"5min":0.32800000000000001,"15min":0.30399999999999999},"max":{"1min":0.71899999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53600000000000003,"15min":0.51000000000000001},"min":{"1min":0.379,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79500000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.59699999999999998}]},{"osd":6,"last update":"Mon Nov 27 21:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.51700000000000002,"15min":0.51000000000000001},"min":{"1min":0.378,"5min":0.36699999999999999,"15min":0.34000000000000002},"max":{"1min":0.76500000000000001,"5min":0.81399999999999995,"15min":0.90900000000000003},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51100000000000001,"15min":0.497},"min":{"1min":0.36099999999999999,"5min":0.35199999999999998,"15min":0.316},"max":{"1min":0.66800000000000004,"5min":0.753,"15min":0.76900000000000002},"last":0.60999999999999999}]},{"osd":7,"last update":"Mon Nov 27 21:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.36599999999999999,"15min":0.36399999999999999},"max":{"1min":0.78500000000000003,"5min":1.071,"15min":1.071},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52600000000000002,"15min":0.51000000000000001},"min":{"1min":0.42099999999999999,"5min":0.373,"15min":0.34000000000000002},"max":{"1min":0.67200000000000004,"5min":0.77000000000000002,"15min":0.92400000000000004},"last":0.57299999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509792,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42852,"kb_used_data":3356,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94328988,"statfs":{"total":96636764160,"available":96592883712,"internally_reserved":0,"allocated":3436544,"data_stored":3238767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.314,"15min":0.309},"min":{"1min":0.23499999999999999,"5min":0.20599999999999999,"15min":0.17000000000000001},"max":{"1min":0.503,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.317,"15min":0.308},"min":{"1min":0.23400000000000001,"5min":0.219,"15min":0.19800000000000001},"max":{"1min":0.51900000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.33600000000000002}]},{"osd":2,"last update":"Mon Nov 27 21:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33100000000000002,"15min":0.313},"min":{"1min":0.216,"5min":0.20799999999999999,"15min":0.192},"max":{"1min":0.45500000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.307},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34100000000000003,"15min":0.34300000000000003},"min":{"1min":0.29099999999999998,"5min":0.22600000000000001,"15min":0.20499999999999999},"max":{"1min":0.438,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.35299999999999998}]},{"osd":3,"last update":"Mon Nov 27 21:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.37,"15min":0.36799999999999999},"min":{"1min":0.28499999999999998,"5min":0.26800000000000002,"15min":0.23300000000000001},"max":{"1min":0.53300000000000003,"5min":0.626,"15min":0.68200000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.376,"15min":0.36799999999999999},"min":{"1min":0.252,"5min":0.24399999999999999,"15min":0.23400000000000001},"max":{"1min":0.57999999999999996,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.375}]},{"osd":4,"last update":"Mon Nov 27 21:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.46999999999999997,"15min":0.46700000000000003},"min":{"1min":0.35799999999999998,"5min":0.313,"15min":0.26600000000000001},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.49399999999999999,"15min":0.48599999999999999},"min":{"1min":0.35299999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.46100000000000002}]},{"osd":5,"last update":"Mon Nov 27 21:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.504,"15min":0.49199999999999999},"min":{"1min":0.36399999999999999,"5min":0.35399999999999998,"15min":0.313},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.48299999999999998,"15min":0.48899999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.4079999999999999},"last":0.47499999999999998}]},{"osd":6,"last update":"Mon Nov 27 21:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52100000000000002,"15min":0.51200000000000001},"min":{"1min":0.42099999999999999,"5min":0.38200000000000001,"15min":0.33600000000000002},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.39500000000000002,"5min":0.36199999999999999,"15min":0.34499999999999997},"max":{"1min":1.292,"5min":1.292,"15min":1.4239999999999999},"last":0.41499999999999998}]},{"osd":7,"last update":"Mon Nov 27 21:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.433,"5min":0.371,"15min":0.33200000000000002},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52200000000000002,"15min":0.51800000000000002},"min":{"1min":0.40799999999999997,"5min":0.38700000000000001,"15min":0.35399999999999998},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.4399999999999999},"last":0.432}]}]},{"osd":0,"up_from":15,"seq":64424509791,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76024,"kb_used_data":8752,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94295816,"statfs":{"total":96636764160,"available":96558915584,"internally_reserved":0,"allocated":8962048,"data_stored":8748777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 21:22:10 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.316,"15min":0.309},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.48699999999999999,"5min":0.51800000000000002,"15min":0.57799999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.311,"5min":0.312,"15min":0.311},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.19},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.69699999999999995},"last":0.375}]},{"osd":2,"last update":"Mon Nov 27 21:22:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.22,"5min":0.22,"15min":0.189},"max":{"1min":0.52600000000000002,"5min":0.54300000000000004,"15min":0.59299999999999997},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.34499999999999997,"15min":0.34300000000000003},"min":{"1min":0.23699999999999999,"5min":0.223,"15min":0.19900000000000001},"max":{"1min":0.42799999999999999,"5min":0.55500000000000005,"15min":0.66900000000000004},"last":0.47199999999999998}]},{"osd":3,"last update":"Mon Nov 27 21:22:10 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.35299999999999998,"15min":0.34499999999999997},"min":{"1min":0.24299999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.41799999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38400000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.21099999999999999},"max":{"1min":0.55800000000000005,"5min":0.58499999999999996,"15min":0.61599999999999999},"last":0.45600000000000002}]},{"osd":4,"last update":"Mon Nov 27 21:22:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.318,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.66100000000000003,"5min":0.67000000000000004,"15min":0.81200000000000006},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47699999999999998,"15min":0.46899999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.27200000000000002},"max":{"1min":0.66000000000000003,"5min":0.71199999999999997,"15min":0.71299999999999997},"last":0.56999999999999995}]},{"osd":5,"last update":"Mon Nov 27 21:22:10 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.50600000000000001,"15min":0.495},"min":{"1min":0.39200000000000002,"5min":0.36599999999999999,"15min":0.32700000000000001},"max":{"1min":0.70199999999999996,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46200000000000002,"15min":0.45900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.317},"max":{"1min":0.626,"5min":0.753,"15min":0.85099999999999998},"last":0.58499999999999996}]},{"osd":6,"last update":"Mon Nov 27 21:22:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.495,"15min":0.48899999999999999},"min":{"1min":0.36799999999999999,"5min":0.35499999999999998,"15min":0.31900000000000001},"max":{"1min":0.67600000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.52100000000000002,"15min":0.51400000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73599999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.61499999999999999}]},{"osd":7,"last update":"Mon Nov 27 21:22:10 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.33500000000000002},"max":{"1min":0.754,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.49199999999999999,"15min":0.49299999999999999},"min":{"1min":0.38100000000000001,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":0.64500000000000002,"5min":0.68899999999999995,"15min":0.78000000000000003},"last":0.64500000000000002}]}]},{"osd":7,"up_from":14,"seq":60129542496,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56968,"kb_used_data":7744,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94314872,"statfs":{"total":96636764160,"available":96578428928,"internally_reserved":0,"allocated":7929856,"data_stored":7711066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":50395595},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.40699999999999997,"15min":0.40200000000000002},"min":{"1min":0.25700000000000001,"5min":0.25,"15min":0.21199999999999999},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.82899999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41499999999999998,"15min":0.42599999999999999},"min":{"1min":0.29999999999999999,"5min":0.27000000000000002,"15min":0.22900000000000001},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.61399999999999999},"last":0.50900000000000001}]},{"osd":1,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.436,"15min":0.432},"min":{"1min":0.32500000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.88500000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.44600000000000001,"15min":0.45300000000000001},"min":{"1min":0.32800000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.873},"last":0.51900000000000002}]},{"osd":2,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.42099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28100000000000003},"max":{"1min":0.51800000000000002,"5min":0.65300000000000002,"15min":0.79700000000000004},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41499999999999998,"15min":0.41899999999999998},"min":{"1min":0.34899999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.501,"5min":0.55200000000000005,"15min":0.68700000000000006},"last":0.47699999999999998}]},{"osd":3,"last update":"Mon Nov 27 21:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.44700000000000001,"15min":0.44600000000000001},"min":{"1min":0.40899999999999997,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64600000000000002,"5min":0.68700000000000006,"15min":0.77100000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.503,"5min":0.46999999999999997,"15min":0.45400000000000001},"min":{"1min":0.35299999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64900000000000002,"5min":0.68600000000000005,"15min":0.90200000000000002},"last":0.5}]},{"osd":4,"last update":"Mon Nov 27 21:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.38200000000000001,"15min":0.39200000000000002},"min":{"1min":0.26400000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.502,"5min":0.59199999999999997,"15min":0.65400000000000003},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.42399999999999999,"15min":0.41699999999999998},"min":{"1min":0.32500000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61599999999999999,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.45100000000000001}]},{"osd":5,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.45100000000000001,"15min":0.44},"min":{"1min":0.28299999999999997,"5min":0.27700000000000002,"15min":0.27300000000000002},"max":{"1min":0.75,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.42799999999999999,"15min":0.44},"min":{"1min":0.27900000000000003,"5min":0.26400000000000001,"15min":0.248},"max":{"1min":0.50700000000000001,"5min":0.71499999999999997,"15min":0.77700000000000002},"last":0.434}]},{"osd":6,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.26600000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.56999999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49399999999999999},"min":{"1min":0.33600000000000002,"5min":0.29099999999999998,"15min":0.28100000000000003},"max":{"1min":0.69199999999999995,"5min":0.751,"15min":0.84999999999999998},"last":0.55700000000000005}]}]},{"osd":4,"up_from":14,"seq":60129542496,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57800,"kb_used_data":8576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94314040,"statfs":{"total":96636764160,"available":96577576960,"internally_reserved":0,"allocated":8781824,"data_stored":8552244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.42199999999999999,"15min":0.40899999999999997},"min":{"1min":0.28399999999999997,"5min":0.248,"15min":0.20200000000000001},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.49299999999999999,"15min":0.44900000000000001},"min":{"1min":0.35599999999999998,"5min":0.28299999999999997,"15min":0.24099999999999999},"max":{"1min":3.948,"5min":3.948,"15min":3.948},"last":0.40400000000000003}]},{"osd":1,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.47499999999999998,"15min":0.433},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.24099999999999999},"max":{"1min":5.0410000000000004,"5min":5.0410000000000004,"15min":5.0410000000000004},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.433,"15min":0.41599999999999998},"min":{"1min":0.29899999999999999,"5min":0.247,"15min":0.247},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.44}]},{"osd":2,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.45100000000000001,"15min":0.43099999999999999},"min":{"1min":0.34200000000000003,"5min":0.29499999999999998,"15min":0.26100000000000001},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.48299999999999998,"15min":0.45900000000000002},"min":{"1min":0.373,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":4.008,"5min":4.008,"15min":4.008},"last":0.433}]},{"osd":3,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.48899999999999999,"15min":0.47099999999999997},"min":{"1min":0.33800000000000002,"5min":0.318,"15min":0.29899999999999999},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.499},{"interface":"front","average":{"1min":1.0940000000000001,"5min":0.58899999999999997,"15min":0.496},"min":{"1min":0.33800000000000002,"5min":0.32600000000000001,"15min":0.28499999999999998},"max":{"1min":10.747999999999999,"5min":10.747999999999999,"15min":10.747999999999999},"last":0.378}]},{"osd":5,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":1.6890000000000001,"5min":0.67600000000000005,"15min":0.47899999999999998},"min":{"1min":0.28599999999999998,"5min":0.23100000000000001,"15min":0.221},"max":{"1min":20.847999999999999,"5min":20.847999999999999,"15min":20.847999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.47099999999999997,"15min":0.43099999999999999},"min":{"1min":0.28199999999999997,"5min":0.26000000000000001,"15min":0.23100000000000001},"max":{"1min":5.0800000000000001,"5min":5.0800000000000001,"15min":5.0800000000000001},"last":0.33000000000000002}]},{"osd":6,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.435,"15min":0.41799999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.24399999999999999},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.499,"15min":0.47099999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.45000000000000001}]},{"osd":7,"last update":"Mon Nov 27 21:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46500000000000002,"15min":0.45400000000000001},"min":{"1min":0.311,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.55900000000000005,"15min":0.52000000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.33400000000000002},"max":{"1min":3.4649999999999999,"5min":3.4649999999999999,"15min":3.4649999999999999},"last":0.39000000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542496,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89188,"kb_used_data":13596,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94282652,"statfs":{"total":96636764160,"available":96545435648,"internally_reserved":0,"allocated":13922304,"data_stored":13708692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:22:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.34200000000000003,"15min":0.32500000000000001},"min":{"1min":0.254,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.42299999999999999,"15min":0.34499999999999997},"min":{"1min":0.217,"5min":0.21099999999999999,"15min":0.192},"max":{"1min":8.9369999999999994,"5min":8.9369999999999994,"15min":8.9369999999999994},"last":0.33100000000000002}]},{"osd":1,"last update":"Mon Nov 27 21:22:05 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.34100000000000003,"15min":0.32200000000000001},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":3.1230000000000002,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.39100000000000001,"15min":0.36099999999999999},"min":{"1min":0.247,"5min":0.23400000000000001,"15min":0.21199999999999999},"max":{"1min":2.8420000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.29399999999999998}]},{"osd":2,"last update":"Mon Nov 27 21:22:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.45900000000000002,"15min":0.39900000000000002},"min":{"1min":0.29999999999999999,"5min":0.25900000000000001,"15min":0.22600000000000001},"max":{"1min":7.0830000000000002,"5min":7.0830000000000002,"15min":7.0830000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.39300000000000002,"15min":0.38},"min":{"1min":0.29499999999999998,"5min":0.25700000000000001,"15min":0.22600000000000001},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.27800000000000002}]},{"osd":4,"last update":"Mon Nov 27 21:22:05 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.48399999999999999,"15min":0.47099999999999997},"min":{"1min":0.35699999999999998,"5min":0.311,"15min":0.311},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.51500000000000001,"15min":0.496},"min":{"1min":0.34699999999999998,"5min":0.34499999999999997,"15min":0.314},"max":{"1min":3.0920000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":0.40999999999999998}]},{"osd":5,"last update":"Mon Nov 27 21:22:05 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.51400000000000001,"15min":0.49299999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.28499999999999998},"max":{"1min":2.5760000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.40500000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.7400000000000002,"5min":2.7400000000000002,"15min":2.7400000000000002},"last":0.46300000000000002}]},{"osd":6,"last update":"Mon Nov 27 21:22:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.55800000000000005,"15min":0.52500000000000002},"min":{"1min":0.41599999999999998,"5min":0.36899999999999999,"15min":0.311},"max":{"1min":4.7169999999999996,"5min":4.7169999999999996,"15min":4.7169999999999996},"last":0.505},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.52300000000000002,"15min":0.51000000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.314},"max":{"1min":2.6120000000000001,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.433}]},{"osd":7,"last update":"Mon Nov 27 21:22:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.40200000000000002,"5min":0.36099999999999999,"15min":0.35999999999999999},"max":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.54000000000000004,"15min":0.52900000000000003},"min":{"1min":0.379,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.48099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8667136,"data_stored":8628738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2547712,"data_stored":2528360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13627392,"data_stored":13588653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8486912,"data_stored":8432205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18833408,"data_stored":18809764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20590592,"data_stored":20576109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7634944,"data_stored":7591027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T21:23:07.589 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:23:07.589 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:23:07.589 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:23:07.589 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:23:07.590 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:23:07.590 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:23:07.590 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:23:07.590 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:23:07.590 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:23:07.591 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:23:07.591 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:23:07.591 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-11-27T20:54:30.644117+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=30, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:23:07.592 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-27T21:23:09.976 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:23:09.978 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:23:27.593 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T21:23:27.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.713+0000 7fd537056640 1 Processor -- start 2023-11-27T21:23:27.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.713+0000 7fd537056640 1 -- start start 2023-11-27T21:23:27.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.714+0000 7fd537056640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd530157240 0x7fd5300c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:27.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.714+0000 7fd537056640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5301577f0 con 0x7fd5300c4610 2023-11-27T21:23:27.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.714+0000 7fd537056640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd530157a90 con 0x7fd530151220 2023-11-27T21:23:27.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.714+0000 7fd537056640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53006f470 con 0x7fd530157240 2023-11-27T21:23:27.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.731+0000 7fd5355f3640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd5300c4610 0x7fd5300710c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54064/0 (socket says 172.21.15.88:54064) 2023-11-27T21:23:27.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.731+0000 7fd5355f3640 1 -- 172.21.15.88:0/1473901177 learned_addr learned my addr 172.21.15.88:0/1473901177 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:23:27.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.734+0000 7fd52f7fe640 1 -- 172.21.15.88:0/1473901177 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826862135 0 0) 0x7fd5301577f0 con 0x7fd5300c4610 2023-11-27T21:23:27.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.734+0000 7fd52f7fe640 1 -- 172.21.15.88:0/1473901177 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd518003520 con 0x7fd5300c4610 2023-11-27T21:23:27.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.737+0000 7fd52f7fe640 1 -- 172.21.15.88:0/1473901177 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3344712057 0 0) 0x7fd518003520 con 0x7fd5300c4610 2023-11-27T21:23:27.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.737+0000 7fd52f7fe640 1 -- 172.21.15.88:0/1473901177 >> v2:172.21.15.167:3300/0 conn(0x7fd530157240 msgr2=0x7fd5300c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:23:27.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.737+0000 7fd52f7fe640 1 --2- 172.21.15.88:0/1473901177 >> v2:172.21.15.167:3300/0 conn(0x7fd530157240 0x7fd5300c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:27.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.737+0000 7fd52f7fe640 1 -- 172.21.15.88:0/1473901177 >> v1:172.21.15.167:6789/0 conn(0x7fd530151220 legacy=0x7fd53006ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:23:27.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.737+0000 7fd52f7fe640 1 -- 172.21.15.88:0/1473901177 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd530157d30 con 0x7fd5300c4610 2023-11-27T21:23:27.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.737+0000 7fd52f7fe640 1 -- 172.21.15.88:0/1473901177 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1067350109 0 0) 0x7fd520001670 con 0x7fd5300c4610 2023-11-27T21:23:27.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.737+0000 7fd52f7fe640 1 -- 172.21.15.88:0/1473901177 >> v1:172.21.15.88:6789/0 conn(0x7fd5300c4610 legacy=0x7fd5300710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:27.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.737+0000 7fd52f7fe640 1 --2- 172.21.15.88:0/1473901177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd518003a30 0x7fd518003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:27.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.737+0000 7fd52f7fe640 1 --2- 172.21.15.88:0/1473901177 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5180047c0 0x7fd518004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:27.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.737+0000 7fd52f7fe640 1 --2- 172.21.15.88:0/1473901177 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd518005380 0x7fd51800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:27.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.737+0000 7fd52f7fe640 1 -- 172.21.15.88:0/1473901177 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53006f470 con 0x7fd518005380 2023-11-27T21:23:27.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.737+0000 7fd52f7fe640 1 -- 172.21.15.88:0/1473901177 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51800c250 con 0x7fd518003a30 2023-11-27T21:23:27.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.737+0000 7fd52f7fe640 1 -- 172.21.15.88:0/1473901177 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51800c410 con 0x7fd5180047c0 2023-11-27T21:23:27.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.740+0000 7fd5355f3640 1 --2- 172.21.15.88:0/1473901177 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd518005380 0x7fd51800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:27.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.743+0000 7fd5355f3640 1 -- 172.21.15.88:0/1473901177 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5180047c0 msgr2=0x7fd518004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:23:27.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.743+0000 7fd5355f3640 1 --2- 172.21.15.88:0/1473901177 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5180047c0 0x7fd518004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:27.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.743+0000 7fd5355f3640 1 -- 172.21.15.88:0/1473901177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd518003a30 msgr2=0x7fd518003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:23:27.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.743+0000 7fd5355f3640 1 --2- 172.21.15.88:0/1473901177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd518003a30 0x7fd518003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:27.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.743+0000 7fd5355f3640 1 -- 172.21.15.88:0/1473901177 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd518003520 con 0x7fd518005380 2023-11-27T21:23:27.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.744+0000 7fd5355f3640 1 -- 172.21.15.88:0/1473901177 reap_dead start 2023-11-27T21:23:27.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.745+0000 7fd5355f3640 1 --2- 172.21.15.88:0/1473901177 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd518005380 0x7fd51800b980 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd52000c0e0 tx=0x7fd5180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188ab20d11347995 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:27.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.750+0000 7fd52f7fe640 1 -- 172.21.15.88:0/1473901177 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd520005ad0 con 0x7fd518005380 2023-11-27T21:23:27.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.750+0000 7fd52f7fe640 1 -- 172.21.15.88:0/1473901177 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd520005c70 con 0x7fd518005380 2023-11-27T21:23:27.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.750+0000 7fd52f7fe640 1 -- 172.21.15.88:0/1473901177 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52002c810 con 0x7fd518005380 2023-11-27T21:23:27.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.751+0000 7fd537056640 1 -- 172.21.15.88:0/1473901177 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd518005380 msgr2=0x7fd51800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:27.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.751+0000 7fd537056640 1 --2- 172.21.15.88:0/1473901177 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd518005380 0x7fd51800b980 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd52000c0e0 tx=0x7fd5180057f0 comp rx=0 tx=0).stop 2023-11-27T21:23:27.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.751+0000 7fd537056640 1 -- 172.21.15.88:0/1473901177 shutdown_connections 2023-11-27T21:23:27.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.751+0000 7fd537056640 1 --2- 172.21.15.88:0/1473901177 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd518005380 0x7fd51800b980 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:27.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.751+0000 7fd537056640 1 -- 172.21.15.88:0/1473901177 >> 172.21.15.88:0/1473901177 conn(0x7fd53006c5f0 msgr2=0x7fd53006c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:23:27.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.751+0000 7fd537056640 1 -- 172.21.15.88:0/1473901177 shutdown_connections 2023-11-27T21:23:27.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.751+0000 7fd537056640 1 -- 172.21.15.88:0/1473901177 wait complete. 2023-11-27T21:23:27.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.752+0000 7fd537056640 1 Processor -- start 2023-11-27T21:23:27.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.752+0000 7fd537056640 1 -- start start 2023-11-27T21:23:27.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.753+0000 7fd537056640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd518005380 0x7fd5301f2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:27.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.753+0000 7fd537056640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd53014dc30 0x7fd5300c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:27.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.753+0000 7fd537056640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5300c7ad0 0x7fd5301eedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:27.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.753+0000 7fd537056640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd530144100 con 0x7fd518005380 2023-11-27T21:23:27.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.753+0000 7fd537056640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5300c2080 con 0x7fd5300c7ad0 2023-11-27T21:23:27.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.753+0000 7fd537056640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5300c2320 con 0x7fd53014dc30 2023-11-27T21:23:27.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.754+0000 7fd5355f3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5300c7ad0 0x7fd5301eedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:27.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.754+0000 7fd52ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd53014dc30 0x7fd5300c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:27.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.754+0000 7fd5355f3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5300c7ad0 0x7fd5301eedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:39650/0 (socket says 172.21.15.88:39650) 2023-11-27T21:23:27.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.754+0000 7fd5355f3640 1 -- 172.21.15.88:0/2522585651 learned_addr learned my addr 172.21.15.88:0/2522585651 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:23:27.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.758+0000 7fd5355f3640 1 -- 172.21.15.88:0/2522585651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd53014dc30 msgr2=0x7fd5300c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:27.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.758+0000 7fd5355f3640 1 --2- 172.21.15.88:0/2522585651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd53014dc30 0x7fd5300c7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:27.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.758+0000 7fd5355f3640 1 -- 172.21.15.88:0/2522585651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd518005380 msgr2=0x7fd5301f2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:27.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.758+0000 7fd5355f3640 1 --2- 172.21.15.88:0/2522585651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd518005380 0x7fd5301f2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:27.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.758+0000 7fd5355f3640 1 -- 172.21.15.88:0/2522585651 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5300c25c0 con 0x7fd5300c7ad0 2023-11-27T21:23:27.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.758+0000 7fd52ffff640 1 --2- 172.21.15.88:0/2522585651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd53014dc30 0x7fd5300c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T21:23:27.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.761+0000 7fd5355f3640 1 --2- 172.21.15.88:0/2522585651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5300c7ad0 0x7fd5301eedc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd52000c200 tx=0x7fd530158730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:27.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.767+0000 7fd52d7fa640 1 -- 172.21.15.88:0/2522585651 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd520039070 con 0x7fd5300c7ad0 2023-11-27T21:23:27.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.767+0000 7fd52d7fa640 1 -- 172.21.15.88:0/2522585651 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52002ca20 con 0x7fd5300c7ad0 2023-11-27T21:23:27.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.767+0000 7fd537056640 1 -- 172.21.15.88:0/2522585651 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5300c28a0 con 0x7fd5300c7ad0 2023-11-27T21:23:27.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.767+0000 7fd52d7fa640 1 -- 172.21.15.88:0/2522585651 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52002cdd0 con 0x7fd5300c7ad0 2023-11-27T21:23:27.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.767+0000 7fd537056640 1 -- 172.21.15.88:0/2522585651 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5300c3e80 con 0x7fd5300c7ad0 2023-11-27T21:23:27.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.768+0000 7fd537056640 1 -- 172.21.15.88:0/2522585651 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd530072020 con 0x7fd5300c7ad0 2023-11-27T21:23:27.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.788+0000 7fd52d7fa640 1 -- 172.21.15.88:0/2522585651 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd520007070 con 0x7fd5300c7ad0 2023-11-27T21:23:27.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.788+0000 7fd52d7fa640 1 --2- 172.21.15.88:0/2522585651 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd51c06b240 0x7fd51c06d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:27.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.788+0000 7fd534df2640 1 --2- 172.21.15.88:0/2522585651 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd51c06b240 0x7fd51c06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:27.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:27.789+0000 7fd534df2640 1 --2- 172.21.15.88:0/2522585651 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd51c06b240 0x7fd51c06d700 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd528001be0 tx=0x7fd528007d10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:28.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:28.017+0000 7fd52d7fa640 1 -- 172.21.15.88:0/2522585651 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd520079020 con 0x7fd5300c7ad0 2023-11-27T21:23:28.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:28.027+0000 7fd52d7fa640 1 -- 172.21.15.88:0/2522585651 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd520075360 con 0x7fd5300c7ad0 2023-11-27T21:23:28.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:28.192+0000 7fd537056640 1 -- 172.21.15.88:0/2522585651 --> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd5301ee7d0 con 0x7fd51c06b240 2023-11-27T21:23:28.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:28.200+0000 7fd52d7fa640 1 -- 172.21.15.88:0/2522585651 <== mgr.4105 v2:172.21.15.88:6800/352455703 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+373819 (secure 0 0 0) 0x7fd528003970 con 0x7fd51c06b240 2023-11-27T21:23:28.207 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T21:23:28.209 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-11-27T21:23:28.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:28.204+0000 7fd537056640 1 -- 172.21.15.88:0/2522585651 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd51c06b240 msgr2=0x7fd51c06d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:28.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:28.204+0000 7fd537056640 1 --2- 172.21.15.88:0/2522585651 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd51c06b240 0x7fd51c06d700 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd528001be0 tx=0x7fd528007d10 comp rx=0 tx=0).stop 2023-11-27T21:23:28.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:28.204+0000 7fd537056640 1 -- 172.21.15.88:0/2522585651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5300c7ad0 msgr2=0x7fd5301eedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:28.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:28.204+0000 7fd537056640 1 --2- 172.21.15.88:0/2522585651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5300c7ad0 0x7fd5301eedc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd52000c200 tx=0x7fd530158730 comp rx=0 tx=0).stop 2023-11-27T21:23:28.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:28.204+0000 7fd537056640 1 -- 172.21.15.88:0/2522585651 shutdown_connections 2023-11-27T21:23:28.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:28.204+0000 7fd537056640 1 --2- 172.21.15.88:0/2522585651 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fd51c06b240 0x7fd51c06d700 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:28.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:28.204+0000 7fd537056640 1 --2- 172.21.15.88:0/2522585651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5300c7ad0 0x7fd5301eedc0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:28.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:28.204+0000 7fd537056640 1 --2- 172.21.15.88:0/2522585651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd53014dc30 0x7fd5300c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:28.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:28.204+0000 7fd537056640 1 --2- 172.21.15.88:0/2522585651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd518005380 0x7fd5301f2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:28.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:28.204+0000 7fd537056640 1 -- 172.21.15.88:0/2522585651 >> 172.21.15.88:0/2522585651 conn(0x7fd53006c5f0 msgr2=0x7fd530155090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:23:28.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:28.204+0000 7fd537056640 1 -- 172.21.15.88:0/2522585651 shutdown_connections 2023-11-27T21:23:28.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:28.204+0000 7fd537056640 1 -- 172.21.15.88:0/2522585651 wait complete. 2023-11-27T21:23:28.218 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":902,"stamp":"2023-11-27T21:23:27.290089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":44862470,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":1793,"num_read_kb":1913,"num_write":21035,"num_write_kb":386609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25388,"ondisk_log_size":25388,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":567232,"kb_used_data":90176,"kb_used_omap":12,"kb_used_meta":476979,"kb_avail":754407488,"statfs":{"total":773094113280,"available":772513267712,"internally_reserved":0,"allocated":92340224,"data_stored":90685252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":488427057},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003639"},"pg_stats":[{"pgid":"2.1f","version":"28'339","reported_seq":379,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.533002+0000","last_change":"2023-11-27T21:22:21.533049+0000","last_active":"2023-11-27T21:22:21.533002+0000","last_peered":"2023-11-27T21:22:21.533002+0000","last_clean":"2023-11-27T21:22:21.533002+0000","last_became_active":"2023-11-27T20:54:26.221715+0000","last_became_peered":"2023-11-27T20:54:26.221715+0000","last_unstale":"2023-11-27T21:22:21.533002+0000","last_undegraded":"2023-11-27T21:22:21.533002+0000","last_fullsized":"2023-11-27T21:22:21.533002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'339","last_scrub_stamp":"2023-11-27T21:22:21.532905+0000","last_deep_scrub":"28'339","last_deep_scrub_stamp":"2023-11-27T21:22:21.532905+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.532905+0000","objects_scrubbed":7,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:03:03.041969+0000","scrub_duration":0.0081144100000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922212,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":1068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"28'71","reported_seq":111,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:51.278893+0000","last_change":"2023-11-27T21:22:51.278914+0000","last_active":"2023-11-27T21:22:51.278893+0000","last_peered":"2023-11-27T21:22:51.278893+0000","last_clean":"2023-11-27T21:22:51.278893+0000","last_became_active":"2023-11-27T20:54:27.508003+0000","last_became_peered":"2023-11-27T20:54:27.508003+0000","last_unstale":"2023-11-27T21:22:51.278893+0000","last_undegraded":"2023-11-27T21:22:51.278893+0000","last_fullsized":"2023-11-27T21:22:51.278893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'71","last_scrub_stamp":"2023-11-27T21:22:51.278824+0000","last_deep_scrub":"28'71","last_deep_scrub_stamp":"2023-11-27T21:22:51.278824+0000","last_clean_scrub_stamp":"2023-11-27T21:22:51.278824+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:46.619465+0000","scrub_duration":0.001581952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"28'159","reported_seq":194,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:27.322551+0000","last_change":"2023-11-27T21:22:27.322575+0000","last_active":"2023-11-27T21:22:27.322551+0000","last_peered":"2023-11-27T21:22:27.322551+0000","last_clean":"2023-11-27T21:22:27.322551+0000","last_became_active":"2023-11-27T20:54:31.836803+0000","last_became_peered":"2023-11-27T20:54:31.836803+0000","last_unstale":"2023-11-27T21:22:27.322551+0000","last_undegraded":"2023-11-27T21:22:27.322551+0000","last_fullsized":"2023-11-27T21:22:27.322551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'159","last_scrub_stamp":"2023-11-27T21:22:27.322480+0000","last_deep_scrub":"28'159","last_deep_scrub_stamp":"2023-11-27T21:22:27.322480+0000","last_clean_scrub_stamp":"2023-11-27T21:22:27.322480+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:08:23.783315+0000","scrub_duration":0.0022460409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":7710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'739","reported_seq":780,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:28.459705+0000","last_change":"2023-11-27T21:22:28.459705+0000","last_active":"2023-11-27T21:22:28.459705+0000","last_peered":"2023-11-27T21:22:28.459705+0000","last_clean":"2023-11-27T21:22:28.459705+0000","last_became_active":"2023-11-27T20:54:26.227620+0000","last_became_peered":"2023-11-27T20:54:26.227620+0000","last_unstale":"2023-11-27T21:22:28.459705+0000","last_undegraded":"2023-11-27T21:22:28.459705+0000","last_fullsized":"2023-11-27T21:22:28.459705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'739","last_scrub_stamp":"2023-11-27T21:22:28.459580+0000","last_deep_scrub":"28'739","last_deep_scrub_stamp":"2023-11-27T21:22:28.459580+0000","last_clean_scrub_stamp":"2023-11-27T21:22:28.459580+0000","objects_scrubbed":1,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:57:22.369660+0000","scrub_duration":0.011554231,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":733,"num_write_kb":4484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"28'77","reported_seq":116,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:56.340634+0000","last_change":"2023-11-27T21:22:56.340668+0000","last_active":"2023-11-27T21:22:56.340634+0000","last_peered":"2023-11-27T21:22:56.340634+0000","last_clean":"2023-11-27T21:22:56.340634+0000","last_became_active":"2023-11-27T20:54:27.507460+0000","last_became_peered":"2023-11-27T20:54:27.507460+0000","last_unstale":"2023-11-27T21:22:56.340634+0000","last_undegraded":"2023-11-27T21:22:56.340634+0000","last_fullsized":"2023-11-27T21:22:56.340634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:56.340545+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:56.340545+0000","last_clean_scrub_stamp":"2023-11-27T21:22:56.340545+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:20:58.429371+0000","scrub_duration":0.0021526409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"28'166","reported_seq":210,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:20.702787+0000","last_change":"2023-11-27T21:22:20.702834+0000","last_active":"2023-11-27T21:22:20.702787+0000","last_peered":"2023-11-27T21:22:20.702787+0000","last_clean":"2023-11-27T21:22:20.702787+0000","last_became_active":"2023-11-27T20:55:00.593543+0000","last_became_peered":"2023-11-27T20:55:00.593543+0000","last_unstale":"2023-11-27T21:22:20.702787+0000","last_undegraded":"2023-11-27T21:22:20.702787+0000","last_fullsized":"2023-11-27T21:22:20.702787+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'166","last_scrub_stamp":"2023-11-27T21:22:20.702707+0000","last_deep_scrub":"28'166","last_deep_scrub_stamp":"2023-11-27T21:22:20.702707+0000","last_clean_scrub_stamp":"2023-11-27T21:22:20.702707+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:34.996116+0000","scrub_duration":0.0026403020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":12743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"28'187","reported_seq":225,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:18.415812+0000","last_change":"2023-11-27T21:22:18.415839+0000","last_active":"2023-11-27T21:22:18.415812+0000","last_peered":"2023-11-27T21:22:18.415812+0000","last_clean":"2023-11-27T21:22:18.415812+0000","last_became_active":"2023-11-27T20:54:26.226407+0000","last_became_peered":"2023-11-27T20:54:26.226407+0000","last_unstale":"2023-11-27T21:22:18.415812+0000","last_undegraded":"2023-11-27T21:22:18.415812+0000","last_fullsized":"2023-11-27T21:22:18.415812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'187","last_scrub_stamp":"2023-11-27T21:22:18.415750+0000","last_deep_scrub":"28'187","last_deep_scrub_stamp":"2023-11-27T21:22:18.415750+0000","last_clean_scrub_stamp":"2023-11-27T21:22:18.415750+0000","objects_scrubbed":7,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:09.265948+0000","scrub_duration":0.0049688789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'78","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:19.383288+0000","last_change":"2023-11-27T21:22:19.383307+0000","last_active":"2023-11-27T21:22:19.383288+0000","last_peered":"2023-11-27T21:22:19.383288+0000","last_clean":"2023-11-27T21:22:19.383288+0000","last_became_active":"2023-11-27T20:54:27.512548+0000","last_became_peered":"2023-11-27T20:54:27.512548+0000","last_unstale":"2023-11-27T21:22:19.383288+0000","last_undegraded":"2023-11-27T21:22:19.383288+0000","last_fullsized":"2023-11-27T21:22:19.383288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'78","last_scrub_stamp":"2023-11-27T21:22:19.383221+0000","last_deep_scrub":"28'78","last_deep_scrub_stamp":"2023-11-27T21:22:19.383221+0000","last_clean_scrub_stamp":"2023-11-27T21:22:19.383221+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:56:13.237697+0000","scrub_duration":0.0011829830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"28'164","reported_seq":199,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:44.720580+0000","last_change":"2023-11-27T21:22:44.720599+0000","last_active":"2023-11-27T21:22:44.720580+0000","last_peered":"2023-11-27T21:22:44.720580+0000","last_clean":"2023-11-27T21:22:44.720580+0000","last_became_active":"2023-11-27T20:54:31.828045+0000","last_became_peered":"2023-11-27T20:54:31.828045+0000","last_unstale":"2023-11-27T21:22:44.720580+0000","last_undegraded":"2023-11-27T21:22:44.720580+0000","last_fullsized":"2023-11-27T21:22:44.720580+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'164","last_scrub_stamp":"2023-11-27T21:22:44.720523+0000","last_deep_scrub":"28'164","last_deep_scrub_stamp":"2023-11-27T21:22:44.720523+0000","last_clean_scrub_stamp":"2023-11-27T21:22:44.720523+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:29:31.109271+0000","scrub_duration":0.0023621649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":12089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"28'12","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:25.356913+0000","last_change":"2023-11-27T21:22:25.356937+0000","last_active":"2023-11-27T21:22:25.356913+0000","last_peered":"2023-11-27T21:22:25.356913+0000","last_clean":"2023-11-27T21:22:25.356913+0000","last_became_active":"2023-11-27T20:54:26.226522+0000","last_became_peered":"2023-11-27T20:54:26.226522+0000","last_unstale":"2023-11-27T21:22:25.356913+0000","last_undegraded":"2023-11-27T21:22:25.356913+0000","last_fullsized":"2023-11-27T21:22:25.356913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2023-11-27T21:22:25.356853+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2023-11-27T21:22:25.356853+0000","last_clean_scrub_stamp":"2023-11-27T21:22:25.356853+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:24.010754+0000","scrub_duration":0.0030610910000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"28'85","reported_seq":129,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:51.494966+0000","last_change":"2023-11-27T21:22:51.494988+0000","last_active":"2023-11-27T21:22:51.494966+0000","last_peered":"2023-11-27T21:22:51.494966+0000","last_clean":"2023-11-27T21:22:51.494966+0000","last_became_active":"2023-11-27T20:55:00.789772+0000","last_became_peered":"2023-11-27T20:55:00.789772+0000","last_unstale":"2023-11-27T21:22:51.494966+0000","last_undegraded":"2023-11-27T21:22:51.494966+0000","last_fullsized":"2023-11-27T21:22:51.494966+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'85","last_scrub_stamp":"2023-11-27T21:22:51.494889+0000","last_deep_scrub":"28'85","last_deep_scrub_stamp":"2023-11-27T21:22:51.494889+0000","last_clean_scrub_stamp":"2023-11-27T21:22:51.494889+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:34:42.390103+0000","scrub_duration":0.0013219589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"28'169","reported_seq":204,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.736963+0000","last_change":"2023-11-27T21:22:21.736983+0000","last_active":"2023-11-27T21:22:21.736963+0000","last_peered":"2023-11-27T21:22:21.736963+0000","last_clean":"2023-11-27T21:22:21.736963+0000","last_became_active":"2023-11-27T20:54:31.828371+0000","last_became_peered":"2023-11-27T20:54:31.828371+0000","last_unstale":"2023-11-27T21:22:21.736963+0000","last_undegraded":"2023-11-27T21:22:21.736963+0000","last_fullsized":"2023-11-27T21:22:21.736963+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'169","last_scrub_stamp":"2023-11-27T21:22:21.736882+0000","last_deep_scrub":"28'169","last_deep_scrub_stamp":"2023-11-27T21:22:21.736882+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.736882+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:39:05.705679+0000","scrub_duration":0.0027207239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":6774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"28'74","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:52.514077+0000","last_change":"2023-11-27T21:22:52.514095+0000","last_active":"2023-11-27T21:22:52.514077+0000","last_peered":"2023-11-27T21:22:52.514077+0000","last_clean":"2023-11-27T21:22:52.514077+0000","last_became_active":"2023-11-27T20:54:27.498279+0000","last_became_peered":"2023-11-27T20:54:27.498279+0000","last_unstale":"2023-11-27T21:22:52.514077+0000","last_undegraded":"2023-11-27T21:22:52.514077+0000","last_fullsized":"2023-11-27T21:22:52.514077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'74","last_scrub_stamp":"2023-11-27T21:22:52.514018+0000","last_deep_scrub":"28'74","last_deep_scrub_stamp":"2023-11-27T21:22:52.514018+0000","last_clean_scrub_stamp":"2023-11-27T21:22:52.514018+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:32.165678+0000","scrub_duration":0.001193483,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'1124","reported_seq":1163,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:43.632211+0000","last_change":"2023-11-27T21:22:43.632238+0000","last_active":"2023-11-27T21:22:43.632211+0000","last_peered":"2023-11-27T21:22:43.632211+0000","last_clean":"2023-11-27T21:22:43.632211+0000","last_became_active":"2023-11-27T20:54:26.227503+0000","last_became_peered":"2023-11-27T20:54:26.227503+0000","last_unstale":"2023-11-27T21:22:43.632211+0000","last_undegraded":"2023-11-27T21:22:43.632211+0000","last_fullsized":"2023-11-27T21:22:43.632211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1124","last_scrub_stamp":"2023-11-27T21:22:43.632146+0000","last_deep_scrub":"28'1124","last_deep_scrub_stamp":"2023-11-27T21:22:43.632146+0000","last_clean_scrub_stamp":"2023-11-27T21:22:43.632146+0000","objects_scrubbed":3,"log_size":1124,"log_dups_size":0,"ondisk_log_size":1124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:17.249089+0000","scrub_duration":0.013154749,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1114,"num_write_kb":4562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"28'173","reported_seq":209,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:00.478094+0000","last_change":"2023-11-27T21:23:00.478130+0000","last_active":"2023-11-27T21:23:00.478094+0000","last_peered":"2023-11-27T21:23:00.478094+0000","last_clean":"2023-11-27T21:23:00.478094+0000","last_became_active":"2023-11-27T20:54:31.827631+0000","last_became_peered":"2023-11-27T20:54:31.827631+0000","last_unstale":"2023-11-27T21:23:00.478094+0000","last_undegraded":"2023-11-27T21:23:00.478094+0000","last_fullsized":"2023-11-27T21:23:00.478094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'173","last_scrub_stamp":"2023-11-27T21:23:00.478024+0000","last_deep_scrub":"28'173","last_deep_scrub_stamp":"2023-11-27T21:23:00.478024+0000","last_clean_scrub_stamp":"2023-11-27T21:23:00.478024+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:28:40.365877+0000","scrub_duration":0.0024979619999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":8292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"28'70","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:24.322940+0000","last_change":"2023-11-27T21:22:24.322960+0000","last_active":"2023-11-27T21:22:24.322940+0000","last_peered":"2023-11-27T21:22:24.322940+0000","last_clean":"2023-11-27T21:22:24.322940+0000","last_became_active":"2023-11-27T20:54:27.510668+0000","last_became_peered":"2023-11-27T20:54:27.510668+0000","last_unstale":"2023-11-27T21:22:24.322940+0000","last_undegraded":"2023-11-27T21:22:24.322940+0000","last_fullsized":"2023-11-27T21:22:24.322940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'70","last_scrub_stamp":"2023-11-27T21:22:24.322871+0000","last_deep_scrub":"28'70","last_deep_scrub_stamp":"2023-11-27T21:22:24.322871+0000","last_clean_scrub_stamp":"2023-11-27T21:22:24.322871+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:12:30.073196+0000","scrub_duration":0.0016321840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'447","reported_seq":487,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:11.006346+0000","last_change":"2023-11-27T21:22:11.006346+0000","last_active":"2023-11-27T21:22:11.006346+0000","last_peered":"2023-11-27T21:22:11.006346+0000","last_clean":"2023-11-27T21:22:11.006346+0000","last_became_active":"2023-11-27T20:54:26.231081+0000","last_became_peered":"2023-11-27T20:54:26.231081+0000","last_unstale":"2023-11-27T21:22:11.006346+0000","last_undegraded":"2023-11-27T21:22:11.006346+0000","last_fullsized":"2023-11-27T21:22:11.006346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'447","last_scrub_stamp":"2023-11-27T21:22:11.006247+0000","last_deep_scrub":"28'447","last_deep_scrub_stamp":"2023-11-27T21:22:11.006247+0000","last_clean_scrub_stamp":"2023-11-27T21:22:11.006247+0000","objects_scrubbed":2,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:24:18.182726+0000","scrub_duration":0.0020915840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"28'191","reported_seq":227,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:52.442803+0000","last_change":"2023-11-27T21:22:52.442823+0000","last_active":"2023-11-27T21:22:52.442803+0000","last_peered":"2023-11-27T21:22:52.442803+0000","last_clean":"2023-11-27T21:22:52.442803+0000","last_became_active":"2023-11-27T20:54:31.816700+0000","last_became_peered":"2023-11-27T20:54:31.816700+0000","last_unstale":"2023-11-27T21:22:52.442803+0000","last_undegraded":"2023-11-27T21:22:52.442803+0000","last_fullsized":"2023-11-27T21:22:52.442803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'191","last_scrub_stamp":"2023-11-27T21:22:52.442732+0000","last_deep_scrub":"28'191","last_deep_scrub_stamp":"2023-11-27T21:22:52.442732+0000","last_clean_scrub_stamp":"2023-11-27T21:22:52.442732+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:05:38.633591+0000","scrub_duration":0.0028160640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":12458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"28'73","reported_seq":112,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:39.536435+0000","last_change":"2023-11-27T21:22:39.536481+0000","last_active":"2023-11-27T21:22:39.536435+0000","last_peered":"2023-11-27T21:22:39.536435+0000","last_clean":"2023-11-27T21:22:39.536435+0000","last_became_active":"2023-11-27T20:54:27.509961+0000","last_became_peered":"2023-11-27T20:54:27.509961+0000","last_unstale":"2023-11-27T21:22:39.536435+0000","last_undegraded":"2023-11-27T21:22:39.536435+0000","last_fullsized":"2023-11-27T21:22:39.536435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'73","last_scrub_stamp":"2023-11-27T21:22:39.536306+0000","last_deep_scrub":"28'73","last_deep_scrub_stamp":"2023-11-27T21:22:39.536306+0000","last_clean_scrub_stamp":"2023-11-27T21:22:39.536306+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:15:26.032520+0000","scrub_duration":0.001632695,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'339","reported_seq":379,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:17.537795+0000","last_change":"2023-11-27T21:22:17.537795+0000","last_active":"2023-11-27T21:22:17.537795+0000","last_peered":"2023-11-27T21:22:17.537795+0000","last_clean":"2023-11-27T21:22:17.537795+0000","last_became_active":"2023-11-27T20:54:26.223717+0000","last_became_peered":"2023-11-27T20:54:26.223717+0000","last_unstale":"2023-11-27T21:22:17.537795+0000","last_undegraded":"2023-11-27T21:22:17.537795+0000","last_fullsized":"2023-11-27T21:22:17.537795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'339","last_scrub_stamp":"2023-11-27T21:22:17.537656+0000","last_deep_scrub":"28'339","last_deep_scrub_stamp":"2023-11-27T21:22:17.537656+0000","last_clean_scrub_stamp":"2023-11-27T21:22:17.537656+0000","objects_scrubbed":4,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:35:27.345606+0000","scrub_duration":0.0048066070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":333,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'146","reported_seq":182,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:31.285973+0000","last_change":"2023-11-27T21:22:31.285997+0000","last_active":"2023-11-27T21:22:31.285973+0000","last_peered":"2023-11-27T21:22:31.285973+0000","last_clean":"2023-11-27T21:22:31.285973+0000","last_became_active":"2023-11-27T20:54:31.836346+0000","last_became_peered":"2023-11-27T20:54:31.836346+0000","last_unstale":"2023-11-27T21:22:31.285973+0000","last_undegraded":"2023-11-27T21:22:31.285973+0000","last_fullsized":"2023-11-27T21:22:31.285973+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'146","last_scrub_stamp":"2023-11-27T21:22:31.285890+0000","last_deep_scrub":"28'146","last_deep_scrub_stamp":"2023-11-27T21:22:31.285890+0000","last_clean_scrub_stamp":"2023-11-27T21:22:31.285890+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:35:41.093841+0000","scrub_duration":0.0026461219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":6504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'66","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:18.554510+0000","last_change":"2023-11-27T21:22:18.554510+0000","last_active":"2023-11-27T21:22:18.554510+0000","last_peered":"2023-11-27T21:22:18.554510+0000","last_clean":"2023-11-27T21:22:18.554510+0000","last_became_active":"2023-11-27T20:54:27.493327+0000","last_became_peered":"2023-11-27T20:54:27.493327+0000","last_unstale":"2023-11-27T21:22:18.554510+0000","last_undegraded":"2023-11-27T21:22:18.554510+0000","last_fullsized":"2023-11-27T21:22:18.554510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'66","last_scrub_stamp":"2023-11-27T21:22:18.554433+0000","last_deep_scrub":"28'66","last_deep_scrub_stamp":"2023-11-27T21:22:18.554433+0000","last_clean_scrub_stamp":"2023-11-27T21:22:18.554433+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:39:55.933857+0000","scrub_duration":0.0016646670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"28'8","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.398392+0000","last_change":"2023-11-27T21:22:02.398392+0000","last_active":"2023-11-27T21:22:02.398392+0000","last_peered":"2023-11-27T21:22:02.398392+0000","last_clean":"2023-11-27T21:22:02.398392+0000","last_became_active":"2023-11-27T20:54:26.227120+0000","last_became_peered":"2023-11-27T20:54:26.227120+0000","last_unstale":"2023-11-27T21:22:02.398392+0000","last_undegraded":"2023-11-27T21:22:02.398392+0000","last_fullsized":"2023-11-27T21:22:02.398392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2023-11-27T21:22:02.398284+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2023-11-27T21:22:02.398284+0000","last_clean_scrub_stamp":"2023-11-27T21:22:02.398284+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:09:04.340440+0000","scrub_duration":0.00264496,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'197","reported_seq":242,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:46.762074+0000","last_change":"2023-11-27T21:22:46.762092+0000","last_active":"2023-11-27T21:22:46.762074+0000","last_peered":"2023-11-27T21:22:46.762074+0000","last_clean":"2023-11-27T21:22:46.762074+0000","last_became_active":"2023-11-27T20:55:01.286057+0000","last_became_peered":"2023-11-27T20:55:01.286057+0000","last_unstale":"2023-11-27T21:22:46.762074+0000","last_undegraded":"2023-11-27T21:22:46.762074+0000","last_fullsized":"2023-11-27T21:22:46.762074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'197","last_scrub_stamp":"2023-11-27T21:22:46.762011+0000","last_deep_scrub":"28'197","last_deep_scrub_stamp":"2023-11-27T21:22:46.762011+0000","last_clean_scrub_stamp":"2023-11-27T21:22:46.762011+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:05:20.380594+0000","scrub_duration":0.0026407079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":17829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5,7],"acting":[2,1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"28'63","reported_seq":102,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:04.544551+0000","last_change":"2023-11-27T21:22:04.544551+0000","last_active":"2023-11-27T21:22:04.544551+0000","last_peered":"2023-11-27T21:22:04.544551+0000","last_clean":"2023-11-27T21:22:04.544551+0000","last_became_active":"2023-11-27T20:54:27.510573+0000","last_became_peered":"2023-11-27T20:54:27.510573+0000","last_unstale":"2023-11-27T21:22:04.544551+0000","last_undegraded":"2023-11-27T21:22:04.544551+0000","last_fullsized":"2023-11-27T21:22:04.544551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'63","last_scrub_stamp":"2023-11-27T21:22:04.544471+0000","last_deep_scrub":"28'63","last_deep_scrub_stamp":"2023-11-27T21:22:04.544471+0000","last_clean_scrub_stamp":"2023-11-27T21:22:04.544471+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:57:01.291364+0000","scrub_duration":0.0011139559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'17","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:50.541112+0000","last_change":"2023-11-27T21:22:50.541155+0000","last_active":"2023-11-27T21:22:50.541112+0000","last_peered":"2023-11-27T21:22:50.541112+0000","last_clean":"2023-11-27T21:22:50.541112+0000","last_became_active":"2023-11-27T20:54:26.224412+0000","last_became_peered":"2023-11-27T20:54:26.224412+0000","last_unstale":"2023-11-27T21:22:50.541112+0000","last_undegraded":"2023-11-27T21:22:50.541112+0000","last_fullsized":"2023-11-27T21:22:50.541112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'17","last_scrub_stamp":"2023-11-27T21:22:50.541037+0000","last_deep_scrub":"28'17","last_deep_scrub_stamp":"2023-11-27T21:22:50.541037+0000","last_clean_scrub_stamp":"2023-11-27T21:22:50.541037+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:21:53.747491+0000","scrub_duration":0.003553072,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'174","reported_seq":211,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:24.777115+0000","last_change":"2023-11-27T21:22:24.777150+0000","last_active":"2023-11-27T21:22:24.777115+0000","last_peered":"2023-11-27T21:22:24.777115+0000","last_clean":"2023-11-27T21:22:24.777115+0000","last_became_active":"2023-11-27T20:54:31.819371+0000","last_became_peered":"2023-11-27T20:54:31.819371+0000","last_unstale":"2023-11-27T21:22:24.777115+0000","last_undegraded":"2023-11-27T21:22:24.777115+0000","last_fullsized":"2023-11-27T21:22:24.777115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'174","last_scrub_stamp":"2023-11-27T21:22:24.777034+0000","last_deep_scrub":"28'174","last_deep_scrub_stamp":"2023-11-27T21:22:24.777034+0000","last_clean_scrub_stamp":"2023-11-27T21:22:24.777034+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:57:18.687113+0000","scrub_duration":0.0029222290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":8398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"28'71","reported_seq":110,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:05.539610+0000","last_change":"2023-11-27T21:22:05.539610+0000","last_active":"2023-11-27T21:22:05.539610+0000","last_peered":"2023-11-27T21:22:05.539610+0000","last_clean":"2023-11-27T21:22:05.539610+0000","last_became_active":"2023-11-27T20:54:27.500455+0000","last_became_peered":"2023-11-27T20:54:27.500455+0000","last_unstale":"2023-11-27T21:22:05.539610+0000","last_undegraded":"2023-11-27T21:22:05.539610+0000","last_fullsized":"2023-11-27T21:22:05.539610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'71","last_scrub_stamp":"2023-11-27T21:22:05.539526+0000","last_deep_scrub":"28'71","last_deep_scrub_stamp":"2023-11-27T21:22:05.539526+0000","last_clean_scrub_stamp":"2023-11-27T21:22:05.539526+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:13:29.395135+0000","scrub_duration":0.001413643,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'163","reported_seq":203,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:14.476551+0000","last_change":"2023-11-27T21:22:14.476551+0000","last_active":"2023-11-27T21:22:14.476551+0000","last_peered":"2023-11-27T21:22:14.476551+0000","last_clean":"2023-11-27T21:22:14.476551+0000","last_became_active":"2023-11-27T20:54:26.222981+0000","last_became_peered":"2023-11-27T20:54:26.222981+0000","last_unstale":"2023-11-27T21:22:14.476551+0000","last_undegraded":"2023-11-27T21:22:14.476551+0000","last_fullsized":"2023-11-27T21:22:14.476551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'163","last_scrub_stamp":"2023-11-27T21:22:14.476461+0000","last_deep_scrub":"28'163","last_deep_scrub_stamp":"2023-11-27T21:22:14.476461+0000","last_clean_scrub_stamp":"2023-11-27T21:22:14.476461+0000","objects_scrubbed":4,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:08:10.937295+0000","scrub_duration":0.0035278750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":391,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"28'157","reported_seq":195,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:16.485011+0000","last_change":"2023-11-27T21:23:16.485068+0000","last_active":"2023-11-27T21:23:16.485011+0000","last_peered":"2023-11-27T21:23:16.485011+0000","last_clean":"2023-11-27T21:23:16.485011+0000","last_became_active":"2023-11-27T20:54:31.813765+0000","last_became_peered":"2023-11-27T20:54:31.813765+0000","last_unstale":"2023-11-27T21:23:16.485011+0000","last_undegraded":"2023-11-27T21:23:16.485011+0000","last_fullsized":"2023-11-27T21:23:16.485011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'157","last_scrub_stamp":"2023-11-27T21:23:16.484882+0000","last_deep_scrub":"28'157","last_deep_scrub_stamp":"2023-11-27T21:23:16.484882+0000","last_clean_scrub_stamp":"2023-11-27T21:23:16.484882+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:38:08.265429+0000","scrub_duration":0.0030121319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":11921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"28'78","reported_seq":117,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.165891+0000","last_change":"2023-11-27T21:22:21.165911+0000","last_active":"2023-11-27T21:22:21.165891+0000","last_peered":"2023-11-27T21:22:21.165891+0000","last_clean":"2023-11-27T21:22:21.165891+0000","last_became_active":"2023-11-27T20:54:27.506210+0000","last_became_peered":"2023-11-27T20:54:27.506210+0000","last_unstale":"2023-11-27T21:22:21.165891+0000","last_undegraded":"2023-11-27T21:22:21.165891+0000","last_fullsized":"2023-11-27T21:22:21.165891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'78","last_scrub_stamp":"2023-11-27T21:22:21.165807+0000","last_deep_scrub":"28'78","last_deep_scrub_stamp":"2023-11-27T21:22:21.165807+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.165807+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:48:07.689268+0000","scrub_duration":0.0012874189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'248","reported_seq":288,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:27.576119+0000","last_change":"2023-11-27T21:22:27.576142+0000","last_active":"2023-11-27T21:22:27.576119+0000","last_peered":"2023-11-27T21:22:27.576119+0000","last_clean":"2023-11-27T21:22:27.576119+0000","last_became_active":"2023-11-27T20:54:26.219775+0000","last_became_peered":"2023-11-27T20:54:26.219775+0000","last_unstale":"2023-11-27T21:22:27.576119+0000","last_undegraded":"2023-11-27T21:22:27.576119+0000","last_fullsized":"2023-11-27T21:22:27.576119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'248","last_scrub_stamp":"2023-11-27T21:22:27.576061+0000","last_deep_scrub":"28'248","last_deep_scrub_stamp":"2023-11-27T21:22:27.576061+0000","last_clean_scrub_stamp":"2023-11-27T21:22:27.576061+0000","objects_scrubbed":3,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:13:50.937641+0000","scrub_duration":0.004309823,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"28'177","reported_seq":214,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:30.072341+0000","last_change":"2023-11-27T21:22:30.072362+0000","last_active":"2023-11-27T21:22:30.072341+0000","last_peered":"2023-11-27T21:22:30.072341+0000","last_clean":"2023-11-27T21:22:30.072341+0000","last_became_active":"2023-11-27T20:54:31.825591+0000","last_became_peered":"2023-11-27T20:54:31.825591+0000","last_unstale":"2023-11-27T21:22:30.072341+0000","last_undegraded":"2023-11-27T21:22:30.072341+0000","last_fullsized":"2023-11-27T21:22:30.072341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'177","last_scrub_stamp":"2023-11-27T21:22:30.072272+0000","last_deep_scrub":"28'177","last_deep_scrub_stamp":"2023-11-27T21:22:30.072272+0000","last_clean_scrub_stamp":"2023-11-27T21:22:30.072272+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:48:50.193448+0000","scrub_duration":0.002828517,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":8135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"28'65","reported_seq":104,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:06.889843+0000","last_change":"2023-11-27T21:22:06.889864+0000","last_active":"2023-11-27T21:22:06.889843+0000","last_peered":"2023-11-27T21:22:06.889843+0000","last_clean":"2023-11-27T21:22:06.889843+0000","last_became_active":"2023-11-27T20:54:27.500677+0000","last_became_peered":"2023-11-27T20:54:27.500677+0000","last_unstale":"2023-11-27T21:22:06.889843+0000","last_undegraded":"2023-11-27T21:22:06.889843+0000","last_fullsized":"2023-11-27T21:22:06.889843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'65","last_scrub_stamp":"2023-11-27T21:22:06.889775+0000","last_deep_scrub":"28'65","last_deep_scrub_stamp":"2023-11-27T21:22:06.889775+0000","last_clean_scrub_stamp":"2023-11-27T21:22:06.889775+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:19:12.052405+0000","scrub_duration":0.0014482970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"28'6","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:26.399700+0000","last_change":"2023-11-27T21:22:26.399718+0000","last_active":"2023-11-27T21:22:26.399700+0000","last_peered":"2023-11-27T21:22:26.399700+0000","last_clean":"2023-11-27T21:22:26.399700+0000","last_became_active":"2023-11-27T20:54:26.227605+0000","last_became_peered":"2023-11-27T20:54:26.227605+0000","last_unstale":"2023-11-27T21:22:26.399700+0000","last_undegraded":"2023-11-27T21:22:26.399700+0000","last_fullsized":"2023-11-27T21:22:26.399700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2023-11-27T21:22:26.399642+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2023-11-27T21:22:26.399642+0000","last_clean_scrub_stamp":"2023-11-27T21:22:26.399642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:39:10.368439+0000","scrub_duration":0.0011058719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"28'178","reported_seq":215,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:27.137341+0000","last_change":"2023-11-27T21:22:27.137378+0000","last_active":"2023-11-27T21:22:27.137341+0000","last_peered":"2023-11-27T21:22:27.137341+0000","last_clean":"2023-11-27T21:22:27.137341+0000","last_became_active":"2023-11-27T20:54:31.826406+0000","last_became_peered":"2023-11-27T20:54:31.826406+0000","last_unstale":"2023-11-27T21:22:27.137341+0000","last_undegraded":"2023-11-27T21:22:27.137341+0000","last_fullsized":"2023-11-27T21:22:27.137341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'178","last_scrub_stamp":"2023-11-27T21:22:27.137245+0000","last_deep_scrub":"28'178","last_deep_scrub_stamp":"2023-11-27T21:22:27.137245+0000","last_clean_scrub_stamp":"2023-11-27T21:22:27.137245+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:57:21.047325+0000","scrub_duration":0.0027180899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":6957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"28'85","reported_seq":124,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:48.468746+0000","last_change":"2023-11-27T21:22:48.468768+0000","last_active":"2023-11-27T21:22:48.468746+0000","last_peered":"2023-11-27T21:22:48.468746+0000","last_clean":"2023-11-27T21:22:48.468746+0000","last_became_active":"2023-11-27T20:54:27.516686+0000","last_became_peered":"2023-11-27T20:54:27.516686+0000","last_unstale":"2023-11-27T21:22:48.468746+0000","last_undegraded":"2023-11-27T21:22:48.468746+0000","last_fullsized":"2023-11-27T21:22:48.468746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'85","last_scrub_stamp":"2023-11-27T21:22:48.468674+0000","last_deep_scrub":"28'85","last_deep_scrub_stamp":"2023-11-27T21:22:48.468674+0000","last_clean_scrub_stamp":"2023-11-27T21:22:48.468674+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:49:18.145204+0000","scrub_duration":0.0012105060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'918","reported_seq":958,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:23.574077+0000","last_change":"2023-11-27T21:22:23.574100+0000","last_active":"2023-11-27T21:22:23.574077+0000","last_peered":"2023-11-27T21:22:23.574077+0000","last_clean":"2023-11-27T21:22:23.574077+0000","last_became_active":"2023-11-27T20:54:26.229985+0000","last_became_peered":"2023-11-27T20:54:26.229985+0000","last_unstale":"2023-11-27T21:22:23.574077+0000","last_undegraded":"2023-11-27T21:22:23.574077+0000","last_fullsized":"2023-11-27T21:22:23.574077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'918","last_scrub_stamp":"2023-11-27T21:22:23.574017+0000","last_deep_scrub":"28'918","last_deep_scrub_stamp":"2023-11-27T21:22:23.574017+0000","last_clean_scrub_stamp":"2023-11-27T21:22:23.574017+0000","objects_scrubbed":3,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:34:39.196551+0000","scrub_duration":0.013397599,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206463,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":911,"num_write_kb":4580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"28'139","reported_seq":173,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:47.755242+0000","last_change":"2023-11-27T21:22:47.755262+0000","last_active":"2023-11-27T21:22:47.755242+0000","last_peered":"2023-11-27T21:22:47.755242+0000","last_clean":"2023-11-27T21:22:47.755242+0000","last_became_active":"2023-11-27T20:55:00.588018+0000","last_became_peered":"2023-11-27T20:55:00.588018+0000","last_unstale":"2023-11-27T21:22:47.755242+0000","last_undegraded":"2023-11-27T21:22:47.755242+0000","last_fullsized":"2023-11-27T21:22:47.755242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'139","last_scrub_stamp":"2023-11-27T21:22:47.755175+0000","last_deep_scrub":"28'139","last_deep_scrub_stamp":"2023-11-27T21:22:47.755175+0000","last_clean_scrub_stamp":"2023-11-27T21:22:47.755175+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:43.095816+0000","scrub_duration":0.003086409,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":13169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,0,3],"acting":[2,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'77","reported_seq":117,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:59.348680+0000","last_change":"2023-11-27T21:22:59.348724+0000","last_active":"2023-11-27T21:22:59.348680+0000","last_peered":"2023-11-27T21:22:59.348680+0000","last_clean":"2023-11-27T21:22:59.348680+0000","last_became_active":"2023-11-27T20:54:27.512093+0000","last_became_peered":"2023-11-27T20:54:27.512093+0000","last_unstale":"2023-11-27T21:22:59.348680+0000","last_undegraded":"2023-11-27T21:22:59.348680+0000","last_fullsized":"2023-11-27T21:22:59.348680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:59.348610+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:59.348610+0000","last_clean_scrub_stamp":"2023-11-27T21:22:59.348610+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:15:13.167920+0000","scrub_duration":0.001147002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'273","reported_seq":482,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:15.255928+0000","last_change":"2023-11-27T21:22:15.255951+0000","last_active":"2023-11-27T21:22:15.255928+0000","last_peered":"2023-11-27T21:22:15.255928+0000","last_clean":"2023-11-27T21:22:15.255928+0000","last_became_active":"2023-11-27T20:54:26.230548+0000","last_became_peered":"2023-11-27T20:54:26.230548+0000","last_unstale":"2023-11-27T21:22:15.255928+0000","last_undegraded":"2023-11-27T21:22:15.255928+0000","last_fullsized":"2023-11-27T21:22:15.255928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'273","last_scrub_stamp":"2023-11-27T21:22:15.255867+0000","last_deep_scrub":"28'273","last_deep_scrub_stamp":"2023-11-27T21:22:15.255867+0000","last_clean_scrub_stamp":"2023-11-27T21:22:15.255867+0000","objects_scrubbed":4,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:44:57.904993+0000","scrub_duration":0.003822022,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28446,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":170,"num_read_kb":173,"num_write":266,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"28'141","reported_seq":187,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:35.088318+0000","last_change":"2023-11-27T21:22:35.088318+0000","last_active":"2023-11-27T21:22:35.088318+0000","last_peered":"2023-11-27T21:22:35.088318+0000","last_clean":"2023-11-27T21:22:35.088318+0000","last_became_active":"2023-11-27T20:55:00.594705+0000","last_became_peered":"2023-11-27T20:55:00.594705+0000","last_unstale":"2023-11-27T21:22:35.088318+0000","last_undegraded":"2023-11-27T21:22:35.088318+0000","last_fullsized":"2023-11-27T21:22:35.088318+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'141","last_scrub_stamp":"2023-11-27T21:22:35.088216+0000","last_deep_scrub":"28'141","last_deep_scrub_stamp":"2023-11-27T21:22:35.088216+0000","last_clean_scrub_stamp":"2023-11-27T21:22:35.088216+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:06:09.356209+0000","scrub_duration":0.002816444,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":12035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"28'77","reported_seq":116,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:16.088541+0000","last_change":"2023-11-27T21:22:16.088562+0000","last_active":"2023-11-27T21:22:16.088541+0000","last_peered":"2023-11-27T21:22:16.088541+0000","last_clean":"2023-11-27T21:22:16.088541+0000","last_became_active":"2023-11-27T20:54:27.502941+0000","last_became_peered":"2023-11-27T20:54:27.502941+0000","last_unstale":"2023-11-27T21:22:16.088541+0000","last_undegraded":"2023-11-27T21:22:16.088541+0000","last_fullsized":"2023-11-27T21:22:16.088541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:16.088473+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:16.088473+0000","last_clean_scrub_stamp":"2023-11-27T21:22:16.088473+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:26:26.798459+0000","scrub_duration":0.001453584,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'12","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:44.601666+0000","last_change":"2023-11-27T21:22:44.601690+0000","last_active":"2023-11-27T21:22:44.601666+0000","last_peered":"2023-11-27T21:22:44.601666+0000","last_clean":"2023-11-27T21:22:44.601666+0000","last_became_active":"2023-11-27T20:54:26.214166+0000","last_became_peered":"2023-11-27T20:54:26.214166+0000","last_unstale":"2023-11-27T21:22:44.601666+0000","last_undegraded":"2023-11-27T21:22:44.601666+0000","last_fullsized":"2023-11-27T21:22:44.601666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2023-11-27T21:22:44.601613+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2023-11-27T21:22:44.601613+0000","last_clean_scrub_stamp":"2023-11-27T21:22:44.601613+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:37:36.382160+0000","scrub_duration":0.0026042959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"28'132","reported_seq":169,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:08.370422+0000","last_change":"2023-11-27T21:23:08.370442+0000","last_active":"2023-11-27T21:23:08.370422+0000","last_peered":"2023-11-27T21:23:08.370422+0000","last_clean":"2023-11-27T21:23:08.370422+0000","last_became_active":"2023-11-27T20:54:31.832196+0000","last_became_peered":"2023-11-27T20:54:31.832196+0000","last_unstale":"2023-11-27T21:23:08.370422+0000","last_undegraded":"2023-11-27T21:23:08.370422+0000","last_fullsized":"2023-11-27T21:23:08.370422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'132","last_scrub_stamp":"2023-11-27T21:23:08.370358+0000","last_deep_scrub":"28'132","last_deep_scrub_stamp":"2023-11-27T21:23:08.370358+0000","last_clean_scrub_stamp":"2023-11-27T21:23:08.370358+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:54:25.150426+0000","scrub_duration":0.0024136520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":8461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'69","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:00.632140+0000","last_change":"2023-11-27T21:23:00.632159+0000","last_active":"2023-11-27T21:23:00.632140+0000","last_peered":"2023-11-27T21:23:00.632140+0000","last_clean":"2023-11-27T21:23:00.632140+0000","last_became_active":"2023-11-27T20:54:27.433161+0000","last_became_peered":"2023-11-27T20:54:27.433161+0000","last_unstale":"2023-11-27T21:23:00.632140+0000","last_undegraded":"2023-11-27T21:23:00.632140+0000","last_fullsized":"2023-11-27T21:23:00.632140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'69","last_scrub_stamp":"2023-11-27T21:23:00.632077+0000","last_deep_scrub":"28'69","last_deep_scrub_stamp":"2023-11-27T21:23:00.632077+0000","last_clean_scrub_stamp":"2023-11-27T21:23:00.632077+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:09:39.733645+0000","scrub_duration":0.0012750789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'13","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:45.560157+0000","last_change":"2023-11-27T21:22:45.560181+0000","last_active":"2023-11-27T21:22:45.560157+0000","last_peered":"2023-11-27T21:22:45.560157+0000","last_clean":"2023-11-27T21:22:45.560157+0000","last_became_active":"2023-11-27T20:54:26.227133+0000","last_became_peered":"2023-11-27T20:54:26.227133+0000","last_unstale":"2023-11-27T21:22:45.560157+0000","last_undegraded":"2023-11-27T21:22:45.560157+0000","last_fullsized":"2023-11-27T21:22:45.560157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2023-11-27T21:22:45.560102+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2023-11-27T21:22:45.560102+0000","last_clean_scrub_stamp":"2023-11-27T21:22:45.560102+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:50:13.671235+0000","scrub_duration":0.0038425709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":195,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:03.333433+0000","last_change":"2023-11-27T21:22:03.333433+0000","last_active":"2023-11-27T21:22:03.333433+0000","last_peered":"2023-11-27T21:22:03.333433+0000","last_clean":"2023-11-27T21:22:03.333433+0000","last_became_active":"2023-11-27T20:54:11.452181+0000","last_became_peered":"2023-11-27T20:54:11.452181+0000","last_unstale":"2023-11-27T21:22:03.333433+0000","last_undegraded":"2023-11-27T21:22:03.333433+0000","last_fullsized":"2023-11-27T21:22:03.333433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2023-11-27T21:22:03.333356+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2023-11-27T21:22:03.333356+0000","last_clean_scrub_stamp":"2023-11-27T21:22:03.333356+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:51:11.809770+0000","scrub_duration":0.0045126749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'171","reported_seq":208,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:58.455643+0000","last_change":"2023-11-27T21:22:58.455677+0000","last_active":"2023-11-27T21:22:58.455643+0000","last_peered":"2023-11-27T21:22:58.455643+0000","last_clean":"2023-11-27T21:22:58.455643+0000","last_became_active":"2023-11-27T20:54:31.818048+0000","last_became_peered":"2023-11-27T20:54:31.818048+0000","last_unstale":"2023-11-27T21:22:58.455643+0000","last_undegraded":"2023-11-27T21:22:58.455643+0000","last_fullsized":"2023-11-27T21:22:58.455643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'171","last_scrub_stamp":"2023-11-27T21:22:58.455571+0000","last_deep_scrub":"28'171","last_deep_scrub_stamp":"2023-11-27T21:22:58.455571+0000","last_clean_scrub_stamp":"2023-11-27T21:22:58.455571+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:48:52.771160+0000","scrub_duration":0.0021714260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":10034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"28'75","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.521838+0000","last_change":"2023-11-27T21:22:02.521856+0000","last_active":"2023-11-27T21:22:02.521838+0000","last_peered":"2023-11-27T21:22:02.521838+0000","last_clean":"2023-11-27T21:22:02.521838+0000","last_became_active":"2023-11-27T20:54:27.493256+0000","last_became_peered":"2023-11-27T20:54:27.493256+0000","last_unstale":"2023-11-27T21:22:02.521838+0000","last_undegraded":"2023-11-27T21:22:02.521838+0000","last_fullsized":"2023-11-27T21:22:02.521838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:02.521779+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:02.521779+0000","last_clean_scrub_stamp":"2023-11-27T21:22:02.521779+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:35:12.329730+0000","scrub_duration":0.0011699499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'1021","reported_seq":1060,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:09.046981+0000","last_change":"2023-11-27T21:22:09.047006+0000","last_active":"2023-11-27T21:22:09.046981+0000","last_peered":"2023-11-27T21:22:09.046981+0000","last_clean":"2023-11-27T21:22:09.046981+0000","last_became_active":"2023-11-27T20:54:26.229796+0000","last_became_peered":"2023-11-27T20:54:26.229796+0000","last_unstale":"2023-11-27T21:22:09.046981+0000","last_undegraded":"2023-11-27T21:22:09.046981+0000","last_fullsized":"2023-11-27T21:22:09.046981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1021","last_scrub_stamp":"2023-11-27T21:22:09.046925+0000","last_deep_scrub":"28'1021","last_deep_scrub_stamp":"2023-11-27T21:22:09.046925+0000","last_clean_scrub_stamp":"2023-11-27T21:22:09.046925+0000","objects_scrubbed":3,"log_size":1021,"log_dups_size":0,"ondisk_log_size":1021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:11.549792+0000","scrub_duration":0.012870006999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1013,"num_write_kb":4611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'180","reported_seq":217,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:34.732400+0000","last_change":"2023-11-27T21:22:34.732400+0000","last_active":"2023-11-27T21:22:34.732400+0000","last_peered":"2023-11-27T21:22:34.732400+0000","last_clean":"2023-11-27T21:22:34.732400+0000","last_became_active":"2023-11-27T20:54:31.825080+0000","last_became_peered":"2023-11-27T20:54:31.825080+0000","last_unstale":"2023-11-27T21:22:34.732400+0000","last_undegraded":"2023-11-27T21:22:34.732400+0000","last_fullsized":"2023-11-27T21:22:34.732400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'180","last_scrub_stamp":"2023-11-27T21:22:34.732270+0000","last_deep_scrub":"28'180","last_deep_scrub_stamp":"2023-11-27T21:22:34.732270+0000","last_clean_scrub_stamp":"2023-11-27T21:22:34.732270+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:57.356294+0000","scrub_duration":0.0029486389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":9643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'78","reported_seq":101,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.769377+0000","last_change":"2023-11-27T20:55:00.593751+0000","last_active":"2023-11-27T21:22:02.769377+0000","last_peered":"2023-11-27T21:22:02.769377+0000","last_clean":"2023-11-27T21:22:02.769377+0000","last_became_active":"2023-11-27T20:55:00.593249+0000","last_became_peered":"2023-11-27T20:55:00.593249+0000","last_unstale":"2023-11-27T21:22:02.769377+0000","last_undegraded":"2023-11-27T21:22:02.769377+0000","last_fullsized":"2023-11-27T21:22:02.769377+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:54:26.086709+0000","last_clean_scrub_stamp":"2023-11-27T20:54:26.086709+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"28'438","reported_seq":477,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:25.368474+0000","last_change":"2023-11-27T21:22:25.368503+0000","last_active":"2023-11-27T21:22:25.368474+0000","last_peered":"2023-11-27T21:22:25.368474+0000","last_clean":"2023-11-27T21:22:25.368474+0000","last_became_active":"2023-11-27T20:54:26.225886+0000","last_became_peered":"2023-11-27T20:54:26.225886+0000","last_unstale":"2023-11-27T21:22:25.368474+0000","last_undegraded":"2023-11-27T21:22:25.368474+0000","last_fullsized":"2023-11-27T21:22:25.368474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'438","last_scrub_stamp":"2023-11-27T21:22:25.368401+0000","last_deep_scrub":"28'438","last_deep_scrub_stamp":"2023-11-27T21:22:25.368401+0000","last_clean_scrub_stamp":"2023-11-27T21:22:25.368401+0000","objects_scrubbed":2,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:38:39.549160+0000","scrub_duration":0.0081653509999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2473984,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":2660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"28'169","reported_seq":205,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:05.310659+0000","last_change":"2023-11-27T21:23:05.310680+0000","last_active":"2023-11-27T21:23:05.310659+0000","last_peered":"2023-11-27T21:23:05.310659+0000","last_clean":"2023-11-27T21:23:05.310659+0000","last_became_active":"2023-11-27T20:54:31.828368+0000","last_became_peered":"2023-11-27T20:54:31.828368+0000","last_unstale":"2023-11-27T21:23:05.310659+0000","last_undegraded":"2023-11-27T21:23:05.310659+0000","last_fullsized":"2023-11-27T21:23:05.310659+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'169","last_scrub_stamp":"2023-11-27T21:23:05.310589+0000","last_deep_scrub":"28'169","last_deep_scrub_stamp":"2023-11-27T21:23:05.310589+0000","last_clean_scrub_stamp":"2023-11-27T21:23:05.310589+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:59.291860+0000","scrub_duration":0.0026402109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":8527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"28'75","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:39.327209+0000","last_change":"2023-11-27T21:22:39.327230+0000","last_active":"2023-11-27T21:22:39.327209+0000","last_peered":"2023-11-27T21:22:39.327209+0000","last_clean":"2023-11-27T21:22:39.327209+0000","last_became_active":"2023-11-27T20:54:27.515416+0000","last_became_peered":"2023-11-27T20:54:27.515416+0000","last_unstale":"2023-11-27T21:22:39.327209+0000","last_undegraded":"2023-11-27T21:22:39.327209+0000","last_fullsized":"2023-11-27T21:22:39.327209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:39.327132+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:39.327132+0000","last_clean_scrub_stamp":"2023-11-27T21:22:39.327132+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:54:09.127655+0000","scrub_duration":0.001546927,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"28'10","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:36.534862+0000","last_change":"2023-11-27T21:22:36.534919+0000","last_active":"2023-11-27T21:22:36.534862+0000","last_peered":"2023-11-27T21:22:36.534862+0000","last_clean":"2023-11-27T21:22:36.534862+0000","last_became_active":"2023-11-27T20:54:26.224604+0000","last_became_peered":"2023-11-27T20:54:26.224604+0000","last_unstale":"2023-11-27T21:22:36.534862+0000","last_undegraded":"2023-11-27T21:22:36.534862+0000","last_fullsized":"2023-11-27T21:22:36.534862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2023-11-27T21:22:36.534769+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2023-11-27T21:22:36.534769+0000","last_clean_scrub_stamp":"2023-11-27T21:22:36.534769+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:16:44.164481+0000","scrub_duration":0.0029681949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"28'149","reported_seq":186,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:05.434287+0000","last_change":"2023-11-27T21:23:05.434311+0000","last_active":"2023-11-27T21:23:05.434287+0000","last_peered":"2023-11-27T21:23:05.434287+0000","last_clean":"2023-11-27T21:23:05.434287+0000","last_became_active":"2023-11-27T20:54:31.819294+0000","last_became_peered":"2023-11-27T20:54:31.819294+0000","last_unstale":"2023-11-27T21:23:05.434287+0000","last_undegraded":"2023-11-27T21:23:05.434287+0000","last_fullsized":"2023-11-27T21:23:05.434287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'149","last_scrub_stamp":"2023-11-27T21:23:05.434207+0000","last_deep_scrub":"28'149","last_deep_scrub_stamp":"2023-11-27T21:23:05.434207+0000","last_clean_scrub_stamp":"2023-11-27T21:23:05.434207+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:53:30.526364+0000","scrub_duration":0.0026221619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"28'77","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:19.747454+0000","last_change":"2023-11-27T21:22:19.747472+0000","last_active":"2023-11-27T21:22:19.747454+0000","last_peered":"2023-11-27T21:22:19.747454+0000","last_clean":"2023-11-27T21:22:19.747454+0000","last_became_active":"2023-11-27T20:54:27.512663+0000","last_became_peered":"2023-11-27T20:54:27.512663+0000","last_unstale":"2023-11-27T21:22:19.747454+0000","last_undegraded":"2023-11-27T21:22:19.747454+0000","last_fullsized":"2023-11-27T21:22:19.747454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:19.747391+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:19.747391+0000","last_clean_scrub_stamp":"2023-11-27T21:22:19.747391+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:18.401292+0000","scrub_duration":0.0011077389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"28'240","reported_seq":279,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:07.317223+0000","last_change":"2023-11-27T21:22:07.317246+0000","last_active":"2023-11-27T21:22:07.317223+0000","last_peered":"2023-11-27T21:22:07.317223+0000","last_clean":"2023-11-27T21:22:07.317223+0000","last_became_active":"2023-11-27T20:54:26.225056+0000","last_became_peered":"2023-11-27T20:54:26.225056+0000","last_unstale":"2023-11-27T21:22:07.317223+0000","last_undegraded":"2023-11-27T21:22:07.317223+0000","last_fullsized":"2023-11-27T21:22:07.317223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'240","last_scrub_stamp":"2023-11-27T21:22:07.317149+0000","last_deep_scrub":"28'240","last_deep_scrub_stamp":"2023-11-27T21:22:07.317149+0000","last_clean_scrub_stamp":"2023-11-27T21:22:07.317149+0000","objects_scrubbed":2,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:41:09.468592+0000","scrub_duration":0.0039936490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"28'126","reported_seq":163,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:27.495544+0000","last_change":"2023-11-27T21:22:27.495544+0000","last_active":"2023-11-27T21:22:27.495544+0000","last_peered":"2023-11-27T21:22:27.495544+0000","last_clean":"2023-11-27T21:22:27.495544+0000","last_became_active":"2023-11-27T20:54:31.827175+0000","last_became_peered":"2023-11-27T20:54:31.827175+0000","last_unstale":"2023-11-27T21:22:27.495544+0000","last_undegraded":"2023-11-27T21:22:27.495544+0000","last_fullsized":"2023-11-27T21:22:27.495544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'126","last_scrub_stamp":"2023-11-27T21:22:27.495457+0000","last_deep_scrub":"28'126","last_deep_scrub_stamp":"2023-11-27T21:22:27.495457+0000","last_clean_scrub_stamp":"2023-11-27T21:22:27.495457+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:41:29.646900+0000","scrub_duration":0.0023736809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":7629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"28'69","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:09.572831+0000","last_change":"2023-11-27T21:22:09.572831+0000","last_active":"2023-11-27T21:22:09.572831+0000","last_peered":"2023-11-27T21:22:09.572831+0000","last_clean":"2023-11-27T21:22:09.572831+0000","last_became_active":"2023-11-27T20:54:27.498225+0000","last_became_peered":"2023-11-27T20:54:27.498225+0000","last_unstale":"2023-11-27T21:22:09.572831+0000","last_undegraded":"2023-11-27T21:22:09.572831+0000","last_fullsized":"2023-11-27T21:22:09.572831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'69","last_scrub_stamp":"2023-11-27T21:22:09.572724+0000","last_deep_scrub":"28'69","last_deep_scrub_stamp":"2023-11-27T21:22:09.572724+0000","last_clean_scrub_stamp":"2023-11-27T21:22:09.572724+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:13:34.348448+0000","scrub_duration":0.0016942400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'1037","reported_seq":1076,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:11.556868+0000","last_change":"2023-11-27T21:22:11.556868+0000","last_active":"2023-11-27T21:22:11.556868+0000","last_peered":"2023-11-27T21:22:11.556868+0000","last_clean":"2023-11-27T21:22:11.556868+0000","last_became_active":"2023-11-27T20:54:26.225333+0000","last_became_peered":"2023-11-27T20:54:26.225333+0000","last_unstale":"2023-11-27T21:22:11.556868+0000","last_undegraded":"2023-11-27T21:22:11.556868+0000","last_fullsized":"2023-11-27T21:22:11.556868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1037","last_scrub_stamp":"2023-11-27T21:22:11.556754+0000","last_deep_scrub":"28'1037","last_deep_scrub_stamp":"2023-11-27T21:22:11.556754+0000","last_clean_scrub_stamp":"2023-11-27T21:22:11.556754+0000","objects_scrubbed":9,"log_size":1037,"log_dups_size":0,"ondisk_log_size":1037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:14:01.901896+0000","scrub_duration":0.014520241999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3313963,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1025,"num_write_kb":3921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"28'159","reported_seq":194,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:11.372798+0000","last_change":"2023-11-27T21:23:11.372845+0000","last_active":"2023-11-27T21:23:11.372798+0000","last_peered":"2023-11-27T21:23:11.372798+0000","last_clean":"2023-11-27T21:23:11.372798+0000","last_became_active":"2023-11-27T20:54:31.835629+0000","last_became_peered":"2023-11-27T20:54:31.835629+0000","last_unstale":"2023-11-27T21:23:11.372798+0000","last_undegraded":"2023-11-27T21:23:11.372798+0000","last_fullsized":"2023-11-27T21:23:11.372798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'159","last_scrub_stamp":"2023-11-27T21:23:11.372700+0000","last_deep_scrub":"28'159","last_deep_scrub_stamp":"2023-11-27T21:23:11.372700+0000","last_clean_scrub_stamp":"2023-11-27T21:23:11.372700+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:43:31.453747+0000","scrub_duration":0.002592568,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":12674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'64","reported_seq":101,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:10.205669+0000","last_change":"2023-11-27T21:22:10.205669+0000","last_active":"2023-11-27T21:22:10.205669+0000","last_peered":"2023-11-27T21:22:10.205669+0000","last_clean":"2023-11-27T21:22:10.205669+0000","last_became_active":"2023-11-27T20:54:27.510775+0000","last_became_peered":"2023-11-27T20:54:27.510775+0000","last_unstale":"2023-11-27T21:22:10.205669+0000","last_undegraded":"2023-11-27T21:22:10.205669+0000","last_fullsized":"2023-11-27T21:22:10.205669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'64","last_scrub_stamp":"2023-11-27T21:22:10.205582+0000","last_deep_scrub":"28'64","last_deep_scrub_stamp":"2023-11-27T21:22:10.205582+0000","last_clean_scrub_stamp":"2023-11-27T21:22:10.205582+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:12:43.950689+0000","scrub_duration":0.001792397,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"28'1191","reported_seq":1230,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:15.427644+0000","last_change":"2023-11-27T21:22:15.427644+0000","last_active":"2023-11-27T21:22:15.427644+0000","last_peered":"2023-11-27T21:22:15.427644+0000","last_clean":"2023-11-27T21:22:15.427644+0000","last_became_active":"2023-11-27T20:54:26.226745+0000","last_became_peered":"2023-11-27T20:54:26.226745+0000","last_unstale":"2023-11-27T21:22:15.427644+0000","last_undegraded":"2023-11-27T21:22:15.427644+0000","last_fullsized":"2023-11-27T21:22:15.427644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1191","last_scrub_stamp":"2023-11-27T21:22:15.427568+0000","last_deep_scrub":"28'1191","last_deep_scrub_stamp":"2023-11-27T21:22:15.427568+0000","last_clean_scrub_stamp":"2023-11-27T21:22:15.427568+0000","objects_scrubbed":3,"log_size":1191,"log_dups_size":0,"ondisk_log_size":1191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:47:37.149646+0000","scrub_duration":0.012877517,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":4695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"28'169","reported_seq":204,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:07.327420+0000","last_change":"2023-11-27T21:23:07.327443+0000","last_active":"2023-11-27T21:23:07.327420+0000","last_peered":"2023-11-27T21:23:07.327420+0000","last_clean":"2023-11-27T21:23:07.327420+0000","last_became_active":"2023-11-27T20:54:31.831620+0000","last_became_peered":"2023-11-27T20:54:31.831620+0000","last_unstale":"2023-11-27T21:23:07.327420+0000","last_undegraded":"2023-11-27T21:23:07.327420+0000","last_fullsized":"2023-11-27T21:23:07.327420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'169","last_scrub_stamp":"2023-11-27T21:23:07.327345+0000","last_deep_scrub":"28'169","last_deep_scrub_stamp":"2023-11-27T21:23:07.327345+0000","last_clean_scrub_stamp":"2023-11-27T21:23:07.327345+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:05:45.528727+0000","scrub_duration":0.0023055969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":13064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'85","reported_seq":123,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:05.528522+0000","last_change":"2023-11-27T21:22:05.528522+0000","last_active":"2023-11-27T21:22:05.528522+0000","last_peered":"2023-11-27T21:22:05.528522+0000","last_clean":"2023-11-27T21:22:05.528522+0000","last_became_active":"2023-11-27T20:54:27.515524+0000","last_became_peered":"2023-11-27T20:54:27.515524+0000","last_unstale":"2023-11-27T21:22:05.528522+0000","last_undegraded":"2023-11-27T21:22:05.528522+0000","last_fullsized":"2023-11-27T21:22:05.528522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'85","last_scrub_stamp":"2023-11-27T21:22:05.528395+0000","last_deep_scrub":"28'85","last_deep_scrub_stamp":"2023-11-27T21:22:05.528395+0000","last_clean_scrub_stamp":"2023-11-27T21:22:05.528395+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:01:39.543628+0000","scrub_duration":0.0014329239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'245","reported_seq":284,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:49.515716+0000","last_change":"2023-11-27T21:22:49.515740+0000","last_active":"2023-11-27T21:22:49.515716+0000","last_peered":"2023-11-27T21:22:49.515716+0000","last_clean":"2023-11-27T21:22:49.515716+0000","last_became_active":"2023-11-27T20:54:26.225691+0000","last_became_peered":"2023-11-27T20:54:26.225691+0000","last_unstale":"2023-11-27T21:22:49.515716+0000","last_undegraded":"2023-11-27T21:22:49.515716+0000","last_fullsized":"2023-11-27T21:22:49.515716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'245","last_scrub_stamp":"2023-11-27T21:22:49.515658+0000","last_deep_scrub":"28'245","last_deep_scrub_stamp":"2023-11-27T21:22:49.515658+0000","last_clean_scrub_stamp":"2023-11-27T21:22:49.515658+0000","objects_scrubbed":3,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:36:26.863877+0000","scrub_duration":0.003801076,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":236,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"28'150","reported_seq":186,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:31.069109+0000","last_change":"2023-11-27T21:22:31.069109+0000","last_active":"2023-11-27T21:22:31.069109+0000","last_peered":"2023-11-27T21:22:31.069109+0000","last_clean":"2023-11-27T21:22:31.069109+0000","last_became_active":"2023-11-27T20:54:31.826669+0000","last_became_peered":"2023-11-27T20:54:31.826669+0000","last_unstale":"2023-11-27T21:22:31.069109+0000","last_undegraded":"2023-11-27T21:22:31.069109+0000","last_fullsized":"2023-11-27T21:22:31.069109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'150","last_scrub_stamp":"2023-11-27T21:22:31.068996+0000","last_deep_scrub":"28'150","last_deep_scrub_stamp":"2023-11-27T21:22:31.068996+0000","last_clean_scrub_stamp":"2023-11-27T21:22:31.068996+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:53.693019+0000","scrub_duration":0.003059254,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":7432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"28'77","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:17.078803+0000","last_change":"2023-11-27T21:22:17.078803+0000","last_active":"2023-11-27T21:22:17.078803+0000","last_peered":"2023-11-27T21:22:17.078803+0000","last_clean":"2023-11-27T21:22:17.078803+0000","last_became_active":"2023-11-27T20:54:27.502677+0000","last_became_peered":"2023-11-27T20:54:27.502677+0000","last_unstale":"2023-11-27T21:22:17.078803+0000","last_undegraded":"2023-11-27T21:22:17.078803+0000","last_fullsized":"2023-11-27T21:22:17.078803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:17.078722+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:17.078722+0000","last_clean_scrub_stamp":"2023-11-27T21:22:17.078722+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:59:13.020180+0000","scrub_duration":0.00165175,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'332","reported_seq":684,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:05.423669+0000","last_change":"2023-11-27T21:22:05.423669+0000","last_active":"2023-11-27T21:22:05.423669+0000","last_peered":"2023-11-27T21:22:05.423669+0000","last_clean":"2023-11-27T21:22:05.423669+0000","last_became_active":"2023-11-27T20:54:26.227911+0000","last_became_peered":"2023-11-27T20:54:26.227911+0000","last_unstale":"2023-11-27T21:22:05.423669+0000","last_undegraded":"2023-11-27T21:22:05.423669+0000","last_fullsized":"2023-11-27T21:22:05.423669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'332","last_scrub_stamp":"2023-11-27T21:22:05.423586+0000","last_deep_scrub":"28'332","last_deep_scrub_stamp":"2023-11-27T21:22:05.423586+0000","last_clean_scrub_stamp":"2023-11-27T21:22:05.423586+0000","objects_scrubbed":7,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:36:33.071011+0000","scrub_duration":0.0045666969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53552,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":314,"num_read_kb":325,"num_write":327,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'174","reported_seq":209,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:59.437159+0000","last_change":"2023-11-27T21:22:59.437179+0000","last_active":"2023-11-27T21:22:59.437159+0000","last_peered":"2023-11-27T21:22:59.437159+0000","last_clean":"2023-11-27T21:22:59.437159+0000","last_became_active":"2023-11-27T20:54:31.827785+0000","last_became_peered":"2023-11-27T20:54:31.827785+0000","last_unstale":"2023-11-27T21:22:59.437159+0000","last_undegraded":"2023-11-27T21:22:59.437159+0000","last_fullsized":"2023-11-27T21:22:59.437159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'174","last_scrub_stamp":"2023-11-27T21:22:59.437092+0000","last_deep_scrub":"28'174","last_deep_scrub_stamp":"2023-11-27T21:22:59.437092+0000","last_clean_scrub_stamp":"2023-11-27T21:22:59.437092+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:55:18.896366+0000","scrub_duration":0.0024566380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":11290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'75","reported_seq":112,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:32.375542+0000","last_change":"2023-11-27T21:22:32.375562+0000","last_active":"2023-11-27T21:22:32.375542+0000","last_peered":"2023-11-27T21:22:32.375542+0000","last_clean":"2023-11-27T21:22:32.375542+0000","last_became_active":"2023-11-27T20:54:27.513655+0000","last_became_peered":"2023-11-27T20:54:27.513655+0000","last_unstale":"2023-11-27T21:22:32.375542+0000","last_undegraded":"2023-11-27T21:22:32.375542+0000","last_fullsized":"2023-11-27T21:22:32.375542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:32.375477+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:32.375477+0000","last_clean_scrub_stamp":"2023-11-27T21:22:32.375477+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:48:52.496653+0000","scrub_duration":0.0020109640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'1487","reported_seq":1526,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.911976+0000","last_change":"2023-11-27T21:22:02.911976+0000","last_active":"2023-11-27T21:22:02.911976+0000","last_peered":"2023-11-27T21:22:02.911976+0000","last_clean":"2023-11-27T21:22:02.911976+0000","last_became_active":"2023-11-27T20:54:26.230570+0000","last_became_peered":"2023-11-27T20:54:26.230570+0000","last_unstale":"2023-11-27T21:22:02.911976+0000","last_undegraded":"2023-11-27T21:22:02.911976+0000","last_fullsized":"2023-11-27T21:22:02.911976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1487","last_scrub_stamp":"2023-11-27T21:22:02.911868+0000","last_deep_scrub":"28'1487","last_deep_scrub_stamp":"2023-11-27T21:22:02.911868+0000","last_clean_scrub_stamp":"2023-11-27T21:22:02.911868+0000","objects_scrubbed":6,"log_size":1487,"log_dups_size":0,"ondisk_log_size":1487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:31:23.266746+0000","scrub_duration":0.017648026000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1482,"num_write_kb":4539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"28'155","reported_seq":191,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:03.606574+0000","last_change":"2023-11-27T21:23:03.606595+0000","last_active":"2023-11-27T21:23:03.606574+0000","last_peered":"2023-11-27T21:23:03.606574+0000","last_clean":"2023-11-27T21:23:03.606574+0000","last_became_active":"2023-11-27T20:54:31.827872+0000","last_became_peered":"2023-11-27T20:54:31.827872+0000","last_unstale":"2023-11-27T21:23:03.606574+0000","last_undegraded":"2023-11-27T21:23:03.606574+0000","last_fullsized":"2023-11-27T21:23:03.606574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'155","last_scrub_stamp":"2023-11-27T21:23:03.606510+0000","last_deep_scrub":"28'155","last_deep_scrub_stamp":"2023-11-27T21:23:03.606510+0000","last_clean_scrub_stamp":"2023-11-27T21:23:03.606510+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:55:39.168893+0000","scrub_duration":0.0024572700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":8855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'67","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.567411+0000","last_change":"2023-11-27T21:22:21.567411+0000","last_active":"2023-11-27T21:22:21.567411+0000","last_peered":"2023-11-27T21:22:21.567411+0000","last_clean":"2023-11-27T21:22:21.567411+0000","last_became_active":"2023-11-27T20:54:27.493257+0000","last_became_peered":"2023-11-27T20:54:27.493257+0000","last_unstale":"2023-11-27T21:22:21.567411+0000","last_undegraded":"2023-11-27T21:22:21.567411+0000","last_fullsized":"2023-11-27T21:22:21.567411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'67","last_scrub_stamp":"2023-11-27T21:22:21.567332+0000","last_deep_scrub":"28'67","last_deep_scrub_stamp":"2023-11-27T21:22:21.567332+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.567332+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:36:06.913352+0000","scrub_duration":0.00118578,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'152","reported_seq":189,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:06.402443+0000","last_change":"2023-11-27T21:22:06.402467+0000","last_active":"2023-11-27T21:22:06.402443+0000","last_peered":"2023-11-27T21:22:06.402443+0000","last_clean":"2023-11-27T21:22:06.402443+0000","last_became_active":"2023-11-27T20:54:26.230963+0000","last_became_peered":"2023-11-27T20:54:26.230963+0000","last_unstale":"2023-11-27T21:22:06.402443+0000","last_undegraded":"2023-11-27T21:22:06.402443+0000","last_fullsized":"2023-11-27T21:22:06.402443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'152","last_scrub_stamp":"2023-11-27T21:22:06.402381+0000","last_deep_scrub":"28'152","last_deep_scrub_stamp":"2023-11-27T21:22:06.402381+0000","last_clean_scrub_stamp":"2023-11-27T21:22:06.402381+0000","objects_scrubbed":4,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:06:17.621457+0000","scrub_duration":0.0033124059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"28'195","reported_seq":235,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:40.656772+0000","last_change":"2023-11-27T21:22:40.656797+0000","last_active":"2023-11-27T21:22:40.656772+0000","last_peered":"2023-11-27T21:22:40.656772+0000","last_clean":"2023-11-27T21:22:40.656772+0000","last_became_active":"2023-11-27T20:54:31.825038+0000","last_became_peered":"2023-11-27T20:54:31.825038+0000","last_unstale":"2023-11-27T21:22:40.656772+0000","last_undegraded":"2023-11-27T21:22:40.656772+0000","last_fullsized":"2023-11-27T21:22:40.656772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'195","last_scrub_stamp":"2023-11-27T21:22:40.656695+0000","last_deep_scrub":"28'195","last_deep_scrub_stamp":"2023-11-27T21:22:40.656695+0000","last_clean_scrub_stamp":"2023-11-27T21:22:40.656695+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:54:10.457218+0000","scrub_duration":0.0031266419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":102,"num_write":164,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"28'89","reported_seq":126,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:06.407272+0000","last_change":"2023-11-27T21:22:06.407291+0000","last_active":"2023-11-27T21:22:06.407272+0000","last_peered":"2023-11-27T21:22:06.407272+0000","last_clean":"2023-11-27T21:22:06.407272+0000","last_became_active":"2023-11-27T20:54:27.507805+0000","last_became_peered":"2023-11-27T20:54:27.507805+0000","last_unstale":"2023-11-27T21:22:06.407272+0000","last_undegraded":"2023-11-27T21:22:06.407272+0000","last_fullsized":"2023-11-27T21:22:06.407272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'89","last_scrub_stamp":"2023-11-27T21:22:06.407212+0000","last_deep_scrub":"28'89","last_deep_scrub_stamp":"2023-11-27T21:22:06.407212+0000","last_clean_scrub_stamp":"2023-11-27T21:22:06.407212+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:16:55.047816+0000","scrub_duration":0.0014892390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'331","reported_seq":687,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:10.331795+0000","last_change":"2023-11-27T21:22:10.331834+0000","last_active":"2023-11-27T21:22:10.331795+0000","last_peered":"2023-11-27T21:22:10.331795+0000","last_clean":"2023-11-27T21:22:10.331795+0000","last_became_active":"2023-11-27T20:54:26.226679+0000","last_became_peered":"2023-11-27T20:54:26.226679+0000","last_unstale":"2023-11-27T21:22:10.331795+0000","last_undegraded":"2023-11-27T21:22:10.331795+0000","last_fullsized":"2023-11-27T21:22:10.331795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'331","last_scrub_stamp":"2023-11-27T21:22:10.331701+0000","last_deep_scrub":"28'331","last_deep_scrub_stamp":"2023-11-27T21:22:10.331701+0000","last_clean_scrub_stamp":"2023-11-27T21:22:10.331701+0000","objects_scrubbed":3,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:57:26.919946+0000","scrub_duration":0.0033883049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53032,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":318,"num_read_kb":327,"num_write":324,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"28'159","reported_seq":195,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:34.234760+0000","last_change":"2023-11-27T21:22:34.234783+0000","last_active":"2023-11-27T21:22:34.234760+0000","last_peered":"2023-11-27T21:22:34.234760+0000","last_clean":"2023-11-27T21:22:34.234760+0000","last_became_active":"2023-11-27T20:54:31.834569+0000","last_became_peered":"2023-11-27T20:54:31.834569+0000","last_unstale":"2023-11-27T21:22:34.234760+0000","last_undegraded":"2023-11-27T21:22:34.234760+0000","last_fullsized":"2023-11-27T21:22:34.234760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'159","last_scrub_stamp":"2023-11-27T21:22:34.234686+0000","last_deep_scrub":"28'159","last_deep_scrub_stamp":"2023-11-27T21:22:34.234686+0000","last_clean_scrub_stamp":"2023-11-27T21:22:34.234686+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:03:33.554205+0000","scrub_duration":0.0028385089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":7865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'79","reported_seq":116,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:11.809904+0000","last_change":"2023-11-27T21:22:11.809924+0000","last_active":"2023-11-27T21:22:11.809904+0000","last_peered":"2023-11-27T21:22:11.809904+0000","last_clean":"2023-11-27T21:22:11.809904+0000","last_became_active":"2023-11-27T20:54:27.498535+0000","last_became_peered":"2023-11-27T20:54:27.498535+0000","last_unstale":"2023-11-27T21:22:11.809904+0000","last_undegraded":"2023-11-27T21:22:11.809904+0000","last_fullsized":"2023-11-27T21:22:11.809904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'79","last_scrub_stamp":"2023-11-27T21:22:11.809828+0000","last_deep_scrub":"28'79","last_deep_scrub_stamp":"2023-11-27T21:22:11.809828+0000","last_clean_scrub_stamp":"2023-11-27T21:22:11.809828+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:02.660027+0000","scrub_duration":0.001141268,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'177","reported_seq":214,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:04.284387+0000","last_change":"2023-11-27T21:22:04.284409+0000","last_active":"2023-11-27T21:22:04.284387+0000","last_peered":"2023-11-27T21:22:04.284387+0000","last_clean":"2023-11-27T21:22:04.284387+0000","last_became_active":"2023-11-27T20:54:26.227878+0000","last_became_peered":"2023-11-27T20:54:26.227878+0000","last_unstale":"2023-11-27T21:22:04.284387+0000","last_undegraded":"2023-11-27T21:22:04.284387+0000","last_fullsized":"2023-11-27T21:22:04.284387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'177","last_scrub_stamp":"2023-11-27T21:22:04.284332+0000","last_deep_scrub":"28'177","last_deep_scrub_stamp":"2023-11-27T21:22:04.284332+0000","last_clean_scrub_stamp":"2023-11-27T21:22:04.284332+0000","objects_scrubbed":3,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:46:32.962705+0000","scrub_duration":0.0029821639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'104","reported_seq":140,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:05.547800+0000","last_change":"2023-11-27T21:23:05.547821+0000","last_active":"2023-11-27T21:23:05.547800+0000","last_peered":"2023-11-27T21:23:05.547800+0000","last_clean":"2023-11-27T21:23:05.547800+0000","last_became_active":"2023-11-27T20:54:31.824914+0000","last_became_peered":"2023-11-27T20:54:31.824914+0000","last_unstale":"2023-11-27T21:23:05.547800+0000","last_undegraded":"2023-11-27T21:23:05.547800+0000","last_fullsized":"2023-11-27T21:23:05.547800+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'104","last_scrub_stamp":"2023-11-27T21:23:05.547734+0000","last_deep_scrub":"28'104","last_deep_scrub_stamp":"2023-11-27T21:23:05.547734+0000","last_clean_scrub_stamp":"2023-11-27T21:23:05.547734+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:44.467269+0000","scrub_duration":0.002317146,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":7715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"28'152","reported_seq":190,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:12.544122+0000","last_change":"2023-11-27T21:23:12.544144+0000","last_active":"2023-11-27T21:23:12.544122+0000","last_peered":"2023-11-27T21:23:12.544122+0000","last_clean":"2023-11-27T21:23:12.544122+0000","last_became_active":"2023-11-27T20:54:31.827971+0000","last_became_peered":"2023-11-27T20:54:31.827971+0000","last_unstale":"2023-11-27T21:23:12.544122+0000","last_undegraded":"2023-11-27T21:23:12.544122+0000","last_fullsized":"2023-11-27T21:23:12.544122+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'152","last_scrub_stamp":"2023-11-27T21:23:12.544053+0000","last_deep_scrub":"28'152","last_deep_scrub_stamp":"2023-11-27T21:23:12.544053+0000","last_clean_scrub_stamp":"2023-11-27T21:23:12.544053+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:00:35.431060+0000","scrub_duration":0.002940668,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":9456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"28'80","reported_seq":117,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:37.569804+0000","last_change":"2023-11-27T21:22:37.569827+0000","last_active":"2023-11-27T21:22:37.569804+0000","last_peered":"2023-11-27T21:22:37.569804+0000","last_clean":"2023-11-27T21:22:37.569804+0000","last_became_active":"2023-11-27T20:54:27.434635+0000","last_became_peered":"2023-11-27T20:54:27.434635+0000","last_unstale":"2023-11-27T21:22:37.569804+0000","last_undegraded":"2023-11-27T21:22:37.569804+0000","last_fullsized":"2023-11-27T21:22:37.569804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'80","last_scrub_stamp":"2023-11-27T21:22:37.569720+0000","last_deep_scrub":"28'80","last_deep_scrub_stamp":"2023-11-27T21:22:37.569720+0000","last_clean_scrub_stamp":"2023-11-27T21:22:37.569720+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:31:12.846837+0000","scrub_duration":0.0021142689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'7","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:24.573595+0000","last_change":"2023-11-27T21:22:24.573621+0000","last_active":"2023-11-27T21:22:24.573595+0000","last_peered":"2023-11-27T21:22:24.573595+0000","last_clean":"2023-11-27T21:22:24.573595+0000","last_became_active":"2023-11-27T20:54:26.224502+0000","last_became_peered":"2023-11-27T20:54:26.224502+0000","last_unstale":"2023-11-27T21:22:24.573595+0000","last_undegraded":"2023-11-27T21:22:24.573595+0000","last_fullsized":"2023-11-27T21:22:24.573595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2023-11-27T21:22:24.573521+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2023-11-27T21:22:24.573521+0000","last_clean_scrub_stamp":"2023-11-27T21:22:24.573521+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:05:05.366117+0000","scrub_duration":0.0025318630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"28'177","reported_seq":214,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:06.470851+0000","last_change":"2023-11-27T21:23:06.470871+0000","last_active":"2023-11-27T21:23:06.470851+0000","last_peered":"2023-11-27T21:23:06.470851+0000","last_clean":"2023-11-27T21:23:06.470851+0000","last_became_active":"2023-11-27T20:54:31.826790+0000","last_became_peered":"2023-11-27T20:54:31.826790+0000","last_unstale":"2023-11-27T21:23:06.470851+0000","last_undegraded":"2023-11-27T21:23:06.470851+0000","last_fullsized":"2023-11-27T21:23:06.470851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'177","last_scrub_stamp":"2023-11-27T21:23:06.470790+0000","last_deep_scrub":"28'177","last_deep_scrub_stamp":"2023-11-27T21:23:06.470790+0000","last_clean_scrub_stamp":"2023-11-27T21:23:06.470790+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:34:10.962193+0000","scrub_duration":0.0023431469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":15468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'77","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:13.303814+0000","last_change":"2023-11-27T21:22:13.303840+0000","last_active":"2023-11-27T21:22:13.303814+0000","last_peered":"2023-11-27T21:22:13.303814+0000","last_clean":"2023-11-27T21:22:13.303814+0000","last_became_active":"2023-11-27T20:54:27.507698+0000","last_became_peered":"2023-11-27T20:54:27.507698+0000","last_unstale":"2023-11-27T21:22:13.303814+0000","last_undegraded":"2023-11-27T21:22:13.303814+0000","last_fullsized":"2023-11-27T21:22:13.303814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:13.303735+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:13.303735+0000","last_clean_scrub_stamp":"2023-11-27T21:22:13.303735+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:40:38.746430+0000","scrub_duration":0.001443277,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'425","reported_seq":876,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:08.025932+0000","last_change":"2023-11-27T21:22:08.025955+0000","last_active":"2023-11-27T21:22:08.025932+0000","last_peered":"2023-11-27T21:22:08.025932+0000","last_clean":"2023-11-27T21:22:08.025932+0000","last_became_active":"2023-11-27T20:54:26.229725+0000","last_became_peered":"2023-11-27T20:54:26.229725+0000","last_unstale":"2023-11-27T21:22:08.025932+0000","last_undegraded":"2023-11-27T21:22:08.025932+0000","last_fullsized":"2023-11-27T21:22:08.025932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'425","last_scrub_stamp":"2023-11-27T21:22:08.025875+0000","last_deep_scrub":"28'425","last_deep_scrub_stamp":"2023-11-27T21:22:08.025875+0000","last_clean_scrub_stamp":"2023-11-27T21:22:08.025875+0000","objects_scrubbed":3,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:31:28.380754+0000","scrub_duration":0.0038756979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":413,"num_read_kb":420,"num_write":418,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'473","reported_seq":969,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:40.726895+0000","last_change":"2023-11-27T21:22:40.726930+0000","last_active":"2023-11-27T21:22:40.726895+0000","last_peered":"2023-11-27T21:22:40.726895+0000","last_clean":"2023-11-27T21:22:40.726895+0000","last_became_active":"2023-11-27T20:54:26.221715+0000","last_became_peered":"2023-11-27T20:54:26.221715+0000","last_unstale":"2023-11-27T21:22:40.726895+0000","last_undegraded":"2023-11-27T21:22:40.726895+0000","last_fullsized":"2023-11-27T21:22:40.726895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'473","last_scrub_stamp":"2023-11-27T21:22:40.726814+0000","last_deep_scrub":"28'473","last_deep_scrub_stamp":"2023-11-27T21:22:40.726814+0000","last_clean_scrub_stamp":"2023-11-27T21:22:40.726814+0000","objects_scrubbed":4,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:47:25.931117+0000","scrub_duration":0.0047592770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70496,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":458,"num_read_kb":466,"num_write":467,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'78","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:55.598552+0000","last_change":"2023-11-27T21:22:55.598572+0000","last_active":"2023-11-27T21:22:55.598552+0000","last_peered":"2023-11-27T21:22:55.598552+0000","last_clean":"2023-11-27T21:22:55.598552+0000","last_became_active":"2023-11-27T20:54:27.516887+0000","last_became_peered":"2023-11-27T20:54:27.516887+0000","last_unstale":"2023-11-27T21:22:55.598552+0000","last_undegraded":"2023-11-27T21:22:55.598552+0000","last_fullsized":"2023-11-27T21:22:55.598552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'78","last_scrub_stamp":"2023-11-27T21:22:55.598489+0000","last_deep_scrub":"28'78","last_deep_scrub_stamp":"2023-11-27T21:22:55.598489+0000","last_clean_scrub_stamp":"2023-11-27T21:22:55.598489+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:17:44.354934+0000","scrub_duration":0.0014136470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'144","reported_seq":179,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:13.493955+0000","last_change":"2023-11-27T21:23:13.493975+0000","last_active":"2023-11-27T21:23:13.493955+0000","last_peered":"2023-11-27T21:23:13.493955+0000","last_clean":"2023-11-27T21:23:13.493955+0000","last_became_active":"2023-11-27T20:54:31.827395+0000","last_became_peered":"2023-11-27T20:54:31.827395+0000","last_unstale":"2023-11-27T21:23:13.493955+0000","last_undegraded":"2023-11-27T21:23:13.493955+0000","last_fullsized":"2023-11-27T21:23:13.493955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'144","last_scrub_stamp":"2023-11-27T21:23:13.493887+0000","last_deep_scrub":"28'144","last_deep_scrub_stamp":"2023-11-27T21:23:13.493887+0000","last_clean_scrub_stamp":"2023-11-27T21:23:13.493887+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:06:49.230158+0000","scrub_duration":0.0022645339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":4976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'2872","reported_seq":2910,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:31.493285+0000","last_change":"2023-11-27T21:22:31.493337+0000","last_active":"2023-11-27T21:22:31.493285+0000","last_peered":"2023-11-27T21:22:31.493285+0000","last_clean":"2023-11-27T21:22:31.493285+0000","last_became_active":"2023-11-27T20:54:26.227713+0000","last_became_peered":"2023-11-27T20:54:26.227713+0000","last_unstale":"2023-11-27T21:22:31.493285+0000","last_undegraded":"2023-11-27T21:22:31.493285+0000","last_fullsized":"2023-11-27T21:22:31.493285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2872","last_scrub_stamp":"2023-11-27T21:22:31.493188+0000","last_deep_scrub":"28'2872","last_deep_scrub_stamp":"2023-11-27T21:22:31.493188+0000","last_clean_scrub_stamp":"2023-11-27T21:22:31.493188+0000","objects_scrubbed":4,"log_size":2872,"log_dups_size":0,"ondisk_log_size":2872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:48:51.614364+0000","scrub_duration":0.037435849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12113008,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2860,"num_write_kb":13160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"28'94","reported_seq":130,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:12.266321+0000","last_change":"2023-11-27T21:22:12.266341+0000","last_active":"2023-11-27T21:22:12.266321+0000","last_peered":"2023-11-27T21:22:12.266321+0000","last_clean":"2023-11-27T21:22:12.266321+0000","last_became_active":"2023-11-27T20:54:27.506119+0000","last_became_peered":"2023-11-27T20:54:27.506119+0000","last_unstale":"2023-11-27T21:22:12.266321+0000","last_undegraded":"2023-11-27T21:22:12.266321+0000","last_fullsized":"2023-11-27T21:22:12.266321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'94","last_scrub_stamp":"2023-11-27T21:22:12.266264+0000","last_deep_scrub":"28'94","last_deep_scrub_stamp":"2023-11-27T21:22:12.266264+0000","last_clean_scrub_stamp":"2023-11-27T21:22:12.266264+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:50:27.905791+0000","scrub_duration":0.001360986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"28'135","reported_seq":170,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:33.278803+0000","last_change":"2023-11-27T21:22:33.278826+0000","last_active":"2023-11-27T21:22:33.278803+0000","last_peered":"2023-11-27T21:22:33.278803+0000","last_clean":"2023-11-27T21:22:33.278803+0000","last_became_active":"2023-11-27T20:54:31.832813+0000","last_became_peered":"2023-11-27T20:54:31.832813+0000","last_unstale":"2023-11-27T21:22:33.278803+0000","last_undegraded":"2023-11-27T21:22:33.278803+0000","last_fullsized":"2023-11-27T21:22:33.278803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'135","last_scrub_stamp":"2023-11-27T21:22:33.278716+0000","last_deep_scrub":"28'135","last_deep_scrub_stamp":"2023-11-27T21:22:33.278716+0000","last_clean_scrub_stamp":"2023-11-27T21:22:33.278716+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:03:14.787780+0000","scrub_duration":0.0030595430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'74","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:03.899170+0000","last_change":"2023-11-27T21:22:03.899204+0000","last_active":"2023-11-27T21:22:03.899170+0000","last_peered":"2023-11-27T21:22:03.899170+0000","last_clean":"2023-11-27T21:22:03.899170+0000","last_became_active":"2023-11-27T20:54:27.500394+0000","last_became_peered":"2023-11-27T20:54:27.500394+0000","last_unstale":"2023-11-27T21:22:03.899170+0000","last_undegraded":"2023-11-27T21:22:03.899170+0000","last_fullsized":"2023-11-27T21:22:03.899170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'74","last_scrub_stamp":"2023-11-27T21:22:03.899101+0000","last_deep_scrub":"28'74","last_deep_scrub_stamp":"2023-11-27T21:22:03.899101+0000","last_clean_scrub_stamp":"2023-11-27T21:22:03.899101+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:06.401969+0000","scrub_duration":0.0013881010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"28'91","reported_seq":129,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:19.289312+0000","last_change":"2023-11-27T21:22:19.289337+0000","last_active":"2023-11-27T21:22:19.289312+0000","last_peered":"2023-11-27T21:22:19.289312+0000","last_clean":"2023-11-27T21:22:19.289312+0000","last_became_active":"2023-11-27T20:54:27.515173+0000","last_became_peered":"2023-11-27T20:54:27.515173+0000","last_unstale":"2023-11-27T21:22:19.289312+0000","last_undegraded":"2023-11-27T21:22:19.289312+0000","last_fullsized":"2023-11-27T21:22:19.289312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'91","last_scrub_stamp":"2023-11-27T21:22:19.289226+0000","last_deep_scrub":"28'91","last_deep_scrub_stamp":"2023-11-27T21:22:19.289226+0000","last_clean_scrub_stamp":"2023-11-27T21:22:19.289226+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:57:16.036118+0000","scrub_duration":0.0015204750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"28'79","reported_seq":118,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:53.534571+0000","last_change":"2023-11-27T21:22:53.534589+0000","last_active":"2023-11-27T21:22:53.534571+0000","last_peered":"2023-11-27T21:22:53.534571+0000","last_clean":"2023-11-27T21:22:53.534571+0000","last_became_active":"2023-11-27T20:54:27.506112+0000","last_became_peered":"2023-11-27T20:54:27.506112+0000","last_unstale":"2023-11-27T21:22:53.534571+0000","last_undegraded":"2023-11-27T21:22:53.534571+0000","last_fullsized":"2023-11-27T21:22:53.534571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'79","last_scrub_stamp":"2023-11-27T21:22:53.534507+0000","last_deep_scrub":"28'79","last_deep_scrub_stamp":"2023-11-27T21:22:53.534507+0000","last_clean_scrub_stamp":"2023-11-27T21:22:53.534507+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:16:12.287715+0000","scrub_duration":0.00155865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'73","reported_seq":112,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:15.272647+0000","last_change":"2023-11-27T21:22:15.272669+0000","last_active":"2023-11-27T21:22:15.272647+0000","last_peered":"2023-11-27T21:22:15.272647+0000","last_clean":"2023-11-27T21:22:15.272647+0000","last_became_active":"2023-11-27T20:54:27.510532+0000","last_became_peered":"2023-11-27T20:54:27.510532+0000","last_unstale":"2023-11-27T21:22:15.272647+0000","last_undegraded":"2023-11-27T21:22:15.272647+0000","last_fullsized":"2023-11-27T21:22:15.272647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'73","last_scrub_stamp":"2023-11-27T21:22:15.272584+0000","last_deep_scrub":"28'73","last_deep_scrub_stamp":"2023-11-27T21:22:15.272584+0000","last_clean_scrub_stamp":"2023-11-27T21:22:15.272584+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:23:33.117651+0000","scrub_duration":0.0013038769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"28'58","reported_seq":97,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:24.138340+0000","last_change":"2023-11-27T21:22:24.138340+0000","last_active":"2023-11-27T21:22:24.138340+0000","last_peered":"2023-11-27T21:22:24.138340+0000","last_clean":"2023-11-27T21:22:24.138340+0000","last_became_active":"2023-11-27T20:54:27.513517+0000","last_became_peered":"2023-11-27T20:54:27.513517+0000","last_unstale":"2023-11-27T21:22:24.138340+0000","last_undegraded":"2023-11-27T21:22:24.138340+0000","last_fullsized":"2023-11-27T21:22:24.138340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'58","last_scrub_stamp":"2023-11-27T21:22:24.138248+0000","last_deep_scrub":"28'58","last_deep_scrub_stamp":"2023-11-27T21:22:24.138248+0000","last_clean_scrub_stamp":"2023-11-27T21:22:24.138248+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:38.431656+0000","scrub_duration":0.001948988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'78","reported_seq":117,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:25.136381+0000","last_change":"2023-11-27T21:22:25.136381+0000","last_active":"2023-11-27T21:22:25.136381+0000","last_peered":"2023-11-27T21:22:25.136381+0000","last_clean":"2023-11-27T21:22:25.136381+0000","last_became_active":"2023-11-27T20:54:27.511559+0000","last_became_peered":"2023-11-27T20:54:27.511559+0000","last_unstale":"2023-11-27T21:22:25.136381+0000","last_undegraded":"2023-11-27T21:22:25.136381+0000","last_fullsized":"2023-11-27T21:22:25.136381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'78","last_scrub_stamp":"2023-11-27T21:22:25.136275+0000","last_deep_scrub":"28'78","last_deep_scrub_stamp":"2023-11-27T21:22:25.136275+0000","last_clean_scrub_stamp":"2023-11-27T21:22:25.136275+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:39:09.105072+0000","scrub_duration":0.0013808659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"28'75","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:07.894649+0000","last_change":"2023-11-27T21:22:07.894649+0000","last_active":"2023-11-27T21:22:07.894649+0000","last_peered":"2023-11-27T21:22:07.894649+0000","last_clean":"2023-11-27T21:22:07.894649+0000","last_became_active":"2023-11-27T20:54:27.499323+0000","last_became_peered":"2023-11-27T20:54:27.499323+0000","last_unstale":"2023-11-27T21:22:07.894649+0000","last_undegraded":"2023-11-27T21:22:07.894649+0000","last_fullsized":"2023-11-27T21:22:07.894649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:07.894529+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:07.894529+0000","last_clean_scrub_stamp":"2023-11-27T21:22:07.894529+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:40:33.337225+0000","scrub_duration":0.001236841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"28'64","reported_seq":103,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:58.299289+0000","last_change":"2023-11-27T21:22:58.299309+0000","last_active":"2023-11-27T21:22:58.299289+0000","last_peered":"2023-11-27T21:22:58.299289+0000","last_clean":"2023-11-27T21:22:58.299289+0000","last_became_active":"2023-11-27T20:54:27.508615+0000","last_became_peered":"2023-11-27T20:54:27.508615+0000","last_unstale":"2023-11-27T21:22:58.299289+0000","last_undegraded":"2023-11-27T21:22:58.299289+0000","last_fullsized":"2023-11-27T21:22:58.299289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'64","last_scrub_stamp":"2023-11-27T21:22:58.299224+0000","last_deep_scrub":"28'64","last_deep_scrub_stamp":"2023-11-27T21:22:58.299224+0000","last_clean_scrub_stamp":"2023-11-27T21:22:58.299224+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:58:28.149758+0000","scrub_duration":0.0015916179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'78","reported_seq":117,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:11.622552+0000","last_change":"2023-11-27T21:22:11.622552+0000","last_active":"2023-11-27T21:22:11.622552+0000","last_peered":"2023-11-27T21:22:11.622552+0000","last_clean":"2023-11-27T21:22:11.622552+0000","last_became_active":"2023-11-27T20:54:27.510647+0000","last_became_peered":"2023-11-27T20:54:27.510647+0000","last_unstale":"2023-11-27T21:22:11.622552+0000","last_undegraded":"2023-11-27T21:22:11.622552+0000","last_fullsized":"2023-11-27T21:22:11.622552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'78","last_scrub_stamp":"2023-11-27T21:22:11.622453+0000","last_deep_scrub":"28'78","last_deep_scrub_stamp":"2023-11-27T21:22:11.622453+0000","last_clean_scrub_stamp":"2023-11-27T21:22:11.622453+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:16:19.252165+0000","scrub_duration":0.0016600790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"28'92","reported_seq":130,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:42.284848+0000","last_change":"2023-11-27T21:22:42.284869+0000","last_active":"2023-11-27T21:22:42.284848+0000","last_peered":"2023-11-27T21:22:42.284848+0000","last_clean":"2023-11-27T21:22:42.284848+0000","last_became_active":"2023-11-27T20:54:27.508360+0000","last_became_peered":"2023-11-27T20:54:27.508360+0000","last_unstale":"2023-11-27T21:22:42.284848+0000","last_undegraded":"2023-11-27T21:22:42.284848+0000","last_fullsized":"2023-11-27T21:22:42.284848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'92","last_scrub_stamp":"2023-11-27T21:22:42.284775+0000","last_deep_scrub":"28'92","last_deep_scrub_stamp":"2023-11-27T21:22:42.284775+0000","last_clean_scrub_stamp":"2023-11-27T21:22:42.284775+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:06:16.552768+0000","scrub_duration":0.0016812800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"28'87","reported_seq":124,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.447734+0000","last_change":"2023-11-27T21:22:21.447755+0000","last_active":"2023-11-27T21:22:21.447734+0000","last_peered":"2023-11-27T21:22:21.447734+0000","last_clean":"2023-11-27T21:22:21.447734+0000","last_became_active":"2023-11-27T20:54:27.513105+0000","last_became_peered":"2023-11-27T20:54:27.513105+0000","last_unstale":"2023-11-27T21:22:21.447734+0000","last_undegraded":"2023-11-27T21:22:21.447734+0000","last_fullsized":"2023-11-27T21:22:21.447734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'87","last_scrub_stamp":"2023-11-27T21:22:21.447667+0000","last_deep_scrub":"28'87","last_deep_scrub_stamp":"2023-11-27T21:22:21.447667+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.447667+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:48.413351+0000","scrub_duration":0.001278429,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"28'77","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:44.548617+0000","last_change":"2023-11-27T21:22:44.548636+0000","last_active":"2023-11-27T21:22:44.548617+0000","last_peered":"2023-11-27T21:22:44.548617+0000","last_clean":"2023-11-27T21:22:44.548617+0000","last_became_active":"2023-11-27T20:54:27.433179+0000","last_became_peered":"2023-11-27T20:54:27.433179+0000","last_unstale":"2023-11-27T21:22:44.548617+0000","last_undegraded":"2023-11-27T21:22:44.548617+0000","last_fullsized":"2023-11-27T21:22:44.548617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:44.548559+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:44.548559+0000","last_clean_scrub_stamp":"2023-11-27T21:22:44.548559+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:27:07.329368+0000","scrub_duration":0.0014271970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'75","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:27.380380+0000","last_change":"2023-11-27T21:22:27.380399+0000","last_active":"2023-11-27T21:22:27.380380+0000","last_peered":"2023-11-27T21:22:27.380380+0000","last_clean":"2023-11-27T21:22:27.380380+0000","last_became_active":"2023-11-27T20:54:27.515068+0000","last_became_peered":"2023-11-27T20:54:27.515068+0000","last_unstale":"2023-11-27T21:22:27.380380+0000","last_undegraded":"2023-11-27T21:22:27.380380+0000","last_fullsized":"2023-11-27T21:22:27.380380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:27.380315+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:27.380315+0000","last_clean_scrub_stamp":"2023-11-27T21:22:27.380315+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:39:11.349112+0000","scrub_duration":0.0012371560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"28'86","reported_seq":124,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:15.519346+0000","last_change":"2023-11-27T21:22:15.519379+0000","last_active":"2023-11-27T21:22:15.519346+0000","last_peered":"2023-11-27T21:22:15.519346+0000","last_clean":"2023-11-27T21:22:15.519346+0000","last_became_active":"2023-11-27T20:54:27.498306+0000","last_became_peered":"2023-11-27T20:54:27.498306+0000","last_unstale":"2023-11-27T21:22:15.519346+0000","last_undegraded":"2023-11-27T21:22:15.519346+0000","last_fullsized":"2023-11-27T21:22:15.519346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'86","last_scrub_stamp":"2023-11-27T21:22:15.519229+0000","last_deep_scrub":"28'86","last_deep_scrub_stamp":"2023-11-27T21:22:15.519229+0000","last_clean_scrub_stamp":"2023-11-27T21:22:15.519229+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:50.796346+0000","scrub_duration":0.0016617979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'91","reported_seq":128,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:26.319123+0000","last_change":"2023-11-27T21:22:26.319123+0000","last_active":"2023-11-27T21:22:26.319123+0000","last_peered":"2023-11-27T21:22:26.319123+0000","last_clean":"2023-11-27T21:22:26.319123+0000","last_became_active":"2023-11-27T20:54:27.512897+0000","last_became_peered":"2023-11-27T20:54:27.512897+0000","last_unstale":"2023-11-27T21:22:26.319123+0000","last_undegraded":"2023-11-27T21:22:26.319123+0000","last_fullsized":"2023-11-27T21:22:26.319123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'91","last_scrub_stamp":"2023-11-27T21:22:26.319005+0000","last_deep_scrub":"28'91","last_deep_scrub_stamp":"2023-11-27T21:22:26.319005+0000","last_clean_scrub_stamp":"2023-11-27T21:22:26.319005+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:15.398244+0000","scrub_duration":0.0013480289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"28'67","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:16.542687+0000","last_change":"2023-11-27T21:22:16.542687+0000","last_active":"2023-11-27T21:22:16.542687+0000","last_peered":"2023-11-27T21:22:16.542687+0000","last_clean":"2023-11-27T21:22:16.542687+0000","last_became_active":"2023-11-27T20:54:27.514946+0000","last_became_peered":"2023-11-27T20:54:27.514946+0000","last_unstale":"2023-11-27T21:22:16.542687+0000","last_undegraded":"2023-11-27T21:22:16.542687+0000","last_fullsized":"2023-11-27T21:22:16.542687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'67","last_scrub_stamp":"2023-11-27T21:22:16.542611+0000","last_deep_scrub":"28'67","last_deep_scrub_stamp":"2023-11-27T21:22:16.542611+0000","last_clean_scrub_stamp":"2023-11-27T21:22:16.542611+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:43:30.443626+0000","scrub_duration":0.0014583510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"28'80","reported_seq":118,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:22.523993+0000","last_change":"2023-11-27T21:22:22.523993+0000","last_active":"2023-11-27T21:22:22.523993+0000","last_peered":"2023-11-27T21:22:22.523993+0000","last_clean":"2023-11-27T21:22:22.523993+0000","last_became_active":"2023-11-27T20:54:27.493297+0000","last_became_peered":"2023-11-27T20:54:27.493297+0000","last_unstale":"2023-11-27T21:22:22.523993+0000","last_undegraded":"2023-11-27T21:22:22.523993+0000","last_fullsized":"2023-11-27T21:22:22.523993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'80","last_scrub_stamp":"2023-11-27T21:22:22.523857+0000","last_deep_scrub":"28'80","last_deep_scrub_stamp":"2023-11-27T21:22:22.523857+0000","last_clean_scrub_stamp":"2023-11-27T21:22:22.523857+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:17:11.280303+0000","scrub_duration":0.001213053,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"28'75","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:44.285666+0000","last_change":"2023-11-27T21:22:44.285689+0000","last_active":"2023-11-27T21:22:44.285666+0000","last_peered":"2023-11-27T21:22:44.285666+0000","last_clean":"2023-11-27T21:22:44.285666+0000","last_became_active":"2023-11-27T20:54:27.512662+0000","last_became_peered":"2023-11-27T20:54:27.512662+0000","last_unstale":"2023-11-27T21:22:44.285666+0000","last_undegraded":"2023-11-27T21:22:44.285666+0000","last_fullsized":"2023-11-27T21:22:44.285666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:44.285586+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:44.285586+0000","last_clean_scrub_stamp":"2023-11-27T21:22:44.285586+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:13:02.644103+0000","scrub_duration":0.0017812570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'70","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:14.123478+0000","last_change":"2023-11-27T21:22:14.123478+0000","last_active":"2023-11-27T21:22:14.123478+0000","last_peered":"2023-11-27T21:22:14.123478+0000","last_clean":"2023-11-27T21:22:14.123478+0000","last_became_active":"2023-11-27T20:54:27.512124+0000","last_became_peered":"2023-11-27T20:54:27.512124+0000","last_unstale":"2023-11-27T21:22:14.123478+0000","last_undegraded":"2023-11-27T21:22:14.123478+0000","last_fullsized":"2023-11-27T21:22:14.123478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'70","last_scrub_stamp":"2023-11-27T21:22:14.123330+0000","last_deep_scrub":"28'70","last_deep_scrub_stamp":"2023-11-27T21:22:14.123330+0000","last_clean_scrub_stamp":"2023-11-27T21:22:14.123330+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:17:02.763935+0000","scrub_duration":0.0016588200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"28'82","reported_seq":119,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:22.174123+0000","last_change":"2023-11-27T21:22:22.174144+0000","last_active":"2023-11-27T21:22:22.174123+0000","last_peered":"2023-11-27T21:22:22.174123+0000","last_clean":"2023-11-27T21:22:22.174123+0000","last_became_active":"2023-11-27T20:54:27.516907+0000","last_became_peered":"2023-11-27T20:54:27.516907+0000","last_unstale":"2023-11-27T21:22:22.174123+0000","last_undegraded":"2023-11-27T21:22:22.174123+0000","last_fullsized":"2023-11-27T21:22:22.174123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'82","last_scrub_stamp":"2023-11-27T21:22:22.174050+0000","last_deep_scrub":"28'82","last_deep_scrub_stamp":"2023-11-27T21:22:22.174050+0000","last_clean_scrub_stamp":"2023-11-27T21:22:22.174050+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:58:51.653006+0000","scrub_duration":0.0015457279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'68","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:29.387344+0000","last_change":"2023-11-27T21:22:29.387384+0000","last_active":"2023-11-27T21:22:29.387344+0000","last_peered":"2023-11-27T21:22:29.387344+0000","last_clean":"2023-11-27T21:22:29.387344+0000","last_became_active":"2023-11-27T20:54:27.515182+0000","last_became_peered":"2023-11-27T20:54:27.515182+0000","last_unstale":"2023-11-27T21:22:29.387344+0000","last_undegraded":"2023-11-27T21:22:29.387344+0000","last_fullsized":"2023-11-27T21:22:29.387344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'68","last_scrub_stamp":"2023-11-27T21:22:29.387232+0000","last_deep_scrub":"28'68","last_deep_scrub_stamp":"2023-11-27T21:22:29.387232+0000","last_clean_scrub_stamp":"2023-11-27T21:22:29.387232+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:57:23.297311+0000","scrub_duration":0.001412979,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'79","reported_seq":109,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:39.384082+0000","last_change":"2023-11-27T21:22:39.384105+0000","last_active":"2023-11-27T21:22:39.384082+0000","last_peered":"2023-11-27T21:22:39.384082+0000","last_clean":"2023-11-27T21:22:39.384082+0000","last_became_active":"2023-11-27T20:55:00.588298+0000","last_became_peered":"2023-11-27T20:55:00.588298+0000","last_unstale":"2023-11-27T21:22:39.384082+0000","last_undegraded":"2023-11-27T21:22:39.384082+0000","last_fullsized":"2023-11-27T21:22:39.384082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'79","last_scrub_stamp":"2023-11-27T21:22:39.384006+0000","last_deep_scrub":"28'79","last_deep_scrub_stamp":"2023-11-27T21:22:39.384006+0000","last_clean_scrub_stamp":"2023-11-27T21:22:39.384006+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:16:47.013718+0000","scrub_duration":0.001936828,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'77","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:26.381531+0000","last_change":"2023-11-27T21:22:26.381549+0000","last_active":"2023-11-27T21:22:26.381531+0000","last_peered":"2023-11-27T21:22:26.381531+0000","last_clean":"2023-11-27T21:22:26.381531+0000","last_became_active":"2023-11-27T20:54:27.512692+0000","last_became_peered":"2023-11-27T20:54:27.512692+0000","last_unstale":"2023-11-27T21:22:26.381531+0000","last_undegraded":"2023-11-27T21:22:26.381531+0000","last_fullsized":"2023-11-27T21:22:26.381531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:26.381465+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:26.381465+0000","last_clean_scrub_stamp":"2023-11-27T21:22:26.381465+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:38:40.562224+0000","scrub_duration":0.0012122050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"28'75","reported_seq":111,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:23.471759+0000","last_change":"2023-11-27T21:22:23.471793+0000","last_active":"2023-11-27T21:22:23.471759+0000","last_peered":"2023-11-27T21:22:23.471759+0000","last_clean":"2023-11-27T21:22:23.471759+0000","last_became_active":"2023-11-27T20:54:27.498790+0000","last_became_peered":"2023-11-27T20:54:27.498790+0000","last_unstale":"2023-11-27T21:22:23.471759+0000","last_undegraded":"2023-11-27T21:22:23.471759+0000","last_fullsized":"2023-11-27T21:22:23.471759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:23.471665+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:23.471665+0000","last_clean_scrub_stamp":"2023-11-27T21:22:23.471665+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:09:25.413821+0000","scrub_duration":0.0018897339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"28'85","reported_seq":122,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:04.318846+0000","last_change":"2023-11-27T21:23:04.318866+0000","last_active":"2023-11-27T21:23:04.318846+0000","last_peered":"2023-11-27T21:23:04.318846+0000","last_clean":"2023-11-27T21:23:04.318846+0000","last_became_active":"2023-11-27T20:54:27.512777+0000","last_became_peered":"2023-11-27T20:54:27.512777+0000","last_unstale":"2023-11-27T21:23:04.318846+0000","last_undegraded":"2023-11-27T21:23:04.318846+0000","last_fullsized":"2023-11-27T21:23:04.318846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'85","last_scrub_stamp":"2023-11-27T21:23:04.318773+0000","last_deep_scrub":"28'85","last_deep_scrub_stamp":"2023-11-27T21:23:04.318773+0000","last_clean_scrub_stamp":"2023-11-27T21:23:04.318773+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:50:12.048143+0000","scrub_duration":0.0014528500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'65","reported_seq":102,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:33.381938+0000","last_change":"2023-11-27T21:22:33.381969+0000","last_active":"2023-11-27T21:22:33.381938+0000","last_peered":"2023-11-27T21:22:33.381938+0000","last_clean":"2023-11-27T21:22:33.381938+0000","last_became_active":"2023-11-27T20:54:27.512433+0000","last_became_peered":"2023-11-27T20:54:27.512433+0000","last_unstale":"2023-11-27T21:22:33.381938+0000","last_undegraded":"2023-11-27T21:22:33.381938+0000","last_fullsized":"2023-11-27T21:22:33.381938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'65","last_scrub_stamp":"2023-11-27T21:22:33.381875+0000","last_deep_scrub":"28'65","last_deep_scrub_stamp":"2023-11-27T21:22:33.381875+0000","last_clean_scrub_stamp":"2023-11-27T21:22:33.381875+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:56.005899+0000","scrub_duration":0.0018361009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'62","reported_seq":99,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:05.879384+0000","last_change":"2023-11-27T21:22:05.879404+0000","last_active":"2023-11-27T21:22:05.879384+0000","last_peered":"2023-11-27T21:22:05.879384+0000","last_clean":"2023-11-27T21:22:05.879384+0000","last_became_active":"2023-11-27T20:54:27.432152+0000","last_became_peered":"2023-11-27T20:54:27.432152+0000","last_unstale":"2023-11-27T21:22:05.879384+0000","last_undegraded":"2023-11-27T21:22:05.879384+0000","last_fullsized":"2023-11-27T21:22:05.879384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'62","last_scrub_stamp":"2023-11-27T21:22:05.879322+0000","last_deep_scrub":"28'62","last_deep_scrub_stamp":"2023-11-27T21:22:05.879322+0000","last_clean_scrub_stamp":"2023-11-27T21:22:05.879322+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:16:54.519926+0000","scrub_duration":0.001294089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'69","reported_seq":106,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:45.385813+0000","last_change":"2023-11-27T21:22:45.385832+0000","last_active":"2023-11-27T21:22:45.385813+0000","last_peered":"2023-11-27T21:22:45.385813+0000","last_clean":"2023-11-27T21:22:45.385813+0000","last_became_active":"2023-11-27T20:54:27.515801+0000","last_became_peered":"2023-11-27T20:54:27.515801+0000","last_unstale":"2023-11-27T21:22:45.385813+0000","last_undegraded":"2023-11-27T21:22:45.385813+0000","last_fullsized":"2023-11-27T21:22:45.385813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'69","last_scrub_stamp":"2023-11-27T21:22:45.385744+0000","last_deep_scrub":"28'69","last_deep_scrub_stamp":"2023-11-27T21:22:45.385744+0000","last_clean_scrub_stamp":"2023-11-27T21:22:45.385744+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:05:19.004327+0000","scrub_duration":0.001632571,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'75","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:04.865788+0000","last_change":"2023-11-27T21:22:04.865788+0000","last_active":"2023-11-27T21:22:04.865788+0000","last_peered":"2023-11-27T21:22:04.865788+0000","last_clean":"2023-11-27T21:22:04.865788+0000","last_became_active":"2023-11-27T20:54:27.432160+0000","last_became_peered":"2023-11-27T20:54:27.432160+0000","last_unstale":"2023-11-27T21:22:04.865788+0000","last_undegraded":"2023-11-27T21:22:04.865788+0000","last_fullsized":"2023-11-27T21:22:04.865788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:04.865659+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:04.865659+0000","last_clean_scrub_stamp":"2023-11-27T21:22:04.865659+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:24:12.042139+0000","scrub_duration":0.001425869,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'77","reported_seq":116,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:47.341314+0000","last_change":"2023-11-27T21:22:47.341333+0000","last_active":"2023-11-27T21:22:47.341314+0000","last_peered":"2023-11-27T21:22:47.341314+0000","last_clean":"2023-11-27T21:22:47.341314+0000","last_became_active":"2023-11-27T20:54:27.505122+0000","last_became_peered":"2023-11-27T20:54:27.505122+0000","last_unstale":"2023-11-27T21:22:47.341314+0000","last_undegraded":"2023-11-27T21:22:47.341314+0000","last_fullsized":"2023-11-27T21:22:47.341314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:47.341245+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:47.341245+0000","last_clean_scrub_stamp":"2023-11-27T21:22:47.341245+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:10:10.862371+0000","scrub_duration":0.0011517109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"28'74","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.374209+0000","last_change":"2023-11-27T21:22:21.374228+0000","last_active":"2023-11-27T21:22:21.374209+0000","last_peered":"2023-11-27T21:22:21.374209+0000","last_clean":"2023-11-27T21:22:21.374209+0000","last_became_active":"2023-11-27T20:54:27.505236+0000","last_became_peered":"2023-11-27T20:54:27.505236+0000","last_unstale":"2023-11-27T21:22:21.374209+0000","last_undegraded":"2023-11-27T21:22:21.374209+0000","last_fullsized":"2023-11-27T21:22:21.374209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'74","last_scrub_stamp":"2023-11-27T21:22:21.374139+0000","last_deep_scrub":"28'74","last_deep_scrub_stamp":"2023-11-27T21:22:21.374139+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.374139+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:20.028040+0000","scrub_duration":0.0012971980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"28'79","reported_seq":118,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:42.386685+0000","last_change":"2023-11-27T21:22:42.386720+0000","last_active":"2023-11-27T21:22:42.386685+0000","last_peered":"2023-11-27T21:22:42.386685+0000","last_clean":"2023-11-27T21:22:42.386685+0000","last_became_active":"2023-11-27T20:54:27.514846+0000","last_became_peered":"2023-11-27T20:54:27.514846+0000","last_unstale":"2023-11-27T21:22:42.386685+0000","last_undegraded":"2023-11-27T21:22:42.386685+0000","last_fullsized":"2023-11-27T21:22:42.386685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'79","last_scrub_stamp":"2023-11-27T21:22:42.386592+0000","last_deep_scrub":"28'79","last_deep_scrub_stamp":"2023-11-27T21:22:42.386592+0000","last_clean_scrub_stamp":"2023-11-27T21:22:42.386592+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:29:28.775340+0000","scrub_duration":0.00163594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":102,"num_write":4200,"num_write_kb":332069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5131,"ondisk_log_size":5131,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4855,"ondisk_log_size":4855,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":44272102,"num_objects":111,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":1673,"num_read_kb":1711,"num_write":16676,"num_write_kb":52124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":88793088,"data_stored":88544204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15283,"ondisk_log_size":15283,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509795,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95988,"kb_used_data":20396,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94275852,"statfs":{"total":96636764160,"available":96538472448,"internally_reserved":0,"allocated":20885504,"data_stored":20696148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.44800000000000001,"15min":0.41599999999999998},"min":{"1min":0.33500000000000002,"5min":0.22700000000000001,"15min":0.19900000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.95599999999999996},"last":0.435},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.48699999999999999,"15min":0.46800000000000003},"min":{"1min":0.39800000000000002,"5min":0.27500000000000002,"15min":0.24199999999999999},"max":{"1min":0.67000000000000004,"5min":0.72699999999999998,"15min":0.96599999999999997},"last":0.45800000000000002}]},{"osd":1,"last update":"Mon Nov 27 21:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.45900000000000002,"15min":0.438},"min":{"1min":0.36899999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.68799999999999994,"5min":0.69399999999999995,"15min":0.78300000000000003},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.42699999999999999,"15min":0.40799999999999997},"min":{"1min":0.34499999999999997,"5min":0.25600000000000001,"15min":0.247},"max":{"1min":0.59899999999999998,"5min":0.67600000000000005,"15min":0.83999999999999997},"last":0.42099999999999999}]},{"osd":2,"last update":"Mon Nov 27 21:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.436,"15min":0.41199999999999998},"min":{"1min":0.38300000000000001,"5min":0.27700000000000002,"15min":0.23599999999999999},"max":{"1min":0.61299999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.46400000000000002,"15min":0.438},"min":{"1min":0.34100000000000003,"5min":0.26900000000000002,"15min":0.23899999999999999},"max":{"1min":0.67200000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.47199999999999998}]},{"osd":3,"last update":"Mon Nov 27 21:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.45300000000000001,"15min":0.44},"min":{"1min":0.35399999999999998,"5min":0.307,"15min":0.26800000000000002},"max":{"1min":0.63600000000000001,"5min":0.66600000000000004,"15min":0.87},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.48099999999999998,"15min":0.44900000000000001},"min":{"1min":0.39900000000000002,"5min":0.34699999999999998,"15min":0.309},"max":{"1min":0.65500000000000003,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.44400000000000001}]},{"osd":4,"last update":"Mon Nov 27 21:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.40300000000000002,"15min":0.39400000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.23100000000000001},"max":{"1min":0.59999999999999998,"5min":0.66600000000000004,"15min":0.80600000000000005},"last":0.377},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.42299999999999999,"15min":0.41199999999999998},"min":{"1min":0.29399999999999998,"5min":0.27200000000000002,"15min":0.22900000000000001},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.92800000000000005},"last":0.35199999999999998}]},{"osd":5,"last update":"Mon Nov 27 21:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.42499999999999999,"15min":0.40100000000000002},"min":{"1min":0.27700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.59499999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.316},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.46000000000000002,"15min":0.45200000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.25},"max":{"1min":0.61499999999999999,"5min":0.74099999999999999,"15min":0.77600000000000002},"last":0.32800000000000001}]},{"osd":7,"last update":"Mon Nov 27 21:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.46200000000000002,"15min":0.46000000000000002},"min":{"1min":0.29199999999999998,"5min":0.25800000000000001,"15min":0.249},"max":{"1min":0.57699999999999996,"5min":0.68200000000000005,"15min":0.95599999999999996},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.48299999999999998,"15min":0.46500000000000002},"min":{"1min":0.309,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.64400000000000002,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.36299999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509795,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94852,"kb_used_data":19260,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94276988,"statfs":{"total":96636764160,"available":96539635712,"internally_reserved":0,"allocated":19722240,"data_stored":19520171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.433,"15min":0.40999999999999998},"min":{"1min":0.312,"5min":0.25700000000000001,"15min":0.216},"max":{"1min":0.57199999999999995,"5min":1.331,"15min":1.331},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.45000000000000001,"15min":0.42599999999999999},"min":{"1min":0.34000000000000002,"5min":0.27900000000000003,"15min":0.222},"max":{"1min":0.66500000000000004,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.60699999999999998}]},{"osd":1,"last update":"Mon Nov 27 21:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.436,"15min":0.42599999999999999},"min":{"1min":0.30499999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.95999999999999996},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.436,"15min":0.42099999999999999},"min":{"1min":0.33600000000000002,"5min":0.29699999999999999,"15min":0.28599999999999998},"max":{"1min":0.66600000000000004,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.65300000000000002}]},{"osd":2,"last update":"Mon Nov 27 21:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.44,"15min":0.432},"min":{"1min":0.374,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.94599999999999995},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.46000000000000002,"15min":0.435},"min":{"1min":0.38400000000000001,"5min":0.308,"15min":0.29899999999999999},"max":{"1min":0.628,"5min":1.359,"15min":1.359},"last":0.64100000000000001}]},{"osd":3,"last update":"Mon Nov 27 21:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.46600000000000003,"15min":0.45300000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.28899999999999998},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.93300000000000005},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.498,"15min":0.46200000000000002},"min":{"1min":0.38200000000000001,"5min":0.34000000000000002,"15min":0.30199999999999999},"max":{"1min":0.68200000000000005,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":0.59099999999999997}]},{"osd":4,"last update":"Mon Nov 27 21:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.36699999999999999,"15min":0.373},"min":{"1min":0.26100000000000001,"5min":0.23300000000000001,"15min":0.23100000000000001},"max":{"1min":0.55200000000000005,"5min":0.65800000000000003,"15min":0.69199999999999995},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.378,"5min":0.39500000000000002,"15min":0.39800000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.23200000000000001},"max":{"1min":0.54000000000000004,"5min":0.66800000000000004,"15min":0.69999999999999996},"last":0.48899999999999999}]},{"osd":6,"last update":"Mon Nov 27 21:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.39400000000000002,"15min":0.39700000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":0.627,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41899999999999998,"15min":0.42499999999999999},"min":{"1min":0.32100000000000001,"5min":0.27100000000000002,"15min":0.23300000000000001},"max":{"1min":0.60499999999999998,"5min":0.69299999999999995,"15min":0.70399999999999996},"last":0.45200000000000001}]},{"osd":7,"last update":"Mon Nov 27 21:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.44600000000000001,"15min":0.45000000000000001},"min":{"1min":0.28499999999999998,"5min":0.26300000000000001,"15min":0.24199999999999999},"max":{"1min":0.60499999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.34100000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.67900000000000005,"5min":0.71399999999999997,"15min":0.751},"last":0.626}]}]},{"osd":2,"up_from":15,"seq":64424509796,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53560,"kb_used_data":8496,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318280,"statfs":{"total":96636764160,"available":96581918720,"internally_reserved":0,"allocated":8699904,"data_stored":8509387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.32800000000000001,"15min":0.308},"min":{"1min":0.216,"5min":0.19800000000000001,"15min":0.17899999999999999},"max":{"1min":0.433,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.314,"5min":0.32000000000000001,"15min":0.318},"min":{"1min":0.219,"5min":0.216,"15min":0.20200000000000001},"max":{"1min":0.45700000000000002,"5min":0.48299999999999998,"15min":0.61899999999999999},"last":0.28599999999999998}]},{"osd":1,"last update":"Mon Nov 27 21:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.36199999999999999,"15min":0.34699999999999998},"min":{"1min":0.26000000000000001,"5min":0.20599999999999999,"15min":0.19800000000000001},"max":{"1min":0.45600000000000002,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35599999999999998,"15min":0.35099999999999998},"min":{"1min":0.28999999999999998,"5min":0.249,"15min":0.20899999999999999},"max":{"1min":0.48899999999999999,"5min":0.54400000000000004,"15min":0.751},"last":0.32100000000000001}]},{"osd":3,"last update":"Mon Nov 27 21:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.35799999999999998,"15min":0.34699999999999998},"min":{"1min":0.26200000000000001,"5min":0.23999999999999999,"15min":0.224},"max":{"1min":0.46000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.41499999999999998,"15min":0.39200000000000002},"min":{"1min":0.30399999999999999,"5min":0.26200000000000001,"15min":0.26100000000000001},"max":{"1min":0.52700000000000002,"5min":0.62,"15min":0.63700000000000001},"last":0.33600000000000002}]},{"osd":4,"last update":"Mon Nov 27 21:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51900000000000002,"15min":0.49099999999999999},"min":{"1min":0.35199999999999998,"5min":0.313,"15min":0.29499999999999998},"max":{"1min":0.755,"5min":1.044,"15min":1.044},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.497,"15min":0.48599999999999999},"min":{"1min":0.35999999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76400000000000001,"5min":0.78900000000000003,"15min":0.83299999999999996},"last":0.38300000000000001}]},{"osd":5,"last update":"Mon Nov 27 21:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.33000000000000002,"5min":0.32800000000000001,"15min":0.30399999999999999},"max":{"1min":0.71899999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53600000000000003,"15min":0.51000000000000001},"min":{"1min":0.379,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79500000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.35599999999999998}]},{"osd":6,"last update":"Mon Nov 27 21:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.51700000000000002,"15min":0.51000000000000001},"min":{"1min":0.378,"5min":0.36699999999999999,"15min":0.34000000000000002},"max":{"1min":0.76500000000000001,"5min":0.81399999999999995,"15min":0.90900000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51100000000000001,"15min":0.497},"min":{"1min":0.36099999999999999,"5min":0.35199999999999998,"15min":0.316},"max":{"1min":0.66800000000000004,"5min":0.753,"15min":0.76900000000000002},"last":0.45000000000000001}]},{"osd":7,"last update":"Mon Nov 27 21:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.36599999999999999,"15min":0.36399999999999999},"max":{"1min":0.78500000000000003,"5min":1.071,"15min":1.071},"last":0.434},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52600000000000002,"15min":0.51000000000000001},"min":{"1min":0.42099999999999999,"5min":0.373,"15min":0.34000000000000002},"max":{"1min":0.67200000000000004,"5min":0.77000000000000002,"15min":0.92400000000000004},"last":0.40300000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509796,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42852,"kb_used_data":3356,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94328988,"statfs":{"total":96636764160,"available":96592883712,"internally_reserved":0,"allocated":3436544,"data_stored":3238767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.316,"15min":0.311},"min":{"1min":0.22500000000000001,"5min":0.20599999999999999,"15min":0.17000000000000001},"max":{"1min":0.47899999999999998,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.32400000000000001,"15min":0.312},"min":{"1min":0.249,"5min":0.222,"15min":0.19800000000000001},"max":{"1min":0.52100000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.35699999999999998}]},{"osd":2,"last update":"Mon Nov 27 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.32600000000000001,"15min":0.316},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.192},"max":{"1min":0.50800000000000001,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.34499999999999997,"15min":0.34399999999999997},"min":{"1min":0.28299999999999997,"5min":0.22600000000000001,"15min":0.20499999999999999},"max":{"1min":0.54100000000000004,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.31}]},{"osd":3,"last update":"Mon Nov 27 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.36599999999999999,"15min":0.37},"min":{"1min":0.315,"5min":0.26800000000000002,"15min":0.23300000000000001},"max":{"1min":0.61699999999999999,"5min":0.622,"15min":0.68200000000000005},"last":0.377},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38400000000000001,"15min":0.37},"min":{"1min":0.27500000000000002,"5min":0.24399999999999999,"15min":0.23699999999999999},"max":{"1min":0.59199999999999997,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.32000000000000001}]},{"osd":4,"last update":"Mon Nov 27 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.48399999999999999,"15min":0.47199999999999998},"min":{"1min":0.39000000000000001,"5min":0.313,"15min":0.26600000000000001},"max":{"1min":0.83099999999999996,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.498,"15min":0.48799999999999999},"min":{"1min":0.38200000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68899999999999995,"5min":1.26,"15min":1.26},"last":0.434}]},{"osd":5,"last update":"Mon Nov 27 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51300000000000001,"15min":0.497},"min":{"1min":0.41199999999999998,"5min":0.35399999999999998,"15min":0.313},"max":{"1min":0.71199999999999997,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.497,"15min":0.49399999999999999},"min":{"1min":0.38200000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77100000000000002,"5min":1.2689999999999999,"15min":1.4079999999999999},"last":0.45400000000000001}]},{"osd":6,"last update":"Mon Nov 27 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52700000000000002,"15min":0.51600000000000001},"min":{"1min":0.42699999999999999,"5min":0.38200000000000001,"15min":0.33600000000000002},"max":{"1min":0.746,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52200000000000002,"15min":0.52100000000000002},"min":{"1min":0.40100000000000002,"5min":0.36199999999999999,"15min":0.34499999999999997},"max":{"1min":0.76000000000000001,"5min":1.292,"15min":1.4239999999999999},"last":0.48299999999999998}]},{"osd":7,"last update":"Mon Nov 27 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.33200000000000002},"max":{"1min":0.77700000000000002,"5min":1.25,"15min":1.25},"last":0.442},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.53600000000000003,"15min":0.52200000000000002},"min":{"1min":0.432,"5min":0.38700000000000001,"15min":0.35399999999999998},"max":{"1min":0.80000000000000004,"5min":1.3029999999999999,"15min":1.4399999999999999},"last":0.496}]}]},{"osd":0,"up_from":15,"seq":64424509795,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76024,"kb_used_data":8752,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94295816,"statfs":{"total":96636764160,"available":96558915584,"internally_reserved":0,"allocated":8962048,"data_stored":8748777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 21:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.32200000000000001,"15min":0.312},"min":{"1min":0.217,"5min":0.185,"15min":0.185},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.313,"15min":0.313},"min":{"1min":0.23200000000000001,"5min":0.20100000000000001,"15min":0.19},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.69699999999999995},"last":0.51500000000000001}]},{"osd":2,"last update":"Mon Nov 27 21:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.25600000000000001,"5min":0.22,"15min":0.189},"max":{"1min":0.51100000000000001,"5min":0.54300000000000004,"15min":0.59299999999999997},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.34899999999999998,"15min":0.34599999999999997},"min":{"1min":0.31,"5min":0.223,"15min":0.19900000000000001},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.66900000000000004},"last":0.46700000000000003}]},{"osd":3,"last update":"Mon Nov 27 21:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.34499999999999997,"15min":0.34799999999999998},"min":{"1min":0.27100000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55100000000000005,"5min":0.58799999999999997,"15min":0.65200000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39000000000000001,"15min":0.38700000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.21099999999999999},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.49199999999999999}]},{"osd":4,"last update":"Mon Nov 27 21:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.45800000000000002,"15min":0.45300000000000001},"min":{"1min":0.39500000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.81200000000000006},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.49099999999999999,"15min":0.47399999999999998},"min":{"1min":0.36699999999999999,"5min":0.33200000000000002,"15min":0.27200000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.71399999999999997}]},{"osd":5,"last update":"Mon Nov 27 21:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.51000000000000001,"15min":0.498},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.32700000000000001},"max":{"1min":0.74099999999999999,"5min":0.746,"15min":0.81499999999999995},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.48199999999999998,"15min":0.46500000000000002},"min":{"1min":0.40600000000000003,"5min":0.34100000000000003,"15min":0.317},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.69299999999999995}]},{"osd":6,"last update":"Mon Nov 27 21:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.50700000000000001,"15min":0.49399999999999999},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.31900000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.52500000000000002,"15min":0.51800000000000002},"min":{"1min":0.41899999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.85699999999999998},"last":0.72799999999999998}]},{"osd":7,"last update":"Mon Nov 27 21:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.53000000000000003,"15min":0.52600000000000002},"min":{"1min":0.44500000000000001,"5min":0.35399999999999998,"15min":0.33500000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89300000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.503,"15min":0.496},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.78000000000000003},"last":0.73799999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542500,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56968,"kb_used_data":7744,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94314872,"statfs":{"total":96636764160,"available":96578428928,"internally_reserved":0,"allocated":7929856,"data_stored":7711066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":50395595},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.42699999999999999,"15min":0.40799999999999997},"min":{"1min":0.42299999999999999,"5min":0.25,"15min":0.21199999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.82899999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.42699999999999999,"15min":0.42999999999999999},"min":{"1min":0.374,"5min":0.27000000000000002,"15min":0.26200000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.58199999999999996}]},{"osd":1,"last update":"Mon Nov 27 21:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.45700000000000002,"15min":0.438},"min":{"1min":0.38800000000000001,"5min":0.26800000000000002,"15min":0.246},"max":{"1min":0.65400000000000003,"5min":0.72099999999999997,"15min":0.88500000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.46200000000000002,"15min":0.45600000000000002},"min":{"1min":0.41099999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63,"5min":0.64500000000000002,"15min":0.873},"last":0.64700000000000002}]},{"osd":2,"last update":"Mon Nov 27 21:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.433,"15min":0.432},"min":{"1min":0.34599999999999997,"5min":0.28399999999999997,"15min":0.28100000000000003},"max":{"1min":0.65000000000000002,"5min":0.65300000000000002,"15min":0.79700000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.42499999999999999,"15min":0.41999999999999998},"min":{"1min":0.34300000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.68700000000000006},"last":0.623}]},{"osd":3,"last update":"Mon Nov 27 21:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.44700000000000001,"15min":0.44600000000000001},"min":{"1min":0.40899999999999997,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64600000000000002,"5min":0.68700000000000006,"15min":0.77100000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.46999999999999997,"15min":0.45400000000000001},"min":{"1min":0.35299999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64900000000000002,"5min":0.68600000000000005,"15min":0.90200000000000002},"last":0.60899999999999999}]},{"osd":4,"last update":"Mon Nov 27 21:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.38200000000000001,"15min":0.39200000000000002},"min":{"1min":0.26400000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.502,"5min":0.59199999999999997,"15min":0.65400000000000003},"last":0.441},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.42399999999999999,"15min":0.41699999999999998},"min":{"1min":0.32500000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61599999999999999,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.49099999999999999}]},{"osd":5,"last update":"Mon Nov 27 21:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.442,"15min":0.435},"min":{"1min":0.30199999999999999,"5min":0.27700000000000002,"15min":0.27300000000000002},"max":{"1min":0.61799999999999999,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42499999999999999,"15min":0.435},"min":{"1min":0.32300000000000001,"5min":0.26500000000000001,"15min":0.248},"max":{"1min":0.57499999999999996,"5min":0.71499999999999997,"15min":0.77700000000000002},"last":0.47399999999999998}]},{"osd":6,"last update":"Mon Nov 27 21:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.439,"15min":0.45000000000000001},"min":{"1min":0.29699999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58399999999999996,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.313,"5min":0.29099999999999998,"15min":0.28100000000000003},"max":{"1min":0.63600000000000001,"5min":0.751,"15min":0.84999999999999998},"last":0.52900000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542500,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57800,"kb_used_data":8576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94314040,"statfs":{"total":96636764160,"available":96577576960,"internally_reserved":0,"allocated":8781824,"data_stored":8552244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.435,"15min":0.41099999999999998},"min":{"1min":0.39000000000000001,"5min":0.248,"15min":0.20200000000000001},"max":{"1min":0.66600000000000004,"5min":1.446,"15min":1.446},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.505,"15min":0.45400000000000001},"min":{"1min":0.40400000000000003,"5min":0.29099999999999998,"15min":0.24099999999999999},"max":{"1min":0.65000000000000002,"5min":3.948,"15min":3.948},"last":0.49099999999999999}]},{"osd":1,"last update":"Mon Nov 27 21:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.497,"15min":0.442},"min":{"1min":0.41399999999999998,"5min":0.28100000000000003,"15min":0.24099999999999999},"max":{"1min":0.73699999999999999,"5min":5.0410000000000004,"15min":5.0410000000000004},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.44900000000000001,"15min":0.41999999999999998},"min":{"1min":0.38700000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.67800000000000005,"5min":1.181,"15min":1.181},"last":0.61799999999999999}]},{"osd":2,"last update":"Mon Nov 27 21:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.47499999999999998,"15min":0.438},"min":{"1min":0.42899999999999999,"5min":0.29499999999999998,"15min":0.26100000000000001},"max":{"1min":0.72699999999999998,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.49299999999999999,"15min":0.46200000000000002},"min":{"1min":0.34899999999999998,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":0.59799999999999998,"5min":4.008,"15min":4.008},"last":0.60299999999999998}]},{"osd":3,"last update":"Mon Nov 27 21:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.501,"15min":0.47599999999999998},"min":{"1min":0.36299999999999999,"5min":0.318,"15min":0.312},"max":{"1min":0.68500000000000005,"5min":1.532,"15min":1.532},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.498,"5min":0.59399999999999997,"15min":0.498},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.28499999999999998},"max":{"1min":0.68999999999999995,"5min":10.747999999999999,"15min":10.747999999999999},"last":0.64200000000000002}]},{"osd":5,"last update":"Mon Nov 27 21:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.66900000000000004,"15min":0.47899999999999998},"min":{"1min":0.28399999999999997,"5min":0.23100000000000001,"15min":0.221},"max":{"1min":0.55500000000000005,"5min":20.847999999999999,"15min":20.847999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.46999999999999997,"15min":0.42999999999999999},"min":{"1min":0.30199999999999999,"5min":0.26000000000000001,"15min":0.23100000000000001},"max":{"1min":0.58399999999999996,"5min":5.0800000000000001,"15min":5.0800000000000001},"last":0.56000000000000005}]},{"osd":6,"last update":"Mon Nov 27 21:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42999999999999999,"15min":0.41799999999999998},"min":{"1min":0.30099999999999999,"5min":0.255,"15min":0.24399999999999999},"max":{"1min":0.62,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.48899999999999999,"15min":0.47099999999999997},"min":{"1min":0.33000000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.71299999999999997,"5min":1.478,"15min":1.478},"last":0.58699999999999997}]},{"osd":7,"last update":"Mon Nov 27 21:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46300000000000002,"15min":0.45400000000000001},"min":{"1min":0.29599999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.64300000000000002,"5min":1.113,"15min":1.113},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.504,"5min":0.55500000000000005,"15min":0.51900000000000002},"min":{"1min":0.35699999999999998,"5min":0.35099999999999998,"15min":0.33400000000000002},"max":{"1min":0.73899999999999999,"5min":3.4649999999999999,"15min":3.4649999999999999},"last":0.65700000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542500,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89188,"kb_used_data":13596,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94282652,"statfs":{"total":96636764160,"available":96545435648,"internally_reserved":0,"allocated":13922304,"data_stored":13708692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.34100000000000003,"15min":0.32500000000000001},"min":{"1min":0.215,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.39100000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.28699999999999998,"5min":0.41699999999999998,"15min":0.34200000000000003},"min":{"1min":0.23999999999999999,"5min":0.21099999999999999,"15min":0.192},"max":{"1min":0.36899999999999999,"5min":8.9369999999999994,"15min":8.9369999999999994},"last":0.34100000000000003}]},{"osd":1,"last update":"Mon Nov 27 21:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.29399999999999998,"5min":0.34100000000000003,"15min":0.32100000000000001},"min":{"1min":0.218,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.44,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.38300000000000001,"15min":0.35999999999999999},"min":{"1min":0.255,"5min":0.23400000000000001,"15min":0.21199999999999999},"max":{"1min":0.46100000000000002,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.44700000000000001}]},{"osd":2,"last update":"Mon Nov 27 21:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.45600000000000002,"15min":0.39700000000000002},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.22600000000000001},"max":{"1min":0.502,"5min":7.0830000000000002,"15min":7.0830000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.38100000000000001,"15min":0.378},"min":{"1min":0.27800000000000002,"5min":0.25700000000000001,"15min":0.22600000000000001},"max":{"1min":0.47699999999999998,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.46700000000000003}]},{"osd":4,"last update":"Mon Nov 27 21:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.499,"15min":0.47299999999999998},"min":{"1min":0.39300000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.77500000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52900000000000003,"15min":0.497},"min":{"1min":0.36499999999999999,"5min":0.34499999999999997,"15min":0.314},"max":{"1min":0.66300000000000003,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":0.92600000000000005}]},{"osd":5,"last update":"Mon Nov 27 21:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52600000000000002,"15min":0.49399999999999999},"min":{"1min":0.38900000000000001,"5min":0.33600000000000002,"15min":0.28499999999999998},"max":{"1min":0.76100000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.52000000000000002},"min":{"1min":0.38300000000000001,"5min":0.373,"15min":0.34100000000000003},"max":{"1min":0.69299999999999995,"5min":2.7400000000000002,"15min":2.7400000000000002},"last":0.91200000000000003}]},{"osd":6,"last update":"Mon Nov 27 21:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.56000000000000005,"15min":0.52500000000000002},"min":{"1min":0.373,"5min":0.36899999999999999,"15min":0.311},"max":{"1min":0.72499999999999998,"5min":4.7169999999999996,"15min":4.7169999999999996},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53700000000000003,"15min":0.51000000000000001},"min":{"1min":0.37,"5min":0.35499999999999998,"15min":0.314},"max":{"1min":0.76200000000000001,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.89500000000000002}]},{"osd":7,"last update":"Mon Nov 27 21:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.38,"5min":0.36099999999999999,"15min":0.35999999999999999},"max":{"1min":0.77100000000000002,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.40999999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73999999999999999,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.93600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8667136,"data_stored":8628738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2547712,"data_stored":2528360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13627392,"data_stored":13588653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8486912,"data_stored":8432205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18833408,"data_stored":18809764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20590592,"data_stored":20576109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7634944,"data_stored":7591027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T21:23:28.230 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-11-27T20:54:26.086709+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=54, tm_sec=26, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=21, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T21:23:28.231 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-27T21:23:40.114 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:23:40.117 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:23:48.232 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T21:23:48.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.331+0000 7f5e594b4640 1 Processor -- start 2023-11-27T21:23:48.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.331+0000 7f5e594b4640 1 -- start start 2023-11-27T21:23:48.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.332+0000 7f5e594b4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5e540ccac0 0x7f5e540cced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:48.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.332+0000 7f5e594b4640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e540c8240 con 0x7f5e54151680 2023-11-27T21:23:48.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.332+0000 7f5e594b4640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e541575f0 con 0x7f5e541571d0 2023-11-27T21:23:48.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.332+0000 7f5e594b4640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e540cd410 con 0x7f5e540ccac0 2023-11-27T21:23:48.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.333+0000 7f5e52ffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5e54151680 0x7f5e5406f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48248/0 (socket says 172.21.15.88:48248) 2023-11-27T21:23:48.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.333+0000 7f5e52ffd640 1 -- 172.21.15.88:0/4126036049 learned_addr learned my addr 172.21.15.88:0/4126036049 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:23:48.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.333+0000 7f5e537fe640 1 --2- 172.21.15.88:0/4126036049 >> v2:172.21.15.167:3300/0 conn(0x7f5e540ccac0 0x7f5e540cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:48.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.335+0000 7f5e51ffb640 1 -- 172.21.15.88:0/4126036049 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411966386 0 0) 0x7f5e540c8240 con 0x7f5e54151680 2023-11-27T21:23:48.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.335+0000 7f5e51ffb640 1 -- 172.21.15.88:0/4126036049 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e3c003520 con 0x7f5e54151680 2023-11-27T21:23:48.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.337+0000 7f5e537fe640 1 -- 172.21.15.88:0/4126036049 >> v1:172.21.15.167:6789/0 conn(0x7f5e541571d0 legacy=0x7f5e540c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:48.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.337+0000 7f5e537fe640 1 -- 172.21.15.88:0/4126036049 >> v1:172.21.15.88:6789/0 conn(0x7f5e54151680 legacy=0x7f5e5406f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:48.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.337+0000 7f5e537fe640 1 -- 172.21.15.88:0/4126036049 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e54157880 con 0x7f5e540ccac0 2023-11-27T21:23:48.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.341+0000 7f5e537fe640 1 --2- 172.21.15.88:0/4126036049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e540ccac0 0x7f5e540cced0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c0097a0 tx=0x7f5e4c02b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a2dc3ec7c7e0af6 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:48.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.345+0000 7f5e51ffb640 1 -- 172.21.15.88:0/4126036049 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c02f810 con 0x7f5e540ccac0 2023-11-27T21:23:48.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.345+0000 7f5e51ffb640 1 -- 172.21.15.88:0/4126036049 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4c02f970 con 0x7f5e540ccac0 2023-11-27T21:23:48.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.345+0000 7f5e51ffb640 1 -- 172.21.15.88:0/4126036049 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c02fd00 con 0x7f5e540ccac0 2023-11-27T21:23:48.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.346+0000 7f5e594b4640 1 -- 172.21.15.88:0/4126036049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e540ccac0 msgr2=0x7f5e540cced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:48.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.346+0000 7f5e594b4640 1 --2- 172.21.15.88:0/4126036049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e540ccac0 0x7f5e540cced0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c0097a0 tx=0x7f5e4c02b9f0 comp rx=0 tx=0).stop 2023-11-27T21:23:48.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.346+0000 7f5e594b4640 1 -- 172.21.15.88:0/4126036049 shutdown_connections 2023-11-27T21:23:48.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.346+0000 7f5e594b4640 1 --2- 172.21.15.88:0/4126036049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e540ccac0 0x7f5e540cced0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:48.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.346+0000 7f5e594b4640 1 -- 172.21.15.88:0/4126036049 >> 172.21.15.88:0/4126036049 conn(0x7f5e540707f0 msgr2=0x7f5e54070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:23:48.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.346+0000 7f5e594b4640 1 -- 172.21.15.88:0/4126036049 shutdown_connections 2023-11-27T21:23:48.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.346+0000 7f5e594b4640 1 -- 172.21.15.88:0/4126036049 wait complete. 2023-11-27T21:23:48.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.347+0000 7f5e594b4640 1 Processor -- start 2023-11-27T21:23:48.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.347+0000 7f5e594b4640 1 -- start start 2023-11-27T21:23:48.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.348+0000 7f5e594b4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e540ccac0 0x7f5e5414bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:48.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.348+0000 7f5e594b4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e54151680 0x7f5e5414a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:48.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.348+0000 7f5e594b4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e541571d0 0x7f5e540cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:48.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.348+0000 7f5e594b4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e54147040 con 0x7f5e541571d0 2023-11-27T21:23:48.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.348+0000 7f5e594b4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5414c8f0 con 0x7f5e54151680 2023-11-27T21:23:48.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.348+0000 7f5e594b4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e541ed130 con 0x7f5e540ccac0 2023-11-27T21:23:48.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.348+0000 7f5e537fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e541571d0 0x7f5e540cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:48.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.349+0000 7f5e527fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e54151680 0x7f5e5414a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:48.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.349+0000 7f5e52ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e540ccac0 0x7f5e5414bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:48.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.349+0000 7f5e537fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e541571d0 0x7f5e540cbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46484/0 (socket says 172.21.15.88:46484) 2023-11-27T21:23:48.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.349+0000 7f5e537fe640 1 -- 172.21.15.88:0/4070651521 learned_addr learned my addr 172.21.15.88:0/4070651521 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:23:48.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.352+0000 7f5e537fe640 1 -- 172.21.15.88:0/4070651521 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e540ccac0 msgr2=0x7f5e5414bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:48.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.352+0000 7f5e537fe640 1 --2- 172.21.15.88:0/4070651521 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e540ccac0 0x7f5e5414bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:48.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.352+0000 7f5e537fe640 1 -- 172.21.15.88:0/4070651521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e54151680 msgr2=0x7f5e5414a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:48.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.352+0000 7f5e537fe640 1 --2- 172.21.15.88:0/4070651521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e54151680 0x7f5e5414a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:48.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.352+0000 7f5e537fe640 1 -- 172.21.15.88:0/4070651521 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4c009400 con 0x7f5e541571d0 2023-11-27T21:23:48.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.354+0000 7f5e537fe640 1 --2- 172.21.15.88:0/4070651521 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e541571d0 0x7f5e540cbbf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c0098c0 tx=0x7f5e4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:48.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.356+0000 7f5e3b7fe640 1 -- 172.21.15.88:0/4070651521 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c03b040 con 0x7f5e541571d0 2023-11-27T21:23:48.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.356+0000 7f5e594b4640 1 -- 172.21.15.88:0/4070651521 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e5414ada0 con 0x7f5e541571d0 2023-11-27T21:23:48.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.356+0000 7f5e594b4640 1 -- 172.21.15.88:0/4070651521 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5414c610 con 0x7f5e541571d0 2023-11-27T21:23:48.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.357+0000 7f5e594b4640 1 -- 172.21.15.88:0/4070651521 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e541ed2a0 con 0x7f5e541571d0 2023-11-27T21:23:48.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.358+0000 7f5e3b7fe640 1 -- 172.21.15.88:0/4070651521 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4c037810 con 0x7f5e541571d0 2023-11-27T21:23:48.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.358+0000 7f5e3b7fe640 1 -- 172.21.15.88:0/4070651521 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c037b80 con 0x7f5e541571d0 2023-11-27T21:23:48.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.596+0000 7f5e3b7fe640 1 -- 172.21.15.88:0/4070651521 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5e4c037ce0 con 0x7f5e541571d0 2023-11-27T21:23:48.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.597+0000 7f5e3b7fe640 1 --2- 172.21.15.88:0/4070651521 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5e4006b1f0 0x7f5e4006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:48.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.597+0000 7f5e52ffd640 1 --2- 172.21.15.88:0/4070651521 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5e4006b1f0 0x7f5e4006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:48.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.597+0000 7f5e52ffd640 1 --2- 172.21.15.88:0/4070651521 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5e4006b1f0 0x7f5e4006d6b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5e44005c00 tx=0x7f5e44009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:48.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.612+0000 7f5e3b7fe640 1 -- 172.21.15.88:0/4070651521 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5e4c07bcb0 con 0x7f5e541571d0 2023-11-27T21:23:48.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.612+0000 7f5e3b7fe640 1 -- 172.21.15.88:0/4070651521 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5e4c077ff0 con 0x7f5e541571d0 2023-11-27T21:23:48.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.777+0000 7f5e594b4640 1 -- 172.21.15.88:0/4070651521 --> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5e54158120 con 0x7f5e4006b1f0 2023-11-27T21:23:48.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.786+0000 7f5e3b7fe640 1 -- 172.21.15.88:0/4070651521 <== mgr.4105 v2:172.21.15.88:6800/352455703 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+373800 (secure 0 0 0) 0x7f5e44001fc0 con 0x7f5e4006b1f0 2023-11-27T21:23:48.793 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T21:23:48.795 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-11-27T21:23:48.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.789+0000 7f5e594b4640 1 -- 172.21.15.88:0/4070651521 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5e4006b1f0 msgr2=0x7f5e4006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:48.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.789+0000 7f5e594b4640 1 --2- 172.21.15.88:0/4070651521 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5e4006b1f0 0x7f5e4006d6b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5e44005c00 tx=0x7f5e44009040 comp rx=0 tx=0).stop 2023-11-27T21:23:48.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.789+0000 7f5e594b4640 1 -- 172.21.15.88:0/4070651521 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e541571d0 msgr2=0x7f5e540cbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:48.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.789+0000 7f5e594b4640 1 --2- 172.21.15.88:0/4070651521 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e541571d0 0x7f5e540cbbf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c0098c0 tx=0x7f5e4c0046c0 comp rx=0 tx=0).stop 2023-11-27T21:23:48.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.790+0000 7f5e594b4640 1 -- 172.21.15.88:0/4070651521 shutdown_connections 2023-11-27T21:23:48.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.790+0000 7f5e594b4640 1 --2- 172.21.15.88:0/4070651521 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f5e4006b1f0 0x7f5e4006d6b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:48.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.790+0000 7f5e594b4640 1 --2- 172.21.15.88:0/4070651521 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e541571d0 0x7f5e540cbbf0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:48.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.790+0000 7f5e594b4640 1 --2- 172.21.15.88:0/4070651521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e54151680 0x7f5e5414a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:48.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.790+0000 7f5e594b4640 1 --2- 172.21.15.88:0/4070651521 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e540ccac0 0x7f5e5414bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:48.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.790+0000 7f5e594b4640 1 -- 172.21.15.88:0/4070651521 >> 172.21.15.88:0/4070651521 conn(0x7f5e540707f0 msgr2=0x7f5e54155430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:23:48.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.790+0000 7f5e594b4640 1 -- 172.21.15.88:0/4070651521 shutdown_connections 2023-11-27T21:23:48.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.790+0000 7f5e594b4640 1 -- 172.21.15.88:0/4070651521 wait complete. 2023-11-27T21:23:48.804 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":912,"stamp":"2023-11-27T21:23:47.295392+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":44862470,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":1793,"num_read_kb":1913,"num_write":21035,"num_write_kb":386609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25388,"ondisk_log_size":25388,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":567232,"kb_used_data":90176,"kb_used_omap":12,"kb_used_meta":476979,"kb_avail":754407488,"statfs":{"total":773094113280,"available":772513267712,"internally_reserved":0,"allocated":92340224,"data_stored":90685252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":488427057},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003215"},"pg_stats":[{"pgid":"2.1f","version":"28'339","reported_seq":380,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.533049+0000","last_change":"2023-11-27T21:22:21.533049+0000","last_active":"2023-11-27T21:22:21.533049+0000","last_peered":"2023-11-27T21:22:21.533049+0000","last_clean":"2023-11-27T21:22:21.533049+0000","last_became_active":"2023-11-27T20:54:26.221715+0000","last_became_peered":"2023-11-27T20:54:26.221715+0000","last_unstale":"2023-11-27T21:22:21.533049+0000","last_undegraded":"2023-11-27T21:22:21.533049+0000","last_fullsized":"2023-11-27T21:22:21.533049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'339","last_scrub_stamp":"2023-11-27T21:22:21.532905+0000","last_deep_scrub":"28'339","last_deep_scrub_stamp":"2023-11-27T21:22:21.532905+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.532905+0000","objects_scrubbed":7,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:03:03.041969+0000","scrub_duration":0.0081144100000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922212,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":1068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"28'71","reported_seq":111,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:51.278893+0000","last_change":"2023-11-27T21:22:51.278914+0000","last_active":"2023-11-27T21:22:51.278893+0000","last_peered":"2023-11-27T21:22:51.278893+0000","last_clean":"2023-11-27T21:22:51.278893+0000","last_became_active":"2023-11-27T20:54:27.508003+0000","last_became_peered":"2023-11-27T20:54:27.508003+0000","last_unstale":"2023-11-27T21:22:51.278893+0000","last_undegraded":"2023-11-27T21:22:51.278893+0000","last_fullsized":"2023-11-27T21:22:51.278893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'71","last_scrub_stamp":"2023-11-27T21:22:51.278824+0000","last_deep_scrub":"28'71","last_deep_scrub_stamp":"2023-11-27T21:22:51.278824+0000","last_clean_scrub_stamp":"2023-11-27T21:22:51.278824+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:46.619465+0000","scrub_duration":0.001581952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"28'159","reported_seq":195,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:27.322575+0000","last_change":"2023-11-27T21:22:27.322575+0000","last_active":"2023-11-27T21:22:27.322575+0000","last_peered":"2023-11-27T21:22:27.322575+0000","last_clean":"2023-11-27T21:22:27.322575+0000","last_became_active":"2023-11-27T20:54:31.836803+0000","last_became_peered":"2023-11-27T20:54:31.836803+0000","last_unstale":"2023-11-27T21:22:27.322575+0000","last_undegraded":"2023-11-27T21:22:27.322575+0000","last_fullsized":"2023-11-27T21:22:27.322575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'159","last_scrub_stamp":"2023-11-27T21:22:27.322480+0000","last_deep_scrub":"28'159","last_deep_scrub_stamp":"2023-11-27T21:22:27.322480+0000","last_clean_scrub_stamp":"2023-11-27T21:22:27.322480+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:08:23.783315+0000","scrub_duration":0.0022460409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":7710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'739","reported_seq":780,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:28.459705+0000","last_change":"2023-11-27T21:22:28.459705+0000","last_active":"2023-11-27T21:22:28.459705+0000","last_peered":"2023-11-27T21:22:28.459705+0000","last_clean":"2023-11-27T21:22:28.459705+0000","last_became_active":"2023-11-27T20:54:26.227620+0000","last_became_peered":"2023-11-27T20:54:26.227620+0000","last_unstale":"2023-11-27T21:22:28.459705+0000","last_undegraded":"2023-11-27T21:22:28.459705+0000","last_fullsized":"2023-11-27T21:22:28.459705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'739","last_scrub_stamp":"2023-11-27T21:22:28.459580+0000","last_deep_scrub":"28'739","last_deep_scrub_stamp":"2023-11-27T21:22:28.459580+0000","last_clean_scrub_stamp":"2023-11-27T21:22:28.459580+0000","objects_scrubbed":1,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:57:22.369660+0000","scrub_duration":0.011554231,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":733,"num_write_kb":4484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"28'77","reported_seq":117,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:56.340668+0000","last_change":"2023-11-27T21:22:56.340668+0000","last_active":"2023-11-27T21:22:56.340668+0000","last_peered":"2023-11-27T21:22:56.340668+0000","last_clean":"2023-11-27T21:22:56.340668+0000","last_became_active":"2023-11-27T20:54:27.507460+0000","last_became_peered":"2023-11-27T20:54:27.507460+0000","last_unstale":"2023-11-27T21:22:56.340668+0000","last_undegraded":"2023-11-27T21:22:56.340668+0000","last_fullsized":"2023-11-27T21:22:56.340668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:56.340545+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:56.340545+0000","last_clean_scrub_stamp":"2023-11-27T21:22:56.340545+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:20:58.429371+0000","scrub_duration":0.0021526409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"28'166","reported_seq":211,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:20.702834+0000","last_change":"2023-11-27T21:22:20.702834+0000","last_active":"2023-11-27T21:22:20.702834+0000","last_peered":"2023-11-27T21:22:20.702834+0000","last_clean":"2023-11-27T21:22:20.702834+0000","last_became_active":"2023-11-27T20:55:00.593543+0000","last_became_peered":"2023-11-27T20:55:00.593543+0000","last_unstale":"2023-11-27T21:22:20.702834+0000","last_undegraded":"2023-11-27T21:22:20.702834+0000","last_fullsized":"2023-11-27T21:22:20.702834+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'166","last_scrub_stamp":"2023-11-27T21:22:20.702707+0000","last_deep_scrub":"28'166","last_deep_scrub_stamp":"2023-11-27T21:22:20.702707+0000","last_clean_scrub_stamp":"2023-11-27T21:22:20.702707+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:34.996116+0000","scrub_duration":0.0026403020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":12743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"28'187","reported_seq":225,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:18.415812+0000","last_change":"2023-11-27T21:22:18.415839+0000","last_active":"2023-11-27T21:22:18.415812+0000","last_peered":"2023-11-27T21:22:18.415812+0000","last_clean":"2023-11-27T21:22:18.415812+0000","last_became_active":"2023-11-27T20:54:26.226407+0000","last_became_peered":"2023-11-27T20:54:26.226407+0000","last_unstale":"2023-11-27T21:22:18.415812+0000","last_undegraded":"2023-11-27T21:22:18.415812+0000","last_fullsized":"2023-11-27T21:22:18.415812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'187","last_scrub_stamp":"2023-11-27T21:22:18.415750+0000","last_deep_scrub":"28'187","last_deep_scrub_stamp":"2023-11-27T21:22:18.415750+0000","last_clean_scrub_stamp":"2023-11-27T21:22:18.415750+0000","objects_scrubbed":7,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:09.265948+0000","scrub_duration":0.0049688789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"28'78","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:19.383288+0000","last_change":"2023-11-27T21:22:19.383307+0000","last_active":"2023-11-27T21:22:19.383288+0000","last_peered":"2023-11-27T21:22:19.383288+0000","last_clean":"2023-11-27T21:22:19.383288+0000","last_became_active":"2023-11-27T20:54:27.512548+0000","last_became_peered":"2023-11-27T20:54:27.512548+0000","last_unstale":"2023-11-27T21:22:19.383288+0000","last_undegraded":"2023-11-27T21:22:19.383288+0000","last_fullsized":"2023-11-27T21:22:19.383288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'78","last_scrub_stamp":"2023-11-27T21:22:19.383221+0000","last_deep_scrub":"28'78","last_deep_scrub_stamp":"2023-11-27T21:22:19.383221+0000","last_clean_scrub_stamp":"2023-11-27T21:22:19.383221+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:56:13.237697+0000","scrub_duration":0.0011829830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"28'164","reported_seq":199,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:44.720580+0000","last_change":"2023-11-27T21:22:44.720599+0000","last_active":"2023-11-27T21:22:44.720580+0000","last_peered":"2023-11-27T21:22:44.720580+0000","last_clean":"2023-11-27T21:22:44.720580+0000","last_became_active":"2023-11-27T20:54:31.828045+0000","last_became_peered":"2023-11-27T20:54:31.828045+0000","last_unstale":"2023-11-27T21:22:44.720580+0000","last_undegraded":"2023-11-27T21:22:44.720580+0000","last_fullsized":"2023-11-27T21:22:44.720580+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'164","last_scrub_stamp":"2023-11-27T21:22:44.720523+0000","last_deep_scrub":"28'164","last_deep_scrub_stamp":"2023-11-27T21:22:44.720523+0000","last_clean_scrub_stamp":"2023-11-27T21:22:44.720523+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:29:31.109271+0000","scrub_duration":0.0023621649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":12089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"28'12","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:25.356913+0000","last_change":"2023-11-27T21:22:25.356937+0000","last_active":"2023-11-27T21:22:25.356913+0000","last_peered":"2023-11-27T21:22:25.356913+0000","last_clean":"2023-11-27T21:22:25.356913+0000","last_became_active":"2023-11-27T20:54:26.226522+0000","last_became_peered":"2023-11-27T20:54:26.226522+0000","last_unstale":"2023-11-27T21:22:25.356913+0000","last_undegraded":"2023-11-27T21:22:25.356913+0000","last_fullsized":"2023-11-27T21:22:25.356913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2023-11-27T21:22:25.356853+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2023-11-27T21:22:25.356853+0000","last_clean_scrub_stamp":"2023-11-27T21:22:25.356853+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:24.010754+0000","scrub_duration":0.0030610910000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"28'85","reported_seq":129,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:51.494966+0000","last_change":"2023-11-27T21:22:51.494988+0000","last_active":"2023-11-27T21:22:51.494966+0000","last_peered":"2023-11-27T21:22:51.494966+0000","last_clean":"2023-11-27T21:22:51.494966+0000","last_became_active":"2023-11-27T20:55:00.789772+0000","last_became_peered":"2023-11-27T20:55:00.789772+0000","last_unstale":"2023-11-27T21:22:51.494966+0000","last_undegraded":"2023-11-27T21:22:51.494966+0000","last_fullsized":"2023-11-27T21:22:51.494966+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'85","last_scrub_stamp":"2023-11-27T21:22:51.494889+0000","last_deep_scrub":"28'85","last_deep_scrub_stamp":"2023-11-27T21:22:51.494889+0000","last_clean_scrub_stamp":"2023-11-27T21:22:51.494889+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:34:42.390103+0000","scrub_duration":0.0013219589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"28'169","reported_seq":204,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.736963+0000","last_change":"2023-11-27T21:22:21.736983+0000","last_active":"2023-11-27T21:22:21.736963+0000","last_peered":"2023-11-27T21:22:21.736963+0000","last_clean":"2023-11-27T21:22:21.736963+0000","last_became_active":"2023-11-27T20:54:31.828371+0000","last_became_peered":"2023-11-27T20:54:31.828371+0000","last_unstale":"2023-11-27T21:22:21.736963+0000","last_undegraded":"2023-11-27T21:22:21.736963+0000","last_fullsized":"2023-11-27T21:22:21.736963+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'169","last_scrub_stamp":"2023-11-27T21:22:21.736882+0000","last_deep_scrub":"28'169","last_deep_scrub_stamp":"2023-11-27T21:22:21.736882+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.736882+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:39:05.705679+0000","scrub_duration":0.0027207239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":6774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"28'74","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:52.514077+0000","last_change":"2023-11-27T21:22:52.514095+0000","last_active":"2023-11-27T21:22:52.514077+0000","last_peered":"2023-11-27T21:22:52.514077+0000","last_clean":"2023-11-27T21:22:52.514077+0000","last_became_active":"2023-11-27T20:54:27.498279+0000","last_became_peered":"2023-11-27T20:54:27.498279+0000","last_unstale":"2023-11-27T21:22:52.514077+0000","last_undegraded":"2023-11-27T21:22:52.514077+0000","last_fullsized":"2023-11-27T21:22:52.514077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'74","last_scrub_stamp":"2023-11-27T21:22:52.514018+0000","last_deep_scrub":"28'74","last_deep_scrub_stamp":"2023-11-27T21:22:52.514018+0000","last_clean_scrub_stamp":"2023-11-27T21:22:52.514018+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:32.165678+0000","scrub_duration":0.001193483,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'1124","reported_seq":1164,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:43.632238+0000","last_change":"2023-11-27T21:22:43.632238+0000","last_active":"2023-11-27T21:22:43.632238+0000","last_peered":"2023-11-27T21:22:43.632238+0000","last_clean":"2023-11-27T21:22:43.632238+0000","last_became_active":"2023-11-27T20:54:26.227503+0000","last_became_peered":"2023-11-27T20:54:26.227503+0000","last_unstale":"2023-11-27T21:22:43.632238+0000","last_undegraded":"2023-11-27T21:22:43.632238+0000","last_fullsized":"2023-11-27T21:22:43.632238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1124","last_scrub_stamp":"2023-11-27T21:22:43.632146+0000","last_deep_scrub":"28'1124","last_deep_scrub_stamp":"2023-11-27T21:22:43.632146+0000","last_clean_scrub_stamp":"2023-11-27T21:22:43.632146+0000","objects_scrubbed":3,"log_size":1124,"log_dups_size":0,"ondisk_log_size":1124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:17.249089+0000","scrub_duration":0.013154749,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1114,"num_write_kb":4562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"28'173","reported_seq":209,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:00.478094+0000","last_change":"2023-11-27T21:23:00.478130+0000","last_active":"2023-11-27T21:23:00.478094+0000","last_peered":"2023-11-27T21:23:00.478094+0000","last_clean":"2023-11-27T21:23:00.478094+0000","last_became_active":"2023-11-27T20:54:31.827631+0000","last_became_peered":"2023-11-27T20:54:31.827631+0000","last_unstale":"2023-11-27T21:23:00.478094+0000","last_undegraded":"2023-11-27T21:23:00.478094+0000","last_fullsized":"2023-11-27T21:23:00.478094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'173","last_scrub_stamp":"2023-11-27T21:23:00.478024+0000","last_deep_scrub":"28'173","last_deep_scrub_stamp":"2023-11-27T21:23:00.478024+0000","last_clean_scrub_stamp":"2023-11-27T21:23:00.478024+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:28:40.365877+0000","scrub_duration":0.0024979619999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":8292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"28'70","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:24.322960+0000","last_change":"2023-11-27T21:22:24.322960+0000","last_active":"2023-11-27T21:22:24.322960+0000","last_peered":"2023-11-27T21:22:24.322960+0000","last_clean":"2023-11-27T21:22:24.322960+0000","last_became_active":"2023-11-27T20:54:27.510668+0000","last_became_peered":"2023-11-27T20:54:27.510668+0000","last_unstale":"2023-11-27T21:22:24.322960+0000","last_undegraded":"2023-11-27T21:22:24.322960+0000","last_fullsized":"2023-11-27T21:22:24.322960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'70","last_scrub_stamp":"2023-11-27T21:22:24.322871+0000","last_deep_scrub":"28'70","last_deep_scrub_stamp":"2023-11-27T21:22:24.322871+0000","last_clean_scrub_stamp":"2023-11-27T21:22:24.322871+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:12:30.073196+0000","scrub_duration":0.0016321840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'447","reported_seq":487,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:11.006346+0000","last_change":"2023-11-27T21:22:11.006346+0000","last_active":"2023-11-27T21:22:11.006346+0000","last_peered":"2023-11-27T21:22:11.006346+0000","last_clean":"2023-11-27T21:22:11.006346+0000","last_became_active":"2023-11-27T20:54:26.231081+0000","last_became_peered":"2023-11-27T20:54:26.231081+0000","last_unstale":"2023-11-27T21:22:11.006346+0000","last_undegraded":"2023-11-27T21:22:11.006346+0000","last_fullsized":"2023-11-27T21:22:11.006346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'447","last_scrub_stamp":"2023-11-27T21:22:11.006247+0000","last_deep_scrub":"28'447","last_deep_scrub_stamp":"2023-11-27T21:22:11.006247+0000","last_clean_scrub_stamp":"2023-11-27T21:22:11.006247+0000","objects_scrubbed":2,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:24:18.182726+0000","scrub_duration":0.0020915840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"28'191","reported_seq":227,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:52.442803+0000","last_change":"2023-11-27T21:22:52.442823+0000","last_active":"2023-11-27T21:22:52.442803+0000","last_peered":"2023-11-27T21:22:52.442803+0000","last_clean":"2023-11-27T21:22:52.442803+0000","last_became_active":"2023-11-27T20:54:31.816700+0000","last_became_peered":"2023-11-27T20:54:31.816700+0000","last_unstale":"2023-11-27T21:22:52.442803+0000","last_undegraded":"2023-11-27T21:22:52.442803+0000","last_fullsized":"2023-11-27T21:22:52.442803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'191","last_scrub_stamp":"2023-11-27T21:22:52.442732+0000","last_deep_scrub":"28'191","last_deep_scrub_stamp":"2023-11-27T21:22:52.442732+0000","last_clean_scrub_stamp":"2023-11-27T21:22:52.442732+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:05:38.633591+0000","scrub_duration":0.0028160640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":12458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"28'73","reported_seq":112,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:39.536435+0000","last_change":"2023-11-27T21:22:39.536481+0000","last_active":"2023-11-27T21:22:39.536435+0000","last_peered":"2023-11-27T21:22:39.536435+0000","last_clean":"2023-11-27T21:22:39.536435+0000","last_became_active":"2023-11-27T20:54:27.509961+0000","last_became_peered":"2023-11-27T20:54:27.509961+0000","last_unstale":"2023-11-27T21:22:39.536435+0000","last_undegraded":"2023-11-27T21:22:39.536435+0000","last_fullsized":"2023-11-27T21:22:39.536435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'73","last_scrub_stamp":"2023-11-27T21:22:39.536306+0000","last_deep_scrub":"28'73","last_deep_scrub_stamp":"2023-11-27T21:22:39.536306+0000","last_clean_scrub_stamp":"2023-11-27T21:22:39.536306+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:15:26.032520+0000","scrub_duration":0.001632695,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'339","reported_seq":379,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:17.537795+0000","last_change":"2023-11-27T21:22:17.537795+0000","last_active":"2023-11-27T21:22:17.537795+0000","last_peered":"2023-11-27T21:22:17.537795+0000","last_clean":"2023-11-27T21:22:17.537795+0000","last_became_active":"2023-11-27T20:54:26.223717+0000","last_became_peered":"2023-11-27T20:54:26.223717+0000","last_unstale":"2023-11-27T21:22:17.537795+0000","last_undegraded":"2023-11-27T21:22:17.537795+0000","last_fullsized":"2023-11-27T21:22:17.537795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'339","last_scrub_stamp":"2023-11-27T21:22:17.537656+0000","last_deep_scrub":"28'339","last_deep_scrub_stamp":"2023-11-27T21:22:17.537656+0000","last_clean_scrub_stamp":"2023-11-27T21:22:17.537656+0000","objects_scrubbed":4,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:35:27.345606+0000","scrub_duration":0.0048066070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":333,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'146","reported_seq":182,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:31.285973+0000","last_change":"2023-11-27T21:22:31.285997+0000","last_active":"2023-11-27T21:22:31.285973+0000","last_peered":"2023-11-27T21:22:31.285973+0000","last_clean":"2023-11-27T21:22:31.285973+0000","last_became_active":"2023-11-27T20:54:31.836346+0000","last_became_peered":"2023-11-27T20:54:31.836346+0000","last_unstale":"2023-11-27T21:22:31.285973+0000","last_undegraded":"2023-11-27T21:22:31.285973+0000","last_fullsized":"2023-11-27T21:22:31.285973+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'146","last_scrub_stamp":"2023-11-27T21:22:31.285890+0000","last_deep_scrub":"28'146","last_deep_scrub_stamp":"2023-11-27T21:22:31.285890+0000","last_clean_scrub_stamp":"2023-11-27T21:22:31.285890+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:35:41.093841+0000","scrub_duration":0.0026461219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":6504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'66","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:18.554510+0000","last_change":"2023-11-27T21:22:18.554510+0000","last_active":"2023-11-27T21:22:18.554510+0000","last_peered":"2023-11-27T21:22:18.554510+0000","last_clean":"2023-11-27T21:22:18.554510+0000","last_became_active":"2023-11-27T20:54:27.493327+0000","last_became_peered":"2023-11-27T20:54:27.493327+0000","last_unstale":"2023-11-27T21:22:18.554510+0000","last_undegraded":"2023-11-27T21:22:18.554510+0000","last_fullsized":"2023-11-27T21:22:18.554510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'66","last_scrub_stamp":"2023-11-27T21:22:18.554433+0000","last_deep_scrub":"28'66","last_deep_scrub_stamp":"2023-11-27T21:22:18.554433+0000","last_clean_scrub_stamp":"2023-11-27T21:22:18.554433+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:39:55.933857+0000","scrub_duration":0.0016646670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"28'8","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.398392+0000","last_change":"2023-11-27T21:22:02.398392+0000","last_active":"2023-11-27T21:22:02.398392+0000","last_peered":"2023-11-27T21:22:02.398392+0000","last_clean":"2023-11-27T21:22:02.398392+0000","last_became_active":"2023-11-27T20:54:26.227120+0000","last_became_peered":"2023-11-27T20:54:26.227120+0000","last_unstale":"2023-11-27T21:22:02.398392+0000","last_undegraded":"2023-11-27T21:22:02.398392+0000","last_fullsized":"2023-11-27T21:22:02.398392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2023-11-27T21:22:02.398284+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2023-11-27T21:22:02.398284+0000","last_clean_scrub_stamp":"2023-11-27T21:22:02.398284+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:09:04.340440+0000","scrub_duration":0.00264496,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'197","reported_seq":242,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:46.762074+0000","last_change":"2023-11-27T21:22:46.762092+0000","last_active":"2023-11-27T21:22:46.762074+0000","last_peered":"2023-11-27T21:22:46.762074+0000","last_clean":"2023-11-27T21:22:46.762074+0000","last_became_active":"2023-11-27T20:55:01.286057+0000","last_became_peered":"2023-11-27T20:55:01.286057+0000","last_unstale":"2023-11-27T21:22:46.762074+0000","last_undegraded":"2023-11-27T21:22:46.762074+0000","last_fullsized":"2023-11-27T21:22:46.762074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'197","last_scrub_stamp":"2023-11-27T21:22:46.762011+0000","last_deep_scrub":"28'197","last_deep_scrub_stamp":"2023-11-27T21:22:46.762011+0000","last_clean_scrub_stamp":"2023-11-27T21:22:46.762011+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:05:20.380594+0000","scrub_duration":0.0026407079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":17829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5,7],"acting":[2,1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"28'63","reported_seq":102,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:04.544551+0000","last_change":"2023-11-27T21:22:04.544551+0000","last_active":"2023-11-27T21:22:04.544551+0000","last_peered":"2023-11-27T21:22:04.544551+0000","last_clean":"2023-11-27T21:22:04.544551+0000","last_became_active":"2023-11-27T20:54:27.510573+0000","last_became_peered":"2023-11-27T20:54:27.510573+0000","last_unstale":"2023-11-27T21:22:04.544551+0000","last_undegraded":"2023-11-27T21:22:04.544551+0000","last_fullsized":"2023-11-27T21:22:04.544551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'63","last_scrub_stamp":"2023-11-27T21:22:04.544471+0000","last_deep_scrub":"28'63","last_deep_scrub_stamp":"2023-11-27T21:22:04.544471+0000","last_clean_scrub_stamp":"2023-11-27T21:22:04.544471+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:57:01.291364+0000","scrub_duration":0.0011139559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'17","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:50.541112+0000","last_change":"2023-11-27T21:22:50.541155+0000","last_active":"2023-11-27T21:22:50.541112+0000","last_peered":"2023-11-27T21:22:50.541112+0000","last_clean":"2023-11-27T21:22:50.541112+0000","last_became_active":"2023-11-27T20:54:26.224412+0000","last_became_peered":"2023-11-27T20:54:26.224412+0000","last_unstale":"2023-11-27T21:22:50.541112+0000","last_undegraded":"2023-11-27T21:22:50.541112+0000","last_fullsized":"2023-11-27T21:22:50.541112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'17","last_scrub_stamp":"2023-11-27T21:22:50.541037+0000","last_deep_scrub":"28'17","last_deep_scrub_stamp":"2023-11-27T21:22:50.541037+0000","last_clean_scrub_stamp":"2023-11-27T21:22:50.541037+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:21:53.747491+0000","scrub_duration":0.003553072,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'174","reported_seq":212,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:24.777150+0000","last_change":"2023-11-27T21:22:24.777150+0000","last_active":"2023-11-27T21:22:24.777150+0000","last_peered":"2023-11-27T21:22:24.777150+0000","last_clean":"2023-11-27T21:22:24.777150+0000","last_became_active":"2023-11-27T20:54:31.819371+0000","last_became_peered":"2023-11-27T20:54:31.819371+0000","last_unstale":"2023-11-27T21:22:24.777150+0000","last_undegraded":"2023-11-27T21:22:24.777150+0000","last_fullsized":"2023-11-27T21:22:24.777150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'174","last_scrub_stamp":"2023-11-27T21:22:24.777034+0000","last_deep_scrub":"28'174","last_deep_scrub_stamp":"2023-11-27T21:22:24.777034+0000","last_clean_scrub_stamp":"2023-11-27T21:22:24.777034+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:57:18.687113+0000","scrub_duration":0.0029222290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":8398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"28'71","reported_seq":110,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:05.539610+0000","last_change":"2023-11-27T21:22:05.539610+0000","last_active":"2023-11-27T21:22:05.539610+0000","last_peered":"2023-11-27T21:22:05.539610+0000","last_clean":"2023-11-27T21:22:05.539610+0000","last_became_active":"2023-11-27T20:54:27.500455+0000","last_became_peered":"2023-11-27T20:54:27.500455+0000","last_unstale":"2023-11-27T21:22:05.539610+0000","last_undegraded":"2023-11-27T21:22:05.539610+0000","last_fullsized":"2023-11-27T21:22:05.539610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'71","last_scrub_stamp":"2023-11-27T21:22:05.539526+0000","last_deep_scrub":"28'71","last_deep_scrub_stamp":"2023-11-27T21:22:05.539526+0000","last_clean_scrub_stamp":"2023-11-27T21:22:05.539526+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:13:29.395135+0000","scrub_duration":0.001413643,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'163","reported_seq":203,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:14.476551+0000","last_change":"2023-11-27T21:22:14.476551+0000","last_active":"2023-11-27T21:22:14.476551+0000","last_peered":"2023-11-27T21:22:14.476551+0000","last_clean":"2023-11-27T21:22:14.476551+0000","last_became_active":"2023-11-27T20:54:26.222981+0000","last_became_peered":"2023-11-27T20:54:26.222981+0000","last_unstale":"2023-11-27T21:22:14.476551+0000","last_undegraded":"2023-11-27T21:22:14.476551+0000","last_fullsized":"2023-11-27T21:22:14.476551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'163","last_scrub_stamp":"2023-11-27T21:22:14.476461+0000","last_deep_scrub":"28'163","last_deep_scrub_stamp":"2023-11-27T21:22:14.476461+0000","last_clean_scrub_stamp":"2023-11-27T21:22:14.476461+0000","objects_scrubbed":4,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:08:10.937295+0000","scrub_duration":0.0035278750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":391,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"28'157","reported_seq":195,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:16.485011+0000","last_change":"2023-11-27T21:23:16.485068+0000","last_active":"2023-11-27T21:23:16.485011+0000","last_peered":"2023-11-27T21:23:16.485011+0000","last_clean":"2023-11-27T21:23:16.485011+0000","last_became_active":"2023-11-27T20:54:31.813765+0000","last_became_peered":"2023-11-27T20:54:31.813765+0000","last_unstale":"2023-11-27T21:23:16.485011+0000","last_undegraded":"2023-11-27T21:23:16.485011+0000","last_fullsized":"2023-11-27T21:23:16.485011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'157","last_scrub_stamp":"2023-11-27T21:23:16.484882+0000","last_deep_scrub":"28'157","last_deep_scrub_stamp":"2023-11-27T21:23:16.484882+0000","last_clean_scrub_stamp":"2023-11-27T21:23:16.484882+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:38:08.265429+0000","scrub_duration":0.0030121319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":11921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"28'78","reported_seq":118,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.165911+0000","last_change":"2023-11-27T21:22:21.165911+0000","last_active":"2023-11-27T21:22:21.165911+0000","last_peered":"2023-11-27T21:22:21.165911+0000","last_clean":"2023-11-27T21:22:21.165911+0000","last_became_active":"2023-11-27T20:54:27.506210+0000","last_became_peered":"2023-11-27T20:54:27.506210+0000","last_unstale":"2023-11-27T21:22:21.165911+0000","last_undegraded":"2023-11-27T21:22:21.165911+0000","last_fullsized":"2023-11-27T21:22:21.165911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'78","last_scrub_stamp":"2023-11-27T21:22:21.165807+0000","last_deep_scrub":"28'78","last_deep_scrub_stamp":"2023-11-27T21:22:21.165807+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.165807+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:48:07.689268+0000","scrub_duration":0.0012874189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'248","reported_seq":289,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:27.576142+0000","last_change":"2023-11-27T21:22:27.576142+0000","last_active":"2023-11-27T21:22:27.576142+0000","last_peered":"2023-11-27T21:22:27.576142+0000","last_clean":"2023-11-27T21:22:27.576142+0000","last_became_active":"2023-11-27T20:54:26.219775+0000","last_became_peered":"2023-11-27T20:54:26.219775+0000","last_unstale":"2023-11-27T21:22:27.576142+0000","last_undegraded":"2023-11-27T21:22:27.576142+0000","last_fullsized":"2023-11-27T21:22:27.576142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'248","last_scrub_stamp":"2023-11-27T21:22:27.576061+0000","last_deep_scrub":"28'248","last_deep_scrub_stamp":"2023-11-27T21:22:27.576061+0000","last_clean_scrub_stamp":"2023-11-27T21:22:27.576061+0000","objects_scrubbed":3,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:13:50.937641+0000","scrub_duration":0.004309823,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"28'177","reported_seq":215,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:30.072362+0000","last_change":"2023-11-27T21:22:30.072362+0000","last_active":"2023-11-27T21:22:30.072362+0000","last_peered":"2023-11-27T21:22:30.072362+0000","last_clean":"2023-11-27T21:22:30.072362+0000","last_became_active":"2023-11-27T20:54:31.825591+0000","last_became_peered":"2023-11-27T20:54:31.825591+0000","last_unstale":"2023-11-27T21:22:30.072362+0000","last_undegraded":"2023-11-27T21:22:30.072362+0000","last_fullsized":"2023-11-27T21:22:30.072362+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'177","last_scrub_stamp":"2023-11-27T21:22:30.072272+0000","last_deep_scrub":"28'177","last_deep_scrub_stamp":"2023-11-27T21:22:30.072272+0000","last_clean_scrub_stamp":"2023-11-27T21:22:30.072272+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:48:50.193448+0000","scrub_duration":0.002828517,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":8135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"28'65","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:06.889864+0000","last_change":"2023-11-27T21:22:06.889864+0000","last_active":"2023-11-27T21:22:06.889864+0000","last_peered":"2023-11-27T21:22:06.889864+0000","last_clean":"2023-11-27T21:22:06.889864+0000","last_became_active":"2023-11-27T20:54:27.500677+0000","last_became_peered":"2023-11-27T20:54:27.500677+0000","last_unstale":"2023-11-27T21:22:06.889864+0000","last_undegraded":"2023-11-27T21:22:06.889864+0000","last_fullsized":"2023-11-27T21:22:06.889864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'65","last_scrub_stamp":"2023-11-27T21:22:06.889775+0000","last_deep_scrub":"28'65","last_deep_scrub_stamp":"2023-11-27T21:22:06.889775+0000","last_clean_scrub_stamp":"2023-11-27T21:22:06.889775+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:19:12.052405+0000","scrub_duration":0.0014482970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"28'6","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:26.399718+0000","last_change":"2023-11-27T21:22:26.399718+0000","last_active":"2023-11-27T21:22:26.399718+0000","last_peered":"2023-11-27T21:22:26.399718+0000","last_clean":"2023-11-27T21:22:26.399718+0000","last_became_active":"2023-11-27T20:54:26.227605+0000","last_became_peered":"2023-11-27T20:54:26.227605+0000","last_unstale":"2023-11-27T21:22:26.399718+0000","last_undegraded":"2023-11-27T21:22:26.399718+0000","last_fullsized":"2023-11-27T21:22:26.399718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2023-11-27T21:22:26.399642+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2023-11-27T21:22:26.399642+0000","last_clean_scrub_stamp":"2023-11-27T21:22:26.399642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:39:10.368439+0000","scrub_duration":0.0011058719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"28'178","reported_seq":216,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:27.137378+0000","last_change":"2023-11-27T21:22:27.137378+0000","last_active":"2023-11-27T21:22:27.137378+0000","last_peered":"2023-11-27T21:22:27.137378+0000","last_clean":"2023-11-27T21:22:27.137378+0000","last_became_active":"2023-11-27T20:54:31.826406+0000","last_became_peered":"2023-11-27T20:54:31.826406+0000","last_unstale":"2023-11-27T21:22:27.137378+0000","last_undegraded":"2023-11-27T21:22:27.137378+0000","last_fullsized":"2023-11-27T21:22:27.137378+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'178","last_scrub_stamp":"2023-11-27T21:22:27.137245+0000","last_deep_scrub":"28'178","last_deep_scrub_stamp":"2023-11-27T21:22:27.137245+0000","last_clean_scrub_stamp":"2023-11-27T21:22:27.137245+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:57:21.047325+0000","scrub_duration":0.0027180899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":6957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"28'85","reported_seq":125,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:48.468768+0000","last_change":"2023-11-27T21:22:48.468768+0000","last_active":"2023-11-27T21:22:48.468768+0000","last_peered":"2023-11-27T21:22:48.468768+0000","last_clean":"2023-11-27T21:22:48.468768+0000","last_became_active":"2023-11-27T20:54:27.516686+0000","last_became_peered":"2023-11-27T20:54:27.516686+0000","last_unstale":"2023-11-27T21:22:48.468768+0000","last_undegraded":"2023-11-27T21:22:48.468768+0000","last_fullsized":"2023-11-27T21:22:48.468768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'85","last_scrub_stamp":"2023-11-27T21:22:48.468674+0000","last_deep_scrub":"28'85","last_deep_scrub_stamp":"2023-11-27T21:22:48.468674+0000","last_clean_scrub_stamp":"2023-11-27T21:22:48.468674+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:49:18.145204+0000","scrub_duration":0.0012105060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'918","reported_seq":959,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:23.574100+0000","last_change":"2023-11-27T21:22:23.574100+0000","last_active":"2023-11-27T21:22:23.574100+0000","last_peered":"2023-11-27T21:22:23.574100+0000","last_clean":"2023-11-27T21:22:23.574100+0000","last_became_active":"2023-11-27T20:54:26.229985+0000","last_became_peered":"2023-11-27T20:54:26.229985+0000","last_unstale":"2023-11-27T21:22:23.574100+0000","last_undegraded":"2023-11-27T21:22:23.574100+0000","last_fullsized":"2023-11-27T21:22:23.574100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'918","last_scrub_stamp":"2023-11-27T21:22:23.574017+0000","last_deep_scrub":"28'918","last_deep_scrub_stamp":"2023-11-27T21:22:23.574017+0000","last_clean_scrub_stamp":"2023-11-27T21:22:23.574017+0000","objects_scrubbed":3,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:34:39.196551+0000","scrub_duration":0.013397599,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206463,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":911,"num_write_kb":4580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"28'139","reported_seq":173,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:47.755242+0000","last_change":"2023-11-27T21:22:47.755262+0000","last_active":"2023-11-27T21:22:47.755242+0000","last_peered":"2023-11-27T21:22:47.755242+0000","last_clean":"2023-11-27T21:22:47.755242+0000","last_became_active":"2023-11-27T20:55:00.588018+0000","last_became_peered":"2023-11-27T20:55:00.588018+0000","last_unstale":"2023-11-27T21:22:47.755242+0000","last_undegraded":"2023-11-27T21:22:47.755242+0000","last_fullsized":"2023-11-27T21:22:47.755242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'139","last_scrub_stamp":"2023-11-27T21:22:47.755175+0000","last_deep_scrub":"28'139","last_deep_scrub_stamp":"2023-11-27T21:22:47.755175+0000","last_clean_scrub_stamp":"2023-11-27T21:22:47.755175+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:43.095816+0000","scrub_duration":0.003086409,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":13169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,0,3],"acting":[2,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'77","reported_seq":117,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:59.348680+0000","last_change":"2023-11-27T21:22:59.348724+0000","last_active":"2023-11-27T21:22:59.348680+0000","last_peered":"2023-11-27T21:22:59.348680+0000","last_clean":"2023-11-27T21:22:59.348680+0000","last_became_active":"2023-11-27T20:54:27.512093+0000","last_became_peered":"2023-11-27T20:54:27.512093+0000","last_unstale":"2023-11-27T21:22:59.348680+0000","last_undegraded":"2023-11-27T21:22:59.348680+0000","last_fullsized":"2023-11-27T21:22:59.348680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:59.348610+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:59.348610+0000","last_clean_scrub_stamp":"2023-11-27T21:22:59.348610+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:15:13.167920+0000","scrub_duration":0.001147002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'273","reported_seq":483,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:15.255951+0000","last_change":"2023-11-27T21:22:15.255951+0000","last_active":"2023-11-27T21:22:15.255951+0000","last_peered":"2023-11-27T21:22:15.255951+0000","last_clean":"2023-11-27T21:22:15.255951+0000","last_became_active":"2023-11-27T20:54:26.230548+0000","last_became_peered":"2023-11-27T20:54:26.230548+0000","last_unstale":"2023-11-27T21:22:15.255951+0000","last_undegraded":"2023-11-27T21:22:15.255951+0000","last_fullsized":"2023-11-27T21:22:15.255951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'273","last_scrub_stamp":"2023-11-27T21:22:15.255867+0000","last_deep_scrub":"28'273","last_deep_scrub_stamp":"2023-11-27T21:22:15.255867+0000","last_clean_scrub_stamp":"2023-11-27T21:22:15.255867+0000","objects_scrubbed":4,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:44:57.904993+0000","scrub_duration":0.003822022,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28446,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":170,"num_read_kb":173,"num_write":266,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"28'141","reported_seq":187,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:35.088318+0000","last_change":"2023-11-27T21:22:35.088318+0000","last_active":"2023-11-27T21:22:35.088318+0000","last_peered":"2023-11-27T21:22:35.088318+0000","last_clean":"2023-11-27T21:22:35.088318+0000","last_became_active":"2023-11-27T20:55:00.594705+0000","last_became_peered":"2023-11-27T20:55:00.594705+0000","last_unstale":"2023-11-27T21:22:35.088318+0000","last_undegraded":"2023-11-27T21:22:35.088318+0000","last_fullsized":"2023-11-27T21:22:35.088318+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'141","last_scrub_stamp":"2023-11-27T21:22:35.088216+0000","last_deep_scrub":"28'141","last_deep_scrub_stamp":"2023-11-27T21:22:35.088216+0000","last_clean_scrub_stamp":"2023-11-27T21:22:35.088216+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:06:09.356209+0000","scrub_duration":0.002816444,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":12035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"28'77","reported_seq":117,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:16.088562+0000","last_change":"2023-11-27T21:22:16.088562+0000","last_active":"2023-11-27T21:22:16.088562+0000","last_peered":"2023-11-27T21:22:16.088562+0000","last_clean":"2023-11-27T21:22:16.088562+0000","last_became_active":"2023-11-27T20:54:27.502941+0000","last_became_peered":"2023-11-27T20:54:27.502941+0000","last_unstale":"2023-11-27T21:22:16.088562+0000","last_undegraded":"2023-11-27T21:22:16.088562+0000","last_fullsized":"2023-11-27T21:22:16.088562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:16.088473+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:16.088473+0000","last_clean_scrub_stamp":"2023-11-27T21:22:16.088473+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:26:26.798459+0000","scrub_duration":0.001453584,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'12","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:44.601666+0000","last_change":"2023-11-27T21:22:44.601690+0000","last_active":"2023-11-27T21:22:44.601666+0000","last_peered":"2023-11-27T21:22:44.601666+0000","last_clean":"2023-11-27T21:22:44.601666+0000","last_became_active":"2023-11-27T20:54:26.214166+0000","last_became_peered":"2023-11-27T20:54:26.214166+0000","last_unstale":"2023-11-27T21:22:44.601666+0000","last_undegraded":"2023-11-27T21:22:44.601666+0000","last_fullsized":"2023-11-27T21:22:44.601666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2023-11-27T21:22:44.601613+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2023-11-27T21:22:44.601613+0000","last_clean_scrub_stamp":"2023-11-27T21:22:44.601613+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:37:36.382160+0000","scrub_duration":0.0026042959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"28'132","reported_seq":169,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:08.370422+0000","last_change":"2023-11-27T21:23:08.370442+0000","last_active":"2023-11-27T21:23:08.370422+0000","last_peered":"2023-11-27T21:23:08.370422+0000","last_clean":"2023-11-27T21:23:08.370422+0000","last_became_active":"2023-11-27T20:54:31.832196+0000","last_became_peered":"2023-11-27T20:54:31.832196+0000","last_unstale":"2023-11-27T21:23:08.370422+0000","last_undegraded":"2023-11-27T21:23:08.370422+0000","last_fullsized":"2023-11-27T21:23:08.370422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'132","last_scrub_stamp":"2023-11-27T21:23:08.370358+0000","last_deep_scrub":"28'132","last_deep_scrub_stamp":"2023-11-27T21:23:08.370358+0000","last_clean_scrub_stamp":"2023-11-27T21:23:08.370358+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:54:25.150426+0000","scrub_duration":0.0024136520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":8461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'69","reported_seq":109,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:00.632159+0000","last_change":"2023-11-27T21:23:00.632159+0000","last_active":"2023-11-27T21:23:00.632159+0000","last_peered":"2023-11-27T21:23:00.632159+0000","last_clean":"2023-11-27T21:23:00.632159+0000","last_became_active":"2023-11-27T20:54:27.433161+0000","last_became_peered":"2023-11-27T20:54:27.433161+0000","last_unstale":"2023-11-27T21:23:00.632159+0000","last_undegraded":"2023-11-27T21:23:00.632159+0000","last_fullsized":"2023-11-27T21:23:00.632159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'69","last_scrub_stamp":"2023-11-27T21:23:00.632077+0000","last_deep_scrub":"28'69","last_deep_scrub_stamp":"2023-11-27T21:23:00.632077+0000","last_clean_scrub_stamp":"2023-11-27T21:23:00.632077+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:09:39.733645+0000","scrub_duration":0.0012750789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'13","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:45.560181+0000","last_change":"2023-11-27T21:22:45.560181+0000","last_active":"2023-11-27T21:22:45.560181+0000","last_peered":"2023-11-27T21:22:45.560181+0000","last_clean":"2023-11-27T21:22:45.560181+0000","last_became_active":"2023-11-27T20:54:26.227133+0000","last_became_peered":"2023-11-27T20:54:26.227133+0000","last_unstale":"2023-11-27T21:22:45.560181+0000","last_undegraded":"2023-11-27T21:22:45.560181+0000","last_fullsized":"2023-11-27T21:22:45.560181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2023-11-27T21:22:45.560102+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2023-11-27T21:22:45.560102+0000","last_clean_scrub_stamp":"2023-11-27T21:22:45.560102+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:50:13.671235+0000","scrub_duration":0.0038425709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":195,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:03.333433+0000","last_change":"2023-11-27T21:22:03.333433+0000","last_active":"2023-11-27T21:22:03.333433+0000","last_peered":"2023-11-27T21:22:03.333433+0000","last_clean":"2023-11-27T21:22:03.333433+0000","last_became_active":"2023-11-27T20:54:11.452181+0000","last_became_peered":"2023-11-27T20:54:11.452181+0000","last_unstale":"2023-11-27T21:22:03.333433+0000","last_undegraded":"2023-11-27T21:22:03.333433+0000","last_fullsized":"2023-11-27T21:22:03.333433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2023-11-27T21:22:03.333356+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2023-11-27T21:22:03.333356+0000","last_clean_scrub_stamp":"2023-11-27T21:22:03.333356+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:51:11.809770+0000","scrub_duration":0.0045126749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'171","reported_seq":208,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:58.455643+0000","last_change":"2023-11-27T21:22:58.455677+0000","last_active":"2023-11-27T21:22:58.455643+0000","last_peered":"2023-11-27T21:22:58.455643+0000","last_clean":"2023-11-27T21:22:58.455643+0000","last_became_active":"2023-11-27T20:54:31.818048+0000","last_became_peered":"2023-11-27T20:54:31.818048+0000","last_unstale":"2023-11-27T21:22:58.455643+0000","last_undegraded":"2023-11-27T21:22:58.455643+0000","last_fullsized":"2023-11-27T21:22:58.455643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'171","last_scrub_stamp":"2023-11-27T21:22:58.455571+0000","last_deep_scrub":"28'171","last_deep_scrub_stamp":"2023-11-27T21:22:58.455571+0000","last_clean_scrub_stamp":"2023-11-27T21:22:58.455571+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:48:52.771160+0000","scrub_duration":0.0021714260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":10034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"28'75","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.521856+0000","last_change":"2023-11-27T21:22:02.521856+0000","last_active":"2023-11-27T21:22:02.521856+0000","last_peered":"2023-11-27T21:22:02.521856+0000","last_clean":"2023-11-27T21:22:02.521856+0000","last_became_active":"2023-11-27T20:54:27.493256+0000","last_became_peered":"2023-11-27T20:54:27.493256+0000","last_unstale":"2023-11-27T21:22:02.521856+0000","last_undegraded":"2023-11-27T21:22:02.521856+0000","last_fullsized":"2023-11-27T21:22:02.521856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:02.521779+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:02.521779+0000","last_clean_scrub_stamp":"2023-11-27T21:22:02.521779+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:35:12.329730+0000","scrub_duration":0.0011699499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'1021","reported_seq":1061,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:09.047006+0000","last_change":"2023-11-27T21:22:09.047006+0000","last_active":"2023-11-27T21:22:09.047006+0000","last_peered":"2023-11-27T21:22:09.047006+0000","last_clean":"2023-11-27T21:22:09.047006+0000","last_became_active":"2023-11-27T20:54:26.229796+0000","last_became_peered":"2023-11-27T20:54:26.229796+0000","last_unstale":"2023-11-27T21:22:09.047006+0000","last_undegraded":"2023-11-27T21:22:09.047006+0000","last_fullsized":"2023-11-27T21:22:09.047006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1021","last_scrub_stamp":"2023-11-27T21:22:09.046925+0000","last_deep_scrub":"28'1021","last_deep_scrub_stamp":"2023-11-27T21:22:09.046925+0000","last_clean_scrub_stamp":"2023-11-27T21:22:09.046925+0000","objects_scrubbed":3,"log_size":1021,"log_dups_size":0,"ondisk_log_size":1021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:11.549792+0000","scrub_duration":0.012870006999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1013,"num_write_kb":4611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'180","reported_seq":217,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:34.732400+0000","last_change":"2023-11-27T21:22:34.732400+0000","last_active":"2023-11-27T21:22:34.732400+0000","last_peered":"2023-11-27T21:22:34.732400+0000","last_clean":"2023-11-27T21:22:34.732400+0000","last_became_active":"2023-11-27T20:54:31.825080+0000","last_became_peered":"2023-11-27T20:54:31.825080+0000","last_unstale":"2023-11-27T21:22:34.732400+0000","last_undegraded":"2023-11-27T21:22:34.732400+0000","last_fullsized":"2023-11-27T21:22:34.732400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'180","last_scrub_stamp":"2023-11-27T21:22:34.732270+0000","last_deep_scrub":"28'180","last_deep_scrub_stamp":"2023-11-27T21:22:34.732270+0000","last_clean_scrub_stamp":"2023-11-27T21:22:34.732270+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:57.356294+0000","scrub_duration":0.0029486389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":9643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'78","reported_seq":109,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:25.609003+0000","last_change":"2023-11-27T21:23:25.609022+0000","last_active":"2023-11-27T21:23:25.609003+0000","last_peered":"2023-11-27T21:23:25.609003+0000","last_clean":"2023-11-27T21:23:25.609003+0000","last_became_active":"2023-11-27T20:55:00.593249+0000","last_became_peered":"2023-11-27T20:55:00.593249+0000","last_unstale":"2023-11-27T21:23:25.609003+0000","last_undegraded":"2023-11-27T21:23:25.609003+0000","last_fullsized":"2023-11-27T21:23:25.609003+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'78","last_scrub_stamp":"2023-11-27T21:23:25.608938+0000","last_deep_scrub":"28'78","last_deep_scrub_stamp":"2023-11-27T21:23:25.608938+0000","last_clean_scrub_stamp":"2023-11-27T21:23:25.608938+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:43:40.216265+0000","scrub_duration":0.001264891,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"28'438","reported_seq":478,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:25.368503+0000","last_change":"2023-11-27T21:22:25.368503+0000","last_active":"2023-11-27T21:22:25.368503+0000","last_peered":"2023-11-27T21:22:25.368503+0000","last_clean":"2023-11-27T21:22:25.368503+0000","last_became_active":"2023-11-27T20:54:26.225886+0000","last_became_peered":"2023-11-27T20:54:26.225886+0000","last_unstale":"2023-11-27T21:22:25.368503+0000","last_undegraded":"2023-11-27T21:22:25.368503+0000","last_fullsized":"2023-11-27T21:22:25.368503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'438","last_scrub_stamp":"2023-11-27T21:22:25.368401+0000","last_deep_scrub":"28'438","last_deep_scrub_stamp":"2023-11-27T21:22:25.368401+0000","last_clean_scrub_stamp":"2023-11-27T21:22:25.368401+0000","objects_scrubbed":2,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:38:39.549160+0000","scrub_duration":0.0081653509999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2473984,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":2660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"28'169","reported_seq":205,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:05.310659+0000","last_change":"2023-11-27T21:23:05.310680+0000","last_active":"2023-11-27T21:23:05.310659+0000","last_peered":"2023-11-27T21:23:05.310659+0000","last_clean":"2023-11-27T21:23:05.310659+0000","last_became_active":"2023-11-27T20:54:31.828368+0000","last_became_peered":"2023-11-27T20:54:31.828368+0000","last_unstale":"2023-11-27T21:23:05.310659+0000","last_undegraded":"2023-11-27T21:23:05.310659+0000","last_fullsized":"2023-11-27T21:23:05.310659+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'169","last_scrub_stamp":"2023-11-27T21:23:05.310589+0000","last_deep_scrub":"28'169","last_deep_scrub_stamp":"2023-11-27T21:23:05.310589+0000","last_clean_scrub_stamp":"2023-11-27T21:23:05.310589+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:59.291860+0000","scrub_duration":0.0026402109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":8527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"28'75","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:39.327230+0000","last_change":"2023-11-27T21:22:39.327230+0000","last_active":"2023-11-27T21:22:39.327230+0000","last_peered":"2023-11-27T21:22:39.327230+0000","last_clean":"2023-11-27T21:22:39.327230+0000","last_became_active":"2023-11-27T20:54:27.515416+0000","last_became_peered":"2023-11-27T20:54:27.515416+0000","last_unstale":"2023-11-27T21:22:39.327230+0000","last_undegraded":"2023-11-27T21:22:39.327230+0000","last_fullsized":"2023-11-27T21:22:39.327230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:39.327132+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:39.327132+0000","last_clean_scrub_stamp":"2023-11-27T21:22:39.327132+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:54:09.127655+0000","scrub_duration":0.001546927,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"28'10","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:36.534919+0000","last_change":"2023-11-27T21:22:36.534919+0000","last_active":"2023-11-27T21:22:36.534919+0000","last_peered":"2023-11-27T21:22:36.534919+0000","last_clean":"2023-11-27T21:22:36.534919+0000","last_became_active":"2023-11-27T20:54:26.224604+0000","last_became_peered":"2023-11-27T20:54:26.224604+0000","last_unstale":"2023-11-27T21:22:36.534919+0000","last_undegraded":"2023-11-27T21:22:36.534919+0000","last_fullsized":"2023-11-27T21:22:36.534919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2023-11-27T21:22:36.534769+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2023-11-27T21:22:36.534769+0000","last_clean_scrub_stamp":"2023-11-27T21:22:36.534769+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:16:44.164481+0000","scrub_duration":0.0029681949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"28'149","reported_seq":186,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:05.434287+0000","last_change":"2023-11-27T21:23:05.434311+0000","last_active":"2023-11-27T21:23:05.434287+0000","last_peered":"2023-11-27T21:23:05.434287+0000","last_clean":"2023-11-27T21:23:05.434287+0000","last_became_active":"2023-11-27T20:54:31.819294+0000","last_became_peered":"2023-11-27T20:54:31.819294+0000","last_unstale":"2023-11-27T21:23:05.434287+0000","last_undegraded":"2023-11-27T21:23:05.434287+0000","last_fullsized":"2023-11-27T21:23:05.434287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'149","last_scrub_stamp":"2023-11-27T21:23:05.434207+0000","last_deep_scrub":"28'149","last_deep_scrub_stamp":"2023-11-27T21:23:05.434207+0000","last_clean_scrub_stamp":"2023-11-27T21:23:05.434207+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:53:30.526364+0000","scrub_duration":0.0026221619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"28'77","reported_seq":116,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:19.747472+0000","last_change":"2023-11-27T21:22:19.747472+0000","last_active":"2023-11-27T21:22:19.747472+0000","last_peered":"2023-11-27T21:22:19.747472+0000","last_clean":"2023-11-27T21:22:19.747472+0000","last_became_active":"2023-11-27T20:54:27.512663+0000","last_became_peered":"2023-11-27T20:54:27.512663+0000","last_unstale":"2023-11-27T21:22:19.747472+0000","last_undegraded":"2023-11-27T21:22:19.747472+0000","last_fullsized":"2023-11-27T21:22:19.747472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:19.747391+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:19.747391+0000","last_clean_scrub_stamp":"2023-11-27T21:22:19.747391+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:18.401292+0000","scrub_duration":0.0011077389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"28'240","reported_seq":280,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:07.317246+0000","last_change":"2023-11-27T21:22:07.317246+0000","last_active":"2023-11-27T21:22:07.317246+0000","last_peered":"2023-11-27T21:22:07.317246+0000","last_clean":"2023-11-27T21:22:07.317246+0000","last_became_active":"2023-11-27T20:54:26.225056+0000","last_became_peered":"2023-11-27T20:54:26.225056+0000","last_unstale":"2023-11-27T21:22:07.317246+0000","last_undegraded":"2023-11-27T21:22:07.317246+0000","last_fullsized":"2023-11-27T21:22:07.317246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'240","last_scrub_stamp":"2023-11-27T21:22:07.317149+0000","last_deep_scrub":"28'240","last_deep_scrub_stamp":"2023-11-27T21:22:07.317149+0000","last_clean_scrub_stamp":"2023-11-27T21:22:07.317149+0000","objects_scrubbed":2,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:41:09.468592+0000","scrub_duration":0.0039936490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"28'126","reported_seq":163,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:27.495544+0000","last_change":"2023-11-27T21:22:27.495544+0000","last_active":"2023-11-27T21:22:27.495544+0000","last_peered":"2023-11-27T21:22:27.495544+0000","last_clean":"2023-11-27T21:22:27.495544+0000","last_became_active":"2023-11-27T20:54:31.827175+0000","last_became_peered":"2023-11-27T20:54:31.827175+0000","last_unstale":"2023-11-27T21:22:27.495544+0000","last_undegraded":"2023-11-27T21:22:27.495544+0000","last_fullsized":"2023-11-27T21:22:27.495544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'126","last_scrub_stamp":"2023-11-27T21:22:27.495457+0000","last_deep_scrub":"28'126","last_deep_scrub_stamp":"2023-11-27T21:22:27.495457+0000","last_clean_scrub_stamp":"2023-11-27T21:22:27.495457+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:41:29.646900+0000","scrub_duration":0.0023736809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":7629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"28'69","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:09.572831+0000","last_change":"2023-11-27T21:22:09.572831+0000","last_active":"2023-11-27T21:22:09.572831+0000","last_peered":"2023-11-27T21:22:09.572831+0000","last_clean":"2023-11-27T21:22:09.572831+0000","last_became_active":"2023-11-27T20:54:27.498225+0000","last_became_peered":"2023-11-27T20:54:27.498225+0000","last_unstale":"2023-11-27T21:22:09.572831+0000","last_undegraded":"2023-11-27T21:22:09.572831+0000","last_fullsized":"2023-11-27T21:22:09.572831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'69","last_scrub_stamp":"2023-11-27T21:22:09.572724+0000","last_deep_scrub":"28'69","last_deep_scrub_stamp":"2023-11-27T21:22:09.572724+0000","last_clean_scrub_stamp":"2023-11-27T21:22:09.572724+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:13:34.348448+0000","scrub_duration":0.0016942400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'1037","reported_seq":1076,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:11.556868+0000","last_change":"2023-11-27T21:22:11.556868+0000","last_active":"2023-11-27T21:22:11.556868+0000","last_peered":"2023-11-27T21:22:11.556868+0000","last_clean":"2023-11-27T21:22:11.556868+0000","last_became_active":"2023-11-27T20:54:26.225333+0000","last_became_peered":"2023-11-27T20:54:26.225333+0000","last_unstale":"2023-11-27T21:22:11.556868+0000","last_undegraded":"2023-11-27T21:22:11.556868+0000","last_fullsized":"2023-11-27T21:22:11.556868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1037","last_scrub_stamp":"2023-11-27T21:22:11.556754+0000","last_deep_scrub":"28'1037","last_deep_scrub_stamp":"2023-11-27T21:22:11.556754+0000","last_clean_scrub_stamp":"2023-11-27T21:22:11.556754+0000","objects_scrubbed":9,"log_size":1037,"log_dups_size":0,"ondisk_log_size":1037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:14:01.901896+0000","scrub_duration":0.014520241999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3313963,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1025,"num_write_kb":3921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"28'159","reported_seq":195,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:11.372845+0000","last_change":"2023-11-27T21:23:11.372845+0000","last_active":"2023-11-27T21:23:11.372845+0000","last_peered":"2023-11-27T21:23:11.372845+0000","last_clean":"2023-11-27T21:23:11.372845+0000","last_became_active":"2023-11-27T20:54:31.835629+0000","last_became_peered":"2023-11-27T20:54:31.835629+0000","last_unstale":"2023-11-27T21:23:11.372845+0000","last_undegraded":"2023-11-27T21:23:11.372845+0000","last_fullsized":"2023-11-27T21:23:11.372845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'159","last_scrub_stamp":"2023-11-27T21:23:11.372700+0000","last_deep_scrub":"28'159","last_deep_scrub_stamp":"2023-11-27T21:23:11.372700+0000","last_clean_scrub_stamp":"2023-11-27T21:23:11.372700+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:43:31.453747+0000","scrub_duration":0.002592568,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":12674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'64","reported_seq":101,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:10.205669+0000","last_change":"2023-11-27T21:22:10.205669+0000","last_active":"2023-11-27T21:22:10.205669+0000","last_peered":"2023-11-27T21:22:10.205669+0000","last_clean":"2023-11-27T21:22:10.205669+0000","last_became_active":"2023-11-27T20:54:27.510775+0000","last_became_peered":"2023-11-27T20:54:27.510775+0000","last_unstale":"2023-11-27T21:22:10.205669+0000","last_undegraded":"2023-11-27T21:22:10.205669+0000","last_fullsized":"2023-11-27T21:22:10.205669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'64","last_scrub_stamp":"2023-11-27T21:22:10.205582+0000","last_deep_scrub":"28'64","last_deep_scrub_stamp":"2023-11-27T21:22:10.205582+0000","last_clean_scrub_stamp":"2023-11-27T21:22:10.205582+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:12:43.950689+0000","scrub_duration":0.001792397,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"28'1191","reported_seq":1230,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:15.427644+0000","last_change":"2023-11-27T21:22:15.427644+0000","last_active":"2023-11-27T21:22:15.427644+0000","last_peered":"2023-11-27T21:22:15.427644+0000","last_clean":"2023-11-27T21:22:15.427644+0000","last_became_active":"2023-11-27T20:54:26.226745+0000","last_became_peered":"2023-11-27T20:54:26.226745+0000","last_unstale":"2023-11-27T21:22:15.427644+0000","last_undegraded":"2023-11-27T21:22:15.427644+0000","last_fullsized":"2023-11-27T21:22:15.427644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1191","last_scrub_stamp":"2023-11-27T21:22:15.427568+0000","last_deep_scrub":"28'1191","last_deep_scrub_stamp":"2023-11-27T21:22:15.427568+0000","last_clean_scrub_stamp":"2023-11-27T21:22:15.427568+0000","objects_scrubbed":3,"log_size":1191,"log_dups_size":0,"ondisk_log_size":1191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:47:37.149646+0000","scrub_duration":0.012877517,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":4695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"28'169","reported_seq":205,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:07.327443+0000","last_change":"2023-11-27T21:23:07.327443+0000","last_active":"2023-11-27T21:23:07.327443+0000","last_peered":"2023-11-27T21:23:07.327443+0000","last_clean":"2023-11-27T21:23:07.327443+0000","last_became_active":"2023-11-27T20:54:31.831620+0000","last_became_peered":"2023-11-27T20:54:31.831620+0000","last_unstale":"2023-11-27T21:23:07.327443+0000","last_undegraded":"2023-11-27T21:23:07.327443+0000","last_fullsized":"2023-11-27T21:23:07.327443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'169","last_scrub_stamp":"2023-11-27T21:23:07.327345+0000","last_deep_scrub":"28'169","last_deep_scrub_stamp":"2023-11-27T21:23:07.327345+0000","last_clean_scrub_stamp":"2023-11-27T21:23:07.327345+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:05:45.528727+0000","scrub_duration":0.0023055969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":13064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'85","reported_seq":123,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:05.528522+0000","last_change":"2023-11-27T21:22:05.528522+0000","last_active":"2023-11-27T21:22:05.528522+0000","last_peered":"2023-11-27T21:22:05.528522+0000","last_clean":"2023-11-27T21:22:05.528522+0000","last_became_active":"2023-11-27T20:54:27.515524+0000","last_became_peered":"2023-11-27T20:54:27.515524+0000","last_unstale":"2023-11-27T21:22:05.528522+0000","last_undegraded":"2023-11-27T21:22:05.528522+0000","last_fullsized":"2023-11-27T21:22:05.528522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'85","last_scrub_stamp":"2023-11-27T21:22:05.528395+0000","last_deep_scrub":"28'85","last_deep_scrub_stamp":"2023-11-27T21:22:05.528395+0000","last_clean_scrub_stamp":"2023-11-27T21:22:05.528395+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:01:39.543628+0000","scrub_duration":0.0014329239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'245","reported_seq":284,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:49.515716+0000","last_change":"2023-11-27T21:22:49.515740+0000","last_active":"2023-11-27T21:22:49.515716+0000","last_peered":"2023-11-27T21:22:49.515716+0000","last_clean":"2023-11-27T21:22:49.515716+0000","last_became_active":"2023-11-27T20:54:26.225691+0000","last_became_peered":"2023-11-27T20:54:26.225691+0000","last_unstale":"2023-11-27T21:22:49.515716+0000","last_undegraded":"2023-11-27T21:22:49.515716+0000","last_fullsized":"2023-11-27T21:22:49.515716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'245","last_scrub_stamp":"2023-11-27T21:22:49.515658+0000","last_deep_scrub":"28'245","last_deep_scrub_stamp":"2023-11-27T21:22:49.515658+0000","last_clean_scrub_stamp":"2023-11-27T21:22:49.515658+0000","objects_scrubbed":3,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:36:26.863877+0000","scrub_duration":0.003801076,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":236,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"28'150","reported_seq":186,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:31.069109+0000","last_change":"2023-11-27T21:22:31.069109+0000","last_active":"2023-11-27T21:22:31.069109+0000","last_peered":"2023-11-27T21:22:31.069109+0000","last_clean":"2023-11-27T21:22:31.069109+0000","last_became_active":"2023-11-27T20:54:31.826669+0000","last_became_peered":"2023-11-27T20:54:31.826669+0000","last_unstale":"2023-11-27T21:22:31.069109+0000","last_undegraded":"2023-11-27T21:22:31.069109+0000","last_fullsized":"2023-11-27T21:22:31.069109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'150","last_scrub_stamp":"2023-11-27T21:22:31.068996+0000","last_deep_scrub":"28'150","last_deep_scrub_stamp":"2023-11-27T21:22:31.068996+0000","last_clean_scrub_stamp":"2023-11-27T21:22:31.068996+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:53.693019+0000","scrub_duration":0.003059254,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":7432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"28'77","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:17.078803+0000","last_change":"2023-11-27T21:22:17.078803+0000","last_active":"2023-11-27T21:22:17.078803+0000","last_peered":"2023-11-27T21:22:17.078803+0000","last_clean":"2023-11-27T21:22:17.078803+0000","last_became_active":"2023-11-27T20:54:27.502677+0000","last_became_peered":"2023-11-27T20:54:27.502677+0000","last_unstale":"2023-11-27T21:22:17.078803+0000","last_undegraded":"2023-11-27T21:22:17.078803+0000","last_fullsized":"2023-11-27T21:22:17.078803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:17.078722+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:17.078722+0000","last_clean_scrub_stamp":"2023-11-27T21:22:17.078722+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:59:13.020180+0000","scrub_duration":0.00165175,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'332","reported_seq":684,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:05.423669+0000","last_change":"2023-11-27T21:22:05.423669+0000","last_active":"2023-11-27T21:22:05.423669+0000","last_peered":"2023-11-27T21:22:05.423669+0000","last_clean":"2023-11-27T21:22:05.423669+0000","last_became_active":"2023-11-27T20:54:26.227911+0000","last_became_peered":"2023-11-27T20:54:26.227911+0000","last_unstale":"2023-11-27T21:22:05.423669+0000","last_undegraded":"2023-11-27T21:22:05.423669+0000","last_fullsized":"2023-11-27T21:22:05.423669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'332","last_scrub_stamp":"2023-11-27T21:22:05.423586+0000","last_deep_scrub":"28'332","last_deep_scrub_stamp":"2023-11-27T21:22:05.423586+0000","last_clean_scrub_stamp":"2023-11-27T21:22:05.423586+0000","objects_scrubbed":7,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:36:33.071011+0000","scrub_duration":0.0045666969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53552,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":314,"num_read_kb":325,"num_write":327,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'174","reported_seq":210,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:59.437179+0000","last_change":"2023-11-27T21:22:59.437179+0000","last_active":"2023-11-27T21:22:59.437179+0000","last_peered":"2023-11-27T21:22:59.437179+0000","last_clean":"2023-11-27T21:22:59.437179+0000","last_became_active":"2023-11-27T20:54:31.827785+0000","last_became_peered":"2023-11-27T20:54:31.827785+0000","last_unstale":"2023-11-27T21:22:59.437179+0000","last_undegraded":"2023-11-27T21:22:59.437179+0000","last_fullsized":"2023-11-27T21:22:59.437179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'174","last_scrub_stamp":"2023-11-27T21:22:59.437092+0000","last_deep_scrub":"28'174","last_deep_scrub_stamp":"2023-11-27T21:22:59.437092+0000","last_clean_scrub_stamp":"2023-11-27T21:22:59.437092+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:55:18.896366+0000","scrub_duration":0.0024566380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":11290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'75","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:32.375562+0000","last_change":"2023-11-27T21:22:32.375562+0000","last_active":"2023-11-27T21:22:32.375562+0000","last_peered":"2023-11-27T21:22:32.375562+0000","last_clean":"2023-11-27T21:22:32.375562+0000","last_became_active":"2023-11-27T20:54:27.513655+0000","last_became_peered":"2023-11-27T20:54:27.513655+0000","last_unstale":"2023-11-27T21:22:32.375562+0000","last_undegraded":"2023-11-27T21:22:32.375562+0000","last_fullsized":"2023-11-27T21:22:32.375562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:32.375477+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:32.375477+0000","last_clean_scrub_stamp":"2023-11-27T21:22:32.375477+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:48:52.496653+0000","scrub_duration":0.0020109640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'1487","reported_seq":1526,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:02.911976+0000","last_change":"2023-11-27T21:22:02.911976+0000","last_active":"2023-11-27T21:22:02.911976+0000","last_peered":"2023-11-27T21:22:02.911976+0000","last_clean":"2023-11-27T21:22:02.911976+0000","last_became_active":"2023-11-27T20:54:26.230570+0000","last_became_peered":"2023-11-27T20:54:26.230570+0000","last_unstale":"2023-11-27T21:22:02.911976+0000","last_undegraded":"2023-11-27T21:22:02.911976+0000","last_fullsized":"2023-11-27T21:22:02.911976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1487","last_scrub_stamp":"2023-11-27T21:22:02.911868+0000","last_deep_scrub":"28'1487","last_deep_scrub_stamp":"2023-11-27T21:22:02.911868+0000","last_clean_scrub_stamp":"2023-11-27T21:22:02.911868+0000","objects_scrubbed":6,"log_size":1487,"log_dups_size":0,"ondisk_log_size":1487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:31:23.266746+0000","scrub_duration":0.017648026000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1482,"num_write_kb":4539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"28'155","reported_seq":191,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:03.606574+0000","last_change":"2023-11-27T21:23:03.606595+0000","last_active":"2023-11-27T21:23:03.606574+0000","last_peered":"2023-11-27T21:23:03.606574+0000","last_clean":"2023-11-27T21:23:03.606574+0000","last_became_active":"2023-11-27T20:54:31.827872+0000","last_became_peered":"2023-11-27T20:54:31.827872+0000","last_unstale":"2023-11-27T21:23:03.606574+0000","last_undegraded":"2023-11-27T21:23:03.606574+0000","last_fullsized":"2023-11-27T21:23:03.606574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'155","last_scrub_stamp":"2023-11-27T21:23:03.606510+0000","last_deep_scrub":"28'155","last_deep_scrub_stamp":"2023-11-27T21:23:03.606510+0000","last_clean_scrub_stamp":"2023-11-27T21:23:03.606510+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:55:39.168893+0000","scrub_duration":0.0024572700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":8855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'67","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.567411+0000","last_change":"2023-11-27T21:22:21.567411+0000","last_active":"2023-11-27T21:22:21.567411+0000","last_peered":"2023-11-27T21:22:21.567411+0000","last_clean":"2023-11-27T21:22:21.567411+0000","last_became_active":"2023-11-27T20:54:27.493257+0000","last_became_peered":"2023-11-27T20:54:27.493257+0000","last_unstale":"2023-11-27T21:22:21.567411+0000","last_undegraded":"2023-11-27T21:22:21.567411+0000","last_fullsized":"2023-11-27T21:22:21.567411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'67","last_scrub_stamp":"2023-11-27T21:22:21.567332+0000","last_deep_scrub":"28'67","last_deep_scrub_stamp":"2023-11-27T21:22:21.567332+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.567332+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:36:06.913352+0000","scrub_duration":0.00118578,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'152","reported_seq":190,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:06.402467+0000","last_change":"2023-11-27T21:22:06.402467+0000","last_active":"2023-11-27T21:22:06.402467+0000","last_peered":"2023-11-27T21:22:06.402467+0000","last_clean":"2023-11-27T21:22:06.402467+0000","last_became_active":"2023-11-27T20:54:26.230963+0000","last_became_peered":"2023-11-27T20:54:26.230963+0000","last_unstale":"2023-11-27T21:22:06.402467+0000","last_undegraded":"2023-11-27T21:22:06.402467+0000","last_fullsized":"2023-11-27T21:22:06.402467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'152","last_scrub_stamp":"2023-11-27T21:22:06.402381+0000","last_deep_scrub":"28'152","last_deep_scrub_stamp":"2023-11-27T21:22:06.402381+0000","last_clean_scrub_stamp":"2023-11-27T21:22:06.402381+0000","objects_scrubbed":4,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:06:17.621457+0000","scrub_duration":0.0033124059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"28'195","reported_seq":235,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:40.656772+0000","last_change":"2023-11-27T21:22:40.656797+0000","last_active":"2023-11-27T21:22:40.656772+0000","last_peered":"2023-11-27T21:22:40.656772+0000","last_clean":"2023-11-27T21:22:40.656772+0000","last_became_active":"2023-11-27T20:54:31.825038+0000","last_became_peered":"2023-11-27T20:54:31.825038+0000","last_unstale":"2023-11-27T21:22:40.656772+0000","last_undegraded":"2023-11-27T21:22:40.656772+0000","last_fullsized":"2023-11-27T21:22:40.656772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'195","last_scrub_stamp":"2023-11-27T21:22:40.656695+0000","last_deep_scrub":"28'195","last_deep_scrub_stamp":"2023-11-27T21:22:40.656695+0000","last_clean_scrub_stamp":"2023-11-27T21:22:40.656695+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:54:10.457218+0000","scrub_duration":0.0031266419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":102,"num_write":164,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"28'89","reported_seq":127,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:06.407291+0000","last_change":"2023-11-27T21:22:06.407291+0000","last_active":"2023-11-27T21:22:06.407291+0000","last_peered":"2023-11-27T21:22:06.407291+0000","last_clean":"2023-11-27T21:22:06.407291+0000","last_became_active":"2023-11-27T20:54:27.507805+0000","last_became_peered":"2023-11-27T20:54:27.507805+0000","last_unstale":"2023-11-27T21:22:06.407291+0000","last_undegraded":"2023-11-27T21:22:06.407291+0000","last_fullsized":"2023-11-27T21:22:06.407291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'89","last_scrub_stamp":"2023-11-27T21:22:06.407212+0000","last_deep_scrub":"28'89","last_deep_scrub_stamp":"2023-11-27T21:22:06.407212+0000","last_clean_scrub_stamp":"2023-11-27T21:22:06.407212+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:16:55.047816+0000","scrub_duration":0.0014892390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'331","reported_seq":688,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:10.331834+0000","last_change":"2023-11-27T21:22:10.331834+0000","last_active":"2023-11-27T21:22:10.331834+0000","last_peered":"2023-11-27T21:22:10.331834+0000","last_clean":"2023-11-27T21:22:10.331834+0000","last_became_active":"2023-11-27T20:54:26.226679+0000","last_became_peered":"2023-11-27T20:54:26.226679+0000","last_unstale":"2023-11-27T21:22:10.331834+0000","last_undegraded":"2023-11-27T21:22:10.331834+0000","last_fullsized":"2023-11-27T21:22:10.331834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'331","last_scrub_stamp":"2023-11-27T21:22:10.331701+0000","last_deep_scrub":"28'331","last_deep_scrub_stamp":"2023-11-27T21:22:10.331701+0000","last_clean_scrub_stamp":"2023-11-27T21:22:10.331701+0000","objects_scrubbed":3,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:57:26.919946+0000","scrub_duration":0.0033883049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53032,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":318,"num_read_kb":327,"num_write":324,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"28'159","reported_seq":195,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:34.234760+0000","last_change":"2023-11-27T21:22:34.234783+0000","last_active":"2023-11-27T21:22:34.234760+0000","last_peered":"2023-11-27T21:22:34.234760+0000","last_clean":"2023-11-27T21:22:34.234760+0000","last_became_active":"2023-11-27T20:54:31.834569+0000","last_became_peered":"2023-11-27T20:54:31.834569+0000","last_unstale":"2023-11-27T21:22:34.234760+0000","last_undegraded":"2023-11-27T21:22:34.234760+0000","last_fullsized":"2023-11-27T21:22:34.234760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'159","last_scrub_stamp":"2023-11-27T21:22:34.234686+0000","last_deep_scrub":"28'159","last_deep_scrub_stamp":"2023-11-27T21:22:34.234686+0000","last_clean_scrub_stamp":"2023-11-27T21:22:34.234686+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:03:33.554205+0000","scrub_duration":0.0028385089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":7865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'79","reported_seq":117,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:11.809924+0000","last_change":"2023-11-27T21:22:11.809924+0000","last_active":"2023-11-27T21:22:11.809924+0000","last_peered":"2023-11-27T21:22:11.809924+0000","last_clean":"2023-11-27T21:22:11.809924+0000","last_became_active":"2023-11-27T20:54:27.498535+0000","last_became_peered":"2023-11-27T20:54:27.498535+0000","last_unstale":"2023-11-27T21:22:11.809924+0000","last_undegraded":"2023-11-27T21:22:11.809924+0000","last_fullsized":"2023-11-27T21:22:11.809924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'79","last_scrub_stamp":"2023-11-27T21:22:11.809828+0000","last_deep_scrub":"28'79","last_deep_scrub_stamp":"2023-11-27T21:22:11.809828+0000","last_clean_scrub_stamp":"2023-11-27T21:22:11.809828+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:02.660027+0000","scrub_duration":0.001141268,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'177","reported_seq":215,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:04.284409+0000","last_change":"2023-11-27T21:22:04.284409+0000","last_active":"2023-11-27T21:22:04.284409+0000","last_peered":"2023-11-27T21:22:04.284409+0000","last_clean":"2023-11-27T21:22:04.284409+0000","last_became_active":"2023-11-27T20:54:26.227878+0000","last_became_peered":"2023-11-27T20:54:26.227878+0000","last_unstale":"2023-11-27T21:22:04.284409+0000","last_undegraded":"2023-11-27T21:22:04.284409+0000","last_fullsized":"2023-11-27T21:22:04.284409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'177","last_scrub_stamp":"2023-11-27T21:22:04.284332+0000","last_deep_scrub":"28'177","last_deep_scrub_stamp":"2023-11-27T21:22:04.284332+0000","last_clean_scrub_stamp":"2023-11-27T21:22:04.284332+0000","objects_scrubbed":3,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:46:32.962705+0000","scrub_duration":0.0029821639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'104","reported_seq":140,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:05.547800+0000","last_change":"2023-11-27T21:23:05.547821+0000","last_active":"2023-11-27T21:23:05.547800+0000","last_peered":"2023-11-27T21:23:05.547800+0000","last_clean":"2023-11-27T21:23:05.547800+0000","last_became_active":"2023-11-27T20:54:31.824914+0000","last_became_peered":"2023-11-27T20:54:31.824914+0000","last_unstale":"2023-11-27T21:23:05.547800+0000","last_undegraded":"2023-11-27T21:23:05.547800+0000","last_fullsized":"2023-11-27T21:23:05.547800+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'104","last_scrub_stamp":"2023-11-27T21:23:05.547734+0000","last_deep_scrub":"28'104","last_deep_scrub_stamp":"2023-11-27T21:23:05.547734+0000","last_clean_scrub_stamp":"2023-11-27T21:23:05.547734+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:44.467269+0000","scrub_duration":0.002317146,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":7715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"28'152","reported_seq":190,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:12.544122+0000","last_change":"2023-11-27T21:23:12.544144+0000","last_active":"2023-11-27T21:23:12.544122+0000","last_peered":"2023-11-27T21:23:12.544122+0000","last_clean":"2023-11-27T21:23:12.544122+0000","last_became_active":"2023-11-27T20:54:31.827971+0000","last_became_peered":"2023-11-27T20:54:31.827971+0000","last_unstale":"2023-11-27T21:23:12.544122+0000","last_undegraded":"2023-11-27T21:23:12.544122+0000","last_fullsized":"2023-11-27T21:23:12.544122+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'152","last_scrub_stamp":"2023-11-27T21:23:12.544053+0000","last_deep_scrub":"28'152","last_deep_scrub_stamp":"2023-11-27T21:23:12.544053+0000","last_clean_scrub_stamp":"2023-11-27T21:23:12.544053+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:00:35.431060+0000","scrub_duration":0.002940668,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":9456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"28'80","reported_seq":118,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:37.569827+0000","last_change":"2023-11-27T21:22:37.569827+0000","last_active":"2023-11-27T21:22:37.569827+0000","last_peered":"2023-11-27T21:22:37.569827+0000","last_clean":"2023-11-27T21:22:37.569827+0000","last_became_active":"2023-11-27T20:54:27.434635+0000","last_became_peered":"2023-11-27T20:54:27.434635+0000","last_unstale":"2023-11-27T21:22:37.569827+0000","last_undegraded":"2023-11-27T21:22:37.569827+0000","last_fullsized":"2023-11-27T21:22:37.569827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'80","last_scrub_stamp":"2023-11-27T21:22:37.569720+0000","last_deep_scrub":"28'80","last_deep_scrub_stamp":"2023-11-27T21:22:37.569720+0000","last_clean_scrub_stamp":"2023-11-27T21:22:37.569720+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:31:12.846837+0000","scrub_duration":0.0021142689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'7","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:24.573621+0000","last_change":"2023-11-27T21:22:24.573621+0000","last_active":"2023-11-27T21:22:24.573621+0000","last_peered":"2023-11-27T21:22:24.573621+0000","last_clean":"2023-11-27T21:22:24.573621+0000","last_became_active":"2023-11-27T20:54:26.224502+0000","last_became_peered":"2023-11-27T20:54:26.224502+0000","last_unstale":"2023-11-27T21:22:24.573621+0000","last_undegraded":"2023-11-27T21:22:24.573621+0000","last_fullsized":"2023-11-27T21:22:24.573621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2023-11-27T21:22:24.573521+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2023-11-27T21:22:24.573521+0000","last_clean_scrub_stamp":"2023-11-27T21:22:24.573521+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:05:05.366117+0000","scrub_duration":0.0025318630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"28'177","reported_seq":215,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:06.470871+0000","last_change":"2023-11-27T21:23:06.470871+0000","last_active":"2023-11-27T21:23:06.470871+0000","last_peered":"2023-11-27T21:23:06.470871+0000","last_clean":"2023-11-27T21:23:06.470871+0000","last_became_active":"2023-11-27T20:54:31.826790+0000","last_became_peered":"2023-11-27T20:54:31.826790+0000","last_unstale":"2023-11-27T21:23:06.470871+0000","last_undegraded":"2023-11-27T21:23:06.470871+0000","last_fullsized":"2023-11-27T21:23:06.470871+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'177","last_scrub_stamp":"2023-11-27T21:23:06.470790+0000","last_deep_scrub":"28'177","last_deep_scrub_stamp":"2023-11-27T21:23:06.470790+0000","last_clean_scrub_stamp":"2023-11-27T21:23:06.470790+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:34:10.962193+0000","scrub_duration":0.0023431469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":15468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'77","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:13.303840+0000","last_change":"2023-11-27T21:22:13.303840+0000","last_active":"2023-11-27T21:22:13.303840+0000","last_peered":"2023-11-27T21:22:13.303840+0000","last_clean":"2023-11-27T21:22:13.303840+0000","last_became_active":"2023-11-27T20:54:27.507698+0000","last_became_peered":"2023-11-27T20:54:27.507698+0000","last_unstale":"2023-11-27T21:22:13.303840+0000","last_undegraded":"2023-11-27T21:22:13.303840+0000","last_fullsized":"2023-11-27T21:22:13.303840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:13.303735+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:13.303735+0000","last_clean_scrub_stamp":"2023-11-27T21:22:13.303735+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:40:38.746430+0000","scrub_duration":0.001443277,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'425","reported_seq":877,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:08.025955+0000","last_change":"2023-11-27T21:22:08.025955+0000","last_active":"2023-11-27T21:22:08.025955+0000","last_peered":"2023-11-27T21:22:08.025955+0000","last_clean":"2023-11-27T21:22:08.025955+0000","last_became_active":"2023-11-27T20:54:26.229725+0000","last_became_peered":"2023-11-27T20:54:26.229725+0000","last_unstale":"2023-11-27T21:22:08.025955+0000","last_undegraded":"2023-11-27T21:22:08.025955+0000","last_fullsized":"2023-11-27T21:22:08.025955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'425","last_scrub_stamp":"2023-11-27T21:22:08.025875+0000","last_deep_scrub":"28'425","last_deep_scrub_stamp":"2023-11-27T21:22:08.025875+0000","last_clean_scrub_stamp":"2023-11-27T21:22:08.025875+0000","objects_scrubbed":3,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:31:28.380754+0000","scrub_duration":0.0038756979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":413,"num_read_kb":420,"num_write":418,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'473","reported_seq":969,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:40.726895+0000","last_change":"2023-11-27T21:22:40.726930+0000","last_active":"2023-11-27T21:22:40.726895+0000","last_peered":"2023-11-27T21:22:40.726895+0000","last_clean":"2023-11-27T21:22:40.726895+0000","last_became_active":"2023-11-27T20:54:26.221715+0000","last_became_peered":"2023-11-27T20:54:26.221715+0000","last_unstale":"2023-11-27T21:22:40.726895+0000","last_undegraded":"2023-11-27T21:22:40.726895+0000","last_fullsized":"2023-11-27T21:22:40.726895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'473","last_scrub_stamp":"2023-11-27T21:22:40.726814+0000","last_deep_scrub":"28'473","last_deep_scrub_stamp":"2023-11-27T21:22:40.726814+0000","last_clean_scrub_stamp":"2023-11-27T21:22:40.726814+0000","objects_scrubbed":4,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:47:25.931117+0000","scrub_duration":0.0047592770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70496,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":458,"num_read_kb":466,"num_write":467,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'78","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:55.598552+0000","last_change":"2023-11-27T21:22:55.598572+0000","last_active":"2023-11-27T21:22:55.598552+0000","last_peered":"2023-11-27T21:22:55.598552+0000","last_clean":"2023-11-27T21:22:55.598552+0000","last_became_active":"2023-11-27T20:54:27.516887+0000","last_became_peered":"2023-11-27T20:54:27.516887+0000","last_unstale":"2023-11-27T21:22:55.598552+0000","last_undegraded":"2023-11-27T21:22:55.598552+0000","last_fullsized":"2023-11-27T21:22:55.598552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'78","last_scrub_stamp":"2023-11-27T21:22:55.598489+0000","last_deep_scrub":"28'78","last_deep_scrub_stamp":"2023-11-27T21:22:55.598489+0000","last_clean_scrub_stamp":"2023-11-27T21:22:55.598489+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:17:44.354934+0000","scrub_duration":0.0014136470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'144","reported_seq":179,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:13.493955+0000","last_change":"2023-11-27T21:23:13.493975+0000","last_active":"2023-11-27T21:23:13.493955+0000","last_peered":"2023-11-27T21:23:13.493955+0000","last_clean":"2023-11-27T21:23:13.493955+0000","last_became_active":"2023-11-27T20:54:31.827395+0000","last_became_peered":"2023-11-27T20:54:31.827395+0000","last_unstale":"2023-11-27T21:23:13.493955+0000","last_undegraded":"2023-11-27T21:23:13.493955+0000","last_fullsized":"2023-11-27T21:23:13.493955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'144","last_scrub_stamp":"2023-11-27T21:23:13.493887+0000","last_deep_scrub":"28'144","last_deep_scrub_stamp":"2023-11-27T21:23:13.493887+0000","last_clean_scrub_stamp":"2023-11-27T21:23:13.493887+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:06:49.230158+0000","scrub_duration":0.0022645339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":4976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'2872","reported_seq":2910,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:31.493285+0000","last_change":"2023-11-27T21:22:31.493337+0000","last_active":"2023-11-27T21:22:31.493285+0000","last_peered":"2023-11-27T21:22:31.493285+0000","last_clean":"2023-11-27T21:22:31.493285+0000","last_became_active":"2023-11-27T20:54:26.227713+0000","last_became_peered":"2023-11-27T20:54:26.227713+0000","last_unstale":"2023-11-27T21:22:31.493285+0000","last_undegraded":"2023-11-27T21:22:31.493285+0000","last_fullsized":"2023-11-27T21:22:31.493285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2872","last_scrub_stamp":"2023-11-27T21:22:31.493188+0000","last_deep_scrub":"28'2872","last_deep_scrub_stamp":"2023-11-27T21:22:31.493188+0000","last_clean_scrub_stamp":"2023-11-27T21:22:31.493188+0000","objects_scrubbed":4,"log_size":2872,"log_dups_size":0,"ondisk_log_size":2872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:48:51.614364+0000","scrub_duration":0.037435849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12113008,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2860,"num_write_kb":13160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"28'94","reported_seq":130,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:12.266321+0000","last_change":"2023-11-27T21:22:12.266341+0000","last_active":"2023-11-27T21:22:12.266321+0000","last_peered":"2023-11-27T21:22:12.266321+0000","last_clean":"2023-11-27T21:22:12.266321+0000","last_became_active":"2023-11-27T20:54:27.506119+0000","last_became_peered":"2023-11-27T20:54:27.506119+0000","last_unstale":"2023-11-27T21:22:12.266321+0000","last_undegraded":"2023-11-27T21:22:12.266321+0000","last_fullsized":"2023-11-27T21:22:12.266321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'94","last_scrub_stamp":"2023-11-27T21:22:12.266264+0000","last_deep_scrub":"28'94","last_deep_scrub_stamp":"2023-11-27T21:22:12.266264+0000","last_clean_scrub_stamp":"2023-11-27T21:22:12.266264+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:50:27.905791+0000","scrub_duration":0.001360986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"28'135","reported_seq":170,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:33.278803+0000","last_change":"2023-11-27T21:22:33.278826+0000","last_active":"2023-11-27T21:22:33.278803+0000","last_peered":"2023-11-27T21:22:33.278803+0000","last_clean":"2023-11-27T21:22:33.278803+0000","last_became_active":"2023-11-27T20:54:31.832813+0000","last_became_peered":"2023-11-27T20:54:31.832813+0000","last_unstale":"2023-11-27T21:22:33.278803+0000","last_undegraded":"2023-11-27T21:22:33.278803+0000","last_fullsized":"2023-11-27T21:22:33.278803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'135","last_scrub_stamp":"2023-11-27T21:22:33.278716+0000","last_deep_scrub":"28'135","last_deep_scrub_stamp":"2023-11-27T21:22:33.278716+0000","last_clean_scrub_stamp":"2023-11-27T21:22:33.278716+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:03:14.787780+0000","scrub_duration":0.0030595430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'74","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:03.899204+0000","last_change":"2023-11-27T21:22:03.899204+0000","last_active":"2023-11-27T21:22:03.899204+0000","last_peered":"2023-11-27T21:22:03.899204+0000","last_clean":"2023-11-27T21:22:03.899204+0000","last_became_active":"2023-11-27T20:54:27.500394+0000","last_became_peered":"2023-11-27T20:54:27.500394+0000","last_unstale":"2023-11-27T21:22:03.899204+0000","last_undegraded":"2023-11-27T21:22:03.899204+0000","last_fullsized":"2023-11-27T21:22:03.899204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'74","last_scrub_stamp":"2023-11-27T21:22:03.899101+0000","last_deep_scrub":"28'74","last_deep_scrub_stamp":"2023-11-27T21:22:03.899101+0000","last_clean_scrub_stamp":"2023-11-27T21:22:03.899101+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:06.401969+0000","scrub_duration":0.0013881010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"28'91","reported_seq":130,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:19.289337+0000","last_change":"2023-11-27T21:22:19.289337+0000","last_active":"2023-11-27T21:22:19.289337+0000","last_peered":"2023-11-27T21:22:19.289337+0000","last_clean":"2023-11-27T21:22:19.289337+0000","last_became_active":"2023-11-27T20:54:27.515173+0000","last_became_peered":"2023-11-27T20:54:27.515173+0000","last_unstale":"2023-11-27T21:22:19.289337+0000","last_undegraded":"2023-11-27T21:22:19.289337+0000","last_fullsized":"2023-11-27T21:22:19.289337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'91","last_scrub_stamp":"2023-11-27T21:22:19.289226+0000","last_deep_scrub":"28'91","last_deep_scrub_stamp":"2023-11-27T21:22:19.289226+0000","last_clean_scrub_stamp":"2023-11-27T21:22:19.289226+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:57:16.036118+0000","scrub_duration":0.0015204750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"28'79","reported_seq":119,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:53.534589+0000","last_change":"2023-11-27T21:22:53.534589+0000","last_active":"2023-11-27T21:22:53.534589+0000","last_peered":"2023-11-27T21:22:53.534589+0000","last_clean":"2023-11-27T21:22:53.534589+0000","last_became_active":"2023-11-27T20:54:27.506112+0000","last_became_peered":"2023-11-27T20:54:27.506112+0000","last_unstale":"2023-11-27T21:22:53.534589+0000","last_undegraded":"2023-11-27T21:22:53.534589+0000","last_fullsized":"2023-11-27T21:22:53.534589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'79","last_scrub_stamp":"2023-11-27T21:22:53.534507+0000","last_deep_scrub":"28'79","last_deep_scrub_stamp":"2023-11-27T21:22:53.534507+0000","last_clean_scrub_stamp":"2023-11-27T21:22:53.534507+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:16:12.287715+0000","scrub_duration":0.00155865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'73","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:15.272669+0000","last_change":"2023-11-27T21:22:15.272669+0000","last_active":"2023-11-27T21:22:15.272669+0000","last_peered":"2023-11-27T21:22:15.272669+0000","last_clean":"2023-11-27T21:22:15.272669+0000","last_became_active":"2023-11-27T20:54:27.510532+0000","last_became_peered":"2023-11-27T20:54:27.510532+0000","last_unstale":"2023-11-27T21:22:15.272669+0000","last_undegraded":"2023-11-27T21:22:15.272669+0000","last_fullsized":"2023-11-27T21:22:15.272669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'73","last_scrub_stamp":"2023-11-27T21:22:15.272584+0000","last_deep_scrub":"28'73","last_deep_scrub_stamp":"2023-11-27T21:22:15.272584+0000","last_clean_scrub_stamp":"2023-11-27T21:22:15.272584+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:23:33.117651+0000","scrub_duration":0.0013038769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"28'58","reported_seq":97,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:24.138340+0000","last_change":"2023-11-27T21:22:24.138340+0000","last_active":"2023-11-27T21:22:24.138340+0000","last_peered":"2023-11-27T21:22:24.138340+0000","last_clean":"2023-11-27T21:22:24.138340+0000","last_became_active":"2023-11-27T20:54:27.513517+0000","last_became_peered":"2023-11-27T20:54:27.513517+0000","last_unstale":"2023-11-27T21:22:24.138340+0000","last_undegraded":"2023-11-27T21:22:24.138340+0000","last_fullsized":"2023-11-27T21:22:24.138340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'58","last_scrub_stamp":"2023-11-27T21:22:24.138248+0000","last_deep_scrub":"28'58","last_deep_scrub_stamp":"2023-11-27T21:22:24.138248+0000","last_clean_scrub_stamp":"2023-11-27T21:22:24.138248+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:38.431656+0000","scrub_duration":0.001948988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'78","reported_seq":117,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:25.136381+0000","last_change":"2023-11-27T21:22:25.136381+0000","last_active":"2023-11-27T21:22:25.136381+0000","last_peered":"2023-11-27T21:22:25.136381+0000","last_clean":"2023-11-27T21:22:25.136381+0000","last_became_active":"2023-11-27T20:54:27.511559+0000","last_became_peered":"2023-11-27T20:54:27.511559+0000","last_unstale":"2023-11-27T21:22:25.136381+0000","last_undegraded":"2023-11-27T21:22:25.136381+0000","last_fullsized":"2023-11-27T21:22:25.136381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'78","last_scrub_stamp":"2023-11-27T21:22:25.136275+0000","last_deep_scrub":"28'78","last_deep_scrub_stamp":"2023-11-27T21:22:25.136275+0000","last_clean_scrub_stamp":"2023-11-27T21:22:25.136275+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:39:09.105072+0000","scrub_duration":0.0013808659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"28'75","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:07.894649+0000","last_change":"2023-11-27T21:22:07.894649+0000","last_active":"2023-11-27T21:22:07.894649+0000","last_peered":"2023-11-27T21:22:07.894649+0000","last_clean":"2023-11-27T21:22:07.894649+0000","last_became_active":"2023-11-27T20:54:27.499323+0000","last_became_peered":"2023-11-27T20:54:27.499323+0000","last_unstale":"2023-11-27T21:22:07.894649+0000","last_undegraded":"2023-11-27T21:22:07.894649+0000","last_fullsized":"2023-11-27T21:22:07.894649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:07.894529+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:07.894529+0000","last_clean_scrub_stamp":"2023-11-27T21:22:07.894529+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:40:33.337225+0000","scrub_duration":0.001236841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"28'64","reported_seq":103,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:58.299289+0000","last_change":"2023-11-27T21:22:58.299309+0000","last_active":"2023-11-27T21:22:58.299289+0000","last_peered":"2023-11-27T21:22:58.299289+0000","last_clean":"2023-11-27T21:22:58.299289+0000","last_became_active":"2023-11-27T20:54:27.508615+0000","last_became_peered":"2023-11-27T20:54:27.508615+0000","last_unstale":"2023-11-27T21:22:58.299289+0000","last_undegraded":"2023-11-27T21:22:58.299289+0000","last_fullsized":"2023-11-27T21:22:58.299289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'64","last_scrub_stamp":"2023-11-27T21:22:58.299224+0000","last_deep_scrub":"28'64","last_deep_scrub_stamp":"2023-11-27T21:22:58.299224+0000","last_clean_scrub_stamp":"2023-11-27T21:22:58.299224+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:58:28.149758+0000","scrub_duration":0.0015916179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"28'78","reported_seq":117,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:11.622552+0000","last_change":"2023-11-27T21:22:11.622552+0000","last_active":"2023-11-27T21:22:11.622552+0000","last_peered":"2023-11-27T21:22:11.622552+0000","last_clean":"2023-11-27T21:22:11.622552+0000","last_became_active":"2023-11-27T20:54:27.510647+0000","last_became_peered":"2023-11-27T20:54:27.510647+0000","last_unstale":"2023-11-27T21:22:11.622552+0000","last_undegraded":"2023-11-27T21:22:11.622552+0000","last_fullsized":"2023-11-27T21:22:11.622552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'78","last_scrub_stamp":"2023-11-27T21:22:11.622453+0000","last_deep_scrub":"28'78","last_deep_scrub_stamp":"2023-11-27T21:22:11.622453+0000","last_clean_scrub_stamp":"2023-11-27T21:22:11.622453+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:16:19.252165+0000","scrub_duration":0.0016600790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"28'92","reported_seq":131,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:42.284869+0000","last_change":"2023-11-27T21:22:42.284869+0000","last_active":"2023-11-27T21:22:42.284869+0000","last_peered":"2023-11-27T21:22:42.284869+0000","last_clean":"2023-11-27T21:22:42.284869+0000","last_became_active":"2023-11-27T20:54:27.508360+0000","last_became_peered":"2023-11-27T20:54:27.508360+0000","last_unstale":"2023-11-27T21:22:42.284869+0000","last_undegraded":"2023-11-27T21:22:42.284869+0000","last_fullsized":"2023-11-27T21:22:42.284869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'92","last_scrub_stamp":"2023-11-27T21:22:42.284775+0000","last_deep_scrub":"28'92","last_deep_scrub_stamp":"2023-11-27T21:22:42.284775+0000","last_clean_scrub_stamp":"2023-11-27T21:22:42.284775+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:06:16.552768+0000","scrub_duration":0.0016812800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"28'87","reported_seq":125,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.447755+0000","last_change":"2023-11-27T21:22:21.447755+0000","last_active":"2023-11-27T21:22:21.447755+0000","last_peered":"2023-11-27T21:22:21.447755+0000","last_clean":"2023-11-27T21:22:21.447755+0000","last_became_active":"2023-11-27T20:54:27.513105+0000","last_became_peered":"2023-11-27T20:54:27.513105+0000","last_unstale":"2023-11-27T21:22:21.447755+0000","last_undegraded":"2023-11-27T21:22:21.447755+0000","last_fullsized":"2023-11-27T21:22:21.447755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'87","last_scrub_stamp":"2023-11-27T21:22:21.447667+0000","last_deep_scrub":"28'87","last_deep_scrub_stamp":"2023-11-27T21:22:21.447667+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.447667+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:48.413351+0000","scrub_duration":0.001278429,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"28'77","reported_seq":116,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:44.548636+0000","last_change":"2023-11-27T21:22:44.548636+0000","last_active":"2023-11-27T21:22:44.548636+0000","last_peered":"2023-11-27T21:22:44.548636+0000","last_clean":"2023-11-27T21:22:44.548636+0000","last_became_active":"2023-11-27T20:54:27.433179+0000","last_became_peered":"2023-11-27T20:54:27.433179+0000","last_unstale":"2023-11-27T21:22:44.548636+0000","last_undegraded":"2023-11-27T21:22:44.548636+0000","last_fullsized":"2023-11-27T21:22:44.548636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:44.548559+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:44.548559+0000","last_clean_scrub_stamp":"2023-11-27T21:22:44.548559+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:27:07.329368+0000","scrub_duration":0.0014271970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'75","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:27.380399+0000","last_change":"2023-11-27T21:22:27.380399+0000","last_active":"2023-11-27T21:22:27.380399+0000","last_peered":"2023-11-27T21:22:27.380399+0000","last_clean":"2023-11-27T21:22:27.380399+0000","last_became_active":"2023-11-27T20:54:27.515068+0000","last_became_peered":"2023-11-27T20:54:27.515068+0000","last_unstale":"2023-11-27T21:22:27.380399+0000","last_undegraded":"2023-11-27T21:22:27.380399+0000","last_fullsized":"2023-11-27T21:22:27.380399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:27.380315+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:27.380315+0000","last_clean_scrub_stamp":"2023-11-27T21:22:27.380315+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:39:11.349112+0000","scrub_duration":0.0012371560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"28'86","reported_seq":124,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:15.519346+0000","last_change":"2023-11-27T21:22:15.519379+0000","last_active":"2023-11-27T21:22:15.519346+0000","last_peered":"2023-11-27T21:22:15.519346+0000","last_clean":"2023-11-27T21:22:15.519346+0000","last_became_active":"2023-11-27T20:54:27.498306+0000","last_became_peered":"2023-11-27T20:54:27.498306+0000","last_unstale":"2023-11-27T21:22:15.519346+0000","last_undegraded":"2023-11-27T21:22:15.519346+0000","last_fullsized":"2023-11-27T21:22:15.519346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'86","last_scrub_stamp":"2023-11-27T21:22:15.519229+0000","last_deep_scrub":"28'86","last_deep_scrub_stamp":"2023-11-27T21:22:15.519229+0000","last_clean_scrub_stamp":"2023-11-27T21:22:15.519229+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:50.796346+0000","scrub_duration":0.0016617979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"28'91","reported_seq":128,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:26.319123+0000","last_change":"2023-11-27T21:22:26.319123+0000","last_active":"2023-11-27T21:22:26.319123+0000","last_peered":"2023-11-27T21:22:26.319123+0000","last_clean":"2023-11-27T21:22:26.319123+0000","last_became_active":"2023-11-27T20:54:27.512897+0000","last_became_peered":"2023-11-27T20:54:27.512897+0000","last_unstale":"2023-11-27T21:22:26.319123+0000","last_undegraded":"2023-11-27T21:22:26.319123+0000","last_fullsized":"2023-11-27T21:22:26.319123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'91","last_scrub_stamp":"2023-11-27T21:22:26.319005+0000","last_deep_scrub":"28'91","last_deep_scrub_stamp":"2023-11-27T21:22:26.319005+0000","last_clean_scrub_stamp":"2023-11-27T21:22:26.319005+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:15.398244+0000","scrub_duration":0.0013480289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"28'67","reported_seq":105,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:16.542687+0000","last_change":"2023-11-27T21:22:16.542687+0000","last_active":"2023-11-27T21:22:16.542687+0000","last_peered":"2023-11-27T21:22:16.542687+0000","last_clean":"2023-11-27T21:22:16.542687+0000","last_became_active":"2023-11-27T20:54:27.514946+0000","last_became_peered":"2023-11-27T20:54:27.514946+0000","last_unstale":"2023-11-27T21:22:16.542687+0000","last_undegraded":"2023-11-27T21:22:16.542687+0000","last_fullsized":"2023-11-27T21:22:16.542687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'67","last_scrub_stamp":"2023-11-27T21:22:16.542611+0000","last_deep_scrub":"28'67","last_deep_scrub_stamp":"2023-11-27T21:22:16.542611+0000","last_clean_scrub_stamp":"2023-11-27T21:22:16.542611+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:43:30.443626+0000","scrub_duration":0.0014583510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"28'80","reported_seq":118,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:22.523993+0000","last_change":"2023-11-27T21:22:22.523993+0000","last_active":"2023-11-27T21:22:22.523993+0000","last_peered":"2023-11-27T21:22:22.523993+0000","last_clean":"2023-11-27T21:22:22.523993+0000","last_became_active":"2023-11-27T20:54:27.493297+0000","last_became_peered":"2023-11-27T20:54:27.493297+0000","last_unstale":"2023-11-27T21:22:22.523993+0000","last_undegraded":"2023-11-27T21:22:22.523993+0000","last_fullsized":"2023-11-27T21:22:22.523993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'80","last_scrub_stamp":"2023-11-27T21:22:22.523857+0000","last_deep_scrub":"28'80","last_deep_scrub_stamp":"2023-11-27T21:22:22.523857+0000","last_clean_scrub_stamp":"2023-11-27T21:22:22.523857+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:17:11.280303+0000","scrub_duration":0.001213053,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"28'75","reported_seq":113,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:44.285666+0000","last_change":"2023-11-27T21:22:44.285689+0000","last_active":"2023-11-27T21:22:44.285666+0000","last_peered":"2023-11-27T21:22:44.285666+0000","last_clean":"2023-11-27T21:22:44.285666+0000","last_became_active":"2023-11-27T20:54:27.512662+0000","last_became_peered":"2023-11-27T20:54:27.512662+0000","last_unstale":"2023-11-27T21:22:44.285666+0000","last_undegraded":"2023-11-27T21:22:44.285666+0000","last_fullsized":"2023-11-27T21:22:44.285666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:44.285586+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:44.285586+0000","last_clean_scrub_stamp":"2023-11-27T21:22:44.285586+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:13:02.644103+0000","scrub_duration":0.0017812570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'70","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:14.123478+0000","last_change":"2023-11-27T21:22:14.123478+0000","last_active":"2023-11-27T21:22:14.123478+0000","last_peered":"2023-11-27T21:22:14.123478+0000","last_clean":"2023-11-27T21:22:14.123478+0000","last_became_active":"2023-11-27T20:54:27.512124+0000","last_became_peered":"2023-11-27T20:54:27.512124+0000","last_unstale":"2023-11-27T21:22:14.123478+0000","last_undegraded":"2023-11-27T21:22:14.123478+0000","last_fullsized":"2023-11-27T21:22:14.123478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'70","last_scrub_stamp":"2023-11-27T21:22:14.123330+0000","last_deep_scrub":"28'70","last_deep_scrub_stamp":"2023-11-27T21:22:14.123330+0000","last_clean_scrub_stamp":"2023-11-27T21:22:14.123330+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:17:02.763935+0000","scrub_duration":0.0016588200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"28'82","reported_seq":120,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:22.174144+0000","last_change":"2023-11-27T21:22:22.174144+0000","last_active":"2023-11-27T21:22:22.174144+0000","last_peered":"2023-11-27T21:22:22.174144+0000","last_clean":"2023-11-27T21:22:22.174144+0000","last_became_active":"2023-11-27T20:54:27.516907+0000","last_became_peered":"2023-11-27T20:54:27.516907+0000","last_unstale":"2023-11-27T21:22:22.174144+0000","last_undegraded":"2023-11-27T21:22:22.174144+0000","last_fullsized":"2023-11-27T21:22:22.174144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'82","last_scrub_stamp":"2023-11-27T21:22:22.174050+0000","last_deep_scrub":"28'82","last_deep_scrub_stamp":"2023-11-27T21:22:22.174050+0000","last_clean_scrub_stamp":"2023-11-27T21:22:22.174050+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:58:51.653006+0000","scrub_duration":0.0015457279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'68","reported_seq":106,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:29.387384+0000","last_change":"2023-11-27T21:22:29.387384+0000","last_active":"2023-11-27T21:22:29.387384+0000","last_peered":"2023-11-27T21:22:29.387384+0000","last_clean":"2023-11-27T21:22:29.387384+0000","last_became_active":"2023-11-27T20:54:27.515182+0000","last_became_peered":"2023-11-27T20:54:27.515182+0000","last_unstale":"2023-11-27T21:22:29.387384+0000","last_undegraded":"2023-11-27T21:22:29.387384+0000","last_fullsized":"2023-11-27T21:22:29.387384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'68","last_scrub_stamp":"2023-11-27T21:22:29.387232+0000","last_deep_scrub":"28'68","last_deep_scrub_stamp":"2023-11-27T21:22:29.387232+0000","last_clean_scrub_stamp":"2023-11-27T21:22:29.387232+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:57:23.297311+0000","scrub_duration":0.001412979,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"28'79","reported_seq":109,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:39.384082+0000","last_change":"2023-11-27T21:22:39.384105+0000","last_active":"2023-11-27T21:22:39.384082+0000","last_peered":"2023-11-27T21:22:39.384082+0000","last_clean":"2023-11-27T21:22:39.384082+0000","last_became_active":"2023-11-27T20:55:00.588298+0000","last_became_peered":"2023-11-27T20:55:00.588298+0000","last_unstale":"2023-11-27T21:22:39.384082+0000","last_undegraded":"2023-11-27T21:22:39.384082+0000","last_fullsized":"2023-11-27T21:22:39.384082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'79","last_scrub_stamp":"2023-11-27T21:22:39.384006+0000","last_deep_scrub":"28'79","last_deep_scrub_stamp":"2023-11-27T21:22:39.384006+0000","last_clean_scrub_stamp":"2023-11-27T21:22:39.384006+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:16:47.013718+0000","scrub_duration":0.001936828,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'77","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:26.381549+0000","last_change":"2023-11-27T21:22:26.381549+0000","last_active":"2023-11-27T21:22:26.381549+0000","last_peered":"2023-11-27T21:22:26.381549+0000","last_clean":"2023-11-27T21:22:26.381549+0000","last_became_active":"2023-11-27T20:54:27.512692+0000","last_became_peered":"2023-11-27T20:54:27.512692+0000","last_unstale":"2023-11-27T21:22:26.381549+0000","last_undegraded":"2023-11-27T21:22:26.381549+0000","last_fullsized":"2023-11-27T21:22:26.381549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:26.381465+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:26.381465+0000","last_clean_scrub_stamp":"2023-11-27T21:22:26.381465+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:38:40.562224+0000","scrub_duration":0.0012122050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"28'75","reported_seq":112,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:23.471793+0000","last_change":"2023-11-27T21:22:23.471793+0000","last_active":"2023-11-27T21:22:23.471793+0000","last_peered":"2023-11-27T21:22:23.471793+0000","last_clean":"2023-11-27T21:22:23.471793+0000","last_became_active":"2023-11-27T20:54:27.498790+0000","last_became_peered":"2023-11-27T20:54:27.498790+0000","last_unstale":"2023-11-27T21:22:23.471793+0000","last_undegraded":"2023-11-27T21:22:23.471793+0000","last_fullsized":"2023-11-27T21:22:23.471793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:23.471665+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:23.471665+0000","last_clean_scrub_stamp":"2023-11-27T21:22:23.471665+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:09:25.413821+0000","scrub_duration":0.0018897339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"28'85","reported_seq":122,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:23:04.318846+0000","last_change":"2023-11-27T21:23:04.318866+0000","last_active":"2023-11-27T21:23:04.318846+0000","last_peered":"2023-11-27T21:23:04.318846+0000","last_clean":"2023-11-27T21:23:04.318846+0000","last_became_active":"2023-11-27T20:54:27.512777+0000","last_became_peered":"2023-11-27T20:54:27.512777+0000","last_unstale":"2023-11-27T21:23:04.318846+0000","last_undegraded":"2023-11-27T21:23:04.318846+0000","last_fullsized":"2023-11-27T21:23:04.318846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'85","last_scrub_stamp":"2023-11-27T21:23:04.318773+0000","last_deep_scrub":"28'85","last_deep_scrub_stamp":"2023-11-27T21:23:04.318773+0000","last_clean_scrub_stamp":"2023-11-27T21:23:04.318773+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:50:12.048143+0000","scrub_duration":0.0014528500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'65","reported_seq":102,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:33.381938+0000","last_change":"2023-11-27T21:22:33.381969+0000","last_active":"2023-11-27T21:22:33.381938+0000","last_peered":"2023-11-27T21:22:33.381938+0000","last_clean":"2023-11-27T21:22:33.381938+0000","last_became_active":"2023-11-27T20:54:27.512433+0000","last_became_peered":"2023-11-27T20:54:27.512433+0000","last_unstale":"2023-11-27T21:22:33.381938+0000","last_undegraded":"2023-11-27T21:22:33.381938+0000","last_fullsized":"2023-11-27T21:22:33.381938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'65","last_scrub_stamp":"2023-11-27T21:22:33.381875+0000","last_deep_scrub":"28'65","last_deep_scrub_stamp":"2023-11-27T21:22:33.381875+0000","last_clean_scrub_stamp":"2023-11-27T21:22:33.381875+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:56.005899+0000","scrub_duration":0.0018361009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"28'62","reported_seq":99,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:05.879384+0000","last_change":"2023-11-27T21:22:05.879404+0000","last_active":"2023-11-27T21:22:05.879384+0000","last_peered":"2023-11-27T21:22:05.879384+0000","last_clean":"2023-11-27T21:22:05.879384+0000","last_became_active":"2023-11-27T20:54:27.432152+0000","last_became_peered":"2023-11-27T20:54:27.432152+0000","last_unstale":"2023-11-27T21:22:05.879384+0000","last_undegraded":"2023-11-27T21:22:05.879384+0000","last_fullsized":"2023-11-27T21:22:05.879384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'62","last_scrub_stamp":"2023-11-27T21:22:05.879322+0000","last_deep_scrub":"28'62","last_deep_scrub_stamp":"2023-11-27T21:22:05.879322+0000","last_clean_scrub_stamp":"2023-11-27T21:22:05.879322+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:16:54.519926+0000","scrub_duration":0.001294089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"28'69","reported_seq":106,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:45.385813+0000","last_change":"2023-11-27T21:22:45.385832+0000","last_active":"2023-11-27T21:22:45.385813+0000","last_peered":"2023-11-27T21:22:45.385813+0000","last_clean":"2023-11-27T21:22:45.385813+0000","last_became_active":"2023-11-27T20:54:27.515801+0000","last_became_peered":"2023-11-27T20:54:27.515801+0000","last_unstale":"2023-11-27T21:22:45.385813+0000","last_undegraded":"2023-11-27T21:22:45.385813+0000","last_fullsized":"2023-11-27T21:22:45.385813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'69","last_scrub_stamp":"2023-11-27T21:22:45.385744+0000","last_deep_scrub":"28'69","last_deep_scrub_stamp":"2023-11-27T21:22:45.385744+0000","last_clean_scrub_stamp":"2023-11-27T21:22:45.385744+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:05:19.004327+0000","scrub_duration":0.001632571,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'75","reported_seq":115,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:04.865788+0000","last_change":"2023-11-27T21:22:04.865788+0000","last_active":"2023-11-27T21:22:04.865788+0000","last_peered":"2023-11-27T21:22:04.865788+0000","last_clean":"2023-11-27T21:22:04.865788+0000","last_became_active":"2023-11-27T20:54:27.432160+0000","last_became_peered":"2023-11-27T20:54:27.432160+0000","last_unstale":"2023-11-27T21:22:04.865788+0000","last_undegraded":"2023-11-27T21:22:04.865788+0000","last_fullsized":"2023-11-27T21:22:04.865788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-11-27T21:22:04.865659+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-11-27T21:22:04.865659+0000","last_clean_scrub_stamp":"2023-11-27T21:22:04.865659+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:24:12.042139+0000","scrub_duration":0.001425869,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'77","reported_seq":117,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:47.341333+0000","last_change":"2023-11-27T21:22:47.341333+0000","last_active":"2023-11-27T21:22:47.341333+0000","last_peered":"2023-11-27T21:22:47.341333+0000","last_clean":"2023-11-27T21:22:47.341333+0000","last_became_active":"2023-11-27T20:54:27.505122+0000","last_became_peered":"2023-11-27T20:54:27.505122+0000","last_unstale":"2023-11-27T21:22:47.341333+0000","last_undegraded":"2023-11-27T21:22:47.341333+0000","last_fullsized":"2023-11-27T21:22:47.341333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'77","last_scrub_stamp":"2023-11-27T21:22:47.341245+0000","last_deep_scrub":"28'77","last_deep_scrub_stamp":"2023-11-27T21:22:47.341245+0000","last_clean_scrub_stamp":"2023-11-27T21:22:47.341245+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:10:10.862371+0000","scrub_duration":0.0011517109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"28'74","reported_seq":114,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:21.374228+0000","last_change":"2023-11-27T21:22:21.374228+0000","last_active":"2023-11-27T21:22:21.374228+0000","last_peered":"2023-11-27T21:22:21.374228+0000","last_clean":"2023-11-27T21:22:21.374228+0000","last_became_active":"2023-11-27T20:54:27.505236+0000","last_became_peered":"2023-11-27T20:54:27.505236+0000","last_unstale":"2023-11-27T21:22:21.374228+0000","last_undegraded":"2023-11-27T21:22:21.374228+0000","last_fullsized":"2023-11-27T21:22:21.374228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'74","last_scrub_stamp":"2023-11-27T21:22:21.374139+0000","last_deep_scrub":"28'74","last_deep_scrub_stamp":"2023-11-27T21:22:21.374139+0000","last_clean_scrub_stamp":"2023-11-27T21:22:21.374139+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:20.028040+0000","scrub_duration":0.0012971980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"28'79","reported_seq":119,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-27T21:22:42.386720+0000","last_change":"2023-11-27T21:22:42.386720+0000","last_active":"2023-11-27T21:22:42.386720+0000","last_peered":"2023-11-27T21:22:42.386720+0000","last_clean":"2023-11-27T21:22:42.386720+0000","last_became_active":"2023-11-27T20:54:27.514846+0000","last_became_peered":"2023-11-27T20:54:27.514846+0000","last_unstale":"2023-11-27T21:22:42.386720+0000","last_undegraded":"2023-11-27T21:22:42.386720+0000","last_fullsized":"2023-11-27T21:22:42.386720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'79","last_scrub_stamp":"2023-11-27T21:22:42.386592+0000","last_deep_scrub":"28'79","last_deep_scrub_stamp":"2023-11-27T21:22:42.386592+0000","last_clean_scrub_stamp":"2023-11-27T21:22:42.386592+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:29:28.775340+0000","scrub_duration":0.00163594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":102,"num_write":4200,"num_write_kb":332069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5131,"ondisk_log_size":5131,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4855,"ondisk_log_size":4855,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":44272102,"num_objects":111,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":1673,"num_read_kb":1711,"num_write":16676,"num_write_kb":52124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":88793088,"data_stored":88544204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15283,"ondisk_log_size":15283,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509799,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95988,"kb_used_data":20396,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94275852,"statfs":{"total":96636764160,"available":96538472448,"internally_reserved":0,"allocated":20885504,"data_stored":20696148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.44800000000000001,"15min":0.41599999999999998},"min":{"1min":0.33500000000000002,"5min":0.22700000000000001,"15min":0.19900000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.95599999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.48699999999999999,"15min":0.46800000000000003},"min":{"1min":0.39800000000000002,"5min":0.27500000000000002,"15min":0.24199999999999999},"max":{"1min":0.67000000000000004,"5min":0.72699999999999998,"15min":0.96599999999999997},"last":0.50600000000000001}]},{"osd":1,"last update":"Mon Nov 27 21:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.45900000000000002,"15min":0.438},"min":{"1min":0.36899999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.68799999999999994,"5min":0.69399999999999995,"15min":0.78300000000000003},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.42699999999999999,"15min":0.40799999999999997},"min":{"1min":0.34499999999999997,"5min":0.25600000000000001,"15min":0.247},"max":{"1min":0.59899999999999998,"5min":0.67600000000000005,"15min":0.83999999999999997},"last":0.47199999999999998}]},{"osd":2,"last update":"Mon Nov 27 21:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.436,"15min":0.41199999999999998},"min":{"1min":0.38300000000000001,"5min":0.27700000000000002,"15min":0.23599999999999999},"max":{"1min":0.61299999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.46400000000000002,"15min":0.438},"min":{"1min":0.34100000000000003,"5min":0.26900000000000002,"15min":0.23899999999999999},"max":{"1min":0.67200000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.498}]},{"osd":3,"last update":"Mon Nov 27 21:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.45300000000000001,"15min":0.44},"min":{"1min":0.35399999999999998,"5min":0.307,"15min":0.26800000000000002},"max":{"1min":0.63600000000000001,"5min":0.66600000000000004,"15min":0.87},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.48099999999999998,"15min":0.44900000000000001},"min":{"1min":0.39900000000000002,"5min":0.34699999999999998,"15min":0.309},"max":{"1min":0.65500000000000003,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56899999999999995}]},{"osd":4,"last update":"Mon Nov 27 21:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.40300000000000002,"15min":0.39400000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.23100000000000001},"max":{"1min":0.59999999999999998,"5min":0.66600000000000004,"15min":0.80600000000000005},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.42299999999999999,"15min":0.41199999999999998},"min":{"1min":0.29399999999999998,"5min":0.27200000000000002,"15min":0.22900000000000001},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.92800000000000005},"last":0.315}]},{"osd":5,"last update":"Mon Nov 27 21:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.42499999999999999,"15min":0.40100000000000002},"min":{"1min":0.27700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.59499999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.46000000000000002,"15min":0.45200000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.25},"max":{"1min":0.61499999999999999,"5min":0.74099999999999999,"15min":0.77600000000000002},"last":0.34499999999999997}]},{"osd":7,"last update":"Mon Nov 27 21:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.46200000000000002,"15min":0.46000000000000002},"min":{"1min":0.29199999999999998,"5min":0.25800000000000001,"15min":0.249},"max":{"1min":0.57699999999999996,"5min":0.68200000000000005,"15min":0.95599999999999996},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.48299999999999998,"15min":0.46500000000000002},"min":{"1min":0.309,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.64400000000000002,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.379}]}]},{"osd":5,"up_from":15,"seq":64424509799,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94852,"kb_used_data":19260,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94276988,"statfs":{"total":96636764160,"available":96539635712,"internally_reserved":0,"allocated":19722240,"data_stored":19520171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.433,"15min":0.40999999999999998},"min":{"1min":0.312,"5min":0.25700000000000001,"15min":0.216},"max":{"1min":0.57199999999999995,"5min":1.331,"15min":1.331},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.45000000000000001,"15min":0.42599999999999999},"min":{"1min":0.34000000000000002,"5min":0.27900000000000003,"15min":0.222},"max":{"1min":0.66500000000000004,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.54700000000000004}]},{"osd":1,"last update":"Mon Nov 27 21:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.436,"15min":0.42599999999999999},"min":{"1min":0.30499999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.95999999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.436,"15min":0.42099999999999999},"min":{"1min":0.33600000000000002,"5min":0.29699999999999999,"15min":0.28599999999999998},"max":{"1min":0.66600000000000004,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.56000000000000005}]},{"osd":2,"last update":"Mon Nov 27 21:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.44,"15min":0.432},"min":{"1min":0.374,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.94599999999999995},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.46000000000000002,"15min":0.435},"min":{"1min":0.38400000000000001,"5min":0.308,"15min":0.29899999999999999},"max":{"1min":0.628,"5min":1.359,"15min":1.359},"last":0.58099999999999996}]},{"osd":3,"last update":"Mon Nov 27 21:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.46600000000000003,"15min":0.45300000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.28899999999999998},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.93300000000000005},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.498,"15min":0.46200000000000002},"min":{"1min":0.38200000000000001,"5min":0.34000000000000002,"15min":0.30199999999999999},"max":{"1min":0.68200000000000005,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":0.501}]},{"osd":4,"last update":"Mon Nov 27 21:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.36699999999999999,"15min":0.373},"min":{"1min":0.26100000000000001,"5min":0.23300000000000001,"15min":0.23100000000000001},"max":{"1min":0.55200000000000005,"5min":0.65800000000000003,"15min":0.69199999999999995},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.39500000000000002,"15min":0.39800000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.23200000000000001},"max":{"1min":0.54000000000000004,"5min":0.66800000000000004,"15min":0.69999999999999996},"last":0.42199999999999999}]},{"osd":6,"last update":"Mon Nov 27 21:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.39400000000000002,"15min":0.39700000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":0.627,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41899999999999998,"15min":0.42499999999999999},"min":{"1min":0.32100000000000001,"5min":0.27100000000000002,"15min":0.23300000000000001},"max":{"1min":0.60499999999999998,"5min":0.69299999999999995,"15min":0.70399999999999996},"last":0.44700000000000001}]},{"osd":7,"last update":"Mon Nov 27 21:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.44600000000000001,"15min":0.45000000000000001},"min":{"1min":0.28499999999999998,"5min":0.26300000000000001,"15min":0.24199999999999999},"max":{"1min":0.60499999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.34100000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.67900000000000005,"5min":0.71399999999999997,"15min":0.751},"last":0.46800000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509800,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53560,"kb_used_data":8496,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318280,"statfs":{"total":96636764160,"available":96581918720,"internally_reserved":0,"allocated":8699904,"data_stored":8509387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.32800000000000001,"15min":0.308},"min":{"1min":0.216,"5min":0.19800000000000001,"15min":0.17899999999999999},"max":{"1min":0.433,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.314,"5min":0.32000000000000001,"15min":0.318},"min":{"1min":0.219,"5min":0.216,"15min":0.20200000000000001},"max":{"1min":0.45700000000000002,"5min":0.48299999999999998,"15min":0.61899999999999999},"last":0.25}]},{"osd":1,"last update":"Mon Nov 27 21:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.36199999999999999,"15min":0.34699999999999998},"min":{"1min":0.26000000000000001,"5min":0.20599999999999999,"15min":0.19800000000000001},"max":{"1min":0.45600000000000002,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35599999999999998,"15min":0.35099999999999998},"min":{"1min":0.28999999999999998,"5min":0.249,"15min":0.20899999999999999},"max":{"1min":0.48899999999999999,"5min":0.54400000000000004,"15min":0.751},"last":0.32900000000000001}]},{"osd":3,"last update":"Mon Nov 27 21:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.35799999999999998,"15min":0.34699999999999998},"min":{"1min":0.26200000000000001,"5min":0.23999999999999999,"15min":0.224},"max":{"1min":0.46000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.41499999999999998,"15min":0.39200000000000002},"min":{"1min":0.30399999999999999,"5min":0.26200000000000001,"15min":0.26100000000000001},"max":{"1min":0.52700000000000002,"5min":0.62,"15min":0.63700000000000001},"last":0.45300000000000001}]},{"osd":4,"last update":"Mon Nov 27 21:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51900000000000002,"15min":0.49099999999999999},"min":{"1min":0.35199999999999998,"5min":0.313,"15min":0.29499999999999998},"max":{"1min":0.755,"5min":1.044,"15min":1.044},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.497,"15min":0.48599999999999999},"min":{"1min":0.35999999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76400000000000001,"5min":0.78900000000000003,"15min":0.83299999999999996},"last":0.503}]},{"osd":5,"last update":"Mon Nov 27 21:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.33000000000000002,"5min":0.32800000000000001,"15min":0.30399999999999999},"max":{"1min":0.71899999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53600000000000003,"15min":0.51000000000000001},"min":{"1min":0.379,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79500000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.53300000000000003}]},{"osd":6,"last update":"Mon Nov 27 21:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.51700000000000002,"15min":0.51000000000000001},"min":{"1min":0.378,"5min":0.36699999999999999,"15min":0.34000000000000002},"max":{"1min":0.76500000000000001,"5min":0.81399999999999995,"15min":0.90900000000000003},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51100000000000001,"15min":0.497},"min":{"1min":0.36099999999999999,"5min":0.35199999999999998,"15min":0.316},"max":{"1min":0.66800000000000004,"5min":0.753,"15min":0.76900000000000002},"last":0.68500000000000005}]},{"osd":7,"last update":"Mon Nov 27 21:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.36599999999999999,"15min":0.36399999999999999},"max":{"1min":0.78500000000000003,"5min":1.071,"15min":1.071},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52600000000000002,"15min":0.51000000000000001},"min":{"1min":0.42099999999999999,"5min":0.373,"15min":0.34000000000000002},"max":{"1min":0.67200000000000004,"5min":0.77000000000000002,"15min":0.92400000000000004},"last":0.629}]}]},{"osd":1,"up_from":15,"seq":64424509800,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42852,"kb_used_data":3356,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94328988,"statfs":{"total":96636764160,"available":96592883712,"internally_reserved":0,"allocated":3436544,"data_stored":3238767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.316,"15min":0.311},"min":{"1min":0.22500000000000001,"5min":0.20599999999999999,"15min":0.17000000000000001},"max":{"1min":0.47899999999999998,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.32400000000000001,"15min":0.312},"min":{"1min":0.249,"5min":0.222,"15min":0.19800000000000001},"max":{"1min":0.52100000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.35099999999999998}]},{"osd":2,"last update":"Mon Nov 27 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.32600000000000001,"15min":0.316},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.192},"max":{"1min":0.50800000000000001,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.34499999999999997,"15min":0.34399999999999997},"min":{"1min":0.28299999999999997,"5min":0.22600000000000001,"15min":0.20499999999999999},"max":{"1min":0.54100000000000004,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.40100000000000002}]},{"osd":3,"last update":"Mon Nov 27 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.36599999999999999,"15min":0.37},"min":{"1min":0.315,"5min":0.26800000000000002,"15min":0.23300000000000001},"max":{"1min":0.61699999999999999,"5min":0.622,"15min":0.68200000000000005},"last":0.372},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38400000000000001,"15min":0.37},"min":{"1min":0.27500000000000002,"5min":0.24399999999999999,"15min":0.23699999999999999},"max":{"1min":0.59199999999999997,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.27600000000000002}]},{"osd":4,"last update":"Mon Nov 27 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.48399999999999999,"15min":0.47199999999999998},"min":{"1min":0.39000000000000001,"5min":0.313,"15min":0.26600000000000001},"max":{"1min":0.83099999999999996,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.498,"15min":0.48799999999999999},"min":{"1min":0.38200000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68899999999999995,"5min":1.26,"15min":1.26},"last":0.54700000000000004}]},{"osd":5,"last update":"Mon Nov 27 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51300000000000001,"15min":0.497},"min":{"1min":0.41199999999999998,"5min":0.35399999999999998,"15min":0.313},"max":{"1min":0.71199999999999997,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.497,"15min":0.49399999999999999},"min":{"1min":0.38200000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77100000000000002,"5min":1.2689999999999999,"15min":1.4079999999999999},"last":0.45300000000000001}]},{"osd":6,"last update":"Mon Nov 27 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52700000000000002,"15min":0.51600000000000001},"min":{"1min":0.42699999999999999,"5min":0.38200000000000001,"15min":0.33600000000000002},"max":{"1min":0.746,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.501},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52200000000000002,"15min":0.52100000000000002},"min":{"1min":0.40100000000000002,"5min":0.36199999999999999,"15min":0.34499999999999997},"max":{"1min":0.76000000000000001,"5min":1.292,"15min":1.4239999999999999},"last":0.44400000000000001}]},{"osd":7,"last update":"Mon Nov 27 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.33200000000000002},"max":{"1min":0.77700000000000002,"5min":1.25,"15min":1.25},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.53600000000000003,"15min":0.52200000000000002},"min":{"1min":0.432,"5min":0.38700000000000001,"15min":0.35399999999999998},"max":{"1min":0.80000000000000004,"5min":1.3029999999999999,"15min":1.4399999999999999},"last":0.48699999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509799,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76024,"kb_used_data":8752,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94295816,"statfs":{"total":96636764160,"available":96558915584,"internally_reserved":0,"allocated":8962048,"data_stored":8748777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 21:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.32200000000000001,"15min":0.312},"min":{"1min":0.217,"5min":0.185,"15min":0.185},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.313,"15min":0.313},"min":{"1min":0.23200000000000001,"5min":0.20100000000000001,"15min":0.19},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.69699999999999995},"last":0.251}]},{"osd":2,"last update":"Mon Nov 27 21:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.25600000000000001,"5min":0.22,"15min":0.189},"max":{"1min":0.51100000000000001,"5min":0.54300000000000004,"15min":0.59299999999999997},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.34899999999999998,"15min":0.34599999999999997},"min":{"1min":0.31,"5min":0.223,"15min":0.19900000000000001},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.66900000000000004},"last":0.316}]},{"osd":3,"last update":"Mon Nov 27 21:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.34499999999999997,"15min":0.34799999999999998},"min":{"1min":0.27100000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55100000000000005,"5min":0.58799999999999997,"15min":0.65200000000000002},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39000000000000001,"15min":0.38700000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.21099999999999999},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.26700000000000002}]},{"osd":4,"last update":"Mon Nov 27 21:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.45800000000000002,"15min":0.45300000000000001},"min":{"1min":0.39500000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.81200000000000006},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.49099999999999999,"15min":0.47399999999999998},"min":{"1min":0.36699999999999999,"5min":0.33200000000000002,"15min":0.27200000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.48299999999999998}]},{"osd":5,"last update":"Mon Nov 27 21:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.51000000000000001,"15min":0.498},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.32700000000000001},"max":{"1min":0.74099999999999999,"5min":0.746,"15min":0.81499999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.48199999999999998,"15min":0.46500000000000002},"min":{"1min":0.40600000000000003,"5min":0.34100000000000003,"15min":0.317},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.56899999999999995}]},{"osd":6,"last update":"Mon Nov 27 21:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.50700000000000001,"15min":0.49399999999999999},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.31900000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.52500000000000002,"15min":0.51800000000000002},"min":{"1min":0.41899999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.85699999999999998},"last":0.58299999999999996}]},{"osd":7,"last update":"Mon Nov 27 21:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.53000000000000003,"15min":0.52600000000000002},"min":{"1min":0.44500000000000001,"5min":0.35399999999999998,"15min":0.33500000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89300000000000002},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.503,"15min":0.496},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.78000000000000003},"last":0.59899999999999998}]}]},{"osd":7,"up_from":14,"seq":60129542504,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56968,"kb_used_data":7744,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94314872,"statfs":{"total":96636764160,"available":96578428928,"internally_reserved":0,"allocated":7929856,"data_stored":7711066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":50395595},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.42699999999999999,"15min":0.40799999999999997},"min":{"1min":0.42299999999999999,"5min":0.25,"15min":0.21199999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.82899999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.42699999999999999,"15min":0.42999999999999999},"min":{"1min":0.374,"5min":0.27000000000000002,"15min":0.26200000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.40500000000000003}]},{"osd":1,"last update":"Mon Nov 27 21:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.45700000000000002,"15min":0.438},"min":{"1min":0.38800000000000001,"5min":0.26800000000000002,"15min":0.246},"max":{"1min":0.65400000000000003,"5min":0.72099999999999997,"15min":0.88500000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.46200000000000002,"15min":0.45600000000000002},"min":{"1min":0.41099999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63,"5min":0.64500000000000002,"15min":0.873},"last":0.41599999999999998}]},{"osd":2,"last update":"Mon Nov 27 21:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.433,"15min":0.432},"min":{"1min":0.34599999999999997,"5min":0.28399999999999997,"15min":0.28100000000000003},"max":{"1min":0.65000000000000002,"5min":0.65300000000000002,"15min":0.79700000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.42499999999999999,"15min":0.41999999999999998},"min":{"1min":0.34300000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.68700000000000006},"last":0.46000000000000002}]},{"osd":3,"last update":"Mon Nov 27 21:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.44700000000000001,"15min":0.44600000000000001},"min":{"1min":0.40899999999999997,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64600000000000002,"5min":0.68700000000000006,"15min":0.77100000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.46999999999999997,"15min":0.45400000000000001},"min":{"1min":0.35299999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64900000000000002,"5min":0.68600000000000005,"15min":0.90200000000000002},"last":0.47699999999999998}]},{"osd":4,"last update":"Mon Nov 27 21:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.38200000000000001,"15min":0.39200000000000002},"min":{"1min":0.26400000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.502,"5min":0.59199999999999997,"15min":0.65400000000000003},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.42399999999999999,"15min":0.41699999999999998},"min":{"1min":0.32500000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61599999999999999,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.29499999999999998}]},{"osd":5,"last update":"Mon Nov 27 21:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.442,"15min":0.435},"min":{"1min":0.30199999999999999,"5min":0.27700000000000002,"15min":0.27300000000000002},"max":{"1min":0.61799999999999999,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42499999999999999,"15min":0.435},"min":{"1min":0.32300000000000001,"5min":0.26500000000000001,"15min":0.248},"max":{"1min":0.57499999999999996,"5min":0.71499999999999997,"15min":0.77700000000000002},"last":0.44500000000000001}]},{"osd":6,"last update":"Mon Nov 27 21:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.439,"15min":0.45000000000000001},"min":{"1min":0.29699999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58399999999999996,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.313,"5min":0.29099999999999998,"15min":0.28100000000000003},"max":{"1min":0.63600000000000001,"5min":0.751,"15min":0.84999999999999998},"last":0.42699999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542504,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57800,"kb_used_data":8576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94314040,"statfs":{"total":96636764160,"available":96577576960,"internally_reserved":0,"allocated":8781824,"data_stored":8552244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.435,"15min":0.41099999999999998},"min":{"1min":0.39000000000000001,"5min":0.248,"15min":0.20200000000000001},"max":{"1min":0.66600000000000004,"5min":1.446,"15min":1.446},"last":0.749},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.505,"15min":0.45400000000000001},"min":{"1min":0.40400000000000003,"5min":0.29099999999999998,"15min":0.24099999999999999},"max":{"1min":0.65000000000000002,"5min":3.948,"15min":3.948},"last":0.77600000000000002}]},{"osd":1,"last update":"Mon Nov 27 21:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.497,"15min":0.442},"min":{"1min":0.41399999999999998,"5min":0.28100000000000003,"15min":0.24099999999999999},"max":{"1min":0.73699999999999999,"5min":5.0410000000000004,"15min":5.0410000000000004},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.502,"5min":0.44900000000000001,"15min":0.41999999999999998},"min":{"1min":0.38700000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.67800000000000005,"5min":1.181,"15min":1.181},"last":0.80100000000000005}]},{"osd":2,"last update":"Mon Nov 27 21:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.47499999999999998,"15min":0.438},"min":{"1min":0.42899999999999999,"5min":0.29499999999999998,"15min":0.26100000000000001},"max":{"1min":0.72699999999999998,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.49299999999999999,"15min":0.46200000000000002},"min":{"1min":0.34899999999999998,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":0.59799999999999998,"5min":4.008,"15min":4.008},"last":0.627}]},{"osd":3,"last update":"Mon Nov 27 21:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.501,"15min":0.47599999999999998},"min":{"1min":0.36299999999999999,"5min":0.318,"15min":0.312},"max":{"1min":0.68500000000000005,"5min":1.532,"15min":1.532},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.59399999999999997,"15min":0.498},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.28499999999999998},"max":{"1min":0.68999999999999995,"5min":10.747999999999999,"15min":10.747999999999999},"last":0.79000000000000004}]},{"osd":5,"last update":"Mon Nov 27 21:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.66900000000000004,"15min":0.47899999999999998},"min":{"1min":0.28399999999999997,"5min":0.23100000000000001,"15min":0.221},"max":{"1min":0.55500000000000005,"5min":20.847999999999999,"15min":20.847999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.46999999999999997,"15min":0.42999999999999999},"min":{"1min":0.30199999999999999,"5min":0.26000000000000001,"15min":0.23100000000000001},"max":{"1min":0.58399999999999996,"5min":5.0800000000000001,"15min":5.0800000000000001},"last":0.39900000000000002}]},{"osd":6,"last update":"Mon Nov 27 21:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42999999999999999,"15min":0.41799999999999998},"min":{"1min":0.30099999999999999,"5min":0.255,"15min":0.24399999999999999},"max":{"1min":0.62,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.48899999999999999,"15min":0.47099999999999997},"min":{"1min":0.33000000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.71299999999999997,"5min":1.478,"15min":1.478},"last":0.435}]},{"osd":7,"last update":"Mon Nov 27 21:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46300000000000002,"15min":0.45400000000000001},"min":{"1min":0.29599999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.64300000000000002,"5min":1.113,"15min":1.113},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.55500000000000005,"15min":0.51900000000000002},"min":{"1min":0.35699999999999998,"5min":0.35099999999999998,"15min":0.33400000000000002},"max":{"1min":0.73899999999999999,"5min":3.4649999999999999,"15min":3.4649999999999999},"last":0.498}]}]},{"osd":3,"up_from":14,"seq":60129542504,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89188,"kb_used_data":13596,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94282652,"statfs":{"total":96636764160,"available":96545435648,"internally_reserved":0,"allocated":13922304,"data_stored":13708692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 21:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.34100000000000003,"15min":0.32500000000000001},"min":{"1min":0.215,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.39100000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.28699999999999998,"5min":0.41699999999999998,"15min":0.34200000000000003},"min":{"1min":0.23999999999999999,"5min":0.21099999999999999,"15min":0.192},"max":{"1min":0.36899999999999999,"5min":8.9369999999999994,"15min":8.9369999999999994},"last":0.52000000000000002}]},{"osd":1,"last update":"Mon Nov 27 21:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.29399999999999998,"5min":0.34100000000000003,"15min":0.32100000000000001},"min":{"1min":0.218,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.44,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.38300000000000001,"15min":0.35999999999999999},"min":{"1min":0.255,"5min":0.23400000000000001,"15min":0.21199999999999999},"max":{"1min":0.46100000000000002,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.47499999999999998}]},{"osd":2,"last update":"Mon Nov 27 21:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.45600000000000002,"15min":0.39700000000000002},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.22600000000000001},"max":{"1min":0.502,"5min":7.0830000000000002,"15min":7.0830000000000002},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.38100000000000001,"15min":0.378},"min":{"1min":0.27800000000000002,"5min":0.25700000000000001,"15min":0.22600000000000001},"max":{"1min":0.47699999999999998,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.498}]},{"osd":4,"last update":"Mon Nov 27 21:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.499,"15min":0.47299999999999998},"min":{"1min":0.39300000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.77500000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52900000000000003,"15min":0.497},"min":{"1min":0.36499999999999999,"5min":0.34499999999999997,"15min":0.314},"max":{"1min":0.66300000000000003,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":0.72199999999999998}]},{"osd":5,"last update":"Mon Nov 27 21:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52600000000000002,"15min":0.49399999999999999},"min":{"1min":0.38900000000000001,"5min":0.33600000000000002,"15min":0.28499999999999998},"max":{"1min":0.76100000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.745},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.52000000000000002},"min":{"1min":0.38300000000000001,"5min":0.373,"15min":0.34100000000000003},"max":{"1min":0.69299999999999995,"5min":2.7400000000000002,"15min":2.7400000000000002},"last":0.78700000000000003}]},{"osd":6,"last update":"Mon Nov 27 21:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.56000000000000005,"15min":0.52500000000000002},"min":{"1min":0.373,"5min":0.36899999999999999,"15min":0.311},"max":{"1min":0.72499999999999998,"5min":4.7169999999999996,"15min":4.7169999999999996},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53700000000000003,"15min":0.51000000000000001},"min":{"1min":0.37,"5min":0.35499999999999998,"15min":0.314},"max":{"1min":0.76200000000000001,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.80600000000000005}]},{"osd":7,"last update":"Mon Nov 27 21:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.38,"5min":0.36099999999999999,"15min":0.35999999999999999},"max":{"1min":0.77100000000000002,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.40999999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73999999999999999,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.83999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8667136,"data_stored":8628738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2547712,"data_stored":2528360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13627392,"data_stored":13588653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8486912,"data_stored":8432205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18833408,"data_stored":18809764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20590592,"data_stored":20576109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7634944,"data_stored":7591027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T21:23:48.816 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-27T21:23:48.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.941+0000 7fe7a1f2c640 1 Processor -- start 2023-11-27T21:23:48.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.941+0000 7fe7a1f2c640 1 -- start start 2023-11-27T21:23:48.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.941+0000 7fe7a1f2c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe79c0710c0 0x7fe79c071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:48.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.941+0000 7fe7a1f2c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79c1577f0 con 0x7fe79c157240 2023-11-27T21:23:48.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.941+0000 7fe7a1f2c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79c157a90 con 0x7fe79c151220 2023-11-27T21:23:48.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.941+0000 7fe7a1f2c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79c06f470 con 0x7fe79c0710c0 2023-11-27T21:23:48.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.942+0000 7fe792ffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe79c157240 0x7fe79c0c40d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48256/0 (socket says 172.21.15.88:48256) 2023-11-27T21:23:48.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.942+0000 7fe792ffd640 1 -- 172.21.15.88:0/1990755621 learned_addr learned my addr 172.21.15.88:0/1990755621 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:23:48.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.943+0000 7fe79bfff640 1 --2- 172.21.15.88:0/1990755621 >> v2:172.21.15.167:3300/0 conn(0x7fe79c0710c0 0x7fe79c071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:48.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.945+0000 7fe79affd640 1 -- 172.21.15.88:0/1990755621 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744807177 0 0) 0x7fe79c1577f0 con 0x7fe79c157240 2023-11-27T21:23:48.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.945+0000 7fe79affd640 1 -- 172.21.15.88:0/1990755621 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe788003520 con 0x7fe79c157240 2023-11-27T21:23:48.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.946+0000 7fe79bfff640 1 -- 172.21.15.88:0/1990755621 >> v1:172.21.15.167:6789/0 conn(0x7fe79c151220 legacy=0x7fe79c06ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:48.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.946+0000 7fe79bfff640 1 -- 172.21.15.88:0/1990755621 >> v1:172.21.15.88:6789/0 conn(0x7fe79c157240 legacy=0x7fe79c0c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:48.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.946+0000 7fe79bfff640 1 -- 172.21.15.88:0/1990755621 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79c157d30 con 0x7fe79c0710c0 2023-11-27T21:23:48.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.951+0000 7fe79bfff640 1 --2- 172.21.15.88:0/1990755621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe79c0710c0 0x7fe79c071530 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe79c06f5b0 tx=0x7fe79402bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aeaa9854c94647ed server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:48.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.956+0000 7fe79affd640 1 -- 172.21.15.88:0/1990755621 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79402cd80 con 0x7fe79c0710c0 2023-11-27T21:23:48.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.956+0000 7fe79affd640 1 -- 172.21.15.88:0/1990755621 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe794034440 con 0x7fe79c0710c0 2023-11-27T21:23:48.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.956+0000 7fe79affd640 1 -- 172.21.15.88:0/1990755621 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7940347d0 con 0x7fe79c0710c0 2023-11-27T21:23:48.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.956+0000 7fe7a1f2c640 1 -- 172.21.15.88:0/1990755621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe79c0710c0 msgr2=0x7fe79c071530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:48.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.956+0000 7fe7a1f2c640 1 --2- 172.21.15.88:0/1990755621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe79c0710c0 0x7fe79c071530 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe79c06f5b0 tx=0x7fe79402bfd0 comp rx=0 tx=0).stop 2023-11-27T21:23:48.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.956+0000 7fe7a1f2c640 1 -- 172.21.15.88:0/1990755621 shutdown_connections 2023-11-27T21:23:48.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.956+0000 7fe7a1f2c640 1 --2- 172.21.15.88:0/1990755621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe79c0710c0 0x7fe79c071530 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:48.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.956+0000 7fe7a1f2c640 1 -- 172.21.15.88:0/1990755621 >> 172.21.15.88:0/1990755621 conn(0x7fe79c06c5f0 msgr2=0x7fe79c06c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:23:48.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.956+0000 7fe7a1f2c640 1 -- 172.21.15.88:0/1990755621 shutdown_connections 2023-11-27T21:23:48.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.956+0000 7fe7a1f2c640 1 -- 172.21.15.88:0/1990755621 wait complete. 2023-11-27T21:23:48.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.957+0000 7fe7a1f2c640 1 Processor -- start 2023-11-27T21:23:48.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.957+0000 7fe7a1f2c640 1 -- start start 2023-11-27T21:23:48.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.959+0000 7fe7a1f2c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe79c0710c0 0x7fe79c1ee170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:48.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.959+0000 7fe7a1f2c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe79c151220 0x7fe79c146a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:48.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.959+0000 7fe7a1f2c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe79c157240 0x7fe79c152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:48.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.959+0000 7fe7a1f2c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c0cb250 con 0x7fe79c0710c0 2023-11-27T21:23:48.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.959+0000 7fe7a1f2c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c1eeb60 con 0x7fe79c151220 2023-11-27T21:23:48.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.959+0000 7fe7a1f2c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c1ee6b0 con 0x7fe79c157240 2023-11-27T21:23:48.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.959+0000 7fe79b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe79c0710c0 0x7fe79c1ee170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:48.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.959+0000 7fe792ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe79c151220 0x7fe79c146a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:48.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.959+0000 7fe79bfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe79c157240 0x7fe79c152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:48.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.959+0000 7fe79b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe79c0710c0 0x7fe79c1ee170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46492/0 (socket says 172.21.15.88:46492) 2023-11-27T21:23:48.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.959+0000 7fe792ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe79c151220 0x7fe79c146a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:59774/0 (socket says 172.21.15.88:59774) 2023-11-27T21:23:48.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.959+0000 7fe79b7fe640 1 -- 172.21.15.88:0/226817045 learned_addr learned my addr 172.21.15.88:0/226817045 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:23:48.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.963+0000 7fe79b7fe640 1 -- 172.21.15.88:0/226817045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe79c157240 msgr2=0x7fe79c152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:48.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.963+0000 7fe79b7fe640 1 --2- 172.21.15.88:0/226817045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe79c157240 0x7fe79c152010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:48.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.963+0000 7fe79b7fe640 1 -- 172.21.15.88:0/226817045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe79c151220 msgr2=0x7fe79c146a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:48.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.963+0000 7fe79b7fe640 1 --2- 172.21.15.88:0/226817045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe79c151220 0x7fe79c146a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:48.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.963+0000 7fe79b7fe640 1 -- 172.21.15.88:0/226817045 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe794009a70 con 0x7fe79c0710c0 2023-11-27T21:23:48.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.965+0000 7fe79b7fe640 1 --2- 172.21.15.88:0/226817045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe79c0710c0 0x7fe79c1ee170 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00c400 tx=0x7fe78c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:48.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.969+0000 7fe798ff9640 1 -- 172.21.15.88:0/226817045 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c0052d0 con 0x7fe79c0710c0 2023-11-27T21:23:48.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.969+0000 7fe798ff9640 1 -- 172.21.15.88:0/226817045 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c005450 con 0x7fe79c0710c0 2023-11-27T21:23:48.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.969+0000 7fe798ff9640 1 -- 172.21.15.88:0/226817045 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c007260 con 0x7fe79c0710c0 2023-11-27T21:23:48.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.969+0000 7fe7a1f2c640 1 -- 172.21.15.88:0/226817045 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79c153db0 con 0x7fe79c0710c0 2023-11-27T21:23:48.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.969+0000 7fe7a1f2c640 1 -- 172.21.15.88:0/226817045 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79c1518a0 con 0x7fe79c0710c0 2023-11-27T21:23:48.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:48.969+0000 7fe7a1f2c640 1 -- 172.21.15.88:0/226817045 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79c072020 con 0x7fe79c0710c0 2023-11-27T21:23:49.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.209+0000 7fe798ff9640 1 -- 172.21.15.88:0/226817045 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe78c0073c0 con 0x7fe79c0710c0 2023-11-27T21:23:49.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.210+0000 7fe798ff9640 1 --2- 172.21.15.88:0/226817045 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fe77c06b210 0x7fe77c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:49.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.210+0000 7fe792ffd640 1 --2- 172.21.15.88:0/226817045 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fe77c06b210 0x7fe77c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:49.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.210+0000 7fe792ffd640 1 --2- 172.21.15.88:0/226817045 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fe77c06b210 0x7fe77c06d6d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe79c0c1830 tx=0x7fe784007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:49.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.223+0000 7fe798ff9640 1 -- 172.21.15.88:0/226817045 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe78c007670 con 0x7fe79c0710c0 2023-11-27T21:23:49.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.223+0000 7fe798ff9640 1 -- 172.21.15.88:0/226817045 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe78c054350 con 0x7fe79c0710c0 2023-11-27T21:23:49.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.398+0000 7fe7a1f2c640 1 -- 172.21.15.88:0/226817045 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fe79c067470 con 0x7fe79c0710c0 2023-11-27T21:23:49.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.661+0000 7fe798ff9640 1 -- 172.21.15.88:0/226817045 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7fe78c0200c0 con 0x7fe79c0710c0 2023-11-27T21:23:49.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.661+0000 7fe798ff9640 1 -- 172.21.15.88:0/226817045 <== mon.0 v2:172.21.15.88:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe78c058010 con 0x7fe79c0710c0 2023-11-27T21:23:49.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.663+0000 7fe7a1f2c640 1 -- 172.21.15.88:0/226817045 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fe77c06b210 msgr2=0x7fe77c06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:49.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.663+0000 7fe7a1f2c640 1 --2- 172.21.15.88:0/226817045 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fe77c06b210 0x7fe77c06d6d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe79c0c1830 tx=0x7fe784007d30 comp rx=0 tx=0).stop 2023-11-27T21:23:49.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.663+0000 7fe7a1f2c640 1 -- 172.21.15.88:0/226817045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe79c0710c0 msgr2=0x7fe79c1ee170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:49.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.663+0000 7fe7a1f2c640 1 --2- 172.21.15.88:0/226817045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe79c0710c0 0x7fe79c1ee170 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00c400 tx=0x7fe78c00c8c0 comp rx=0 tx=0).stop 2023-11-27T21:23:49.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.663+0000 7fe7a1f2c640 1 -- 172.21.15.88:0/226817045 shutdown_connections 2023-11-27T21:23:49.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.663+0000 7fe7a1f2c640 1 --2- 172.21.15.88:0/226817045 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fe77c06b210 0x7fe77c06d6d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:49.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.663+0000 7fe7a1f2c640 1 --2- 172.21.15.88:0/226817045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe79c157240 0x7fe79c152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:49.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.663+0000 7fe7a1f2c640 1 --2- 172.21.15.88:0/226817045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe79c151220 0x7fe79c146a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:49.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.663+0000 7fe7a1f2c640 1 --2- 172.21.15.88:0/226817045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe79c0710c0 0x7fe79c1ee170 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:49.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.663+0000 7fe7a1f2c640 1 -- 172.21.15.88:0/226817045 >> 172.21.15.88:0/226817045 conn(0x7fe79c06c5f0 msgr2=0x7fe79c14f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:23:49.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.663+0000 7fe7a1f2c640 1 -- 172.21.15.88:0/226817045 shutdown_connections 2023-11-27T21:23:49.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.663+0000 7fe7a1f2c640 1 -- 172.21.15.88:0/226817045 wait complete. 2023-11-27T21:23:49.677 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-27T21:23:49.678 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T21:23:49.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.778+0000 7fb5734a2640 1 Processor -- start 2023-11-27T21:23:49.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.778+0000 7fb5734a2640 1 -- start start 2023-11-27T21:23:49.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.779+0000 7fb5734a2640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb56c0710c0 0x7fb56c071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:49.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.779+0000 7fb5734a2640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb56c1577f0 con 0x7fb56c151220 2023-11-27T21:23:49.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.779+0000 7fb5734a2640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb56c157a90 con 0x7fb56c157240 2023-11-27T21:23:49.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.779+0000 7fb5734a2640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb56c06f470 con 0x7fb56c0710c0 2023-11-27T21:23:49.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.779+0000 7fb571a3f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb56c0710c0 0x7fb56c071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:49.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.780+0000 7fb570a3d640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fb56c157240 0x7fb56c0c40d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:43960/0 (socket says 172.21.15.88:43960) 2023-11-27T21:23:49.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.780+0000 7fb570a3d640 1 -- 172.21.15.88:0/416138513 learned_addr learned my addr 172.21.15.88:0/416138513 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:23:49.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.783+0000 7fb55ffff640 1 -- 172.21.15.88:0/416138513 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 17425409 0 0) 0x7fb56c157a90 con 0x7fb56c157240 2023-11-27T21:23:49.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.783+0000 7fb55ffff640 1 -- 172.21.15.88:0/416138513 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb558003520 con 0x7fb56c157240 2023-11-27T21:23:49.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.784+0000 7fb571a3f640 1 -- 172.21.15.88:0/416138513 >> v1:172.21.15.167:6789/0 conn(0x7fb56c157240 legacy=0x7fb56c0c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:49.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.784+0000 7fb571a3f640 1 -- 172.21.15.88:0/416138513 >> v1:172.21.15.88:6789/0 conn(0x7fb56c151220 legacy=0x7fb56c06ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:49.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.784+0000 7fb571a3f640 1 -- 172.21.15.88:0/416138513 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56c157d30 con 0x7fb56c0710c0 2023-11-27T21:23:49.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.788+0000 7fb571a3f640 1 --2- 172.21.15.88:0/416138513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb56c0710c0 0x7fb56c071530 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb56c06f5b0 tx=0x7fb56402bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8d8f81f15cc995 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:49.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.792+0000 7fb55ffff640 1 -- 172.21.15.88:0/416138513 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56402cd80 con 0x7fb56c0710c0 2023-11-27T21:23:49.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.792+0000 7fb55ffff640 1 -- 172.21.15.88:0/416138513 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb564034440 con 0x7fb56c0710c0 2023-11-27T21:23:49.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.792+0000 7fb55ffff640 1 -- 172.21.15.88:0/416138513 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5640347f0 con 0x7fb56c0710c0 2023-11-27T21:23:49.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.792+0000 7fb5734a2640 1 -- 172.21.15.88:0/416138513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb56c0710c0 msgr2=0x7fb56c071530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:49.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.792+0000 7fb5734a2640 1 --2- 172.21.15.88:0/416138513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb56c0710c0 0x7fb56c071530 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb56c06f5b0 tx=0x7fb56402bfd0 comp rx=0 tx=0).stop 2023-11-27T21:23:49.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.792+0000 7fb5734a2640 1 -- 172.21.15.88:0/416138513 shutdown_connections 2023-11-27T21:23:49.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.792+0000 7fb5734a2640 1 --2- 172.21.15.88:0/416138513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb56c0710c0 0x7fb56c071530 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:49.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.792+0000 7fb5734a2640 1 -- 172.21.15.88:0/416138513 >> 172.21.15.88:0/416138513 conn(0x7fb56c06c5f0 msgr2=0x7fb56c06c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:23:49.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.792+0000 7fb5734a2640 1 -- 172.21.15.88:0/416138513 shutdown_connections 2023-11-27T21:23:49.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.792+0000 7fb5734a2640 1 -- 172.21.15.88:0/416138513 wait complete. 2023-11-27T21:23:49.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.793+0000 7fb5734a2640 1 Processor -- start 2023-11-27T21:23:49.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.793+0000 7fb5734a2640 1 -- start start 2023-11-27T21:23:49.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.794+0000 7fb5734a2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb56c0710c0 0x7fb56c14c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:49.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.794+0000 7fb5734a2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb56c151220 0x7fb56c145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:49.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.794+0000 7fb5734a2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb56c157240 0x7fb56c1460f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:49.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.794+0000 7fb5734a2640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c0c8120 con 0x7fb56c151220 2023-11-27T21:23:49.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.794+0000 7fb5734a2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c14d1c0 con 0x7fb56c0710c0 2023-11-27T21:23:49.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.794+0000 7fb5734a2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c14c040 con 0x7fb56c157240 2023-11-27T21:23:49.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.794+0000 7fb570a3d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb56c151220 0x7fb56c145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:49.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.794+0000 7fb57123e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb56c0710c0 0x7fb56c14c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:49.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.794+0000 7fb571a3f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb56c157240 0x7fb56c1460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:49.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.794+0000 7fb57123e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb56c0710c0 0x7fb56c14c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:59776/0 (socket says 172.21.15.88:59776) 2023-11-27T21:23:49.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.795+0000 7fb57123e640 1 -- 172.21.15.88:0/2990755651 learned_addr learned my addr 172.21.15.88:0/2990755651 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:23:49.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.798+0000 7fb570a3d640 1 -- 172.21.15.88:0/2990755651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb56c157240 msgr2=0x7fb56c1460f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:49.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.798+0000 7fb570a3d640 1 --2- 172.21.15.88:0/2990755651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb56c157240 0x7fb56c1460f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:49.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.798+0000 7fb570a3d640 1 -- 172.21.15.88:0/2990755651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb56c0710c0 msgr2=0x7fb56c14c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:49.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.798+0000 7fb570a3d640 1 --2- 172.21.15.88:0/2990755651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb56c0710c0 0x7fb56c14c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:49.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.798+0000 7fb570a3d640 1 -- 172.21.15.88:0/2990755651 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb564009a70 con 0x7fb56c151220 2023-11-27T21:23:49.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.800+0000 7fb570a3d640 1 --2- 172.21.15.88:0/2990755651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb56c151220 0x7fb56c145bb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb56000c3f0 tx=0x7fb560001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:49.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.804+0000 7fb55dffb640 1 -- 172.21.15.88:0/2990755651 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560005ce0 con 0x7fb56c151220 2023-11-27T21:23:49.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.804+0000 7fb55dffb640 1 -- 172.21.15.88:0/2990755651 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb560005e40 con 0x7fb56c151220 2023-11-27T21:23:49.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.804+0000 7fb55dffb640 1 -- 172.21.15.88:0/2990755651 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5600072f0 con 0x7fb56c151220 2023-11-27T21:23:49.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.804+0000 7fb5734a2640 1 -- 172.21.15.88:0/2990755651 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb56c142e00 con 0x7fb56c151220 2023-11-27T21:23:49.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.804+0000 7fb5734a2640 1 -- 172.21.15.88:0/2990755651 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb56c143510 con 0x7fb56c151220 2023-11-27T21:23:49.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.805+0000 7fb5734a2640 1 -- 172.21.15.88:0/2990755651 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb56c072020 con 0x7fb56c151220 2023-11-27T21:23:49.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.824+0000 7fb55dffb640 1 -- 172.21.15.88:0/2990755651 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb560007450 con 0x7fb56c151220 2023-11-27T21:23:49.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.825+0000 7fb55dffb640 1 --2- 172.21.15.88:0/2990755651 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb55006b210 0x7fb55006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:49.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.825+0000 7fb57123e640 1 --2- 172.21.15.88:0/2990755651 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb55006b210 0x7fb55006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:49.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:49.825+0000 7fb57123e640 1 --2- 172.21.15.88:0/2990755651 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb55006b210 0x7fb55006d6d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb568001840 tx=0x7fb568009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:50.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.059+0000 7fb55dffb640 1 -- 172.21.15.88:0/2990755651 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb560013e70 con 0x7fb56c151220 2023-11-27T21:23:50.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.059+0000 7fb55dffb640 1 -- 172.21.15.88:0/2990755651 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb5600541e0 con 0x7fb56c151220 2023-11-27T21:23:50.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.262+0000 7fb5734a2640 1 -- 172.21.15.88:0/2990755651 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb56c067470 con 0x7fb56c151220 2023-11-27T21:23:50.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.276+0000 7fb55dffb640 1 -- 172.21.15.88:0/2990755651 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+6570 (secure 0 0 0) 0x7fb560017020 con 0x7fb56c151220 2023-11-27T21:23:50.279 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T21:23:50.279 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":96,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/298325117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":298325117},{"type":"v1","addr":"172.21.15.88:6837","nonce":298325117}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:54:26.940968+0000","modified":"2023-11-27T21:23:46.133185+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34205,"mds_1":34199,"mds_2":34190,"mds_3":34187,"mds_4":4258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4258":{"gid":4258,"name":"f","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.167:6837/1596074914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1596074914},{"type":"v1","addr":"172.21.15.167:6837","nonce":1596074914}]},"join_fscid":-1,"export_targets":[0],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34187":{"gid":34187,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":15,"addr":"172.21.15.88:6835/256796309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":256796309},{"type":"v1","addr":"172.21.15.88:6835","nonce":256796309}]},"join_fscid":-1,"export_targets":[0],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34190":{"gid":34190,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":14,"addr":"172.21.15.167:6833/1245449675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1245449675},{"type":"v1","addr":"172.21.15.167:6833","nonce":1245449675}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34199":{"gid":34199,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":14,"addr":"172.21.15.167:6835/327644613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":327644613},{"type":"v1","addr":"172.21.15.167:6835","nonce":327644613}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34205":{"gid":34205,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.88:6839/2120059880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":2120059880},{"type":"v1","addr":"172.21.15.88:6839","nonce":2120059880}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T21:23:50.279 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 96 2023-11-27T21:23:50.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.278+0000 7fb5734a2640 1 -- 172.21.15.88:0/2990755651 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb55006b210 msgr2=0x7fb55006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:50.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.278+0000 7fb5734a2640 1 --2- 172.21.15.88:0/2990755651 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb55006b210 0x7fb55006d6d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb568001840 tx=0x7fb568009040 comp rx=0 tx=0).stop 2023-11-27T21:23:50.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.278+0000 7fb5734a2640 1 -- 172.21.15.88:0/2990755651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb56c151220 msgr2=0x7fb56c145bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:50.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.278+0000 7fb5734a2640 1 --2- 172.21.15.88:0/2990755651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb56c151220 0x7fb56c145bb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb56000c3f0 tx=0x7fb560001e70 comp rx=0 tx=0).stop 2023-11-27T21:23:50.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.278+0000 7fb5734a2640 1 -- 172.21.15.88:0/2990755651 shutdown_connections 2023-11-27T21:23:50.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.278+0000 7fb5734a2640 1 --2- 172.21.15.88:0/2990755651 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fb55006b210 0x7fb55006d6d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:50.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.278+0000 7fb5734a2640 1 --2- 172.21.15.88:0/2990755651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb56c157240 0x7fb56c1460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:50.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.278+0000 7fb5734a2640 1 --2- 172.21.15.88:0/2990755651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb56c151220 0x7fb56c145bb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:50.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.278+0000 7fb5734a2640 1 --2- 172.21.15.88:0/2990755651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb56c0710c0 0x7fb56c14c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:50.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.278+0000 7fb5734a2640 1 -- 172.21.15.88:0/2990755651 >> 172.21.15.88:0/2990755651 conn(0x7fb56c06c5f0 msgr2=0x7fb56c14fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:23:50.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.278+0000 7fb5734a2640 1 -- 172.21.15.88:0/2990755651 shutdown_connections 2023-11-27T21:23:50.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.278+0000 7fb5734a2640 1 -- 172.21.15.88:0/2990755651 wait complete. 2023-11-27T21:23:50.292 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T21:23:50.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.390+0000 7fe08f2c9640 1 Processor -- start 2023-11-27T21:23:50.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.391+0000 7fe08f2c9640 1 -- start start 2023-11-27T21:23:50.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.391+0000 7fe08f2c9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0880cc420 0x7fe088159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:50.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.391+0000 7fe08f2c9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0880cbda0 con 0x7fe088159b50 2023-11-27T21:23:50.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.391+0000 7fe08f2c9640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0880cea60 con 0x7fe0880cda70 2023-11-27T21:23:50.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.391+0000 7fe08f2c9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0880cc230 con 0x7fe0880cc420 2023-11-27T21:23:50.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.392+0000 7fe08d866640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe088159b50 0x7fe0880c9620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48270/0 (socket says 172.21.15.88:48270) 2023-11-27T21:23:50.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.392+0000 7fe08d866640 1 -- 172.21.15.88:0/2631141244 learned_addr learned my addr 172.21.15.88:0/2631141244 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:23:50.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.392+0000 7fe08c864640 1 --2- 172.21.15.88:0/2631141244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0880cc420 0x7fe088159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:50.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.395+0000 7fe07ffff640 1 -- 172.21.15.88:0/2631141244 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648670899 0 0) 0x7fe0880cbda0 con 0x7fe088159b50 2023-11-27T21:23:50.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.395+0000 7fe07ffff640 1 -- 172.21.15.88:0/2631141244 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe074003520 con 0x7fe088159b50 2023-11-27T21:23:50.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.395+0000 7fe07ffff640 1 -- 172.21.15.88:0/2631141244 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 406703887 0 0) 0x7fe0880cea60 con 0x7fe0880cda70 2023-11-27T21:23:50.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.395+0000 7fe07ffff640 1 -- 172.21.15.88:0/2631141244 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0880cbda0 con 0x7fe0880cda70 2023-11-27T21:23:50.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.396+0000 7fe08c864640 1 -- 172.21.15.88:0/2631141244 >> v1:172.21.15.167:6789/0 conn(0x7fe0880cda70 legacy=0x7fe0880ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:50.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.396+0000 7fe08c864640 1 -- 172.21.15.88:0/2631141244 >> v1:172.21.15.88:6789/0 conn(0x7fe088159b50 legacy=0x7fe0880c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:50.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.396+0000 7fe08c864640 1 -- 172.21.15.88:0/2631141244 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0880cb4e0 con 0x7fe0880cc420 2023-11-27T21:23:50.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.398+0000 7fe08c864640 1 --2- 172.21.15.88:0/2631141244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0880cc420 0x7fe088159610 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe0780097d0 tx=0x7fe07802b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdf6f9f74b51beaf server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:50.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.403+0000 7fe07ffff640 1 -- 172.21.15.88:0/2631141244 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe078030880 con 0x7fe0880cc420 2023-11-27T21:23:50.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.403+0000 7fe07ffff640 1 -- 172.21.15.88:0/2631141244 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe0780309e0 con 0x7fe0880cc420 2023-11-27T21:23:50.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.403+0000 7fe07ffff640 1 -- 172.21.15.88:0/2631141244 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe078030d90 con 0x7fe0880cc420 2023-11-27T21:23:50.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.403+0000 7fe08f2c9640 1 -- 172.21.15.88:0/2631141244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0880cc420 msgr2=0x7fe088159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:50.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.403+0000 7fe08f2c9640 1 --2- 172.21.15.88:0/2631141244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0880cc420 0x7fe088159610 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe0780097d0 tx=0x7fe07802b9c0 comp rx=0 tx=0).stop 2023-11-27T21:23:50.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.403+0000 7fe08f2c9640 1 -- 172.21.15.88:0/2631141244 shutdown_connections 2023-11-27T21:23:50.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.403+0000 7fe08f2c9640 1 --2- 172.21.15.88:0/2631141244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0880cc420 0x7fe088159610 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:50.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.403+0000 7fe08f2c9640 1 -- 172.21.15.88:0/2631141244 >> 172.21.15.88:0/2631141244 conn(0x7fe0880b07b0 msgr2=0x7fe0880b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:23:50.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.403+0000 7fe08f2c9640 1 -- 172.21.15.88:0/2631141244 shutdown_connections 2023-11-27T21:23:50.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.403+0000 7fe08f2c9640 1 -- 172.21.15.88:0/2631141244 wait complete. 2023-11-27T21:23:50.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.405+0000 7fe08f2c9640 1 Processor -- start 2023-11-27T21:23:50.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.405+0000 7fe08f2c9640 1 -- start start 2023-11-27T21:23:50.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.405+0000 7fe08f2c9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0880cc420 0x7fe088158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:50.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.405+0000 7fe08f2c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0880cda70 0x7fe0880c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:50.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.405+0000 7fe08f2c9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe088159b50 0x7fe0881ef5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:50.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.405+0000 7fe08f2c9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0880c5250 con 0x7fe088159b50 2023-11-27T21:23:50.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.405+0000 7fe08f2c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0881f36c0 con 0x7fe0880cda70 2023-11-27T21:23:50.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.405+0000 7fe08f2c9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0881f2ab0 con 0x7fe0880cc420 2023-11-27T21:23:50.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.406+0000 7fe08d866640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe088159b50 0x7fe0881ef5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:50.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.406+0000 7fe08d866640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe088159b50 0x7fe0881ef5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46514/0 (socket says 172.21.15.88:46514) 2023-11-27T21:23:50.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.406+0000 7fe08d866640 1 -- 172.21.15.88:0/266337980 learned_addr learned my addr 172.21.15.88:0/266337980 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:23:50.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.406+0000 7fe08c864640 1 --2- 172.21.15.88:0/266337980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0880cda70 0x7fe0880c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:50.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.406+0000 7fe08d065640 1 --2- 172.21.15.88:0/266337980 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0880cc420 0x7fe088158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:50.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.409+0000 7fe08d866640 1 -- 172.21.15.88:0/266337980 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0880cc420 msgr2=0x7fe088158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:50.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.409+0000 7fe08d866640 1 --2- 172.21.15.88:0/266337980 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0880cc420 0x7fe088158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:50.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.409+0000 7fe08d866640 1 -- 172.21.15.88:0/266337980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0880cda70 msgr2=0x7fe0880c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:50.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.409+0000 7fe08d866640 1 --2- 172.21.15.88:0/266337980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0880cda70 0x7fe0880c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:50.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.410+0000 7fe08d866640 1 -- 172.21.15.88:0/266337980 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe078009400 con 0x7fe088159b50 2023-11-27T21:23:50.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.412+0000 7fe08d866640 1 --2- 172.21.15.88:0/266337980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe088159b50 0x7fe0881ef5c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe08400c3c0 tx=0x7fe08400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:50.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.416+0000 7fe07dffb640 1 -- 172.21.15.88:0/266337980 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe084005ce0 con 0x7fe088159b50 2023-11-27T21:23:50.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.416+0000 7fe07dffb640 1 -- 172.21.15.88:0/266337980 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe084005e40 con 0x7fe088159b50 2023-11-27T21:23:50.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.416+0000 7fe08f2c9640 1 -- 172.21.15.88:0/266337980 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0881f2d90 con 0x7fe088159b50 2023-11-27T21:23:50.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.416+0000 7fe07dffb640 1 -- 172.21.15.88:0/266337980 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe084007310 con 0x7fe088159b50 2023-11-27T21:23:50.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.416+0000 7fe08f2c9640 1 -- 172.21.15.88:0/266337980 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0881f3350 con 0x7fe088159b50 2023-11-27T21:23:50.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.417+0000 7fe08f2c9640 1 -- 172.21.15.88:0/266337980 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe088067470 con 0x7fe088159b50 2023-11-27T21:23:50.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.658+0000 7fe07dffb640 1 -- 172.21.15.88:0/266337980 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe084007470 con 0x7fe088159b50 2023-11-27T21:23:50.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.658+0000 7fe07dffb640 1 --2- 172.21.15.88:0/266337980 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fe06c06b1c0 0x7fe06c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:50.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.659+0000 7fe08d065640 1 --2- 172.21.15.88:0/266337980 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fe06c06b1c0 0x7fe06c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:50.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.659+0000 7fe08d065640 1 --2- 172.21.15.88:0/266337980 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fe06c06b1c0 0x7fe06c06d680 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe080001ea0 tx=0x7fe080009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:50.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.672+0000 7fe07dffb640 1 -- 172.21.15.88:0/266337980 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe084007720 con 0x7fe088159b50 2023-11-27T21:23:50.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.672+0000 7fe07dffb640 1 -- 172.21.15.88:0/266337980 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe084054100 con 0x7fe088159b50 2023-11-27T21:23:50.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.881+0000 7fe08f2c9640 1 -- 172.21.15.88:0/266337980 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0880b4c20 con 0x7fe088159b50 2023-11-27T21:23:50.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.893+0000 7fe07dffb640 1 -- 172.21.15.88:0/266337980 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+6570 (secure 0 0 0) 0x7fe084056030 con 0x7fe088159b50 2023-11-27T21:23:50.895 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T21:23:50.896 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":96,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/298325117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":298325117},{"type":"v1","addr":"172.21.15.88:6837","nonce":298325117}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:54:26.940968+0000","modified":"2023-11-27T21:23:46.133185+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34205,"mds_1":34199,"mds_2":34190,"mds_3":34187,"mds_4":4258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4258":{"gid":4258,"name":"f","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.167:6837/1596074914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1596074914},{"type":"v1","addr":"172.21.15.167:6837","nonce":1596074914}]},"join_fscid":-1,"export_targets":[0],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34187":{"gid":34187,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":15,"addr":"172.21.15.88:6835/256796309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":256796309},{"type":"v1","addr":"172.21.15.88:6835","nonce":256796309}]},"join_fscid":-1,"export_targets":[0],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34190":{"gid":34190,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":14,"addr":"172.21.15.167:6833/1245449675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1245449675},{"type":"v1","addr":"172.21.15.167:6833","nonce":1245449675}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34199":{"gid":34199,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":14,"addr":"172.21.15.167:6835/327644613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":327644613},{"type":"v1","addr":"172.21.15.167:6835","nonce":327644613}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34205":{"gid":34205,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.88:6839/2120059880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":2120059880},{"type":"v1","addr":"172.21.15.88:6839","nonce":2120059880}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T21:23:50.896 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 96 2023-11-27T21:23:50.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.895+0000 7fe08f2c9640 1 -- 172.21.15.88:0/266337980 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fe06c06b1c0 msgr2=0x7fe06c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:50.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.895+0000 7fe08f2c9640 1 --2- 172.21.15.88:0/266337980 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fe06c06b1c0 0x7fe06c06d680 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe080001ea0 tx=0x7fe080009040 comp rx=0 tx=0).stop 2023-11-27T21:23:50.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.895+0000 7fe08f2c9640 1 -- 172.21.15.88:0/266337980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe088159b50 msgr2=0x7fe0881ef5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:50.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.895+0000 7fe08f2c9640 1 --2- 172.21.15.88:0/266337980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe088159b50 0x7fe0881ef5c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe08400c3c0 tx=0x7fe08400c880 comp rx=0 tx=0).stop 2023-11-27T21:23:50.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.895+0000 7fe08f2c9640 1 -- 172.21.15.88:0/266337980 shutdown_connections 2023-11-27T21:23:50.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.895+0000 7fe08f2c9640 1 --2- 172.21.15.88:0/266337980 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fe06c06b1c0 0x7fe06c06d680 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:50.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.895+0000 7fe08f2c9640 1 --2- 172.21.15.88:0/266337980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe088159b50 0x7fe0881ef5c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:50.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.895+0000 7fe08f2c9640 1 --2- 172.21.15.88:0/266337980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0880cda70 0x7fe0880c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:50.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.895+0000 7fe08f2c9640 1 --2- 172.21.15.88:0/266337980 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0880cc420 0x7fe088158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:50.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.895+0000 7fe08f2c9640 1 -- 172.21.15.88:0/266337980 >> 172.21.15.88:0/266337980 conn(0x7fe0880b07b0 msgr2=0x7fe0880af8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:23:50.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.896+0000 7fe08f2c9640 1 -- 172.21.15.88:0/266337980 shutdown_connections 2023-11-27T21:23:50.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:50.896+0000 7fe08f2c9640 1 -- 172.21.15.88:0/266337980 wait complete. 2023-11-27T21:23:50.909 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T21:23:51.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.006+0000 7f53965d0640 1 Processor -- start 2023-11-27T21:23:51.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.006+0000 7f53965d0640 1 -- start start 2023-11-27T21:23:51.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.007+0000 7f53965d0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5390157240 0x7f53900c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:51.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.007+0000 7f53965d0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53900c4610 0x7f53900710c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:51.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.007+0000 7f53965d0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53901577f0 con 0x7f5390151220 2023-11-27T21:23:51.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.007+0000 7f53965d0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f539006f470 con 0x7f5390157240 2023-11-27T21:23:51.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.007+0000 7f53965d0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5390157a90 con 0x7f53900c4610 2023-11-27T21:23:51.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.008+0000 7f5394b6d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53900c4610 0x7f53900710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:51.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.008+0000 7f538f7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5390157240 0x7f53900c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:51.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.008+0000 7f538ffff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f5390151220 0x7f539006ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:38962/0 (socket says 172.21.15.88:38962) 2023-11-27T21:23:51.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.008+0000 7f5394b6d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53900c4610 0x7f53900710c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:40662/0 (socket says 172.21.15.88:40662) 2023-11-27T21:23:51.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.008+0000 7f538ffff640 1 -- 172.21.15.88:0/3408822666 learned_addr learned my addr 172.21.15.88:0/3408822666 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:23:51.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.011+0000 7f5394b6d640 1 -- 172.21.15.88:0/3408822666 >> v2:172.21.15.167:3300/0 conn(0x7f5390157240 msgr2=0x7f53900c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:23:51.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.011+0000 7f5394b6d640 1 --2- 172.21.15.88:0/3408822666 >> v2:172.21.15.167:3300/0 conn(0x7f5390157240 0x7f53900c40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:51.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.011+0000 7f5394b6d640 1 -- 172.21.15.88:0/3408822666 >> v1:172.21.15.167:6789/0 conn(0x7f5390151220 legacy=0x7f539006ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:51.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.011+0000 7f5394b6d640 1 -- 172.21.15.88:0/3408822666 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5390157d30 con 0x7f53900c4610 2023-11-27T21:23:51.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.013+0000 7f5394b6d640 1 --2- 172.21.15.88:0/3408822666 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53900c4610 0x7f53900710c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5388009d90 tx=0x7f538802bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7593f3c6b2baa5f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:51.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.017+0000 7f538effd640 1 -- 172.21.15.88:0/3408822666 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538802cce0 con 0x7f53900c4610 2023-11-27T21:23:51.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.017+0000 7f538effd640 1 -- 172.21.15.88:0/3408822666 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f538802ce40 con 0x7f53900c4610 2023-11-27T21:23:51.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.017+0000 7f538effd640 1 -- 172.21.15.88:0/3408822666 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5388034680 con 0x7f53900c4610 2023-11-27T21:23:51.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.018+0000 7f53965d0640 1 -- 172.21.15.88:0/3408822666 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53900c4610 msgr2=0x7f53900710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:51.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.018+0000 7f53965d0640 1 --2- 172.21.15.88:0/3408822666 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53900c4610 0x7f53900710c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5388009d90 tx=0x7f538802bf30 comp rx=0 tx=0).stop 2023-11-27T21:23:51.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.018+0000 7f53965d0640 1 -- 172.21.15.88:0/3408822666 shutdown_connections 2023-11-27T21:23:51.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.018+0000 7f53965d0640 1 --2- 172.21.15.88:0/3408822666 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53900c4610 0x7f53900710c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:51.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.018+0000 7f53965d0640 1 --2- 172.21.15.88:0/3408822666 >> v2:172.21.15.167:3300/0 conn(0x7f5390157240 0x7f53900c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:51.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.018+0000 7f53965d0640 1 -- 172.21.15.88:0/3408822666 >> 172.21.15.88:0/3408822666 conn(0x7f539006c5f0 msgr2=0x7f539006c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:23:51.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.018+0000 7f53965d0640 1 -- 172.21.15.88:0/3408822666 shutdown_connections 2023-11-27T21:23:51.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.018+0000 7f53965d0640 1 -- 172.21.15.88:0/3408822666 wait complete. 2023-11-27T21:23:51.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.019+0000 7f53965d0640 1 Processor -- start 2023-11-27T21:23:51.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.019+0000 7f53965d0640 1 -- start start 2023-11-27T21:23:51.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.020+0000 7f53965d0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53900c4610 0x7f5390155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:51.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.020+0000 7f53965d0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5390151220 0x7f53901f0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:51.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.020+0000 7f53965d0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5390157240 0x7f539013e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:51.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.020+0000 7f53965d0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5390154e80 con 0x7f53900c4610 2023-11-27T21:23:51.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.020+0000 7f53965d0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53900cb230 con 0x7f5390151220 2023-11-27T21:23:51.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.020+0000 7f53965d0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53900caf90 con 0x7f5390157240 2023-11-27T21:23:51.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.021+0000 7f538ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53900c4610 0x7f5390155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:51.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.021+0000 7f538f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5390151220 0x7f53901f0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:51.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.021+0000 7f5394b6d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5390157240 0x7f539013e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:51.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.021+0000 7f538ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53900c4610 0x7f5390155770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47222/0 (socket says 172.21.15.88:47222) 2023-11-27T21:23:51.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.021+0000 7f538ffff640 1 -- 172.21.15.88:0/3252540735 learned_addr learned my addr 172.21.15.88:0/3252540735 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:23:51.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.024+0000 7f538ffff640 1 -- 172.21.15.88:0/3252540735 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5390157240 msgr2=0x7f539013e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:51.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.024+0000 7f538ffff640 1 --2- 172.21.15.88:0/3252540735 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5390157240 0x7f539013e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:51.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.024+0000 7f538ffff640 1 -- 172.21.15.88:0/3252540735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5390151220 msgr2=0x7f53901f0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:51.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.024+0000 7f538ffff640 1 --2- 172.21.15.88:0/3252540735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5390151220 0x7f53901f0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:51.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.024+0000 7f538ffff640 1 -- 172.21.15.88:0/3252540735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5388009a70 con 0x7f53900c4610 2023-11-27T21:23:51.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.027+0000 7f538ffff640 1 --2- 172.21.15.88:0/3252540735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53900c4610 0x7f5390155770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f538000c430 tx=0x7f538000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:51.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.030+0000 7f538cff9640 1 -- 172.21.15.88:0/3252540735 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5380005ce0 con 0x7f53900c4610 2023-11-27T21:23:51.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.031+0000 7f538cff9640 1 -- 172.21.15.88:0/3252540735 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5380005e40 con 0x7f53900c4610 2023-11-27T21:23:51.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.031+0000 7f53965d0640 1 -- 172.21.15.88:0/3252540735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5390154bb0 con 0x7f53900c4610 2023-11-27T21:23:51.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.031+0000 7f538cff9640 1 -- 172.21.15.88:0/3252540735 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5380007330 con 0x7f53900c4610 2023-11-27T21:23:51.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.031+0000 7f53965d0640 1 -- 172.21.15.88:0/3252540735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5390143590 con 0x7f53900c4610 2023-11-27T21:23:51.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.032+0000 7f53965d0640 1 -- 172.21.15.88:0/3252540735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5390072020 con 0x7f53900c4610 2023-11-27T21:23:51.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.049+0000 7f538cff9640 1 -- 172.21.15.88:0/3252540735 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5380007550 con 0x7f53900c4610 2023-11-27T21:23:51.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.050+0000 7f538cff9640 1 --2- 172.21.15.88:0/3252540735 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f537c06b210 0x7f537c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:51.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.050+0000 7f538f7fe640 1 --2- 172.21.15.88:0/3252540735 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f537c06b210 0x7f537c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:51.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.050+0000 7f538f7fe640 1 --2- 172.21.15.88:0/3252540735 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f537c06b210 0x7f537c06d6d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5390071ad0 tx=0x7f5384009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:51.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.054+0000 7f538cff9640 1 -- 172.21.15.88:0/3252540735 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5380013e70 con 0x7f53900c4610 2023-11-27T21:23:51.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.303+0000 7f538cff9640 1 -- 172.21.15.88:0/3252540735 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f53800541e0 con 0x7f53900c4610 2023-11-27T21:23:51.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.474+0000 7f53965d0640 1 -- 172.21.15.88:0/3252540735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5390067470 con 0x7f53900c4610 2023-11-27T21:23:51.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.517+0000 7f538cff9640 1 -- 172.21.15.88:0/3252540735 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18666 (secure 0 0 0) 0x7f5380017020 con 0x7f53900c4610 2023-11-27T21:23:51.520 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-27T21:23:51.520 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":28,"fsid":"ef9a9b3d-c8d8-4bc5-8a1a-530a440c5afc","created":"2023-11-27T20:53:53.110827+0000","modified":"2023-11-27T20:55:00.550945+0000","last_up_change":"2023-11-27T20:54:08.219383+0000","last_in_change":"2023-11-27T20:53:59.022798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:54:09.277670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:54:24.503156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:54:25.744043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T20:54:29.704111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1207ca0f-bef1-44c6-b66b-58bf0e080ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6819","nonce":3952326022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6821","nonce":3952326022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6825","nonce":3952326022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3952326022},{"type":"v1","addr":"172.21.15.88:6823","nonce":3952326022}]},"public_addr":"172.21.15.88:6819/3952326022","cluster_addr":"172.21.15.88:6821/3952326022","heartbeat_back_addr":"172.21.15.88:6825/3952326022","heartbeat_front_addr":"172.21.15.88:6823/3952326022","state":["exists","up"]},{"osd":1,"uuid":"8d1be479-4241-4335-9633-1394311fde76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6827","nonce":1788401966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6829","nonce":1788401966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6833","nonce":1788401966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1788401966},{"type":"v1","addr":"172.21.15.88:6831","nonce":1788401966}]},"public_addr":"172.21.15.88:6827/1788401966","cluster_addr":"172.21.15.88:6829/1788401966","heartbeat_back_addr":"172.21.15.88:6833/1788401966","heartbeat_front_addr":"172.21.15.88:6831/1788401966","state":["exists","up"]},{"osd":2,"uuid":"7536b008-05dd-40eb-9d4a-bdac4b1c38c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6803","nonce":1166333913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6805","nonce":1166333913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6809","nonce":1166333913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1166333913},{"type":"v1","addr":"172.21.15.88:6807","nonce":1166333913}]},"public_addr":"172.21.15.88:6803/1166333913","cluster_addr":"172.21.15.88:6805/1166333913","heartbeat_back_addr":"172.21.15.88:6809/1166333913","heartbeat_front_addr":"172.21.15.88:6807/1166333913","state":["exists","up"]},{"osd":3,"uuid":"47edd4d7-e99c-4ce3-851b-cc9c8e2d4480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6811","nonce":406887502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6813","nonce":406887502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6817","nonce":406887502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":406887502},{"type":"v1","addr":"172.21.15.88:6815","nonce":406887502}]},"public_addr":"172.21.15.88:6811/406887502","cluster_addr":"172.21.15.88:6813/406887502","heartbeat_back_addr":"172.21.15.88:6817/406887502","heartbeat_front_addr":"172.21.15.88:6815/406887502","state":["exists","up"]},{"osd":4,"uuid":"0a81dd31-1a8b-41af-b933-d74aae63f3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6801","nonce":2551293703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6803","nonce":2551293703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6807","nonce":2551293703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2551293703},{"type":"v1","addr":"172.21.15.167:6805","nonce":2551293703}]},"public_addr":"172.21.15.167:6801/2551293703","cluster_addr":"172.21.15.167:6803/2551293703","heartbeat_back_addr":"172.21.15.167:6807/2551293703","heartbeat_front_addr":"172.21.15.167:6805/2551293703","state":["exists","up"]},{"osd":5,"uuid":"1c462d0d-3361-48b3-a82a-86a920539e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6825","nonce":866085094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6827","nonce":866085094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6831","nonce":866085094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":866085094},{"type":"v1","addr":"172.21.15.167:6829","nonce":866085094}]},"public_addr":"172.21.15.167:6825/866085094","cluster_addr":"172.21.15.167:6827/866085094","heartbeat_back_addr":"172.21.15.167:6831/866085094","heartbeat_front_addr":"172.21.15.167:6829/866085094","state":["exists","up"]},{"osd":6,"uuid":"d687c5ad-6c88-4a15-8120-0cdbc5610535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6809","nonce":2766725538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6811","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6813","nonce":2766725538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6819","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6821","nonce":2766725538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6815","nonce":2766725538},{"type":"v1","addr":"172.21.15.167:6817","nonce":2766725538}]},"public_addr":"172.21.15.167:6809/2766725538","cluster_addr":"172.21.15.167:6813/2766725538","heartbeat_back_addr":"172.21.15.167:6821/2766725538","heartbeat_front_addr":"172.21.15.167:6817/2766725538","state":["exists","up"]},{"osd":7,"uuid":"c9a50596-4981-4bd8-a8ef-d7679f8d9559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6812","nonce":2695037266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6816","nonce":2695037266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6823","nonce":2695037266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2695037266},{"type":"v1","addr":"172.21.15.167:6820","nonce":2695037266}]},"public_addr":"172.21.15.167:6812/2695037266","cluster_addr":"172.21.15.167:6816/2695037266","heartbeat_back_addr":"172.21.15.167:6823/2695037266","heartbeat_front_addr":"172.21.15.167:6820/2695037266","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.522590+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.483170+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.492504+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.432204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.414964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.459803+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.437250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:54:04.460394+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.1d","mappings":[{"from":0,"to":1}]},{"pgid":"3.35","mappings":[{"from":0,"to":7}]},{"pgid":"4.4","mappings":[{"from":6,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":4}]},{"pgid":"4.e","mappings":[{"from":3,"to":5}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T21:23:51.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.519+0000 7f53965d0640 1 -- 172.21.15.88:0/3252540735 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f537c06b210 msgr2=0x7f537c06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:51.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.519+0000 7f53965d0640 1 --2- 172.21.15.88:0/3252540735 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f537c06b210 0x7f537c06d6d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5390071ad0 tx=0x7f5384009190 comp rx=0 tx=0).stop 2023-11-27T21:23:51.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.519+0000 7f53965d0640 1 -- 172.21.15.88:0/3252540735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53900c4610 msgr2=0x7f5390155770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:51.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.519+0000 7f53965d0640 1 --2- 172.21.15.88:0/3252540735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53900c4610 0x7f5390155770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f538000c430 tx=0x7f538000c8f0 comp rx=0 tx=0).stop 2023-11-27T21:23:51.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.519+0000 7f53965d0640 1 -- 172.21.15.88:0/3252540735 shutdown_connections 2023-11-27T21:23:51.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.519+0000 7f53965d0640 1 --2- 172.21.15.88:0/3252540735 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f537c06b210 0x7f537c06d6d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:51.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.519+0000 7f53965d0640 1 --2- 172.21.15.88:0/3252540735 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5390157240 0x7f539013e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:51.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.519+0000 7f53965d0640 1 --2- 172.21.15.88:0/3252540735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5390151220 0x7f53901f0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:51.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.519+0000 7f53965d0640 1 --2- 172.21.15.88:0/3252540735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53900c4610 0x7f5390155770 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:51.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.519+0000 7f53965d0640 1 -- 172.21.15.88:0/3252540735 >> 172.21.15.88:0/3252540735 conn(0x7f539006c5f0 msgr2=0x7f539014e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:23:51.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.519+0000 7f53965d0640 1 -- 172.21.15.88:0/3252540735 shutdown_connections 2023-11-27T21:23:51.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.519+0000 7f53965d0640 1 -- 172.21.15.88:0/3252540735 wait complete. 2023-11-27T21:23:51.533 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-27T21:23:51.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.630+0000 7effc7b05640 1 Processor -- start 2023-11-27T21:23:51.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.630+0000 7effc7b05640 1 -- start start 2023-11-27T21:23:51.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.631+0000 7effc7b05640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc00cda70 0x7effc00ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:51.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.631+0000 7effc7b05640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7effc00cc420 0x7effc0159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:51.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.631+0000 7effc7b05640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc00cbda0 con 0x7effc0159b50 2023-11-27T21:23:51.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.631+0000 7effc7b05640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc00cc230 con 0x7effc00cc420 2023-11-27T21:23:51.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.631+0000 7effc7b05640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc00cb4e0 con 0x7effc00cda70 2023-11-27T21:23:51.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.632+0000 7effc58a1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc00cda70 0x7effc00ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:51.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.632+0000 7effc50a0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7effc00cc420 0x7effc0159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:51.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.632+0000 7effc60a2640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7effc0159b50 0x7effc00c9620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.88:38970/0 (socket says 172.21.15.88:38970) 2023-11-27T21:23:51.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.632+0000 7effc60a2640 1 -- 172.21.15.88:0/2705110878 learned_addr learned my addr 172.21.15.88:0/2705110878 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:23:51.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.635+0000 7effc58a1640 1 -- 172.21.15.88:0/2705110878 >> v2:172.21.15.167:3300/0 conn(0x7effc00cc420 msgr2=0x7effc0159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:23:51.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.635+0000 7effc58a1640 1 --2- 172.21.15.88:0/2705110878 >> v2:172.21.15.167:3300/0 conn(0x7effc00cc420 0x7effc0159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:51.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.635+0000 7effc58a1640 1 -- 172.21.15.88:0/2705110878 >> v1:172.21.15.167:6789/0 conn(0x7effc0159b50 legacy=0x7effc00c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:51.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.635+0000 7effc58a1640 1 -- 172.21.15.88:0/2705110878 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc00cce00 con 0x7effc00cda70 2023-11-27T21:23:51.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.638+0000 7effc58a1640 1 --2- 172.21.15.88:0/2705110878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc00cda70 0x7effc00ce350 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7effbc009d90 tx=0x7effbc02bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4419881ac04269d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:51.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.642+0000 7effc489f640 1 -- 172.21.15.88:0/2705110878 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc02cce0 con 0x7effc00cda70 2023-11-27T21:23:51.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.642+0000 7effc489f640 1 -- 172.21.15.88:0/2705110878 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7effbc02ce40 con 0x7effc00cda70 2023-11-27T21:23:51.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.642+0000 7effc489f640 1 -- 172.21.15.88:0/2705110878 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc034680 con 0x7effc00cda70 2023-11-27T21:23:51.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.643+0000 7effc7b05640 1 -- 172.21.15.88:0/2705110878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc00cda70 msgr2=0x7effc00ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:51.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.643+0000 7effc7b05640 1 --2- 172.21.15.88:0/2705110878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc00cda70 0x7effc00ce350 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7effbc009d90 tx=0x7effbc02bf30 comp rx=0 tx=0).stop 2023-11-27T21:23:51.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.643+0000 7effc7b05640 1 -- 172.21.15.88:0/2705110878 shutdown_connections 2023-11-27T21:23:51.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.643+0000 7effc7b05640 1 --2- 172.21.15.88:0/2705110878 >> v2:172.21.15.167:3300/0 conn(0x7effc00cc420 0x7effc0159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:51.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.643+0000 7effc7b05640 1 --2- 172.21.15.88:0/2705110878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc00cda70 0x7effc00ce350 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:51.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.643+0000 7effc7b05640 1 -- 172.21.15.88:0/2705110878 >> 172.21.15.88:0/2705110878 conn(0x7effc00b07b0 msgr2=0x7effc00b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:23:51.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.643+0000 7effc7b05640 1 -- 172.21.15.88:0/2705110878 shutdown_connections 2023-11-27T21:23:51.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.643+0000 7effc7b05640 1 -- 172.21.15.88:0/2705110878 wait complete. 2023-11-27T21:23:51.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.644+0000 7effc7b05640 1 Processor -- start 2023-11-27T21:23:51.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.644+0000 7effc7b05640 1 -- start start 2023-11-27T21:23:51.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.645+0000 7effc7b05640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc00cc420 0x7effc01efc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:51.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.645+0000 7effc7b05640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effc00cda70 0x7effc0159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:51.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.645+0000 7effc7b05640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effc0159b50 0x7effc0154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:51.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.645+0000 7effc7b05640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc01f0180 con 0x7effc00cda70 2023-11-27T21:23:51.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.645+0000 7effc7b05640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc0154610 con 0x7effc0159b50 2023-11-27T21:23:51.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.645+0000 7effc7b05640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc00c5a20 con 0x7effc00cc420 2023-11-27T21:23:51.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.645+0000 7effc58a1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc00cc420 0x7effc01efc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:51.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.645+0000 7effc50a0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effc00cda70 0x7effc0159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:51.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.645+0000 7effc60a2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effc0159b50 0x7effc0154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:51.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.645+0000 7effc58a1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc00cc420 0x7effc01efc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:40686/0 (socket says 172.21.15.88:40686) 2023-11-27T21:23:51.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.646+0000 7effc58a1640 1 -- 172.21.15.88:0/2743760952 learned_addr learned my addr 172.21.15.88:0/2743760952 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:23:51.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.649+0000 7effc58a1640 1 -- 172.21.15.88:0/2743760952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effc0159b50 msgr2=0x7effc0154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:51.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.649+0000 7effc58a1640 1 --2- 172.21.15.88:0/2743760952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effc0159b50 0x7effc0154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:51.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.649+0000 7effc58a1640 1 -- 172.21.15.88:0/2743760952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effc00cda70 msgr2=0x7effc0159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:51.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.649+0000 7effc58a1640 1 --2- 172.21.15.88:0/2743760952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effc00cda70 0x7effc0159040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:51.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.649+0000 7effc58a1640 1 -- 172.21.15.88:0/2743760952 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc009a70 con 0x7effc00cc420 2023-11-27T21:23:51.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.651+0000 7effc58a1640 1 --2- 172.21.15.88:0/2743760952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc00cc420 0x7effc01efc40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7effbc000f80 tx=0x7effbc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:51.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.655+0000 7effb67fc640 1 -- 172.21.15.88:0/2743760952 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc03e610 con 0x7effc00cc420 2023-11-27T21:23:51.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.655+0000 7effb67fc640 1 -- 172.21.15.88:0/2743760952 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7effbc03e770 con 0x7effc00cc420 2023-11-27T21:23:51.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.655+0000 7effb67fc640 1 -- 172.21.15.88:0/2743760952 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc03eb40 con 0x7effc00cc420 2023-11-27T21:23:51.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.655+0000 7effc7b05640 1 -- 172.21.15.88:0/2743760952 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc00c27d0 con 0x7effc00cc420 2023-11-27T21:23:51.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.655+0000 7effc7b05640 1 -- 172.21.15.88:0/2743760952 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc00c2d80 con 0x7effc00cc420 2023-11-27T21:23:51.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.656+0000 7effc7b05640 1 -- 172.21.15.88:0/2743760952 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc0067470 con 0x7effc00cc420 2023-11-27T21:23:51.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.906+0000 7effb67fc640 1 -- 172.21.15.88:0/2743760952 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7effbc03b050 con 0x7effc00cc420 2023-11-27T21:23:51.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.907+0000 7effb67fc640 1 --2- 172.21.15.88:0/2743760952 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7effa406b210 0x7effa406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:51.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.907+0000 7effc50a0640 1 --2- 172.21.15.88:0/2743760952 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7effa406b210 0x7effa406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:51.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.907+0000 7effc50a0640 1 --2- 172.21.15.88:0/2743760952 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7effa406b210 0x7effa406d6d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7effc00ca8d0 tx=0x7effb0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:51.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.910+0000 7effb67fc640 1 -- 172.21.15.88:0/2743760952 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7effbc07bbd0 con 0x7effc00cc420 2023-11-27T21:23:51.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:51.920+0000 7effb67fc640 1 -- 172.21.15.88:0/2743760952 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7effbc077f10 con 0x7effc00cc420 2023-11-27T21:23:52.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.129+0000 7effc7b05640 1 -- 172.21.15.88:0/2743760952 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7effc0159930 con 0x7effc00cc420 2023-11-27T21:23:52.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.345+0000 7effb67fc640 1 -- 172.21.15.88:0/2743760952 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v98) v1 ==== 161+0+0 (secure 0 0 0) 0x7effbc039030 con 0x7effc00cc420 2023-11-27T21:23:52.347 INFO:teuthology.orchestra.run.smithi088.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-27T21:23:52.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.347+0000 7effc7b05640 1 -- 172.21.15.88:0/2743760952 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7effa406b210 msgr2=0x7effa406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:52.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.347+0000 7effc7b05640 1 --2- 172.21.15.88:0/2743760952 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7effa406b210 0x7effa406d6d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7effc00ca8d0 tx=0x7effb0009190 comp rx=0 tx=0).stop 2023-11-27T21:23:52.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.347+0000 7effc7b05640 1 -- 172.21.15.88:0/2743760952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc00cc420 msgr2=0x7effc01efc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:52.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.347+0000 7effc7b05640 1 --2- 172.21.15.88:0/2743760952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc00cc420 0x7effc01efc40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7effbc000f80 tx=0x7effbc004a40 comp rx=0 tx=0).stop 2023-11-27T21:23:52.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.347+0000 7effc7b05640 1 -- 172.21.15.88:0/2743760952 shutdown_connections 2023-11-27T21:23:52.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.347+0000 7effc7b05640 1 --2- 172.21.15.88:0/2743760952 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7effa406b210 0x7effa406d6d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:52.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.347+0000 7effc7b05640 1 --2- 172.21.15.88:0/2743760952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effc0159b50 0x7effc0154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:52.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.347+0000 7effc7b05640 1 --2- 172.21.15.88:0/2743760952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effc00cda70 0x7effc0159040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:52.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.347+0000 7effc7b05640 1 --2- 172.21.15.88:0/2743760952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc00cc420 0x7effc01efc40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:52.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.347+0000 7effc7b05640 1 -- 172.21.15.88:0/2743760952 >> 172.21.15.88:0/2743760952 conn(0x7effc00b07b0 msgr2=0x7effc00cf240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:23:52.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.347+0000 7effc7b05640 1 -- 172.21.15.88:0/2743760952 shutdown_connections 2023-11-27T21:23:52.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.347+0000 7effc7b05640 1 -- 172.21.15.88:0/2743760952 wait complete. 2023-11-27T21:23:52.362 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-27T21:23:52.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.464+0000 7f0fd5bd0640 1 Processor -- start 2023-11-27T21:23:52.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.465+0000 7f0fd5bd0640 1 -- start start 2023-11-27T21:23:52.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.465+0000 7f0fd5bd0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fd00cc420 0x7f0fd0159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:52.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.465+0000 7f0fd5bd0640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0fd0159b50 0x7f0fd00c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:52.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.465+0000 7f0fd5bd0640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd00cbda0 con 0x7f0fd00cda70 2023-11-27T21:23:52.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.465+0000 7f0fd5bd0640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd00cc230 con 0x7f0fd0159b50 2023-11-27T21:23:52.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.465+0000 7f0fd5bd0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd00cea60 con 0x7f0fd00cc420 2023-11-27T21:23:52.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.466+0000 7f0fcffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0fd0159b50 0x7f0fd00c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:52.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.466+0000 7f0fceffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fd00cc420 0x7f0fd0159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:52.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.467+0000 7f0fceffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fd00cc420 0x7f0fd0159610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:40698/0 (socket says 172.21.15.88:40698) 2023-11-27T21:23:52.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.467+0000 7f0fceffd640 1 -- 172.21.15.88:0/713111484 learned_addr learned my addr 172.21.15.88:0/713111484 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:23:52.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.469+0000 7f0fceffd640 1 -- 172.21.15.88:0/713111484 >> v2:172.21.15.88:3300/0 conn(0x7f0fd0159b50 msgr2=0x7f0fd00c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:23:52.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.469+0000 7f0fceffd640 1 --2- 172.21.15.88:0/713111484 >> v2:172.21.15.88:3300/0 conn(0x7f0fd0159b50 0x7f0fd00c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:52.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.469+0000 7f0fceffd640 1 -- 172.21.15.88:0/713111484 >> v1:172.21.15.88:6789/0 conn(0x7f0fd00cda70 legacy=0x7f0fd00ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:52.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.469+0000 7f0fceffd640 1 -- 172.21.15.88:0/713111484 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd00cb4e0 con 0x7f0fd00cc420 2023-11-27T21:23:52.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.471+0000 7f0fceffd640 1 --2- 172.21.15.88:0/713111484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fd00cc420 0x7f0fd0159610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4009870 tx=0x7f0fc402ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d60f7747ca9fe8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:52.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.473+0000 7f0fce7fc640 1 -- 172.21.15.88:0/713111484 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc402f840 con 0x7f0fd00cc420 2023-11-27T21:23:52.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.476+0000 7f0fce7fc640 1 -- 172.21.15.88:0/713111484 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0fc402f9a0 con 0x7f0fd00cc420 2023-11-27T21:23:52.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.476+0000 7f0fce7fc640 1 -- 172.21.15.88:0/713111484 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc402fd50 con 0x7f0fd00cc420 2023-11-27T21:23:52.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.476+0000 7f0fd5bd0640 1 -- 172.21.15.88:0/713111484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fd00cc420 msgr2=0x7f0fd0159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:52.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.476+0000 7f0fd5bd0640 1 --2- 172.21.15.88:0/713111484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fd00cc420 0x7f0fd0159610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4009870 tx=0x7f0fc402ba20 comp rx=0 tx=0).stop 2023-11-27T21:23:52.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.477+0000 7f0fd5bd0640 1 -- 172.21.15.88:0/713111484 shutdown_connections 2023-11-27T21:23:52.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.477+0000 7f0fd5bd0640 1 --2- 172.21.15.88:0/713111484 >> v2:172.21.15.88:3300/0 conn(0x7f0fd0159b50 0x7f0fd00c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:52.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.477+0000 7f0fd5bd0640 1 --2- 172.21.15.88:0/713111484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fd00cc420 0x7f0fd0159610 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:52.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.477+0000 7f0fd5bd0640 1 -- 172.21.15.88:0/713111484 >> 172.21.15.88:0/713111484 conn(0x7f0fd00b07b0 msgr2=0x7f0fd00b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:23:52.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.477+0000 7f0fd5bd0640 1 -- 172.21.15.88:0/713111484 shutdown_connections 2023-11-27T21:23:52.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.477+0000 7f0fd5bd0640 1 -- 172.21.15.88:0/713111484 wait complete. 2023-11-27T21:23:52.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.478+0000 7f0fd5bd0640 1 Processor -- start 2023-11-27T21:23:52.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.478+0000 7f0fd5bd0640 1 -- start start 2023-11-27T21:23:52.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.479+0000 7f0fd5bd0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fd00cc420 0x7f0fd00adf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:52.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.479+0000 7f0fd5bd0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0fd00cda70 0x7f0fd00c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:52.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.479+0000 7f0fd5bd0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fd0159b50 0x7f0fd0152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:52.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.479+0000 7f0fd5bd0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd00c52f0 con 0x7f0fd0159b50 2023-11-27T21:23:52.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.479+0000 7f0fd5bd0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd00c4310 con 0x7f0fd00cda70 2023-11-27T21:23:52.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.479+0000 7f0fd5bd0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd00b0310 con 0x7f0fd00cc420 2023-11-27T21:23:52.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.479+0000 7f0fcffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fd0159b50 0x7f0fd0152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:52.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.479+0000 7f0fcf7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fd00cc420 0x7f0fd00adf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:52.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.479+0000 7f0fceffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0fd00cda70 0x7f0fd00c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:52.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.480+0000 7f0fcffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fd0159b50 0x7f0fd0152b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47258/0 (socket says 172.21.15.88:47258) 2023-11-27T21:23:52.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.480+0000 7f0fcffff640 1 -- 172.21.15.88:0/1875167604 learned_addr learned my addr 172.21.15.88:0/1875167604 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:23:52.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.483+0000 7f0fcffff640 1 -- 172.21.15.88:0/1875167604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fd00cc420 msgr2=0x7f0fd00adf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:52.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.483+0000 7f0fcffff640 1 --2- 172.21.15.88:0/1875167604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fd00cc420 0x7f0fd00adf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:52.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.483+0000 7f0fcffff640 1 -- 172.21.15.88:0/1875167604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0fd00cda70 msgr2=0x7f0fd00c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:52.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.483+0000 7f0fcffff640 1 --2- 172.21.15.88:0/1875167604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0fd00cda70 0x7f0fd00c4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:52.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.483+0000 7f0fcffff640 1 -- 172.21.15.88:0/1875167604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc40094d0 con 0x7f0fd0159b50 2023-11-27T21:23:52.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.483+0000 7f0fcf7fe640 1 --2- 172.21.15.88:0/1875167604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fd00cc420 0x7f0fd00adf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T21:23:52.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.485+0000 7f0fcffff640 1 --2- 172.21.15.88:0/1875167604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fd0159b50 0x7f0fd0152b20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0fc800ec10 tx=0x7f0fc800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:52.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.489+0000 7f0fb7fff640 1 -- 172.21.15.88:0/1875167604 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc800cd20 con 0x7f0fd0159b50 2023-11-27T21:23:52.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.489+0000 7f0fb7fff640 1 -- 172.21.15.88:0/1875167604 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0fc800f040 con 0x7f0fd0159b50 2023-11-27T21:23:52.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.489+0000 7f0fb7fff640 1 -- 172.21.15.88:0/1875167604 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc80146e0 con 0x7f0fd0159b50 2023-11-27T21:23:52.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.489+0000 7f0fd5bd0640 1 -- 172.21.15.88:0/1875167604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd00c7530 con 0x7f0fd0159b50 2023-11-27T21:23:52.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.489+0000 7f0fd5bd0640 1 -- 172.21.15.88:0/1875167604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd00c45b0 con 0x7f0fd0159b50 2023-11-27T21:23:52.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.490+0000 7f0fd5bd0640 1 -- 172.21.15.88:0/1875167604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd00c5b80 con 0x7f0fd0159b50 2023-11-27T21:23:52.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.742+0000 7f0fb7fff640 1 -- 172.21.15.88:0/1875167604 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0fc8014a50 con 0x7f0fd0159b50 2023-11-27T21:23:52.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.743+0000 7f0fb7fff640 1 --2- 172.21.15.88:0/1875167604 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f0fbc06b240 0x7f0fbc06d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:52.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.743+0000 7f0fcf7fe640 1 --2- 172.21.15.88:0/1875167604 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f0fbc06b240 0x7f0fbc06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:52.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.743+0000 7f0fcf7fe640 1 --2- 172.21.15.88:0/1875167604 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f0fbc06b240 0x7f0fbc06d700 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0001b70 tx=0x7f0fc0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:52.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.765+0000 7f0fb7fff640 1 -- 172.21.15.88:0/1875167604 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f0fc800ce80 con 0x7f0fd0159b50 2023-11-27T21:23:52.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.765+0000 7f0fb7fff640 1 -- 172.21.15.88:0/1875167604 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0fc8055c70 con 0x7f0fd0159b50 2023-11-27T21:23:52.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:52.980+0000 7f0fd5bd0640 1 -- 172.21.15.88:0/1875167604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0fd0067470 con 0x7f0fd0159b50 2023-11-27T21:23:53.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.261+0000 7f0fb7fff640 1 -- 172.21.15.88:0/1875167604 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v99) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0fc8018020 con 0x7f0fd0159b50 2023-11-27T21:23:53.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.264+0000 7f0fd5bd0640 1 -- 172.21.15.88:0/1875167604 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f0fbc06b240 msgr2=0x7f0fbc06d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:53.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.264+0000 7f0fd5bd0640 1 --2- 172.21.15.88:0/1875167604 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f0fbc06b240 0x7f0fbc06d700 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0001b70 tx=0x7f0fc0009040 comp rx=0 tx=0).stop 2023-11-27T21:23:53.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.264+0000 7f0fd5bd0640 1 -- 172.21.15.88:0/1875167604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fd0159b50 msgr2=0x7f0fd0152b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:53.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.264+0000 7f0fd5bd0640 1 --2- 172.21.15.88:0/1875167604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fd0159b50 0x7f0fd0152b20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0fc800ec10 tx=0x7f0fc800c490 comp rx=0 tx=0).stop 2023-11-27T21:23:53.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.264+0000 7f0fd5bd0640 1 -- 172.21.15.88:0/1875167604 shutdown_connections 2023-11-27T21:23:53.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.264+0000 7f0fd5bd0640 1 --2- 172.21.15.88:0/1875167604 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f0fbc06b240 0x7f0fbc06d700 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:53.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.264+0000 7f0fd5bd0640 1 --2- 172.21.15.88:0/1875167604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fd0159b50 0x7f0fd0152b20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:53.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.264+0000 7f0fd5bd0640 1 --2- 172.21.15.88:0/1875167604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0fd00cda70 0x7f0fd00c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:53.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.264+0000 7f0fd5bd0640 1 --2- 172.21.15.88:0/1875167604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fd00cc420 0x7f0fd00adf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:53.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.264+0000 7f0fd5bd0640 1 -- 172.21.15.88:0/1875167604 >> 172.21.15.88:0/1875167604 conn(0x7f0fd00b07b0 msgr2=0x7f0fd00af130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:23:53.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.264+0000 7f0fd5bd0640 1 -- 172.21.15.88:0/1875167604 shutdown_connections 2023-11-27T21:23:53.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.264+0000 7f0fd5bd0640 1 -- 172.21.15.88:0/1875167604 wait complete. 2023-11-27T21:23:53.279 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-27T21:23:53.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.398+0000 7f524b18a640 1 Processor -- start 2023-11-27T21:23:53.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.398+0000 7f524b18a640 1 -- start start 2023-11-27T21:23:53.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.399+0000 7f524b18a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f52440cc420 0x7f5244159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:53.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.399+0000 7f524b18a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5244159b50 0x7f52440c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:53.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.399+0000 7f524b18a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52440cbda0 con 0x7f52440cda70 2023-11-27T21:23:53.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.399+0000 7f524b18a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52440cc230 con 0x7f52440cc420 2023-11-27T21:23:53.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.399+0000 7f524b18a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52440cea60 con 0x7f5244159b50 2023-11-27T21:23:53.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.399+0000 7f5243fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f52440cc420 0x7f5244159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:53.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.400+0000 7f5243fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f52440cc420 0x7f5244159610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47268/0 (socket says 172.21.15.88:47268) 2023-11-27T21:23:53.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.400+0000 7f5243fff640 1 -- 172.21.15.88:0/3076972656 learned_addr learned my addr 172.21.15.88:0/3076972656 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:23:53.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.402+0000 7f5243fff640 1 -- 172.21.15.88:0/3076972656 >> v2:172.21.15.167:3300/0 conn(0x7f5244159b50 msgr2=0x7f52440c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:23:53.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.402+0000 7f5243fff640 1 --2- 172.21.15.88:0/3076972656 >> v2:172.21.15.167:3300/0 conn(0x7f5244159b50 0x7f52440c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:53.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.402+0000 7f5243fff640 1 -- 172.21.15.88:0/3076972656 >> v1:172.21.15.167:6789/0 conn(0x7f52440cda70 legacy=0x7f52440ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:23:53.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.402+0000 7f5243fff640 1 -- 172.21.15.88:0/3076972656 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52440cb4e0 con 0x7f52440cc420 2023-11-27T21:23:53.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.404+0000 7f5243fff640 1 --2- 172.21.15.88:0/3076972656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52440cc420 0x7f5244159610 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f524406d2d0 tx=0x7f523002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64383d433f9cad69 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:53.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.408+0000 7f52437fe640 1 -- 172.21.15.88:0/3076972656 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5230030860 con 0x7f52440cc420 2023-11-27T21:23:53.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.408+0000 7f52437fe640 1 -- 172.21.15.88:0/3076972656 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f52300309c0 con 0x7f52440cc420 2023-11-27T21:23:53.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.408+0000 7f52437fe640 1 -- 172.21.15.88:0/3076972656 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5230030d70 con 0x7f52440cc420 2023-11-27T21:23:53.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.409+0000 7f524b18a640 1 -- 172.21.15.88:0/3076972656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52440cc420 msgr2=0x7f5244159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:53.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.409+0000 7f524b18a640 1 --2- 172.21.15.88:0/3076972656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52440cc420 0x7f5244159610 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f524406d2d0 tx=0x7f523002b9a0 comp rx=0 tx=0).stop 2023-11-27T21:23:53.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.409+0000 7f524b18a640 1 -- 172.21.15.88:0/3076972656 shutdown_connections 2023-11-27T21:23:53.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.409+0000 7f524b18a640 1 --2- 172.21.15.88:0/3076972656 >> v2:172.21.15.167:3300/0 conn(0x7f5244159b50 0x7f52440c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:53.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.409+0000 7f524b18a640 1 --2- 172.21.15.88:0/3076972656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52440cc420 0x7f5244159610 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:53.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.409+0000 7f524b18a640 1 -- 172.21.15.88:0/3076972656 >> 172.21.15.88:0/3076972656 conn(0x7f52440b07b0 msgr2=0x7f52440b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:23:53.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.409+0000 7f524b18a640 1 -- 172.21.15.88:0/3076972656 shutdown_connections 2023-11-27T21:23:53.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.409+0000 7f524b18a640 1 -- 172.21.15.88:0/3076972656 wait complete. 2023-11-27T21:23:53.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.410+0000 7f524b18a640 1 Processor -- start 2023-11-27T21:23:53.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.410+0000 7f524b18a640 1 -- start start 2023-11-27T21:23:53.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.411+0000 7f524b18a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52440cc420 0x7f52441f06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:53.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.411+0000 7f524b18a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52440cda70 0x7f52441f3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:53.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.411+0000 7f524b18a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5244159b50 0x7f52441efc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:53.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.411+0000 7f524b18a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52441f01a0 con 0x7f52440cda70 2023-11-27T21:23:53.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.411+0000 7f524b18a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52440c4bd0 con 0x7f5244159b50 2023-11-27T21:23:53.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.411+0000 7f524b18a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52440c51f0 con 0x7f52440cc420 2023-11-27T21:23:53.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.412+0000 7f5249727640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5244159b50 0x7f52441efc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:53.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.412+0000 7f5248f26640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52440cc420 0x7f52441f06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:53.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.412+0000 7f5249727640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5244159b50 0x7f52441efc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.88:52320/0 (socket says 172.21.15.88:52320) 2023-11-27T21:23:53.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.412+0000 7f5249727640 1 -- 172.21.15.88:0/2313579843 learned_addr learned my addr 172.21.15.88:0/2313579843 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:23:53.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.417+0000 7f5249727640 1 -- 172.21.15.88:0/2313579843 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52440cc420 msgr2=0x7f52441f06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:53.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.417+0000 7f5249727640 1 --2- 172.21.15.88:0/2313579843 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52440cc420 0x7f52441f06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:53.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.417+0000 7f5249727640 1 -- 172.21.15.88:0/2313579843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52440cda70 msgr2=0x7f52441f3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:53.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.417+0000 7f5249727640 1 --2- 172.21.15.88:0/2313579843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52440cda70 0x7f52441f3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:53.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.417+0000 7f5249727640 1 -- 172.21.15.88:0/2313579843 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52300094d0 con 0x7f5244159b50 2023-11-27T21:23:53.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.420+0000 7f5249727640 1 --2- 172.21.15.88:0/2313579843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5244159b50 0x7f52441efc60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f523c00b9e0 tx=0x7f523c00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:53.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.426+0000 7f52417fa640 1 -- 172.21.15.88:0/2313579843 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c00caa0 con 0x7f5244159b50 2023-11-27T21:23:53.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.426+0000 7f52417fa640 1 -- 172.21.15.88:0/2313579843 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f523c00cc20 con 0x7f5244159b50 2023-11-27T21:23:53.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.426+0000 7f52417fa640 1 -- 172.21.15.88:0/2313579843 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c014440 con 0x7f5244159b50 2023-11-27T21:23:53.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.426+0000 7f524b18a640 1 -- 172.21.15.88:0/2313579843 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52440c54d0 con 0x7f5244159b50 2023-11-27T21:23:53.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.426+0000 7f524b18a640 1 -- 172.21.15.88:0/2313579843 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52441f2a80 con 0x7f5244159b50 2023-11-27T21:23:53.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.427+0000 7f524b18a640 1 -- 172.21.15.88:0/2313579843 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5244067470 con 0x7f5244159b50 2023-11-27T21:23:53.440 INFO:tasks.ceph.mds.d.smithi167.stderr:==00:00:29:44.676 94270== 2023-11-27T21:23:53.440 INFO:tasks.ceph.mds.d.smithi167.stderr:==00:00:29:44.676 94270== Exit program on first error (--exit-on-first-error=yes) 2023-11-27T21:23:53.457 INFO:tasks.ceph.mds.d.smithi167.stderr:daemon-helper: command failed with exit status 42 2023-11-27T21:23:53.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.460+0000 7f52417fa640 1 -- 172.21.15.88:0/2313579843 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f523c01d3b0 con 0x7f5244159b50 2023-11-27T21:23:53.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.460+0000 7f52417fa640 1 --2- 172.21.15.88:0/2313579843 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f522806b1c0 0x7f522806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:53.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.461+0000 7f5248f26640 1 --2- 172.21.15.88:0/2313579843 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f522806b1c0 0x7f522806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:53.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.461+0000 7f5248f26640 1 --2- 172.21.15.88:0/2313579843 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f522806b1c0 0x7f522806d680 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f52380017f0 tx=0x7f5238009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:53.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.466+0000 7f52417fa640 1 -- 172.21.15.88:0/2313579843 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f523c058850 con 0x7f5244159b50 2023-11-27T21:23:53.475 INFO:tasks.ceph.mds.e.smithi088.stderr:==00:00:29:44.707 94585== 2023-11-27T21:23:53.475 INFO:tasks.ceph.mds.e.smithi088.stderr:==00:00:29:44.707 94585== Exit program on first error (--exit-on-first-error=yes) 2023-11-27T21:23:53.508 INFO:tasks.ceph.mds.b.smithi167.stderr:==00:00:29:44.750 94268== 2023-11-27T21:23:53.509 INFO:tasks.ceph.mds.b.smithi167.stderr:==00:00:29:44.750 94268== Exit program on first error (--exit-on-first-error=yes) 2023-11-27T21:23:53.509 INFO:tasks.ceph.mds.f.smithi167.stderr:==00:00:29:44.746 94269== 2023-11-27T21:23:53.509 INFO:tasks.ceph.mds.f.smithi167.stderr:==00:00:29:44.746 94269== Exit program on first error (--exit-on-first-error=yes) 2023-11-27T21:23:53.555 INFO:tasks.ceph.mds.c.smithi088.stderr:==00:00:29:44.799 94584== 2023-11-27T21:23:53.556 INFO:tasks.ceph.mds.c.smithi088.stderr:==00:00:29:44.799 94584== Exit program on first error (--exit-on-first-error=yes) 2023-11-27T21:23:53.627 INFO:tasks.ceph.mds.c.smithi088.stderr:daemon-helper: command failed with exit status 42 2023-11-27T21:23:53.627 INFO:tasks.ceph.mds.e.smithi088.stderr:daemon-helper: command failed with exit status 42 2023-11-27T21:23:53.658 INFO:tasks.ceph.mds.f.smithi167.stderr:daemon-helper: command failed with exit status 42 2023-11-27T21:23:53.658 INFO:tasks.ceph.mds.b.smithi167.stderr:daemon-helper: command failed with exit status 42 2023-11-27T21:23:53.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.716+0000 7f52417fa640 1 -- 172.21.15.88:0/2313579843 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f523c054b00 con 0x7f5244159b50 2023-11-27T21:23:53.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:53.884+0000 7f524b18a640 1 -- 172.21.15.88:0/2313579843 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f52440b4c20 con 0x7f5244159b50 2023-11-27T21:23:54.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.316+0000 7f52417fa640 1 -- 172.21.15.88:0/2313579843 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) v1 ==== 181+0+0 (secure 0 0 0) 0x7f523c019030 con 0x7f5244159b50 2023-11-27T21:23:54.319 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' removed 2023-11-27T21:23:54.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.319+0000 7f524b18a640 1 -- 172.21.15.88:0/2313579843 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f522806b1c0 msgr2=0x7f522806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:54.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.319+0000 7f524b18a640 1 --2- 172.21.15.88:0/2313579843 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f522806b1c0 0x7f522806d680 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f52380017f0 tx=0x7f5238009040 comp rx=0 tx=0).stop 2023-11-27T21:23:54.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.319+0000 7f524b18a640 1 -- 172.21.15.88:0/2313579843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5244159b50 msgr2=0x7f52441efc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:54.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.319+0000 7f524b18a640 1 --2- 172.21.15.88:0/2313579843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5244159b50 0x7f52441efc60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f523c00b9e0 tx=0x7f523c00bea0 comp rx=0 tx=0).stop 2023-11-27T21:23:54.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.319+0000 7f524b18a640 1 -- 172.21.15.88:0/2313579843 shutdown_connections 2023-11-27T21:23:54.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.320+0000 7f524b18a640 1 --2- 172.21.15.88:0/2313579843 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f522806b1c0 0x7f522806d680 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:54.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.320+0000 7f524b18a640 1 --2- 172.21.15.88:0/2313579843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5244159b50 0x7f52441efc60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:54.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.320+0000 7f524b18a640 1 --2- 172.21.15.88:0/2313579843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52440cda70 0x7f52441f3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:54.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.320+0000 7f524b18a640 1 --2- 172.21.15.88:0/2313579843 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52440cc420 0x7f52441f06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:54.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.320+0000 7f524b18a640 1 -- 172.21.15.88:0/2313579843 >> 172.21.15.88:0/2313579843 conn(0x7f52440b07b0 msgr2=0x7f52440c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:23:54.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.320+0000 7f524b18a640 1 -- 172.21.15.88:0/2313579843 shutdown_connections 2023-11-27T21:23:54.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.320+0000 7f524b18a640 1 -- 172.21.15.88:0/2313579843 wait complete. 2023-11-27T21:23:54.335 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-27T21:23:54.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.440+0000 7f95ea3a9640 1 Processor -- start 2023-11-27T21:23:54.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.440+0000 7f95ea3a9640 1 -- start start 2023-11-27T21:23:54.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.441+0000 7f95ea3a9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f95e41538d0 0x7f95e415a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:54.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.441+0000 7f95ea3a9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f95e406ba50 0x7f95e406be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:54.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.441+0000 7f95ea3a9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e40c7640 con 0x7f95e40c8ee0 2023-11-27T21:23:54.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.441+0000 7f95ea3a9640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e406d130 con 0x7f95e41538d0 2023-11-27T21:23:54.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.441+0000 7f95ea3a9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e406b5c0 con 0x7f95e406ba50 2023-11-27T21:23:54.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.442+0000 7f95e3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f95e41538d0 0x7f95e415a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:54.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.442+0000 7f95e8946640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f95e406ba50 0x7f95e406be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:54.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.442+0000 7f95e3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f95e41538d0 0x7f95e415a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47282/0 (socket says 172.21.15.88:47282) 2023-11-27T21:23:54.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.442+0000 7f95e3fff640 1 -- 172.21.15.88:0/291001570 learned_addr learned my addr 172.21.15.88:0/291001570 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:23:54.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.444+0000 7f95e8946640 1 -- 172.21.15.88:0/291001570 >> v2:172.21.15.88:3300/0 conn(0x7f95e41538d0 msgr2=0x7f95e415a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T21:23:54.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.444+0000 7f95e8946640 1 --2- 172.21.15.88:0/291001570 >> v2:172.21.15.88:3300/0 conn(0x7f95e41538d0 0x7f95e415a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:54.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.444+0000 7f95e8946640 1 -- 172.21.15.88:0/291001570 >> v1:172.21.15.88:6789/0 conn(0x7f95e40c8ee0 legacy=0x7f95e406e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:54.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.444+0000 7f95e8946640 1 -- 172.21.15.88:0/291001570 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e415a600 con 0x7f95e406ba50 2023-11-27T21:23:54.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.446+0000 7f95e8946640 1 --2- 172.21.15.88:0/291001570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95e406ba50 0x7f95e406be80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f95e406e350 tx=0x7f95dc02be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b6f266baecb718c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:54.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.450+0000 7f95e2ffd640 1 -- 172.21.15.88:0/291001570 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc02cbf0 con 0x7f95e406ba50 2023-11-27T21:23:54.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.450+0000 7f95e2ffd640 1 -- 172.21.15.88:0/291001570 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f95dc02cd50 con 0x7f95e406ba50 2023-11-27T21:23:54.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.450+0000 7f95e2ffd640 1 -- 172.21.15.88:0/291001570 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc034680 con 0x7f95e406ba50 2023-11-27T21:23:54.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.451+0000 7f95ea3a9640 1 -- 172.21.15.88:0/291001570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95e406ba50 msgr2=0x7f95e406be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:54.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.451+0000 7f95ea3a9640 1 --2- 172.21.15.88:0/291001570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95e406ba50 0x7f95e406be80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f95e406e350 tx=0x7f95dc02be40 comp rx=0 tx=0).stop 2023-11-27T21:23:54.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.451+0000 7f95ea3a9640 1 -- 172.21.15.88:0/291001570 shutdown_connections 2023-11-27T21:23:54.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.451+0000 7f95ea3a9640 1 --2- 172.21.15.88:0/291001570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95e406ba50 0x7f95e406be80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:54.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.451+0000 7f95ea3a9640 1 --2- 172.21.15.88:0/291001570 >> v2:172.21.15.88:3300/0 conn(0x7f95e41538d0 0x7f95e415a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:54.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.451+0000 7f95ea3a9640 1 -- 172.21.15.88:0/291001570 >> 172.21.15.88:0/291001570 conn(0x7f95e4060f20 msgr2=0x7f95e4061300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:23:54.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.451+0000 7f95ea3a9640 1 -- 172.21.15.88:0/291001570 shutdown_connections 2023-11-27T21:23:54.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.451+0000 7f95ea3a9640 1 -- 172.21.15.88:0/291001570 wait complete. 2023-11-27T21:23:54.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.452+0000 7f95ea3a9640 1 Processor -- start 2023-11-27T21:23:54.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.452+0000 7f95ea3a9640 1 -- start start 2023-11-27T21:23:54.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.453+0000 7f95ea3a9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95e406ba50 0x7f95e40afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:54.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.453+0000 7f95ea3a9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95e40c8ee0 0x7f95e40737a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:54.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.453+0000 7f95ea3a9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95e41538d0 0x7f95e414c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:54.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.453+0000 7f95ea3a9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e40b0400 con 0x7f95e40c8ee0 2023-11-27T21:23:54.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.453+0000 7f95ea3a9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e40b06e0 con 0x7f95e41538d0 2023-11-27T21:23:54.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.453+0000 7f95ea3a9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e40c4150 con 0x7f95e406ba50 2023-11-27T21:23:54.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.453+0000 7f95e8946640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95e41538d0 0x7f95e414c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:54.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.453+0000 7f95e3fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95e406ba50 0x7f95e40afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:54.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.453+0000 7f95e37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95e40c8ee0 0x7f95e40737a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:54.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.454+0000 7f95e3fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95e406ba50 0x7f95e40afbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.88:40720/0 (socket says 172.21.15.88:40720) 2023-11-27T21:23:54.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.454+0000 7f95e3fff640 1 -- 172.21.15.88:0/1556991543 learned_addr learned my addr 172.21.15.88:0/1556991543 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:23:54.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.457+0000 7f95e8946640 1 -- 172.21.15.88:0/1556991543 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95e406ba50 msgr2=0x7f95e40afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:54.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.457+0000 7f95e8946640 1 --2- 172.21.15.88:0/1556991543 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95e406ba50 0x7f95e40afbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:54.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.457+0000 7f95e8946640 1 -- 172.21.15.88:0/1556991543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95e40c8ee0 msgr2=0x7f95e40737a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:54.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.457+0000 7f95e8946640 1 --2- 172.21.15.88:0/1556991543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95e40c8ee0 0x7f95e40737a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:54.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.457+0000 7f95e8946640 1 -- 172.21.15.88:0/1556991543 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95dc009a70 con 0x7f95e41538d0 2023-11-27T21:23:54.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.459+0000 7f95e8946640 1 --2- 172.21.15.88:0/1556991543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95e41538d0 0x7f95e414c340 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f95dc033000 tx=0x7f95dc004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:54.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.463+0000 7f95e0ff9640 1 -- 172.21.15.88:0/1556991543 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc040650 con 0x7f95e41538d0 2023-11-27T21:23:54.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.463+0000 7f95e0ff9640 1 -- 172.21.15.88:0/1556991543 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f95dc0407b0 con 0x7f95e41538d0 2023-11-27T21:23:54.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.463+0000 7f95e0ff9640 1 -- 172.21.15.88:0/1556991543 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc040b80 con 0x7f95e41538d0 2023-11-27T21:23:54.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.463+0000 7f95ea3a9640 1 -- 172.21.15.88:0/1556991543 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e40c4430 con 0x7f95e41538d0 2023-11-27T21:23:54.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.463+0000 7f95ea3a9640 1 -- 172.21.15.88:0/1556991543 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e40c49f0 con 0x7f95e41538d0 2023-11-27T21:23:54.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.464+0000 7f95ea3a9640 1 -- 172.21.15.88:0/1556991543 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e406f1e0 con 0x7f95e41538d0 2023-11-27T21:23:54.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.483+0000 7f95e0ff9640 1 -- 172.21.15.88:0/1556991543 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f95dc040ce0 con 0x7f95e41538d0 2023-11-27T21:23:54.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.483+0000 7f95e0ff9640 1 --2- 172.21.15.88:0/1556991543 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f95d006b210 0x7f95d006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:54.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.483+0000 7f95e3fff640 1 --2- 172.21.15.88:0/1556991543 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f95d006b210 0x7f95d006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:54.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.484+0000 7f95e3fff640 1 --2- 172.21.15.88:0/1556991543 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f95d006b210 0x7f95d006d6d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f95d40094a0 tx=0x7f95d4009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:54.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.711+0000 7f95e0ff9640 1 -- 172.21.15.88:0/1556991543 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6655+0+0 (secure 0 0 0) 0x7f95dc07b680 con 0x7f95e41538d0 2023-11-27T21:23:54.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.721+0000 7f95e0ff9640 1 -- 172.21.15.88:0/1556991543 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f95dc0779c0 con 0x7f95e41538d0 2023-11-27T21:23:54.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:54.894+0000 7f95ea3a9640 1 -- 172.21.15.88:0/1556991543 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f95e4067470 con 0x7f95e41538d0 2023-11-27T21:23:55.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.451+0000 7f95e0ff9640 1 -- 172.21.15.88:0/1556991543 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) v1 ==== 169+0+0 (secure 0 0 0) 0x7f95dc0440d0 con 0x7f95e41538d0 2023-11-27T21:23:55.454 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' removed 2023-11-27T21:23:55.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.454+0000 7f95ea3a9640 1 -- 172.21.15.88:0/1556991543 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f95d006b210 msgr2=0x7f95d006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:55.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.454+0000 7f95ea3a9640 1 --2- 172.21.15.88:0/1556991543 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f95d006b210 0x7f95d006d6d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f95d40094a0 tx=0x7f95d4009240 comp rx=0 tx=0).stop 2023-11-27T21:23:55.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.454+0000 7f95ea3a9640 1 -- 172.21.15.88:0/1556991543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95e41538d0 msgr2=0x7f95e414c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:55.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.454+0000 7f95ea3a9640 1 --2- 172.21.15.88:0/1556991543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95e41538d0 0x7f95e414c340 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f95dc033000 tx=0x7f95dc004a40 comp rx=0 tx=0).stop 2023-11-27T21:23:55.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.454+0000 7f95ea3a9640 1 -- 172.21.15.88:0/1556991543 shutdown_connections 2023-11-27T21:23:55.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.454+0000 7f95ea3a9640 1 --2- 172.21.15.88:0/1556991543 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7f95d006b210 0x7f95d006d6d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:55.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.454+0000 7f95ea3a9640 1 --2- 172.21.15.88:0/1556991543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95e41538d0 0x7f95e414c340 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:55.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.454+0000 7f95ea3a9640 1 --2- 172.21.15.88:0/1556991543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95e40c8ee0 0x7f95e40737a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:55.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.454+0000 7f95ea3a9640 1 --2- 172.21.15.88:0/1556991543 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95e406ba50 0x7f95e40afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:55.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.454+0000 7f95ea3a9640 1 -- 172.21.15.88:0/1556991543 >> 172.21.15.88:0/1556991543 conn(0x7f95e4060f20 msgr2=0x7f95e414f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:23:55.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.454+0000 7f95ea3a9640 1 -- 172.21.15.88:0/1556991543 shutdown_connections 2023-11-27T21:23:55.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.454+0000 7f95ea3a9640 1 -- 172.21.15.88:0/1556991543 wait complete. 2023-11-27T21:23:55.467 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-11-27T21:23:55.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.572+0000 7fdc38dd0640 1 Processor -- start 2023-11-27T21:23:55.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.572+0000 7fdc38dd0640 1 -- start start 2023-11-27T21:23:55.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.573+0000 7fdc38dd0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdc340c4aa0 0x7fdc3414fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:55.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.573+0000 7fdc38dd0640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc340c76f0 con 0x7fdc34150290 2023-11-27T21:23:55.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.573+0000 7fdc38dd0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc340c2bc0 con 0x7fdc340c46c0 2023-11-27T21:23:55.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.573+0000 7fdc38dd0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc340c6dc0 con 0x7fdc340c4aa0 2023-11-27T21:23:55.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.574+0000 7fdc31d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdc340c4aa0 0x7fdc3414fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:55.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.574+0000 7fdc32d9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdc34150290 0x7fdc340c1ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42526/0 (socket says 172.21.15.88:42526) 2023-11-27T21:23:55.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.574+0000 7fdc32d9d640 1 -- 172.21.15.88:0/3744351309 learned_addr learned my addr 172.21.15.88:0/3744351309 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-27T21:23:55.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.576+0000 7fdc3159a640 1 -- 172.21.15.88:0/3744351309 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4106553513 0 0) 0x7fdc340c76f0 con 0x7fdc34150290 2023-11-27T21:23:55.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.576+0000 7fdc3159a640 1 -- 172.21.15.88:0/3744351309 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc1c005730 con 0x7fdc34150290 2023-11-27T21:23:55.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.577+0000 7fdc31d9b640 1 -- 172.21.15.88:0/3744351309 >> v1:172.21.15.167:6789/0 conn(0x7fdc340c46c0 legacy=0x7fdc340c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:55.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.577+0000 7fdc31d9b640 1 -- 172.21.15.88:0/3744351309 >> v1:172.21.15.88:6789/0 conn(0x7fdc34150290 legacy=0x7fdc340c1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:55.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.577+0000 7fdc31d9b640 1 -- 172.21.15.88:0/3744351309 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc340c70a0 con 0x7fdc340c4aa0 2023-11-27T21:23:55.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.584+0000 7fdc31d9b640 1 --2- 172.21.15.88:0/3744351309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc340c4aa0 0x7fdc3414fd50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdc28009d90 tx=0x7fdc2802bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57de2a0395b9503d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:55.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.588+0000 7fdc3159a640 1 -- 172.21.15.88:0/3744351309 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2802cd00 con 0x7fdc340c4aa0 2023-11-27T21:23:55.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.588+0000 7fdc3159a640 1 -- 172.21.15.88:0/3744351309 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdc2802ce60 con 0x7fdc340c4aa0 2023-11-27T21:23:55.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.588+0000 7fdc3159a640 1 -- 172.21.15.88:0/3744351309 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc28034680 con 0x7fdc340c4aa0 2023-11-27T21:23:55.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.588+0000 7fdc38dd0640 1 -- 172.21.15.88:0/3744351309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc340c4aa0 msgr2=0x7fdc3414fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:55.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.588+0000 7fdc38dd0640 1 --2- 172.21.15.88:0/3744351309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc340c4aa0 0x7fdc3414fd50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdc28009d90 tx=0x7fdc2802bf50 comp rx=0 tx=0).stop 2023-11-27T21:23:55.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.589+0000 7fdc38dd0640 1 -- 172.21.15.88:0/3744351309 shutdown_connections 2023-11-27T21:23:55.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.589+0000 7fdc38dd0640 1 --2- 172.21.15.88:0/3744351309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc340c4aa0 0x7fdc3414fd50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:55.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.589+0000 7fdc38dd0640 1 -- 172.21.15.88:0/3744351309 >> 172.21.15.88:0/3744351309 conn(0x7fdc3406c5f0 msgr2=0x7fdc3406c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:23:55.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.589+0000 7fdc38dd0640 1 -- 172.21.15.88:0/3744351309 shutdown_connections 2023-11-27T21:23:55.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.589+0000 7fdc38dd0640 1 -- 172.21.15.88:0/3744351309 wait complete. 2023-11-27T21:23:55.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.590+0000 7fdc38dd0640 1 Processor -- start 2023-11-27T21:23:55.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.590+0000 7fdc38dd0640 1 -- start start 2023-11-27T21:23:55.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.591+0000 7fdc38dd0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc340c46c0 0x7fdc341498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:55.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.591+0000 7fdc38dd0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc340c4aa0 0x7fdc340c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:55.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.591+0000 7fdc38dd0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc34150290 0x7fdc341446a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:55.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.591+0000 7fdc38dd0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc34152860 con 0x7fdc34150290 2023-11-27T21:23:55.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.591+0000 7fdc38dd0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc34147260 con 0x7fdc340c46c0 2023-11-27T21:23:55.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.591+0000 7fdc38dd0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc34144be0 con 0x7fdc340c4aa0 2023-11-27T21:23:55.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.591+0000 7fdc32d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc34150290 0x7fdc341446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:55.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.591+0000 7fdc31d9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc340c4aa0 0x7fdc340c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:55.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.591+0000 7fdc32d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc34150290 0x7fdc341446a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47290/0 (socket says 172.21.15.88:47290) 2023-11-27T21:23:55.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.591+0000 7fdc32d9d640 1 -- 172.21.15.88:0/3730455648 learned_addr learned my addr 172.21.15.88:0/3730455648 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-27T21:23:55.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.591+0000 7fdc3259c640 1 --2- 172.21.15.88:0/3730455648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc340c46c0 0x7fdc341498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:55.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.595+0000 7fdc32d9d640 1 -- 172.21.15.88:0/3730455648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc340c4aa0 msgr2=0x7fdc340c96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:55.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.595+0000 7fdc32d9d640 1 --2- 172.21.15.88:0/3730455648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc340c4aa0 0x7fdc340c96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:55.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.595+0000 7fdc32d9d640 1 -- 172.21.15.88:0/3730455648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc340c46c0 msgr2=0x7fdc341498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:55.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.595+0000 7fdc32d9d640 1 --2- 172.21.15.88:0/3730455648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc340c46c0 0x7fdc341498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:55.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.595+0000 7fdc32d9d640 1 -- 172.21.15.88:0/3730455648 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc28009a70 con 0x7fdc34150290 2023-11-27T21:23:55.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.597+0000 7fdc32d9d640 1 --2- 172.21.15.88:0/3730455648 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc34150290 0x7fdc341446a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400c430 tx=0x7fdc2400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:55.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.601+0000 7fdc22ffd640 1 -- 172.21.15.88:0/3730455648 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc24005ce0 con 0x7fdc34150290 2023-11-27T21:23:55.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.601+0000 7fdc22ffd640 1 -- 172.21.15.88:0/3730455648 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdc24005e40 con 0x7fdc34150290 2023-11-27T21:23:55.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.601+0000 7fdc22ffd640 1 -- 172.21.15.88:0/3730455648 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc24007330 con 0x7fdc34150290 2023-11-27T21:23:55.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.601+0000 7fdc38dd0640 1 -- 172.21.15.88:0/3730455648 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc341f21d0 con 0x7fdc34150290 2023-11-27T21:23:55.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.601+0000 7fdc38dd0640 1 -- 172.21.15.88:0/3730455648 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc341f2790 con 0x7fdc34150290 2023-11-27T21:23:55.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.602+0000 7fdc38dd0640 1 -- 172.21.15.88:0/3730455648 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc341529d0 con 0x7fdc34150290 2023-11-27T21:23:55.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.620+0000 7fdc22ffd640 1 -- 172.21.15.88:0/3730455648 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fdc24007490 con 0x7fdc34150290 2023-11-27T21:23:55.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.621+0000 7fdc22ffd640 1 --2- 172.21.15.88:0/3730455648 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fdc1406b210 0x7fdc1406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T21:23:55.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.621+0000 7fdc3259c640 1 --2- 172.21.15.88:0/3730455648 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fdc1406b210 0x7fdc1406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T21:23:55.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.621+0000 7fdc3259c640 1 --2- 172.21.15.88:0/3730455648 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fdc1406b210 0x7fdc1406d6d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c0016e0 tx=0x7fdc2c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T21:23:55.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.855+0000 7fdc22ffd640 1 -- 172.21.15.88:0/3730455648 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6154+0+0 (secure 0 0 0) 0x7fdc24007740 con 0x7fdc34150290 2023-11-27T21:23:55.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:55.855+0000 7fdc22ffd640 1 -- 172.21.15.88:0/3730455648 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fdc240542d0 con 0x7fdc34150290 2023-11-27T21:23:56.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:56.033+0000 7fdc38dd0640 1 -- 172.21.15.88:0/3730455648 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdc34067470 con 0x7fdc34150290 2023-11-27T21:23:56.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:56.607+0000 7fdc22ffd640 1 -- 172.21.15.88:0/3730455648 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) v1 ==== 178+0+0 (secure 0 0 0) 0x7fdc24017020 con 0x7fdc34150290 2023-11-27T21:23:56.609 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data_ec' removed 2023-11-27T21:23:56.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:56.609+0000 7fdc38dd0640 1 -- 172.21.15.88:0/3730455648 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fdc1406b210 msgr2=0x7fdc1406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:56.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:56.609+0000 7fdc38dd0640 1 --2- 172.21.15.88:0/3730455648 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fdc1406b210 0x7fdc1406d6d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c0016e0 tx=0x7fdc2c009040 comp rx=0 tx=0).stop 2023-11-27T21:23:56.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:56.609+0000 7fdc38dd0640 1 -- 172.21.15.88:0/3730455648 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc34150290 msgr2=0x7fdc341446a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T21:23:56.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:56.609+0000 7fdc38dd0640 1 --2- 172.21.15.88:0/3730455648 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc34150290 0x7fdc341446a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400c430 tx=0x7fdc2400c8f0 comp rx=0 tx=0).stop 2023-11-27T21:23:56.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:56.609+0000 7fdc38dd0640 1 -- 172.21.15.88:0/3730455648 shutdown_connections 2023-11-27T21:23:56.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:56.609+0000 7fdc38dd0640 1 --2- 172.21.15.88:0/3730455648 >> [v2:172.21.15.88:6800/352455703,v1:172.21.15.88:6801/352455703] conn(0x7fdc1406b210 0x7fdc1406d6d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:56.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:56.609+0000 7fdc38dd0640 1 --2- 172.21.15.88:0/3730455648 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc34150290 0x7fdc341446a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:56.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:56.609+0000 7fdc38dd0640 1 --2- 172.21.15.88:0/3730455648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc340c4aa0 0x7fdc340c96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:56.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:56.609+0000 7fdc38dd0640 1 --2- 172.21.15.88:0/3730455648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc340c46c0 0x7fdc341498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T21:23:56.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:56.609+0000 7fdc38dd0640 1 -- 172.21.15.88:0/3730455648 >> 172.21.15.88:0/3730455648 conn(0x7fdc3406c5f0 msgr2=0x7fdc3406e270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T21:23:56.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:56.609+0000 7fdc38dd0640 1 -- 172.21.15.88:0/3730455648 shutdown_connections 2023-11-27T21:23:56.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-27T21:23:56.609+0000 7fdc38dd0640 1 -- 172.21.15.88:0/3730455648 wait complete. 2023-11-27T21:23:56.624 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-27T21:23:56.625 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-27T21:23:56.625 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T21:23:56.637 INFO:tasks.ceph.mds.a.smithi088.stderr:2023-11-27T21:23:56.627+0000 b5aa640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a (PID: 94565) UID: 0 2023-11-27T21:23:56.639 INFO:tasks.ceph.mds.a.smithi088.stderr:2023-11-27T21:23:56.629+0000 b5aa640 -1 mds.a *** got signal Terminated *** 2023-11-27T21:23:58.295 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-27T21:23:58.296 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2023-11-27T21:23:58.296 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-11-27T21:23:58.296 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-11-27T21:23:58.296 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2023-11-27T21:24:02.726 INFO:tasks.ceph.mds.a:Stopped 2023-11-27T21:24:02.726 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-27T21:24:02.726 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T21:24:02.726 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-11-27T21:24:02.727 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi088 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c" 2023-11-27T21:24:02.727 INFO:tasks.ceph.mds.c:Stopped 2023-11-27T21:24:02.727 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2023-11-27T21:24:02.728 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T21:24:02.728 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-11-27T21:24:02.728 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi088 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e" 2023-11-27T21:24:02.728 INFO:tasks.ceph.mds.e:Stopped 2023-11-27T21:24:02.728 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-27T21:24:02.728 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T21:24:02.728 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-11-27T21:24:02.728 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi167 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b" 2023-11-27T21:24:02.729 INFO:tasks.ceph.mds.b:Stopped 2023-11-27T21:24:02.729 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-27T21:24:02.729 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T21:24:02.729 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-11-27T21:24:02.729 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi167 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d" 2023-11-27T21:24:02.729 INFO:tasks.ceph.mds.d:Stopped 2023-11-27T21:24:02.729 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2023-11-27T21:24:02.730 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T21:24:02.730 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-11-27T21:24:02.730 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi167 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f" 2023-11-27T21:24:02.730 INFO:tasks.ceph.mds.f:Stopped 2023-11-27T21:24:02.730 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-27T21:24:02.731 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-27T21:24:02.731 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T21:24:02.731 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-11-27T21:24:02.730+0000 7fc10a12b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 88775) UID: 0 2023-11-27T21:24:02.732 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-11-27T21:24:02.730+0000 7fc10a12b640 -1 osd.0 33 *** Got signal Terminated *** 2023-11-27T21:24:04.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-27T21:24:04.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2023-11-27T21:24:04.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-11-27T21:24:04.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-11-27T21:24:04.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2023-11-27T21:24:08.832 INFO:tasks.ceph.osd.0:Stopped 2023-11-27T21:24:08.833 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-27T21:24:08.833 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T21:24:08.834 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-11-27T21:24:08.832+0000 7fb5b2f13640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 88783) UID: 0 2023-11-27T21:24:08.834 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-11-27T21:24:08.832+0000 7fb5b2f13640 -1 osd.1 34 *** Got signal Terminated *** 2023-11-27T21:24:10.211 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:24:10.214 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:24:10.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-11-27T21:24:14.935 INFO:tasks.ceph.osd.1:Stopped 2023-11-27T21:24:14.935 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-27T21:24:14.936 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T21:24:14.937 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-11-27T21:24:14.935+0000 7fdb5d452640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 88784) UID: 0 2023-11-27T21:24:14.937 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-11-27T21:24:14.935+0000 7fdb5d452640 -1 osd.2 36 *** Got signal Terminated *** 2023-11-27T21:24:16.722 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-11-27T21:24:16.723 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-11-27T21:24:21.037 INFO:tasks.ceph.osd.2:Stopped 2023-11-27T21:24:21.038 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-27T21:24:21.038 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T21:24:21.039 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-11-27T21:24:21.037+0000 7f8ebbc61640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 88796) UID: 0 2023-11-27T21:24:21.039 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-11-27T21:24:21.037+0000 7f8ebbc61640 -1 osd.3 37 *** Got signal Terminated *** 2023-11-27T21:24:21.566 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:30:45.475 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:24:21.571 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:30:45.480 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:24:21.625 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:30:45.534 88441== Warning: unimplemented fcntl command: 1036 2023-11-27T21:24:21.628 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:30:45.513 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:24:21.629 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:30:45.515 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:24:21.636 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:30:45.522 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:24:21.638 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:30:45.523 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:24:21.688 INFO:tasks.ceph.mon.c.smithi167.stderr:==00:00:30:45.574 88304== Warning: unimplemented fcntl command: 1036 2023-11-27T21:24:21.694 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:30:45.580 88303== Warning: unimplemented fcntl command: 1036 2023-11-27T21:24:22.730 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-11-27T21:24:27.139 INFO:tasks.ceph.osd.3:Stopped 2023-11-27T21:24:27.140 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-27T21:24:27.140 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T21:24:27.141 INFO:tasks.ceph.osd.4.smithi167.stderr:2023-11-27T21:24:27.139+0000 7fe0c61b5640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 88877) UID: 0 2023-11-27T21:24:27.141 INFO:tasks.ceph.osd.4.smithi167.stderr:2023-11-27T21:24:27.139+0000 7fe0c61b5640 -1 osd.4 38 *** Got signal Terminated *** 2023-11-27T21:24:33.242 INFO:tasks.ceph.osd.4:Stopped 2023-11-27T21:24:33.242 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-27T21:24:33.242 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T21:24:33.243 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-11-27T21:24:33.242+0000 7f5139113640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 88880) UID: 0 2023-11-27T21:24:33.243 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-11-27T21:24:33.242+0000 7f5139113640 -1 osd.5 39 *** Got signal Terminated *** 2023-11-27T21:24:39.344 INFO:tasks.ceph.osd.5:Stopped 2023-11-27T21:24:39.344 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-27T21:24:39.344 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T21:24:39.345 INFO:tasks.ceph.osd.6.smithi167.stderr:2023-11-27T21:24:39.343+0000 7f932b89d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 88883) UID: 0 2023-11-27T21:24:39.345 INFO:tasks.ceph.osd.6.smithi167.stderr:2023-11-27T21:24:39.343+0000 7f932b89d640 -1 osd.6 40 *** Got signal Terminated *** 2023-11-27T21:24:40.376 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:24:40.379 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:24:45.445 INFO:tasks.ceph.osd.6:Stopped 2023-11-27T21:24:45.446 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-27T21:24:45.446 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T21:24:45.447 INFO:tasks.ceph.osd.7.smithi167.stderr:2023-11-27T21:24:45.445+0000 7f4762f09640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 88885) UID: 0 2023-11-27T21:24:45.447 INFO:tasks.ceph.osd.7.smithi167.stderr:2023-11-27T21:24:45.445+0000 7f4762f09640 -1 osd.7 40 *** Got signal Terminated *** 2023-11-27T21:24:45.754 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-11-27T21:24:51.260 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-11-27T21:24:51.260 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-11-27T21:24:51.548 INFO:tasks.ceph.osd.7:Stopped 2023-11-27T21:24:51.548 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-27T21:24:51.548 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-27T21:24:51.549 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T21:24:51.550 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-27T21:24:51.548+0000 7f9c39f0d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 88458) UID: 0 2023-11-27T21:24:51.576 INFO:tasks.ceph.mgr.y:Stopped 2023-11-27T21:24:51.577 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-27T21:24:51.577 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T21:24:51.602 INFO:tasks.ceph.mgr.x:Stopped 2023-11-27T21:24:51.602 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-27T21:24:51.602 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-27T21:24:51.602 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T21:24:51.663 INFO:tasks.ceph.mon.a.smithi088.stderr:2023-11-27T21:24:51.644+0000 9f55640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 88421) UID: 0 2023-11-27T21:24:51.664 INFO:tasks.ceph.mon.a.smithi088.stderr:2023-11-27T21:24:51.645+0000 9f55640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-11-27T21:24:52.355 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:31:16.260 88441== 2023-11-27T21:24:52.355 INFO:tasks.ceph.mon.a.smithi088.stderr:==00:00:31:16.260 88441== Exit program on first error (--exit-on-first-error=yes) 2023-11-27T21:24:52.364 INFO:tasks.ceph.mon.a.smithi088.stderr:daemon-helper: command failed with exit status 42 2023-11-27T21:24:56.463 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-11-27T21:24:56.463 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-11-27T21:24:57.704 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-11-27T21:24:57.704 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi088 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a" 2023-11-27T21:24:57.704 INFO:tasks.ceph.mon.a:Stopped 2023-11-27T21:24:57.705 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-27T21:24:57.705 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T21:24:57.720 INFO:tasks.ceph.mon.b.smithi167.stderr:2023-11-27T21:24:57.707+0000 9f55640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 88296) UID: 0 2023-11-27T21:24:57.721 INFO:tasks.ceph.mon.b.smithi167.stderr:2023-11-27T21:24:57.709+0000 9f55640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-11-27T21:25:01.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-11-27T21:25:10.451 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:25:10.454 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:25:40.587 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:25:40.590 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:26:10.766 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:26:10.769 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:26:40.943 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:26:40.947 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:27:11.029 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:27:11.032 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:27:41.200 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:27:41.203 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:28:11.267 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:28:11.270 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:28:41.352 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:28:41.356 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:29:11.466 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:29:11.471 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:29:41.649 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:29:41.653 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:29:56.771 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-27T21:29:56.772 DEBUG:teuthology.orchestra.run.smithi088:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2023-11-27T21:29:56.885 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi088.front.sepia.ceph.com 2023-11-27T21:29:56.885 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-27T21:29:57.015 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi088.front.sepia.ceph.com 2023-11-27T21:29:57.015 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-27T21:29:57.089 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi088.front.sepia.ceph.com 2023-11-27T21:29:57.089 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-27T21:29:57.159 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi088.front.sepia.ceph.com 2023-11-27T21:29:57.159 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-27T21:29:57.233 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi167.front.sepia.ceph.com 2023-11-27T21:29:57.233 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-27T21:29:57.292 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi167.front.sepia.ceph.com 2023-11-27T21:29:57.292 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-27T21:29:57.366 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi167.front.sepia.ceph.com 2023-11-27T21:29:57.369 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-27T21:29:57.427 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi167.front.sepia.ceph.com 2023-11-27T21:29:57.427 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-27T21:29:57.483 INFO:tasks.ceph:Archiving mon data... 2023-11-27T21:29:57.484 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468107/data/mon.a.tgz 2023-11-27T21:29:57.485 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2023-11-27T21:29:57.500 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.kUSxsPkY6T 2023-11-27T21:29:57.500 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.kUSxsPkY6T 2023-11-27T21:29:57.645 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.kUSxsPkY6T 2023-11-27T21:29:57.729 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.kUSxsPkY6T is 341KB 2023-11-27T21:29:57.828 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.kUSxsPkY6T 2023-11-27T21:29:57.842 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468107/data/mon.b.tgz 2023-11-27T21:29:57.842 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2023-11-27T21:29:57.857 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.FqbBlSkAin 2023-11-27T21:29:57.857 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.FqbBlSkAin 2023-11-27T21:29:58.008 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.FqbBlSkAin 2023-11-27T21:29:58.092 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.FqbBlSkAin is 342KB 2023-11-27T21:29:58.186 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.FqbBlSkAin 2023-11-27T21:29:58.200 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468107/data/mon.c.tgz 2023-11-27T21:29:58.201 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2023-11-27T21:29:58.254 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.Tg9OkvvuDu 2023-11-27T21:29:58.255 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Tg9OkvvuDu 2023-11-27T21:29:58.386 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.Tg9OkvvuDu 2023-11-27T21:29:58.476 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.Tg9OkvvuDu is 344KB 2023-11-27T21:29:58.511 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.Tg9OkvvuDu 2023-11-27T21:29:58.528 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-27T21:29:58.528 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-27T21:29:58.530 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-27T21:29:58.594 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-27T21:29:58.595 DEBUG:teuthology.orchestra.run.smithi088:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-27T21:29:58.600 DEBUG:teuthology.orchestra.run.smithi167:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-27T21:29:58.639 INFO:teuthology.orchestra.run.smithi088.stdout:/var/log/ceph/valgrind/client.0.log: Leak_StillReachable 2023-11-27T21:29:58.639 INFO:teuthology.orchestra.run.smithi088.stdout:/var/log/ceph/valgrind/mds.c.log: Leak_PossiblyLost 2023-11-27T21:29:58.639 INFO:teuthology.orchestra.run.smithi088.stdout:/var/log/ceph/valgrind/mds.e.log: Leak_PossiblyLost 2023-11-27T21:29:58.639 INFO:teuthology.orchestra.run.smithi088.stdout:/var/log/ceph/valgrind/mon.a.log: Leak_StillReachable 2023-11-27T21:29:58.640 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/client.0.log kind Leak_StillReachable 2023-11-27T21:29:58.640 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/client.0.log 2023-11-27T21:29:58.640 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mds.c.log kind Leak_PossiblyLost 2023-11-27T21:29:58.640 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mds.e.log kind Leak_PossiblyLost 2023-11-27T21:29:58.640 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.a.log kind Leak_StillReachable 2023-11-27T21:29:58.641 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.a.log 2023-11-27T21:29:58.675 INFO:teuthology.orchestra.run.smithi167.stdout:/var/log/ceph/valgrind/mds.b.log: Leak_PossiblyLost 2023-11-27T21:29:58.675 INFO:teuthology.orchestra.run.smithi167.stdout:/var/log/ceph/valgrind/mds.d.log: Leak_PossiblyLost 2023-11-27T21:29:58.675 INFO:teuthology.orchestra.run.smithi167.stdout:/var/log/ceph/valgrind/mds.f.log: Leak_PossiblyLost 2023-11-27T21:29:58.676 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mds.b.log kind Leak_PossiblyLost 2023-11-27T21:29:58.676 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mds.d.log kind Leak_PossiblyLost 2023-11-27T21:29:58.676 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mds.f.log kind Leak_PossiblyLost 2023-11-27T21:29:58.676 INFO:tasks.ceph:Archiving crash dumps... 2023-11-27T21:29:58.678 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468107/remote/smithi088/crash 2023-11-27T21:29:58.679 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-27T21:29:58.710 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468107/remote/smithi167/crash 2023-11-27T21:29:58.711 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-27T21:29:58.742 INFO:tasks.ceph:Shutting down logrotate 2023-11-27T21:29:58.742 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:29:58.755 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:29:58.851 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-27T21:29:58.878 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-27T21:29:58.905 INFO:tasks.ceph:Compressing logs... 2023-11-27T21:29:58.905 DEBUG:teuthology.orchestra.run.smithi088:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-27T21:29:58.921 DEBUG:teuthology.orchestra.run.smithi167:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-27T21:29:58.995 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-27T21:29:58.995 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88497.log 2023-11-27T21:29:58.995 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2023-11-27T21:29:58.995 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.88497.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log 2023-11-27T21:29:58.996 INFO:teuthology.orchestra.run.smithi167.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.88497.log.gz 2023-11-27T21:29:58.996 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/valgrind/mon.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2023-11-27T21:29:58.996 INFO:teuthology.orchestra.run.smithi167.stderr: 55.7% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2023-11-27T21:29:58.996 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/valgrind/mds.f.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2023-11-27T21:29:58.996 INFO:teuthology.orchestra.run.smithi167.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2023-11-27T21:29:58.996 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/valgrind/mds.b.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2023-11-27T21:29:58.996 INFO:teuthology.orchestra.run.smithi167.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2023-11-27T21:29:58.996 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88657.log 2023-11-27T21:29:58.996 INFO:teuthology.orchestra.run.smithi167.stderr: 55.6% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2023-11-27T21:29:58.996 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/valgrind/mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88537.log 2023-11-27T21:29:58.996 INFO:teuthology.orchestra.run.smithi167.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2023-11-27T21:29:58.996 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.88657.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-27T21:29:58.997 INFO:teuthology.orchestra.run.smithi167.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.88657.log.gz 2023-11-27T21:29:58.997 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.88537.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-27T21:29:58.997 INFO:teuthology.orchestra.run.smithi167.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88537.log.gz 2023-11-27T21:29:58.997 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-27T21:29:58.997 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88788.log 2023-11-27T21:29:58.997 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-27T21:29:58.998 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.88788.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-27T21:29:58.998 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.7.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88788.log.gz 2023-11-27T21:29:58.998 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88748.log 2023-11-27T21:29:58.998 INFO:teuthology.orchestra.run.smithi167.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-27T21:29:58.998 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88701.log 2023-11-27T21:29:58.998 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-client.admin.88748.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2023-11-27T21:29:58.999 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.88701.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88748.log.gz 2023-11-27T21:29:58.999 INFO:teuthology.orchestra.run.smithi167.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.88701.log.gzgzip 2023-11-27T21:29:58.999 INFO:teuthology.orchestra.run.smithi167.stderr: -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-27T21:29:58.999 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88617.log 2023-11-27T21:29:59.003 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-27T21:29:59.003 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.88617.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88617.log.gz 2023-11-27T21:29:59.010 INFO:teuthology.orchestra.run.smithi167.stderr: 94.9%gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-27T21:29:59.011 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-27T21:29:59.020 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mon.b.log: 93.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-27T21:29:59.020 INFO:teuthology.orchestra.run.smithi167.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2023-11-27T21:29:59.020 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88577.log 2023-11-27T21:29:59.034 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-27T21:29:59.035 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94857.log 2023-11-27T21:29:59.035 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102447.log 2023-11-27T21:29:59.035 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.94857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97541.log 2023-11-27T21:29:59.035 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.102447.log: gzip -5 --verbose 88.2% -- -- replaced with /var/log/ceph/ceph-client.admin.94857.log.gz /var/log/ceph/ceph-client.admin.102236.log 2023-11-27T21:29:59.035 INFO:teuthology.orchestra.run.smithi088.stderr: 2023-11-27T21:29:59.035 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102447.log.gz 2023-11-27T21:29:59.035 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103923.log 2023-11-27T21:29:59.035 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.97541.log: /var/log/ceph/ceph-client.admin.102236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98461.log 2023-11-27T21:29:59.035 INFO:teuthology.orchestra.run.smithi088.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.97541.log.gz 2023-11-27T21:29:59.035 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.103923.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102236.log.gz 2023-11-27T21:29:59.036 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102631.log 2023-11-27T21:29:59.036 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.98461.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103923.log.gz 2023-11-27T21:29:59.036 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94941.log 2023-11-27T21:29:59.036 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.102631.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.98461.log.gz 2023-11-27T21:29:59.036 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99134.log 2023-11-27T21:29:59.036 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.94941.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102631.log.gz 2023-11-27T21:29:59.036 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102715.log 2023-11-27T21:29:59.036 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.94941.log.gz 2023-11-27T21:29:59.036 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.99134.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2023-11-27T21:29:59.036 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.102715.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2023-11-27T21:29:59.036 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/valgrind/mds.c.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102715.log.gz 2023-11-27T21:29:59.036 INFO:teuthology.orchestra.run.smithi088.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.99134.log.gz 2023-11-27T21:29:59.037 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/client.0.log 2023-11-27T21:29:59.037 INFO:teuthology.orchestra.run.smithi088.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2023-11-27T21:29:59.037 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2023-11-27T21:29:59.037 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/valgrind/mds.a.log: /var/log/ceph/valgrind/client.0.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2023-11-27T21:29:59.037 INFO:teuthology.orchestra.run.smithi088.stderr: 57.3% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2023-11-27T21:29:59.037 INFO:teuthology.orchestra.run.smithi088.stderr: 76.9% -- replaced with /var/log/ceph/valgrind/client.0.log.gz 2023-11-27T21:29:59.037 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/valgrind/mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97007.log 2023-11-27T21:29:59.037 INFO:teuthology.orchestra.run.smithi088.stderr: 74.7% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2023-11-27T21:29:59.037 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/valgrind/mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97193.log 2023-11-27T21:29:59.037 INFO:teuthology.orchestra.run.smithi088.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2023-11-27T21:29:59.037 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.97007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98075.log 2023-11-27T21:29:59.038 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.97193.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97007.log.gz 2023-11-27T21:29:59.038 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97540.log 2023-11-27T21:29:59.038 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.98075.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.97193.log.gz -5 2023-11-27T21:29:59.038 INFO:teuthology.orchestra.run.smithi088.stderr: --verbose -- /var/log/ceph/ceph-client.admin.96493.log 2023-11-27T21:29:59.038 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.97540.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98075.log.gz 2023-11-27T21:29:59.038 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99050.log 2023-11-27T21:29:59.038 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97540.log.gz 2023-11-27T21:29:59.038 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.96493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97542.log 2023-11-27T21:29:59.038 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.99050.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96493.log.gz 2023-11-27T21:29:59.039 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103715.log 2023-11-27T21:29:59.039 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.97542.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99050.log.gz 2023-11-27T21:29:59.039 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96635.log 2023-11-27T21:29:59.039 INFO:teuthology.orchestra.run.smithi088.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.97542.log.gz 2023-11-27T21:29:59.039 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.103715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102362.log 2023-11-27T21:29:59.039 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.96635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96325.log 87.1% 2023-11-27T21:29:59.039 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.103715.log.gz 2023-11-27T21:29:59.039 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.102362.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96635.log.gz 2023-11-27T21:29:59.040 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95431.log 2023-11-27T21:29:59.040 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102362.log.gz 2023-11-27T21:29:59.040 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.96325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98182.log 2023-11-27T21:29:59.040 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.95431.log: gzip -5 --verbose 87.5% -- -- replaced with /var/log/ceph/ceph-client.admin.96325.log.gz /var/log/ceph/ceph-client.admin.97109.log 2023-11-27T21:29:59.040 INFO:teuthology.orchestra.run.smithi088.stderr: 2023-11-27T21:29:59.040 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.98182.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95431.log.gz 2023-11-27T21:29:59.040 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96283.log 2023-11-27T21:29:59.040 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98182.log.gz 2023-11-27T21:29:59.041 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.97109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102883.log 2023-11-27T21:29:59.041 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.96283.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97109.log.gz 2023-11-27T21:29:59.041 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103180.log 2023-11-27T21:29:59.041 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.102883.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.96283.log.gz 2023-11-27T21:29:59.041 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102010.log 2023-11-27T21:29:59.041 INFO:teuthology.orchestra.run.smithi088.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.102883.log.gz 2023-11-27T21:29:59.041 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.103180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98714.log 2023-11-27T21:29:59.041 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.102010.log: gzip 87.3% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.103180.log.gz -- 2023-11-27T21:29:59.042 INFO:teuthology.orchestra.run.smithi088.stderr: /var/log/ceph/ceph-client.admin.97796.log 2023-11-27T21:29:59.042 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.98714.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.102010.log.gz 2023-11-27T21:29:59.042 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98232.log 2023-11-27T21:29:59.042 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.98714.log.gz 2023-11-27T21:29:59.042 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.97796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102052.log 2023-11-27T21:29:59.042 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.98232.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97796.log.gz 2023-11-27T21:29:59.042 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95153.log 2023-11-27T21:29:59.043 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.102052.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98232.log.gz 2023-11-27T21:29:59.043 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96965.log 2023-11-27T21:29:59.043 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102052.log.gz 2023-11-27T21:29:59.043 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.95153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98672.log 2023-11-27T21:29:59.043 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95153.log.gz 2023-11-27T21:29:59.043 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.96965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99526.log 2023-11-27T21:29:59.043 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.98672.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96965.log.gz 2023-11-27T21:29:59.043 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103595.log 2023-11-27T21:29:59.044 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3%/var/log/ceph/ceph-client.admin.99526.log: -- replaced with /var/log/ceph/ceph-client.admin.98672.log.gz 2023-11-27T21:29:59.045 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98840.log 2023-11-27T21:29:59.045 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99526.log.gz 2023-11-27T21:29:59.045 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.103595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97533.log 2023-11-27T21:29:59.045 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.98840.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103595.log.gz -5 2023-11-27T21:29:59.045 INFO:teuthology.orchestra.run.smithi088.stderr: --verbose -- /var/log/ceph/ceph-client.admin.98118.log 2023-11-27T21:29:59.045 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2%/var/log/ceph/ceph-client.admin.97533.log: -- replaced with /var/log/ceph/ceph-client.admin.98840.log.gz 2023-11-27T21:29:59.045 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98233.log 2023-11-27T21:29:59.045 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97533.log.gz 2023-11-27T21:29:59.046 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.98118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97730.log 2023-11-27T21:29:59.046 INFO:teuthology.orchestra.run.smithi088.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98118.log.gz 2023-11-27T21:29:59.046 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95473.log 2023-11-27T21:29:59.046 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.98233.log: /var/log/ceph/ceph-client.admin.97730.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98233.log.gz 2023-11-27T21:29:59.046 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103390.log 2023-11-27T21:29:59.046 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97730.log.gz 2023-11-27T21:29:59.046 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.95473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96923.log 2023-11-27T21:29:59.047 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.103390.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95473.log.gz 2023-11-27T21:29:59.047 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95347.log 2023-11-27T21:29:59.047 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.96923.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103390.log.gz 2023-11-27T21:29:59.047 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-27T21:29:59.047 INFO:teuthology.orchestra.run.smithi088.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96923.log.gz 2023-11-27T21:29:59.047 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.95347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103138.log 2023-11-27T21:29:59.047 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103655.log 2023-11-27T21:29:59.047 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95347.log.gz 2023-11-27T21:29:59.048 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.103138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96881.log 2023-11-27T21:29:59.048 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103138.log.gz 2023-11-27T21:29:59.048 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.103655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95623.log 2023-11-27T21:29:59.048 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-27T21:29:59.048 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96719.log 2023-11-27T21:29:59.048 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.96881.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103655.log.gz 2023-11-27T21:29:59.048 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.95623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102094.log 2023-11-27T21:29:59.049 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96881.log.gz 2023-11-27T21:29:59.049 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.96719.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95623.log.gz 2023-11-27T21:29:59.049 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95263.log 2023-11-27T21:29:59.049 INFO:teuthology.orchestra.run.smithi088.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96719.log.gz 2023-11-27T21:29:59.049 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.102094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96593.log 2023-11-27T21:29:59.049 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102094.log.gz 2023-11-27T21:29:59.049 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.95263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94582.log 2023-11-27T21:29:59.049 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.96593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96409.log 2023-11-27T21:29:59.050 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95263.log.gz 2023-11-27T21:29:59.050 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96593.log.gz 2023-11-27T21:29:59.050 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.94582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97906.log 2023-11-27T21:29:59.050 INFO:teuthology.orchestra.run.smithi088.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94582.log.gz 2023-11-27T21:29:59.050 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.96409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97151.log 2023-11-27T21:29:59.050 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.97906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97539.log 2023-11-27T21:29:59.050 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96409.log.gz 2023-11-27T21:29:59.050 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97906.log.gz 2023-11-27T21:29:59.051 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.97151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102178.log 2023-11-27T21:29:59.051 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.97539.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.97151.log.gz 2023-11-27T21:29:59.051 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97277.log 2023-11-27T21:29:59.051 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.102178.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97539.log.gz 2023-11-27T21:29:59.051 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98504.log 2023-11-27T21:29:59.051 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102178.log.gz/var/log/ceph/ceph-client.admin.97277.log: 2023-11-27T21:29:59.051 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98546.log 2023-11-27T21:29:59.051 INFO:teuthology.orchestra.run.smithi088.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97277.log.gz 2023-11-27T21:29:59.052 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.98504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95201.log 2023-11-27T21:29:59.052 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.98546.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98504.log.gz 2023-11-27T21:29:59.052 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95557.log 2023-11-27T21:29:59.052 INFO:teuthology.orchestra.run.smithi088.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.98546.log.gz 2023-11-27T21:29:59.052 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.95201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103755.log 2023-11-27T21:29:59.052 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95201.log.gz 2023-11-27T21:29:59.052 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.95557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96839.log 2023-11-27T21:29:59.053 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.103755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97751.log 2023-11-27T21:29:59.053 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103755.log.gz 2023-11-27T21:29:59.053 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.96839.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.95557.log.gz 2023-11-27T21:29:59.053 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88931.log 2023-11-27T21:29:59.053 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-27T21:29:59.053 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.97751.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96839.log.gz 2023-11-27T21:29:59.053 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.88931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102757.log 2023-11-27T21:29:59.053 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97751.log.gz 2023-11-27T21:29:59.053 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3%/var/log/ceph/ceph-osd.1.log: -- replaced with /var/log/ceph/ceph-client.admin.88931.log.gz 2023-11-27T21:29:59.054 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98630.log 2023-11-27T21:29:59.054 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.102757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103348.log 2023-11-27T21:29:59.054 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.98630.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102757.log.gz 2023-11-27T21:29:59.054 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99332.log 2023-11-27T21:29:59.054 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.98630.log.gz 2023-11-27T21:29:59.054 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98798.log 2023-11-27T21:29:59.054 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.103348.log: /var/log/ceph/ceph-client.admin.99332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94627.log 2023-11-27T21:29:59.054 INFO:teuthology.orchestra.run.smithi088.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.103348.log.gz 2023-11-27T21:29:59.054 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.98798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95025.log 2023-11-27T21:29:59.055 INFO:teuthology.orchestra.run.smithi088.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98798.log.gz 2023-11-27T21:29:59.055 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.94627.log: gzip -5 90.7% --verbose -- /var/log/ceph/ceph-client.admin.95389.log -- replaced with /var/log/ceph/ceph-client.admin.99332.log.gz 2023-11-27T21:29:59.055 INFO:teuthology.orchestra.run.smithi088.stderr: 2023-11-27T21:29:59.055 INFO:teuthology.orchestra.run.smithi088.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.94627.log.gz 2023-11-27T21:29:59.055 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103052.log 2023-11-27T21:29:59.055 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.95025.log: /var/log/ceph/ceph-client.admin.95389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104049.log 2023-11-27T21:29:59.055 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95025.log.gz 2023-11-27T21:29:59.055 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.103052.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95389.log.gz 2023-11-27T21:29:59.055 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102926.log 2023-11-27T21:29:59.055 INFO:teuthology.orchestra.run.smithi088.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.103052.log.gz 2023-11-27T21:29:59.056 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97319.log 2023-11-27T21:29:59.056 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.104049.log: /var/log/ceph/ceph-client.admin.102926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99092.log 2023-11-27T21:29:59.056 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104049.log.gz 2023-11-27T21:29:59.056 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.97319.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102926.log.gz 2023-11-27T21:29:59.056 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97534.log 2023-11-27T21:29:59.056 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97319.log.gz 2023-11-27T21:29:59.056 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.99092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97937.log 2023-11-27T21:29:59.056 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.97534.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99092.log.gz 2023-11-27T21:29:59.056 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104007.log 2023-11-27T21:29:59.056 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97534.log.gz 2023-11-27T21:29:59.056 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.97937.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.82434.log 2023-11-27T21:29:59.057 INFO:teuthology.orchestra.run.smithi088.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97937.log.gz 2023-11-27T21:29:59.057 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102278.log 2023-11-27T21:29:59.057 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.104007.log: /var/log/ceph/ceph.tmp-client.admin.82434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97049.log 2023-11-27T21:29:59.057 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.82434.log.gz 2023-11-27T21:29:59.057 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104007.log.gz 2023-11-27T21:29:59.057 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.102278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97543.log 2023-11-27T21:29:59.057 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.97049.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102278.log.gz 2023-11-27T21:29:59.057 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-27T21:29:59.057 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97049.log.gz 2023-11-27T21:29:59.057 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.97543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102589.log 2023-11-27T21:29:59.057 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.3.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.97543.log.gz 2023-11-27T21:29:59.057 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96551.log 2023-11-27T21:29:59.058 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.102589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102673.log 2023-11-27T21:29:59.058 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102589.log.gz 2023-11-27T21:29:59.058 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.96551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102841.log 2023-11-27T21:29:59.058 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.102673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94467.log 2023-11-27T21:29:59.058 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96551.log.gz 2023-11-27T21:29:59.058 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.102841.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102673.log.gz 2023-11-27T21:29:59.058 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97538.log 2023-11-27T21:29:59.058 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102841.log.gz 2023-11-27T21:29:59.058 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.94467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95067.log 2023-11-27T21:29:59.058 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94800.log 2023-11-27T21:29:59.058 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.97538.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94467.log.gz 2023-11-27T21:29:59.058 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.95067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103965.log 2023-11-27T21:29:59.059 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97538.log.gz 2023-11-27T21:29:59.059 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.95067.log.gz 2023-11-27T21:29:59.059 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.94800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98966.log 2023-11-27T21:29:59.059 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.103965.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94800.log.gz 2023-11-27T21:29:59.059 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94983.log 2023-11-27T21:29:59.059 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.98966.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103965.log.gz 2023-11-27T21:29:59.059 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99912.log 2023-11-27T21:29:59.059 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98966.log.gz 2023-11-27T21:29:59.059 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.94983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103797.log 2023-11-27T21:29:59.059 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103553.log 2023-11-27T21:29:59.059 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.99912.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94983.log.gz 2023-11-27T21:29:59.059 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102405.log 2023-11-27T21:29:59.060 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.103797.log: /var/log/ceph/ceph-client.admin.103553.log: gzip -5 --verbose 87.3% -- /var/log/ceph/ceph-client.admin.98322.log 2023-11-27T21:29:59.060 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.103797.log.gz 2023-11-27T21:29:59.060 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.102405.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103553.log.gz 2023-11-27T21:29:59.060 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98343.log 2023-11-27T21:29:59.060 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102136.log 2023-11-27T21:29:59.060 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102405.log.gz 2023-11-27T21:29:59.060 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.98322.log: /var/log/ceph/ceph-client.admin.98343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98162.log 2023-11-27T21:29:59.060 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98322.log.gz 2023-11-27T21:29:59.060 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2023-11-27T21:29:59.060 INFO:teuthology.orchestra.run.smithi088.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98343.log.gz 2023-11-27T21:29:59.060 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.102136.log: /var/log/ceph/ceph-client.admin.98162.log: gzip -5 --verbose -- 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102136.log.gz 2023-11-27T21:29:59.060 INFO:teuthology.orchestra.run.smithi088.stderr: /var/log/ceph/ceph-client.admin.98924.log 2023-11-27T21:29:59.061 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98162.log.gz 2023-11-27T21:29:59.061 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103264.log 2023-11-27T21:29:59.061 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.98924.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-27T21:29:59.061 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2%/var/log/ceph/ceph-client.admin.103264.log: -- replaced with /var/log/ceph/ceph-client.admin.98924.log.gz 2023-11-27T21:29:59.061 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102968.log 2023-11-27T21:29:59.061 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103264.log.gz 2023-11-27T21:29:59.061 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97235.log 2023-11-27T21:29:59.061 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.102968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97834.log 2023-11-27T21:29:59.061 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102968.log.gz 2023-11-27T21:29:59.061 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.97235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99398.log 2023-11-27T21:29:59.061 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97235.log.gz/var/log/ceph/ceph-client.admin.97834.log: 2023-11-27T21:29:59.061 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96677.log 2023-11-27T21:29:59.061 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97834.log.gz 2023-11-27T21:29:59.062 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.99398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94899.log 2023-11-27T21:29:59.062 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.96677.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96677.log.gz 2023-11-27T21:29:59.062 INFO:teuthology.orchestra.run.smithi088.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.99398.log.gz 2023-11-27T21:29:59.062 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103839.log 2023-11-27T21:29:59.062 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.94899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103096.log 2023-11-27T21:29:59.062 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94899.log.gz 2023-11-27T21:29:59.062 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.103839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98419.log 2023-11-27T21:29:59.062 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6%/var/log/ceph/ceph-client.admin.103096.log: -- replaced with /var/log/ceph/ceph-client.admin.103839.log.gz 2023-11-27T21:29:59.062 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99266.log 2023-11-27T21:29:59.062 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.103096.log.gz 2023-11-27T21:29:59.062 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.98419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103881.log 2023-11-27T21:29:59.063 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.99266.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98419.log.gz 2023-11-27T21:29:59.063 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103306.log 2023-11-27T21:29:59.063 INFO:teuthology.orchestra.run.smithi088.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.99266.log.gz 2023-11-27T21:29:59.063 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.103881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97807.log 2023-11-27T21:29:59.063 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1%/var/log/ceph/ceph-client.admin.103306.log: -- replaced with /var/log/ceph/ceph-client.admin.103881.log.gz 2023-11-27T21:29:59.063 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103493.log 2023-11-27T21:29:59.063 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.103306.log.gz 2023-11-27T21:29:59.063 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101968.log 2023-11-27T21:29:59.063 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.97807.log: /var/log/ceph/ceph-client.admin.103493.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97807.log.gz 2023-11-27T21:29:59.063 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103493.log.gz 2023-11-27T21:29:59.063 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97867.log 2023-11-27T21:29:59.063 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-27T21:29:59.063 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.101968.log: /var/log/ceph/ceph-client.admin.97867.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.101968.log.gz 2023-11-27T21:29:59.064 INFO:teuthology.orchestra.run.smithi088.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97867.log.gz 2023-11-27T21:29:59.064 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98882.log 2023-11-27T21:29:59.064 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102320.log 2023-11-27T21:29:59.064 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.98882.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98882.log.gz 2023-11-27T21:29:59.064 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96761.log 2023-11-27T21:29:59.064 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.102320.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102320.log.gz 2023-11-27T21:29:59.064 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104091.log 2023-11-27T21:29:59.064 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.96761.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96761.log.gz 2023-11-27T21:29:59.064 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96367.log 2023-11-27T21:29:59.064 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.104091.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.104091.log.gz 2023-11-27T21:29:59.064 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-27T21:29:59.065 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.96367.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96367.log.gz 2023-11-27T21:29:59.065 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95515.log 2023-11-27T21:29:59.065 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph.log: 87.2% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-27T21:29:59.065 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-27T21:29:59.065 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.95515.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95515.log.gz 2023-11-27T21:29:59.065 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-27T21:29:59.065 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99008.log 2023-11-27T21:29:59.065 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99200.log 2023-11-27T21:29:59.067 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-27T21:29:59.067 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.88577.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.88577.log.gz 2023-11-27T21:29:59.072 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.99008.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102799.log 2023-11-27T21:29:59.072 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.99200.log: -- replaced with /var/log/ceph/ceph-client.admin.99008.log.gz 2023-11-27T21:29:59.072 INFO:teuthology.orchestra.run.smithi088.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.99200.log.gz 2023-11-27T21:29:59.072 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98756.log 2023-11-27T21:29:59.072 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.102799.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102799.log.gz 2023-11-27T21:29:59.073 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95109.log 2023-11-27T21:29:59.073 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.98756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94712.log 2023-11-27T21:29:59.073 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.95109.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98756.log.gz 2023-11-27T21:29:59.076 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97361.log 2023-11-27T21:29:59.078 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.94712.log: 88.4% 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95109.log.gz 2023-11-27T21:29:59.089 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96057.log 2023-11-27T21:29:59.090 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.97361.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97361.log.gz 2023-11-27T21:29:59.090 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94712.log.gz 2023-11-27T21:29:59.105 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103432.log 2023-11-27T21:29:59.107 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.96057.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.96057.log.gz 2023-11-27T21:29:59.114 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98588.log 2023-11-27T21:29:59.126 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.103432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88460.log 2023-11-27T21:29:59.126 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.98588.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98588.log.gz 2023-11-27T21:29:59.127 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103432.log.gz 2023-11-27T21:29:59.134 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96451.log 2023-11-27T21:29:59.134 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.88460.log: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.88460.log.gz 2023-11-27T21:29:59.143 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103010.log 2023-11-27T21:29:59.152 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.96451.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95305.log 2023-11-27T21:29:59.152 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.103010.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103010.log.gz 2023-11-27T21:29:59.156 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96451.log.gz 2023-11-27T21:29:59.163 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-27T21:29:59.163 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.95305.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95305.log.gz 2023-11-27T21:29:59.172 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103222.log 2023-11-27T21:29:59.186 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mds.a.log: 92.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88801.log 2023-11-27T21:29:59.186 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.103222.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103222.log.gz 2023-11-27T21:29:59.191 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-27T21:29:59.207 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.88801.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.88801.log.gz 2023-11-27T21:29:59.351 INFO:teuthology.orchestra.run.smithi088.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-27T21:29:59.828 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mon.c.log: gzip: /var/log/ceph/ceph-mon.b.log: file size changed while zipping 2023-11-27T21:29:59.838 INFO:teuthology.orchestra.run.smithi167.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-27T21:29:59.869 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:36:23.754 88303== 2023-11-27T21:29:59.869 INFO:tasks.ceph.mon.b.smithi167.stderr:==00:00:36:23.754 88303== Exit program on first error (--exit-on-first-error=yes) 2023-11-27T21:29:59.894 INFO:tasks.ceph.mon.b.smithi167.stderr:daemon-helper: command failed with exit status 42 2023-11-27T21:30:00.032 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/ceph-mon.c.log: file size changed while zipping 2023-11-27T21:30:00.033 INFO:teuthology.orchestra.run.smithi167.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-27T21:30:00.383 INFO:teuthology.orchestra.run.smithi088.stderr: 89.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-27T21:30:03.051 INFO:teuthology.orchestra.run.smithi088.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-27T21:30:03.292 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-11-27T21:30:03.590 INFO:teuthology.orchestra.run.smithi167.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-27T21:30:03.773 INFO:teuthology.orchestra.run.smithi167.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2023-11-27T21:30:03.920 INFO:teuthology.orchestra.run.smithi088.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-27T21:30:04.415 INFO:teuthology.orchestra.run.smithi167.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-27T21:30:04.589 INFO:teuthology.orchestra.run.smithi088.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-27T21:30:05.032 INFO:teuthology.orchestra.run.smithi167.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-27T21:30:05.067 INFO:teuthology.orchestra.run.smithi088.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2023-11-27T21:30:05.478 INFO:teuthology.orchestra.run.smithi167.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-27T21:30:05.488 INFO:teuthology.orchestra.run.smithi167.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-27T21:30:05.619 INFO:teuthology.orchestra.run.smithi088.stderr: 91.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-27T21:30:05.691 INFO:teuthology.orchestra.run.smithi167.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-27T21:30:05.693 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-11-27T21:30:05.693 INFO:teuthology.orchestra.run.smithi167.stderr:real 0m6.728s 2023-11-27T21:30:05.693 INFO:teuthology.orchestra.run.smithi167.stderr:user 0m39.673s 2023-11-27T21:30:05.693 INFO:teuthology.orchestra.run.smithi167.stderr:sys 0m1.107s 2023-11-27T21:30:08.393 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~5s 2023-11-27T21:30:10.733 INFO:teuthology.orchestra.run.smithi088.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-27T21:30:13.495 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~10s 2023-11-27T21:30:14.242 INFO:teuthology.orchestra.run.smithi088.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.99912.log.gz 2023-11-27T21:30:14.243 INFO:teuthology.orchestra.run.smithi088.stderr: 2023-11-27T21:30:14.243 INFO:teuthology.orchestra.run.smithi088.stderr:real 0m15.311s 2023-11-27T21:30:14.243 INFO:teuthology.orchestra.run.smithi088.stderr:user 0m54.164s 2023-11-27T21:30:14.244 INFO:teuthology.orchestra.run.smithi088.stderr:sys 0m1.678s 2023-11-27T21:30:14.244 INFO:tasks.ceph:Archiving logs... 2023-11-27T21:30:14.244 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468107/remote/smithi088/log 2023-11-27T21:30:14.245 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-27T21:30:18.611 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~15s 2023-11-27T21:30:21.445 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468107/remote/smithi167/log 2023-11-27T21:30:21.446 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-27T21:30:23.721 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~20s 2023-11-27T21:30:26.176 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/ceph.py", line 328, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/ceph.py", line 368, in valgrind_post raise valgrind_exception Exception: saw valgrind issues 2023-11-27T21:30:26.178 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-27T21:30:26.194 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/ceph.py", line 328, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/ceph.py", line 368, in valgrind_post raise valgrind_exception Exception: saw valgrind issues 2023-11-27T21:30:26.194 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-27T21:30:26.195 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-27T21:30:26.198 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-27T21:30:26.293 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-27T21:30:26.302 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-27T21:30:26.303 DEBUG:teuthology.orchestra.run.smithi088:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-27T21:30:26.306 DEBUG:teuthology.orchestra.run.smithi167:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-27T21:30:26.320 INFO:teuthology.orchestra.run.smithi088.stderr:bash: line 1: ntpq: command not found 2023-11-27T21:30:26.322 INFO:teuthology.orchestra.run.smithi167.stderr:bash: line 1: ntpq: command not found 2023-11-27T21:30:26.325 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-27T21:30:26.325 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2023-11-27T21:30:26.325 INFO:teuthology.orchestra.run.smithi088.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 63 -9756ns[+5396ns] +/- 92ms 2023-11-27T21:30:26.325 INFO:teuthology.orchestra.run.smithi088.stdout:^* hv02.front.sepia.ceph.com 3 6 377 58 -848us[ -832us] +/- 74ms 2023-11-27T21:30:26.325 INFO:teuthology.orchestra.run.smithi088.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 61 +899us[ +914us] +/- 78ms 2023-11-27T21:30:26.325 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T21:30:26.327 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-27T21:30:26.327 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2023-11-27T21:30:26.327 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 60 -19us[ -15us] +/- 92ms 2023-11-27T21:30:26.327 INFO:teuthology.orchestra.run.smithi167.stdout:^* hv02.front.sepia.ceph.com 3 6 377 57 -861us[ -857us] +/- 74ms 2023-11-27T21:30:26.327 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 +905us[ +910us] +/- 78ms 2023-11-27T21:30:26.327 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T21:30:26.328 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-27T21:30:26.337 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-27T21:30:26.337 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-27T21:30:26.346 DEBUG:teuthology.orchestra.run.smithi088:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-27T21:30:26.471 DEBUG:teuthology.orchestra.run.smithi167:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-27T21:30:26.571 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-27T21:30:26.604 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T21:30:26.605 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-27T21:30:26.638 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T21:30:26.638 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-27T21:30:26.647 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-27T21:30:26.666 INFO:teuthology.task.internal:Duration was 3057.449838 seconds 2023-11-27T21:30:26.666 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-27T21:30:26.675 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-27T21:30:26.676 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-27T21:30:26.678 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-27T21:30:26.720 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-27T21:30:26.723 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-27T21:30:26.918 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-27T21:30:26.918 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi088.front.sepia.ceph.com 2023-11-27T21:30:26.919 DEBUG:teuthology.orchestra.run.smithi088:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-27T21:30:26.937 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi167.front.sepia.ceph.com 2023-11-27T21:30:26.938 DEBUG:teuthology.orchestra.run.smithi167:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-27T21:30:26.959 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-27T21:30:26.959 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-27T21:30:26.981 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-27T21:30:27.029 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-27T21:30:27.029 DEBUG:teuthology.orchestra.run.smithi088:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-27T21:30:27.050 DEBUG:teuthology.orchestra.run.smithi167:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-27T21:30:27.175 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-27T21:30:27.185 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-27T21:30:27.185 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-27T21:30:27.212 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-27T21:30:27.239 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-27T21:30:27.251 DEBUG:teuthology.orchestra.run.smithi088:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-27T21:30:27.255 DEBUG:teuthology.orchestra.run.smithi167:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-27T21:30:27.278 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = core 2023-11-27T21:30:27.305 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = core 2023-11-27T21:30:27.337 DEBUG:teuthology.orchestra.run.smithi088:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-27T21:30:27.351 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T21:30:27.351 DEBUG:teuthology.orchestra.run.smithi167:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-27T21:30:27.390 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T21:30:27.391 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-27T21:30:27.401 INFO:teuthology.task.internal:Transferring archived files... 2023-11-27T21:30:27.402 DEBUG:teuthology.misc:Transferring archived files from smithi088:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468107/remote/smithi088 2023-11-27T21:30:27.402 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-27T21:30:27.442 DEBUG:teuthology.misc:Transferring archived files from smithi167:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468107/remote/smithi167 2023-11-27T21:30:27.442 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-27T21:30:27.481 INFO:teuthology.task.internal:Removing archive directory... 2023-11-27T21:30:27.481 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-27T21:30:27.484 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-27T21:30:27.530 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-27T21:30:27.542 INFO:teuthology.task.internal:Not uploading archives. 2023-11-27T21:30:27.542 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-27T21:30:27.551 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-27T21:30:27.552 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-27T21:30:27.554 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-27T21:30:27.566 INFO:teuthology.orchestra.run.smithi088.stdout: 265245 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 27 21:30 /home/ubuntu/cephtest 2023-11-27T21:30:27.584 INFO:teuthology.orchestra.run.smithi167.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 27 21:30 /home/ubuntu/cephtest 2023-11-27T21:30:27.585 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-27T21:30:27.596 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-27T21:30:27.607 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: saw valgrind issues 2023-11-27T21:30:27.607 INFO:teuthology.nuke:Checking targets against current locks 2023-11-27T21:30:27.630 DEBUG:teuthology.nuke:shortname: smithi088 2023-11-27T21:30:27.630 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-27T21:30:27.653 DEBUG:teuthology.nuke:shortname: smithi167 2023-11-27T21:30:27.654 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-27T21:30:27.657 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468107', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 20:30:20.578743', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL71wxUxtJbDOuVa26K1cK6t4mjPRN/Qcu2tsvDxg8Ssg1F5LLsufU8S4hAbUGgJAfRi9Ls89cxfakoIrcqOeEA='} 2023-11-27T21:30:27.679 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468107', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 20:30:20.576786', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHYOIliM6xRMOlzggjF9H50uOouZE9Vxw7Qk4DkaDeLcLy+l2KC+817iNLxXAzJYTkYkWQzYvPjbMdP/a1TehY4='} 2023-11-27T21:30:27.722 INFO:teuthology.orchestra.console.smithi167:Power off 2023-11-27T21:30:27.732 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-27T21:30:27.777 INFO:teuthology.orchestra.console.smithi088:Power off 2023-11-27T21:30:27.777 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-27T21:30:27.798 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2023-11-27T21:30:27.798 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T21:30:27.811 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2023-11-27T21:30:27.812 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T21:30:27.834 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-11-27T21:30:27.841 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-11-27T21:30:28.822 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~26s 2023-11-27T21:30:31.834 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T21:30:31.842 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T21:30:31.944 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-11-27T21:30:31.952 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-11-27T21:30:33.826 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~31s 2023-11-27T21:30:33.826 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-11-27T21:30:35.946 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T21:30:35.954 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T21:30:36.056 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-11-27T21:30:36.065 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-11-27T21:30:36.165 INFO:teuthology.orchestra.console.smithi088:Power off completed 2023-11-27T21:30:38.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~36s 2023-11-27T21:30:38.831 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~5s 2023-11-27T21:30:40.058 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T21:30:40.168 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-11-27T21:30:40.269 INFO:teuthology.orchestra.console.smithi167:Power off completed 2023-11-27T21:30:40.373 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} duration: 3057.4498376846313 failure_reason: saw valgrind issues flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2023-11-27T21:30:40.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T21:30:40.457 INFO:teuthology.run:FAIL